2024-04-14T23:23:44.326 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-14T23:23:44.326 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575 -- /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575/orig.config.yaml 2024-04-14T23:23:44.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T23:23:44.462 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: ceph-qa@ceph.com first_in_suite: false job_id: '7656575' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 840 sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 sleep_before_teardown: 0 subset: 427/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKE+7PwwSPHx0pg3eybHBwJH86XWGlwSGUIAoWEFJ89XbWsDW0QXYZQHAsOHXL7QUD5dbt1Dvjle5oC88MtThvQ= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPcdOqrFBD0geKGsRwrHJKXb0W+6HG8gpQV5Ix8r6jNxVv2Er7gpP29gUFi8Z5QJOEqUfD2tJ2flEcP0fRCFnHc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-14_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-14T23:23:44.462 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa; will attempt to use it 2024-04-14T23:23:44.463 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks 2024-04-14T23:23:44.463 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-14T23:23:44.465 INFO:teuthology.task.internal:Checking packages... 2024-04-14T23:23:44.488 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a9a752df26c63acad72e1b3569fd79a515ca0765' 2024-04-14T23:23:44.488 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-14T23:23:44.489 INFO:teuthology.packaging:ref: None 2024-04-14T23:23:44.489 INFO:teuthology.packaging:tag: None 2024-04-14T23:23:44.489 INFO:teuthology.packaging:branch: squid 2024-04-14T23:23:44.489 INFO:teuthology.packaging:sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-14T23:23:44.489 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-14T23:23:44.796 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2114.ga9a752df 2024-04-14T23:23:44.797 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-14T23:23:44.804 INFO:teuthology.task.internal:no buildpackages task found 2024-04-14T23:23:44.804 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-14T23:23:44.809 INFO:teuthology.task.internal:Saving configuration 2024-04-14T23:23:44.826 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-14T23:23:44.832 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-14T23:23:44.858 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 23:18:59.114032', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKE+7PwwSPHx0pg3eybHBwJH86XWGlwSGUIAoWEFJ89XbWsDW0QXYZQHAsOHXL7QUD5dbt1Dvjle5oC88MtThvQ='} 2024-04-14T23:23:44.882 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 23:18:59.112398', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPcdOqrFBD0geKGsRwrHJKXb0W+6HG8gpQV5Ix8r6jNxVv2Er7gpP29gUFi8Z5QJOEqUfD2tJ2flEcP0fRCFnHc='} 2024-04-14T23:23:44.882 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-14T23:23:44.888 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-14T23:23:44.888 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-14T23:23:44.888 INFO:teuthology.run_tasks:Running task console_log... 2024-04-14T23:23:44.958 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc6745d60d0>, signals=[15]) 2024-04-14T23:23:44.959 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-14T23:23:44.964 INFO:teuthology.task.internal:Opening connections... 2024-04-14T23:23:44.965 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-04-14T23:23:44.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:23:45.074 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2024-04-14T23:23:45.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:23:45.164 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-14T23:23:45.171 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-04-14T23:23:45.188 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-04-14T23:23:45.188 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-04-14T23:23:45.245 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-04-14T23:23:45.245 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-04-14T23:23:45.245 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-04-14T23:23:45.245 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-04-14T23:23:45.245 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-04-14T23:23:45.245 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-04-14T23:23:45.245 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T23:23:45.246 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-04-14T23:23:45.246 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-04-14T23:23:45.246 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T23:23:45.246 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-04-14T23:23:45.246 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T23:23:45.246 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T23:23:45.246 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T23:23:45.247 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-04-14T23:23:45.268 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-04-14T23:23:45.285 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-04-14T23:23:45.285 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-04-14T23:23:45.342 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-04-14T23:23:45.342 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-04-14T23:23:45.342 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-04-14T23:23:45.342 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-04-14T23:23:45.342 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-04-14T23:23:45.342 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-04-14T23:23:45.342 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T23:23:45.342 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-04-14T23:23:45.342 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-04-14T23:23:45.342 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T23:23:45.342 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-04-14T23:23:45.343 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T23:23:45.343 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T23:23:45.343 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T23:23:45.343 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-04-14T23:23:45.368 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-14T23:23:45.378 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-14T23:23:45.383 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-14T23:23:45.384 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-04-14T23:23:45.386 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2024-04-14T23:23:45.402 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-14T23:23:45.407 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-14T23:23:45.408 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-04-14T23:23:45.443 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2024-04-14T23:23:45.526 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-14T23:23:45.583 INFO:teuthology.run_tasks:Running task kernel... 2024-04-14T23:23:45.598 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-04-14T23:23:45.598 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-04-14T23:23:45.598 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-14T23:23:45.599 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-14T23:23:45.599 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-14T23:23:45.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:23:45.615 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2024-04-14T23:23:45.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:23:45.616 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-04-14T23:23:45.672 INFO:teuthology.orchestra.run.smithi191.stdout:5.14.0-361.el9.x86_64 2024-04-14T23:23:45.672 INFO:teuthology.task.kernel:Running kernel on smithi191: 5.14.0-361.el9.x86_64 2024-04-14T23:23:45.672 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum install -y kernel 2024-04-14T23:23:45.673 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-361.el9.x86_64 2024-04-14T23:23:45.674 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.14.0-361.el9.x86_64 2024-04-14T23:23:45.674 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum install -y kernel 2024-04-14T23:23:47.771 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS-9 - AppStream 17 MB/s | 8.1 MB 00:00 2024-04-14T23:23:47.934 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-9 - AppStream 13 MB/s | 8.1 MB 00:00 2024-04-14T23:23:49.430 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS-9 - BaseOS 8.9 MB/s | 2.5 MB 00:00 2024-04-14T23:23:49.542 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-9 - BaseOS 8.9 MB/s | 2.5 MB 00:00 2024-04-14T23:23:50.725 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-14T23:23:53.337 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 8.0 MB 00:03 2024-04-14T23:23:53.392 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-04-14T23:23:55.280 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-04-14T23:24:05.000 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - CRB 782 kB/s | 6.2 MB 00:08 2024-04-14T23:24:06.655 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 822 kB/s | 6.2 MB 00:07 2024-04-14T23:24:06.826 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 16 kB 00:00 2024-04-14T23:24:08.181 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 16 kB 00:00 2024-04-14T23:24:08.827 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-14T23:24:10.326 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:01 2024-04-14T23:24:13.894 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-14T23:24:15.665 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-14T23:24:16.138 INFO:teuthology.orchestra.run.smithi191.stderr:Modular dependency problems: 2024-04-14T23:24:16.138 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-14T23:24:16.138 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 1: conflicting requests 2024-04-14T23:24:16.138 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.138 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 2: conflicting requests 2024-04-14T23:24:16.138 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.138 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 3: conflicting requests 2024-04-14T23:24:16.138 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.138 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 4: conflicting requests 2024-04-14T23:24:16.139 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.139 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 5: conflicting requests 2024-04-14T23:24:16.139 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.139 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 6: conflicting requests 2024-04-14T23:24:16.139 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.139 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 7: conflicting requests 2024-04-14T23:24:16.139 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.139 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 8: conflicting requests 2024-04-14T23:24:16.139 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.139 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 9: conflicting requests 2024-04-14T23:24:16.139 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.139 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 10: conflicting requests 2024-04-14T23:24:16.139 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.139 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 11: conflicting requests 2024-04-14T23:24:16.139 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.140 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 12: conflicting requests 2024-04-14T23:24:16.140 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.140 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 13: conflicting requests 2024-04-14T23:24:16.140 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.140 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 14: conflicting requests 2024-04-14T23:24:16.140 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.140 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 15: conflicting requests 2024-04-14T23:24:16.140 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.140 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 16: conflicting requests 2024-04-14T23:24:16.140 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.140 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 17: conflicting requests 2024-04-14T23:24:16.140 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.140 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 18: conflicting requests 2024-04-14T23:24:16.141 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.141 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 19: conflicting requests 2024-04-14T23:24:16.141 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.141 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 20: conflicting requests 2024-04-14T23:24:16.141 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.141 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 21: conflicting requests 2024-04-14T23:24:16.141 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.141 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 22: conflicting requests 2024-04-14T23:24:16.141 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.141 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 23: conflicting requests 2024-04-14T23:24:16.141 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.141 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 24: conflicting requests 2024-04-14T23:24:16.141 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.141 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 25: conflicting requests 2024-04-14T23:24:16.142 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.142 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 26: conflicting requests 2024-04-14T23:24:16.142 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.142 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 27: conflicting requests 2024-04-14T23:24:16.142 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.142 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 28: conflicting requests 2024-04-14T23:24:16.142 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.142 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 29: conflicting requests 2024-04-14T23:24:16.142 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.142 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 30: conflicting requests 2024-04-14T23:24:16.142 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.142 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 31: conflicting requests 2024-04-14T23:24:16.142 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.143 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 32: conflicting requests 2024-04-14T23:24:16.143 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.143 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 33: conflicting requests 2024-04-14T23:24:16.143 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.143 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 34: conflicting requests 2024-04-14T23:24:16.143 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.143 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 35: conflicting requests 2024-04-14T23:24:16.143 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.143 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 36: conflicting requests 2024-04-14T23:24:16.143 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.144 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 37: conflicting requests 2024-04-14T23:24:16.144 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.144 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.144 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.144 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T23:24:16.144 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.144 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.144 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.144 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.144 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 39: conflicting requests 2024-04-14T23:24:16.144 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.144 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.144 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.144 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.145 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.145 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.145 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T23:24:16.145 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.145 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.145 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.145 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.145 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T23:24:16.145 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.145 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.145 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.145 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.145 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T23:24:16.145 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.146 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.146 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.146 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.146 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T23:24:16.146 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.146 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.146 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.146 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.146 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T23:24:16.146 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.146 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.146 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.146 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.147 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T23:24:16.147 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.147 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.147 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.147 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T23:24:16.567 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-14T23:24:16.568 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-14T23:24:16.687 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-14T23:24:16.691 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-14T23:24:16.691 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2024-04-14T23:24:16.691 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-14T23:24:16.691 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-14T23:24:16.691 INFO:teuthology.orchestra.run.smithi191.stdout: kernel x86_64 5.14.0-435.el9 baseos 214 k 2024-04-14T23:24:16.691 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-04-14T23:24:16.691 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-core x86_64 5.14.0-435.el9 baseos 15 M 2024-04-14T23:24:16.691 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-modules x86_64 5.14.0-435.el9 baseos 34 M 2024-04-14T23:24:16.691 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-modules-core x86_64 5.14.0-435.el9 baseos 28 M 2024-04-14T23:24:16.691 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:24:16.691 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-14T23:24:16.691 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-14T23:24:16.691 INFO:teuthology.orchestra.run.smithi191.stdout:Install 4 Packages 2024-04-14T23:24:16.692 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:24:16.692 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 77 M 2024-04-14T23:24:16.692 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 123 M 2024-04-14T23:24:16.692 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-14T23:24:16.912 INFO:teuthology.orchestra.run.smithi191.stdout:(1/4): kernel-5.14.0-435.el9.x86_64.rpm 1.3 MB/s | 214 kB 00:00 2024-04-14T23:24:18.030 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-14T23:24:18.030 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-14T23:24:18.030 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-14T23:24:18.030 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.030 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-14T23:24:18.030 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.031 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-14T23:24:18.031 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.031 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-14T23:24:18.031 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.031 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-14T23:24:18.033 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.033 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-14T23:24:18.033 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.033 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-14T23:24:18.033 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.033 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-14T23:24:18.033 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.034 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-14T23:24:18.034 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.034 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-14T23:24:18.034 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.034 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-14T23:24:18.034 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.034 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-14T23:24:18.034 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.034 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-14T23:24:18.034 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.034 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-14T23:24:18.034 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.034 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-14T23:24:18.034 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.035 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-14T23:24:18.035 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.035 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-14T23:24:18.035 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.035 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-14T23:24:18.035 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.035 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-14T23:24:18.035 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.035 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-14T23:24:18.035 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.035 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-14T23:24:18.035 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.035 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-14T23:24:18.035 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.036 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-14T23:24:18.036 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.036 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-14T23:24:18.036 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.036 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-14T23:24:18.036 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.036 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-14T23:24:18.036 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.036 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-14T23:24:18.036 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.036 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-14T23:24:18.036 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.036 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-14T23:24:18.036 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.036 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-14T23:24:18.037 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.037 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-14T23:24:18.037 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.037 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-14T23:24:18.037 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.037 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-14T23:24:18.037 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.037 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-14T23:24:18.037 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.037 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-14T23:24:18.037 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.037 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-14T23:24:18.037 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.037 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-14T23:24:18.037 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.038 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.038 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.038 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T23:24:18.038 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.038 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.038 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.038 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.038 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-14T23:24:18.038 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.038 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.038 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.038 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.038 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.038 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.039 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T23:24:18.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.039 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T23:24:18.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.039 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T23:24:18.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.039 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.040 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T23:24:18.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.040 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T23:24:18.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.040 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T23:24:18.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.040 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.041 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T23:24:18.442 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-14T23:24:18.442 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-14T23:24:18.548 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-14T23:24:18.557 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-14T23:24:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-04-14T23:24:18.557 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-14T23:24:18.557 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-14T23:24:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: kernel x86_64 5.14.0-435.el9 baseos 214 k 2024-04-14T23:24:18.557 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-04-14T23:24:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core x86_64 5.14.0-435.el9 baseos 15 M 2024-04-14T23:24:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules x86_64 5.14.0-435.el9 baseos 34 M 2024-04-14T23:24:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core x86_64 5.14.0-435.el9 baseos 28 M 2024-04-14T23:24:18.557 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:24:18.558 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-14T23:24:18.558 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-04-14T23:24:18.558 INFO:teuthology.orchestra.run.smithi047.stdout:Install 4 Packages 2024-04-14T23:24:18.558 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:24:18.558 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 77 M 2024-04-14T23:24:18.558 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 123 M 2024-04-14T23:24:18.559 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-14T23:24:18.800 INFO:teuthology.orchestra.run.smithi047.stdout:(1/4): kernel-5.14.0-435.el9.x86_64.rpm 1.6 MB/s | 214 kB 00:00 2024-04-14T23:24:19.117 INFO:teuthology.orchestra.run.smithi047.stdout:(2/4): kernel-core-5.14.0-435.el9.x86_64.rpm 34 MB/s | 15 MB 00:00 2024-04-14T23:24:19.509 INFO:teuthology.orchestra.run.smithi047.stdout:(3/4): kernel-modules-5.14.0-435.el9.x86_64.rpm 40 MB/s | 34 MB 00:00 2024-04-14T23:24:19.604 INFO:teuthology.orchestra.run.smithi191.stdout:(2/4): kernel-core-5.14.0-435.el9.x86_64.rpm 5.3 MB/s | 15 MB 00:02 2024-04-14T23:24:19.817 INFO:teuthology.orchestra.run.smithi047.stdout:(4/4): kernel-modules-core-5.14.0-435.el9.x86_6 27 MB/s | 28 MB 00:01 2024-04-14T23:24:19.818 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-14T23:24:19.818 INFO:teuthology.orchestra.run.smithi047.stdout:Total 61 MB/s | 77 MB 00:01 2024-04-14T23:24:20.516 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-14T23:24:20.962 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-14T23:24:20.963 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-14T23:24:21.145 INFO:teuthology.orchestra.run.smithi191.stdout:(3/4): kernel-modules-core-5.14.0-435.el9.x86_6 6.5 MB/s | 28 MB 00:04 2024-04-14T23:24:21.530 INFO:teuthology.orchestra.run.smithi191.stdout:(4/4): kernel-modules-5.14.0-435.el9.x86_64.rpm 7.0 MB/s | 34 MB 00:04 2024-04-14T23:24:21.530 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-14T23:24:21.530 INFO:teuthology.orchestra.run.smithi191.stdout:Total 16 MB/s | 77 MB 00:04 2024-04-14T23:24:22.055 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-14T23:24:22.056 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-14T23:24:22.205 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-14T23:24:22.551 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-14T23:24:22.552 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-14T23:24:23.560 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-14T23:24:23.560 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-14T23:24:24.667 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-14T23:24:25.294 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-core-5.14.0-435.el9.x86_64 1/4 2024-04-14T23:24:25.378 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T23:24:26.021 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-14T23:24:26.622 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : kernel-modules-core-5.14.0-435.el9.x86_64 1/4 2024-04-14T23:24:26.697 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T23:24:28.284 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T23:24:28.421 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T23:24:29.463 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T23:24:29.601 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T23:24:33.527 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T23:24:33.572 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:24:34.350 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T23:24:34.668 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : kernel-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:24:38.701 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:24:39.450 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:25:08.907 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:25:08.907 INFO:teuthology.orchestra.run.smithi191.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-14T23:25:08.908 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:25:08.952 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:25:09.351 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:25:09.352 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-5.14.0-435.el9.x86_64 1/4 2024-04-14T23:25:09.352 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T23:25:09.352 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T23:25:09.649 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:25:09.649 INFO:teuthology.orchestra.run.smithi047.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-14T23:25:09.649 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:25:09.696 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:25:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:25:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:25:09.782 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-14T23:25:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-5.14.0-435.el9.x86_64 2024-04-14T23:25:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-core-5.14.0-435.el9.x86_64 2024-04-14T23:25:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-modules-5.14.0-435.el9.x86_64 2024-04-14T23:25:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-modules-core-5.14.0-435.el9.x86_64 2024-04-14T23:25:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:25:09.783 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-14T23:25:10.143 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:25:10.143 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-5.14.0-435.el9.x86_64 1/4 2024-04-14T23:25:10.144 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T23:25:10.144 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T23:25:10.150 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q kernel | sort -rV | head -n 1 2024-04-14T23:25:10.251 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-14T23:25:10.251 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-14T23:25:10.252 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-435.el9.x86_64 2024-04-14T23:25:10.252 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-14T23:25:10.252 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-14T23:25:10.252 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-04-14T23:25:10.252 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi191.front.sepia.ceph.com, path=None, version=distro) 2024-04-14T23:25:10.252 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q kernel | sort -rV | head -n 1 2024-04-14T23:25:10.333 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-14T23:25:10.333 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-14T23:25:10.333 DEBUG:teuthology.orchestra.run.smithi191:> sudo rpm -qi grub2-tools 2024-04-14T23:25:10.370 INFO:teuthology.orchestra.run.smithi191.stdout:Name : grub2-tools 2024-04-14T23:25:10.371 INFO:teuthology.orchestra.run.smithi191.stdout:Epoch : 1 2024-04-14T23:25:10.371 INFO:teuthology.orchestra.run.smithi191.stdout:Version : 2.06 2024-04-14T23:25:10.371 INFO:teuthology.orchestra.run.smithi191.stdout:Release : 68.el9 2024-04-14T23:25:10.371 INFO:teuthology.orchestra.run.smithi191.stdout:Architecture: x86_64 2024-04-14T23:25:10.371 INFO:teuthology.orchestra.run.smithi191.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-14T23:25:10.371 INFO:teuthology.orchestra.run.smithi191.stdout:Group : Unspecified 2024-04-14T23:25:10.371 INFO:teuthology.orchestra.run.smithi191.stdout:Size : 8264254 2024-04-14T23:25:10.371 INFO:teuthology.orchestra.run.smithi191.stdout:License : GPLv3+ 2024-04-14T23:25:10.371 INFO:teuthology.orchestra.run.smithi191.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-14T23:25:10.371 INFO:teuthology.orchestra.run.smithi191.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-14T23:25:10.371 INFO:teuthology.orchestra.run.smithi191.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-14T23:25:10.371 INFO:teuthology.orchestra.run.smithi191.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-14T23:25:10.371 INFO:teuthology.orchestra.run.smithi191.stdout:Packager : builder@centos.org 2024-04-14T23:25:10.371 INFO:teuthology.orchestra.run.smithi191.stdout:Vendor : CentOS 2024-04-14T23:25:10.372 INFO:teuthology.orchestra.run.smithi191.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-14T23:25:10.372 INFO:teuthology.orchestra.run.smithi191.stdout:Summary : Support tools for GRUB. 2024-04-14T23:25:10.372 INFO:teuthology.orchestra.run.smithi191.stdout:Description : 2024-04-14T23:25:10.372 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:25:10.372 INFO:teuthology.orchestra.run.smithi191.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-14T23:25:10.372 INFO:teuthology.orchestra.run.smithi191.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-14T23:25:10.372 INFO:teuthology.orchestra.run.smithi191.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-14T23:25:10.372 INFO:teuthology.orchestra.run.smithi191.stdout:hardware devices. 2024-04-14T23:25:10.372 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:25:10.372 INFO:teuthology.orchestra.run.smithi191.stdout:This subpackage provides tools for support of all platforms. 2024-04-14T23:25:10.373 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-14T23:25:10.373 INFO:teuthology.task.kernel:Updating grub on smithi191 to boot 5.14.0-435.el9.x86_64 2024-04-14T23:25:10.373 DEBUG:teuthology.orchestra.run.smithi191:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-14T23:25:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T23:25:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:25:10.581 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-14T23:25:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-5.14.0-435.el9.x86_64 2024-04-14T23:25:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core-5.14.0-435.el9.x86_64 2024-04-14T23:25:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-5.14.0-435.el9.x86_64 2024-04-14T23:25:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core-5.14.0-435.el9.x86_64 2024-04-14T23:25:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:25:10.581 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-14T23:25:10.894 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-04-14T23:25:11.003 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-14T23:25:11.004 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-14T23:25:11.005 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-435.el9.x86_64 2024-04-14T23:25:11.005 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-14T23:25:11.005 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-14T23:25:11.005 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-04-14T23:25:11.005 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=None, version=distro) 2024-04-14T23:25:11.005 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-04-14T23:25:11.044 INFO:teuthology.orchestra.run.smithi191.stderr:Generating grub configuration file ... 2024-04-14T23:25:11.089 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-14T23:25:11.090 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-14T23:25:11.090 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -qi grub2-tools 2024-04-14T23:25:11.132 INFO:teuthology.orchestra.run.smithi047.stdout:Name : grub2-tools 2024-04-14T23:25:11.132 INFO:teuthology.orchestra.run.smithi047.stdout:Epoch : 1 2024-04-14T23:25:11.132 INFO:teuthology.orchestra.run.smithi047.stdout:Version : 2.06 2024-04-14T23:25:11.133 INFO:teuthology.orchestra.run.smithi047.stdout:Release : 68.el9 2024-04-14T23:25:11.133 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: x86_64 2024-04-14T23:25:11.133 INFO:teuthology.orchestra.run.smithi047.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-14T23:25:11.133 INFO:teuthology.orchestra.run.smithi047.stdout:Group : Unspecified 2024-04-14T23:25:11.133 INFO:teuthology.orchestra.run.smithi047.stdout:Size : 8264254 2024-04-14T23:25:11.133 INFO:teuthology.orchestra.run.smithi047.stdout:License : GPLv3+ 2024-04-14T23:25:11.133 INFO:teuthology.orchestra.run.smithi047.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-14T23:25:11.133 INFO:teuthology.orchestra.run.smithi047.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-14T23:25:11.133 INFO:teuthology.orchestra.run.smithi047.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-14T23:25:11.133 INFO:teuthology.orchestra.run.smithi047.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-14T23:25:11.133 INFO:teuthology.orchestra.run.smithi047.stdout:Packager : builder@centos.org 2024-04-14T23:25:11.133 INFO:teuthology.orchestra.run.smithi047.stdout:Vendor : CentOS 2024-04-14T23:25:11.133 INFO:teuthology.orchestra.run.smithi047.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-14T23:25:11.133 INFO:teuthology.orchestra.run.smithi047.stdout:Summary : Support tools for GRUB. 2024-04-14T23:25:11.133 INFO:teuthology.orchestra.run.smithi047.stdout:Description : 2024-04-14T23:25:11.134 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:25:11.134 INFO:teuthology.orchestra.run.smithi047.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-14T23:25:11.134 INFO:teuthology.orchestra.run.smithi047.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-14T23:25:11.134 INFO:teuthology.orchestra.run.smithi047.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-14T23:25:11.134 INFO:teuthology.orchestra.run.smithi047.stdout:hardware devices. 2024-04-14T23:25:11.134 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:25:11.134 INFO:teuthology.orchestra.run.smithi047.stdout:This subpackage provides tools for support of all platforms. 2024-04-14T23:25:11.135 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-14T23:25:11.135 INFO:teuthology.task.kernel:Updating grub on smithi047 to boot 5.14.0-435.el9.x86_64 2024-04-14T23:25:11.135 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-14T23:25:11.745 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-04-14T23:25:12.408 INFO:teuthology.orchestra.run.smithi191.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-14T23:25:12.437 INFO:teuthology.orchestra.run.smithi191.stderr:done 2024-04-14T23:25:12.440 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2024-04-14T23:25:12.455 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.zn2NApnk5R 2024-04-14T23:25:12.455 DEBUG:teuthology.orchestra.run.smithi191:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zn2NApnk5R 2024-04-14T23:25:12.533 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.zn2NApnk5R 2024-04-14T23:25:12.672 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.zn2NApnk5R is 6KB 2024-04-14T23:25:12.720 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.zn2NApnk5R 2024-04-14T23:25:12.734 DEBUG:teuthology.orchestra.run.smithi191:> sudo /bin/ls /boot/loader/entries || true 2024-04-14T23:25:12.808 INFO:teuthology.orchestra.run.smithi191.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-14T23:25:12.808 INFO:teuthology.orchestra.run.smithi191.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-14T23:25:12.808 INFO:teuthology.orchestra.run.smithi191.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-14T23:25:12.808 INFO:teuthology.orchestra.run.smithi191.stdout:15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64.conf 2024-04-14T23:25:12.809 DEBUG:teuthology.orchestra.run.smithi191:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64 2024-04-14T23:25:12.958 DEBUG:teuthology.orchestra.run.smithi191:> sudo shutdown -r now 2024-04-14T23:25:13.278 INFO:teuthology.orchestra.run.smithi047.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-14T23:25:13.310 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-04-14T23:25:13.311 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-04-14T23:25:13.367 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.NyikMwJlWr 2024-04-14T23:25:13.367 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NyikMwJlWr 2024-04-14T23:25:13.443 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.NyikMwJlWr 2024-04-14T23:25:13.685 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.NyikMwJlWr is 6KB 2024-04-14T23:25:13.733 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.NyikMwJlWr 2024-04-14T23:25:13.748 DEBUG:teuthology.orchestra.run.smithi047:> sudo /bin/ls /boot/loader/entries || true 2024-04-14T23:25:13.827 INFO:teuthology.orchestra.run.smithi047.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-14T23:25:13.828 INFO:teuthology.orchestra.run.smithi047.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-14T23:25:13.828 INFO:teuthology.orchestra.run.smithi047.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-14T23:25:13.828 INFO:teuthology.orchestra.run.smithi047.stdout:15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64.conf 2024-04-14T23:25:13.829 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64 2024-04-14T23:25:13.968 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-04-14T23:25:42.990 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-14T23:25:42.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-14T23:25:42.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:25:43.972 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-14T23:25:43.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-14T23:25:43.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:26:43.041 DEBUG:teuthology.orchestra.remote:timed out 2024-04-14T23:26:43.977 DEBUG:teuthology.orchestra.remote:timed out 2024-04-14T23:26:52.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-14T23:26:52.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:26:52.669 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-04-14T23:26:52.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-14T23:26:52.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:26:53.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-14T23:26:53.171 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-435.el9.x86_64"... 2024-04-14T23:26:53.171 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2024-04-14T23:26:53.185 INFO:teuthology.orchestra.run.smithi191.stdout:5.14.0-435.el9.x86_64 2024-04-14T23:26:53.186 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-435.el9.x86_64 vs 5.14.0-435.el9.x86_64 2024-04-14T23:26:53.186 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-14T23:26:53.186 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-14T23:26:53.369 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-04-14T23:26:53.790 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-14T23:26:53.790 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-435.el9.x86_64"... 2024-04-14T23:26:53.790 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-04-14T23:26:53.804 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-435.el9.x86_64 2024-04-14T23:26:53.804 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-435.el9.x86_64 vs 5.14.0-435.el9.x86_64 2024-04-14T23:26:53.804 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-14T23:26:53.804 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-14T23:26:54.187 DEBUG:teuthology.parallel:result is None 2024-04-14T23:26:54.805 DEBUG:teuthology.parallel:result is None 2024-04-14T23:26:54.806 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-14T23:26:54.814 INFO:teuthology.task.internal:Creating test directory... 2024-04-14T23:26:54.814 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-14T23:26:54.816 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-14T23:26:54.832 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-14T23:26:54.838 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-14T23:26:54.847 INFO:teuthology.task.internal:Creating archive directory... 2024-04-14T23:26:54.847 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-14T23:26:54.877 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-14T23:26:54.905 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-14T23:26:54.911 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-14T23:26:54.912 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-14T23:26:54.943 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-14T23:26:55.005 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T23:26:55.034 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T23:26:55.073 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T23:26:55.075 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T23:26:55.076 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-14T23:26:55.084 INFO:teuthology.task.internal:Configuring sudo... 2024-04-14T23:26:55.084 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-14T23:26:55.086 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-14T23:26:55.113 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-14T23:26:55.122 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-14T23:26:55.122 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-14T23:26:55.157 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-14T23:26:55.172 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T23:26:55.256 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T23:26:55.309 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T23:26:55.395 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T23:26:55.440 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:26:55.440 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-14T23:26:55.510 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T23:26:55.550 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T23:26:55.602 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T23:26:55.684 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T23:26:55.727 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:26:55.727 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-14T23:26:55.803 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-04-14T23:26:55.805 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2024-04-14T23:26:55.855 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T23:26:55.893 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T23:26:56.233 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-14T23:26:56.242 INFO:teuthology.task.internal:Starting timer... 2024-04-14T23:26:56.242 INFO:teuthology.run_tasks:Running task pcp... 2024-04-14T23:26:56.253 INFO:teuthology.run_tasks:Running task selinux... 2024-04-14T23:26:56.328 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-14T23:26:56.329 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-04-14T23:26:56.404 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-04-14T23:26:56.406 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2024-04-14T23:26:56.455 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: 2024-04-14T23:26:56.457 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-14T23:26:56.457 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-04-14T23:26:56.477 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-04-14T23:26:56.477 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2024-04-14T23:26:56.498 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2024-04-14T23:26:56.498 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi047.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2024-04-14T23:26:56.499 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T23:26:56.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:26:56.546 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T23:26:56.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:26:56.574 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-14T23:26:56.574 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-04-14T23:26:56.622 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2024-04-14T23:26:56.657 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-14T23:26:56.666 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-14T23:26:56.683 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-14T23:26:56.684 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi047.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-14T23:31:17.212 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2024-04-14T23:31:17.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-14T23:31:17.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:31:17.304 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-04-14T23:31:17.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-14T23:31:17.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-14T23:31:17.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T23:31:17.470 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-04-14T23:31:17.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-14T23:31:17.550 INFO:teuthology.run_tasks:Running task clock... 2024-04-14T23:31:17.563 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-14T23:31:17.563 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-14T23:31:17.564 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T23:31:17.566 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-14T23:31:17.566 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T23:31:17.596 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-14T23:31:17.613 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-14T23:31:17.620 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-14T23:31:17.637 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-14T23:31:17.644 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-04-14T23:31:17.657 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-04-14T23:31:17.666 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2024-04-14T23:31:17.674 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-14T23:31:17.680 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2024-04-14T23:31:17.690 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-14T23:31:17.696 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-14T23:31:17.713 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-14T23:31:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-04-14T23:31:17.753 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T23:31:17.753 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-04-14T23:31:17.753 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:31:17.754 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:31:17.754 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:31:17.754 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:31:17.768 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-04-14T23:31:17.771 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T23:31:17.771 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-04-14T23:31:17.771 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:31:17.771 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:31:17.771 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:31:17.771 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:31:17.772 INFO:teuthology.run_tasks:Running task install... 2024-04-14T23:31:17.781 DEBUG:teuthology.task.install:project ceph 2024-04-14T23:31:17.781 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}} 2024-04-14T23:31:17.781 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'} 2024-04-14T23:31:17.781 INFO:teuthology.task.install:Using flavor: default 2024-04-14T23:31:17.788 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-14T23:31:17.788 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-14T23:31:17.788 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'tag': None, 'wait_for_package': False} 2024-04-14T23:31:17.789 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-14T23:31:17.790 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'tag': None, 'wait_for_package': False} 2024-04-14T23:31:17.791 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-14T23:31:17.932 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/ 2024-04-14T23:31:17.932 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2114.ga9a752df 2024-04-14T23:31:17.945 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/ 2024-04-14T23:31:17.945 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2114.ga9a752df 2024-04-14T23:31:18.048 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-14T23:31:18.048 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:31:18.048 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-14T23:31:18.076 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-14T23:31:18.077 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a9a752df26c63acad72e1b3569fd79a515ca0765/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-14T23:31:18.114 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-14T23:31:18.114 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:31:18.114 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-14T23:31:18.143 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-14T23:31:18.143 DEBUG:teuthology.orchestra.run.smithi191:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a9a752df26c63acad72e1b3569fd79a515ca0765/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-14T23:31:18.144 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-14T23:31:18.211 DEBUG:teuthology.orchestra.run.smithi191:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-14T23:31:18.223 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-14T23:31:18.289 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-04-14T23:31:18.291 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-04-14T23:31:18.291 DEBUG:teuthology.orchestra.run.smithi191:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-14T23:31:18.358 INFO:teuthology.orchestra.run.smithi191.stdout:check_obsoletes = 1 2024-04-14T23:31:18.361 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum clean all 2024-04-14T23:31:18.551 INFO:teuthology.orchestra.run.smithi047.stdout:74 files removed 2024-04-14T23:31:18.578 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-14T23:31:18.602 INFO:teuthology.orchestra.run.smithi191.stdout:74 files removed 2024-04-14T23:31:18.629 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-14T23:31:19.264 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 218 kB/s | 83 kB 00:00 2024-04-14T23:31:19.296 INFO:teuthology.orchestra.run.smithi191.stdout:ceph packages for x86_64 227 kB/s | 83 kB 00:00 2024-04-14T23:31:19.655 INFO:teuthology.orchestra.run.smithi191.stdout:ceph noarch packages 37 kB/s | 11 kB 00:00 2024-04-14T23:31:19.698 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 30 kB/s | 11 kB 00:00 2024-04-14T23:31:20.049 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 6.2 kB/s | 1.9 kB 00:00 2024-04-14T23:31:20.080 INFO:teuthology.orchestra.run.smithi191.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-04-14T23:31:20.493 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS-9 - AppStream 20 MB/s | 8.1 MB 00:00 2024-04-14T23:31:20.550 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-9 - AppStream 19 MB/s | 8.1 MB 00:00 2024-04-14T23:31:22.168 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-9 - BaseOS 8.7 MB/s | 2.5 MB 00:00 2024-04-14T23:31:22.269 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS-9 - BaseOS 8.2 MB/s | 2.5 MB 00:00 2024-04-14T23:31:23.400 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-14T23:31:24.225 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.0 MB 00:01 2024-04-14T23:31:25.260 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-04-14T23:31:26.061 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-04-14T23:31:29.503 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-14T23:31:30.104 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-14T23:31:31.188 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-04-14T23:31:31.571 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 16 kB 00:00 2024-04-14T23:31:32.666 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-14T23:31:33.057 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-14T23:31:37.855 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-14T23:31:38.149 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-04-14T23:31:40.566 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-14T23:31:40.567 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-14T23:31:40.567 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-14T23:31:40.567 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.567 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-14T23:31:40.567 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.567 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-14T23:31:40.567 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.567 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-14T23:31:40.567 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.567 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-14T23:31:40.567 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.567 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-14T23:31:40.567 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.568 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-14T23:31:40.568 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.568 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-14T23:31:40.568 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.568 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-14T23:31:40.568 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.568 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-14T23:31:40.568 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.568 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-14T23:31:40.568 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.568 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-14T23:31:40.568 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.568 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-14T23:31:40.568 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.569 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-14T23:31:40.569 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.569 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-14T23:31:40.569 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.569 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-14T23:31:40.569 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.569 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-14T23:31:40.569 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.569 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-14T23:31:40.569 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.569 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-14T23:31:40.569 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.569 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-14T23:31:40.570 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.570 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-14T23:31:40.570 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.570 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-14T23:31:40.570 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.570 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-14T23:31:40.570 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.570 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-14T23:31:40.571 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.571 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-14T23:31:40.571 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.571 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-14T23:31:40.571 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.571 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-14T23:31:40.571 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.571 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-14T23:31:40.571 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.571 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-14T23:31:40.572 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.572 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-14T23:31:40.572 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.572 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-14T23:31:40.572 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.572 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-14T23:31:40.572 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.572 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-14T23:31:40.572 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.572 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-14T23:31:40.572 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.572 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-14T23:31:40.572 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.572 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-14T23:31:40.573 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.573 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-14T23:31:40.573 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.573 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.573 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.573 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T23:31:40.573 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.573 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.573 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.573 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.573 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-14T23:31:40.574 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.574 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.574 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.574 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.574 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.574 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.574 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T23:31:40.574 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.574 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.574 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.575 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.575 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T23:31:40.575 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.575 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.575 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.575 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.575 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T23:31:40.575 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.575 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.575 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.575 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.576 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T23:31:40.576 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.576 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.576 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.576 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.576 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T23:31:40.576 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.576 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.576 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.576 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.576 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T23:31:40.576 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.576 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.577 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.577 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.720 INFO:teuthology.orchestra.run.smithi191.stderr:Modular dependency problems: 2024-04-14T23:31:40.720 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-14T23:31:40.720 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 1: conflicting requests 2024-04-14T23:31:40.720 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.720 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 2: conflicting requests 2024-04-14T23:31:40.720 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.721 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 3: conflicting requests 2024-04-14T23:31:40.721 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.721 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 4: conflicting requests 2024-04-14T23:31:40.721 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.721 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 5: conflicting requests 2024-04-14T23:31:40.721 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.721 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 6: conflicting requests 2024-04-14T23:31:40.721 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.721 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 7: conflicting requests 2024-04-14T23:31:40.721 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.721 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 8: conflicting requests 2024-04-14T23:31:40.721 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.722 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 9: conflicting requests 2024-04-14T23:31:40.722 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.722 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 10: conflicting requests 2024-04-14T23:31:40.722 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.722 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 11: conflicting requests 2024-04-14T23:31:40.722 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.722 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 12: conflicting requests 2024-04-14T23:31:40.722 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.722 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 13: conflicting requests 2024-04-14T23:31:40.722 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.722 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 14: conflicting requests 2024-04-14T23:31:40.722 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.723 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 15: conflicting requests 2024-04-14T23:31:40.723 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.723 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 16: conflicting requests 2024-04-14T23:31:40.723 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.723 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 17: conflicting requests 2024-04-14T23:31:40.723 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.723 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 18: conflicting requests 2024-04-14T23:31:40.723 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.723 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 19: conflicting requests 2024-04-14T23:31:40.723 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.723 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 20: conflicting requests 2024-04-14T23:31:40.723 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.723 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 21: conflicting requests 2024-04-14T23:31:40.723 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.723 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 22: conflicting requests 2024-04-14T23:31:40.724 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.724 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 23: conflicting requests 2024-04-14T23:31:40.724 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.724 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 24: conflicting requests 2024-04-14T23:31:40.724 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.724 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 25: conflicting requests 2024-04-14T23:31:40.724 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.724 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 26: conflicting requests 2024-04-14T23:31:40.724 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.724 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 27: conflicting requests 2024-04-14T23:31:40.724 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.724 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 28: conflicting requests 2024-04-14T23:31:40.724 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.724 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 29: conflicting requests 2024-04-14T23:31:40.725 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.725 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 30: conflicting requests 2024-04-14T23:31:40.725 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.725 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 31: conflicting requests 2024-04-14T23:31:40.725 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.725 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 32: conflicting requests 2024-04-14T23:31:40.725 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.725 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 33: conflicting requests 2024-04-14T23:31:40.725 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.725 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 34: conflicting requests 2024-04-14T23:31:40.725 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.725 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 35: conflicting requests 2024-04-14T23:31:40.725 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.725 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 36: conflicting requests 2024-04-14T23:31:40.726 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.726 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 37: conflicting requests 2024-04-14T23:31:40.726 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.727 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.727 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.727 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T23:31:40.727 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.727 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.727 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.727 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.727 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 39: conflicting requests 2024-04-14T23:31:40.728 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.728 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.728 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.728 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.728 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.728 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.728 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T23:31:40.728 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.728 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.728 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.729 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.729 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T23:31:40.729 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.729 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.729 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.729 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.729 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T23:31:40.729 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.729 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.730 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.730 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.730 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T23:31:40.730 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.730 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.730 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.730 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.730 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T23:31:40.730 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.730 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.731 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.731 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.731 INFO:teuthology.orchestra.run.smithi191.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T23:31:40.731 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.731 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.731 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T23:31:40.731 INFO:teuthology.orchestra.run.smithi191.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T23:31:41.036 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T23:31:41.037 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T23:31:41.051 INFO:teuthology.orchestra.run.smithi047.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-14T23:31:41.052 INFO:teuthology.orchestra.run.smithi047.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-14T23:31:41.053 INFO:teuthology.orchestra.run.smithi047.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-14T23:31:41.054 INFO:teuthology.orchestra.run.smithi047.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-14T23:31:41.056 INFO:teuthology.orchestra.run.smithi047.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-14T23:31:41.062 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-14T23:31:41.062 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-14T23:31:41.159 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-14T23:31:41.171 INFO:teuthology.orchestra.run.smithi047.stdout:========================================================================================= 2024-04-14T23:31:41.172 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-04-14T23:31:41.172 INFO:teuthology.orchestra.run.smithi047.stdout:========================================================================================= 2024-04-14T23:31:41.172 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-14T23:31:41.172 INFO:teuthology.orchestra.run.smithi047.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-14T23:31:41.172 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 6.6 k 2024-04-14T23:31:41.172 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.3 M 2024-04-14T23:31:41.172 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 891 k 2024-04-14T23:31:41.172 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 145 k 2024-04-14T23:31:41.172 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 1.5 M 2024-04-14T23:31:41.172 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 139 k 2024-04-14T23:31:41.172 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 3.5 M 2024-04-14T23:31:41.172 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 7.4 M 2024-04-14T23:31:41.172 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 49 k 2024-04-14T23:31:41.173 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 9.9 M 2024-04-14T23:31:41.173 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 48 M 2024-04-14T23:31:41.173 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 264 k 2024-04-14T23:31:41.173 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 749 k 2024-04-14T23:31:41.173 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 222 k 2024-04-14T23:31:41.173 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-shell x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 27 k 2024-04-14T23:31:41.173 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 18 k 2024-04-14T23:31:41.173 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-14T23:31:41.173 INFO:teuthology.orchestra.run.smithi047.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-14T23:31:41.173 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-14T23:31:41.173 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 32 k 2024-04-14T23:31:41.173 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 746 k 2024-04-14T23:31:41.173 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 127 k 2024-04-14T23:31:41.173 INFO:teuthology.orchestra.run.smithi047.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-14T23:31:41.173 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-14T23:31:41.174 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-14T23:31:41.174 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-14T23:31:41.174 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-14T23:31:41.174 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-14T23:31:41.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 162 k 2024-04-14T23:31:41.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 320 k 2024-04-14T23:31:41.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 298 k 2024-04-14T23:31:41.174 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 99 k 2024-04-14T23:31:41.174 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 85 k 2024-04-14T23:31:41.174 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-14T23:31:41.175 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 171 k 2024-04-14T23:31:41.175 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-14T23:31:41.175 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-04-14T23:31:41.175 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-14T23:31:41.175 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-14T23:31:41.175 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-14T23:31:41.175 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-14T23:31:41.175 INFO:teuthology.orchestra.run.smithi047.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-14T23:31:41.175 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-14T23:31:41.175 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-14T23:31:41.175 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-14T23:31:41.175 INFO:teuthology.orchestra.run.smithi047.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-14T23:31:41.175 INFO:teuthology.orchestra.run.smithi047.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-14T23:31:41.175 INFO:teuthology.orchestra.run.smithi047.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-14T23:31:41.176 INFO:teuthology.orchestra.run.smithi047.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-14T23:31:41.176 INFO:teuthology.orchestra.run.smithi047.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-14T23:31:41.176 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.4 M 2024-04-14T23:31:41.176 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-14T23:31:41.176 INFO:teuthology.orchestra.run.smithi047.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-14T23:31:41.177 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-14T23:31:41.177 INFO:teuthology.orchestra.run.smithi047.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-14T23:31:41.177 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-14T23:31:41.177 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-14T23:31:41.177 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-14T23:31:41.177 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-14T23:31:41.177 INFO:teuthology.orchestra.run.smithi047.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-14T23:31:41.177 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-14T23:31:41.177 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-04-14T23:31:41.177 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-14T23:31:41.177 INFO:teuthology.orchestra.run.smithi047.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-14T23:31:41.177 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-14T23:31:41.177 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 21 M 2024-04-14T23:31:41.177 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 32 k 2024-04-14T23:31:41.178 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 2.4 M 2024-04-14T23:31:41.178 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 248 k 2024-04-14T23:31:41.178 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 4.7 M 2024-04-14T23:31:41.178 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 17 M 2024-04-14T23:31:41.178 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 15 k 2024-04-14T23:31:41.178 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 25 k 2024-04-14T23:31:41.178 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-14T23:31:41.178 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-14T23:31:41.178 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-14T23:31:41.178 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-14T23:31:41.178 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-14T23:31:41.178 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-14T23:31:41.179 INFO:teuthology.orchestra.run.smithi047.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-14T23:31:41.179 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-14T23:31:41.179 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-14T23:31:41.179 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 164 k 2024-04-14T23:31:41.179 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-14T23:31:41.179 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-14T23:31:41.179 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-14T23:31:41.179 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-14T23:31:41.179 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-14T23:31:41.179 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 501 k 2024-04-14T23:31:41.179 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-14T23:31:41.179 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.2 M 2024-04-14T23:31:41.179 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-14T23:31:41.180 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-14T23:31:41.180 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-14T23:31:41.180 INFO:teuthology.orchestra.run.smithi047.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-14T23:31:41.180 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-14T23:31:41.180 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-14T23:31:41.180 INFO:teuthology.orchestra.run.smithi047.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-14T23:31:41.180 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-14T23:31:41.180 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-14T23:31:41.180 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-14T23:31:41.180 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-14T23:31:41.180 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-14T23:31:41.180 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-14T23:31:41.180 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-14T23:31:41.180 INFO:teuthology.orchestra.run.smithi047.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-14T23:31:41.181 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-14T23:31:41.181 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-14T23:31:41.181 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-14T23:31:41.181 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 45 k 2024-04-14T23:31:41.181 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 131 k 2024-04-14T23:31:41.181 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-14T23:31:41.181 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-14T23:31:41.181 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-14T23:31:41.181 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-14T23:31:41.181 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-14T23:31:41.181 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-14T23:31:41.181 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-14T23:31:41.181 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-14T23:31:41.181 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-14T23:31:41.182 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-14T23:31:41.182 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-14T23:31:41.182 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-14T23:31:41.182 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-14T23:31:41.182 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-14T23:31:41.182 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-14T23:31:41.182 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-14T23:31:41.182 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-14T23:31:41.182 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-14T23:31:41.182 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-14T23:31:41.182 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-14T23:31:41.183 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-14T23:31:41.183 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-14T23:31:41.183 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-14T23:31:41.183 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-14T23:31:41.183 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-14T23:31:41.183 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-14T23:31:41.183 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-14T23:31:41.183 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-14T23:31:41.183 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-14T23:31:41.183 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-14T23:31:41.184 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-14T23:31:41.184 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-14T23:31:41.184 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-14T23:31:41.184 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-14T23:31:41.184 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-14T23:31:41.184 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-14T23:31:41.184 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-14T23:31:41.184 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-14T23:31:41.184 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-14T23:31:41.184 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-14T23:31:41.184 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-14T23:31:41.184 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-14T23:31:41.184 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-14T23:31:41.184 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-14T23:31:41.185 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-14T23:31:41.185 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-14T23:31:41.185 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-14T23:31:41.185 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-14T23:31:41.185 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-14T23:31:41.185 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-14T23:31:41.185 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-14T23:31:41.185 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-14T23:31:41.185 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-14T23:31:41.185 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-14T23:31:41.185 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-14T23:31:41.185 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-14T23:31:41.185 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-14T23:31:41.185 INFO:teuthology.orchestra.run.smithi047.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-14T23:31:41.186 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-14T23:31:41.186 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-14T23:31:41.186 INFO:teuthology.orchestra.run.smithi047.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-14T23:31:41.186 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-14T23:31:41.186 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-14T23:31:41.186 INFO:teuthology.orchestra.run.smithi047.stdout:Installing weak dependencies: 2024-04-14T23:31:41.186 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-14T23:31:41.186 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:31:41.186 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-14T23:31:41.186 INFO:teuthology.orchestra.run.smithi047.stdout:========================================================================================= 2024-04-14T23:31:41.186 INFO:teuthology.orchestra.run.smithi047.stdout:Install 150 Packages 2024-04-14T23:31:41.186 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 24 Packages 2024-04-14T23:31:41.186 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:31:41.187 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 228 M 2024-04-14T23:31:41.187 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-14T23:31:41.289 INFO:teuthology.orchestra.run.smithi191.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T23:31:41.290 INFO:teuthology.orchestra.run.smithi191.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T23:31:41.303 INFO:teuthology.orchestra.run.smithi191.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-14T23:31:41.304 INFO:teuthology.orchestra.run.smithi191.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-14T23:31:41.305 INFO:teuthology.orchestra.run.smithi191.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-14T23:31:41.306 INFO:teuthology.orchestra.run.smithi191.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-14T23:31:41.308 INFO:teuthology.orchestra.run.smithi191.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-14T23:31:41.310 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-14T23:31:41.311 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-14T23:31:41.404 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-14T23:31:41.431 INFO:teuthology.orchestra.run.smithi191.stdout:========================================================================================= 2024-04-14T23:31:41.431 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-04-14T23:31:41.431 INFO:teuthology.orchestra.run.smithi191.stdout:========================================================================================= 2024-04-14T23:31:41.431 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-14T23:31:41.432 INFO:teuthology.orchestra.run.smithi191.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-14T23:31:41.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 6.6 k 2024-04-14T23:31:41.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.3 M 2024-04-14T23:31:41.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 891 k 2024-04-14T23:31:41.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 145 k 2024-04-14T23:31:41.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 1.5 M 2024-04-14T23:31:41.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 139 k 2024-04-14T23:31:41.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 3.5 M 2024-04-14T23:31:41.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 7.4 M 2024-04-14T23:31:41.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 49 k 2024-04-14T23:31:41.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 9.9 M 2024-04-14T23:31:41.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 48 M 2024-04-14T23:31:41.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 264 k 2024-04-14T23:31:41.432 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 749 k 2024-04-14T23:31:41.433 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 222 k 2024-04-14T23:31:41.433 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-shell x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 27 k 2024-04-14T23:31:41.433 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 18 k 2024-04-14T23:31:41.433 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-14T23:31:41.433 INFO:teuthology.orchestra.run.smithi191.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-14T23:31:41.433 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-14T23:31:41.433 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 32 k 2024-04-14T23:31:41.433 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 746 k 2024-04-14T23:31:41.433 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 127 k 2024-04-14T23:31:41.433 INFO:teuthology.orchestra.run.smithi191.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-14T23:31:41.433 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-14T23:31:41.433 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-14T23:31:41.433 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-14T23:31:41.433 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-14T23:31:41.434 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-14T23:31:41.434 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 162 k 2024-04-14T23:31:41.434 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 320 k 2024-04-14T23:31:41.434 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 298 k 2024-04-14T23:31:41.434 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 99 k 2024-04-14T23:31:41.434 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 85 k 2024-04-14T23:31:41.434 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-14T23:31:41.434 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 171 k 2024-04-14T23:31:41.434 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-14T23:31:41.434 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrading: 2024-04-14T23:31:41.434 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-14T23:31:41.434 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-14T23:31:41.435 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-14T23:31:41.435 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-14T23:31:41.435 INFO:teuthology.orchestra.run.smithi191.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-14T23:31:41.435 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-14T23:31:41.435 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-14T23:31:41.435 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-14T23:31:41.435 INFO:teuthology.orchestra.run.smithi191.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-14T23:31:41.435 INFO:teuthology.orchestra.run.smithi191.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-14T23:31:41.435 INFO:teuthology.orchestra.run.smithi191.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-14T23:31:41.435 INFO:teuthology.orchestra.run.smithi191.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-14T23:31:41.435 INFO:teuthology.orchestra.run.smithi191.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-14T23:31:41.435 INFO:teuthology.orchestra.run.smithi191.stdout: librados2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.4 M 2024-04-14T23:31:41.435 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-14T23:31:41.436 INFO:teuthology.orchestra.run.smithi191.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-14T23:31:41.436 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-14T23:31:41.436 INFO:teuthology.orchestra.run.smithi191.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-14T23:31:41.436 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-14T23:31:41.436 INFO:teuthology.orchestra.run.smithi191.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-14T23:31:41.436 INFO:teuthology.orchestra.run.smithi191.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-14T23:31:41.436 INFO:teuthology.orchestra.run.smithi191.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-14T23:31:41.436 INFO:teuthology.orchestra.run.smithi191.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-14T23:31:41.436 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-14T23:31:41.436 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-04-14T23:31:41.436 INFO:teuthology.orchestra.run.smithi191.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-14T23:31:41.436 INFO:teuthology.orchestra.run.smithi191.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-14T23:31:41.436 INFO:teuthology.orchestra.run.smithi191.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-14T23:31:41.437 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 21 M 2024-04-14T23:31:41.437 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 32 k 2024-04-14T23:31:41.437 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 2.4 M 2024-04-14T23:31:41.437 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 248 k 2024-04-14T23:31:41.437 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 4.7 M 2024-04-14T23:31:41.437 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 17 M 2024-04-14T23:31:41.437 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 15 k 2024-04-14T23:31:41.437 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 25 k 2024-04-14T23:31:41.437 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-14T23:31:41.437 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-14T23:31:41.437 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-14T23:31:41.437 INFO:teuthology.orchestra.run.smithi191.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-14T23:31:41.437 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-14T23:31:41.438 INFO:teuthology.orchestra.run.smithi191.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-14T23:31:41.438 INFO:teuthology.orchestra.run.smithi191.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-14T23:31:41.438 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-14T23:31:41.438 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-14T23:31:41.438 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 164 k 2024-04-14T23:31:41.438 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-14T23:31:41.438 INFO:teuthology.orchestra.run.smithi191.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-14T23:31:41.438 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-14T23:31:41.438 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-14T23:31:41.438 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-14T23:31:41.438 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 501 k 2024-04-14T23:31:41.438 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-14T23:31:41.438 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.2 M 2024-04-14T23:31:41.439 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-14T23:31:41.439 INFO:teuthology.orchestra.run.smithi191.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-14T23:31:41.439 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-14T23:31:41.439 INFO:teuthology.orchestra.run.smithi191.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-14T23:31:41.439 INFO:teuthology.orchestra.run.smithi191.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-14T23:31:41.439 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-14T23:31:41.439 INFO:teuthology.orchestra.run.smithi191.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-14T23:31:41.439 INFO:teuthology.orchestra.run.smithi191.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-14T23:31:41.439 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-14T23:31:41.439 INFO:teuthology.orchestra.run.smithi191.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-14T23:31:41.439 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-14T23:31:41.439 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-14T23:31:41.439 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-14T23:31:41.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-14T23:31:41.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-14T23:31:41.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-14T23:31:41.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-14T23:31:41.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-14T23:31:41.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 45 k 2024-04-14T23:31:41.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 131 k 2024-04-14T23:31:41.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-14T23:31:41.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-14T23:31:41.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-14T23:31:41.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-14T23:31:41.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-14T23:31:41.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-14T23:31:41.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-14T23:31:41.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-14T23:31:41.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-14T23:31:41.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-14T23:31:41.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-14T23:31:41.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-14T23:31:41.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-14T23:31:41.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-14T23:31:41.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-14T23:31:41.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-14T23:31:41.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-14T23:31:41.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-14T23:31:41.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-14T23:31:41.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-14T23:31:41.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-14T23:31:41.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-14T23:31:41.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-14T23:31:41.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-14T23:31:41.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-14T23:31:41.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-14T23:31:41.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-14T23:31:41.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-14T23:31:41.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-14T23:31:41.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-14T23:31:41.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-14T23:31:41.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-14T23:31:41.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-14T23:31:41.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-14T23:31:41.443 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-14T23:31:41.443 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-14T23:31:41.443 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-14T23:31:41.443 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-14T23:31:41.443 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-14T23:31:41.443 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-14T23:31:41.443 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-14T23:31:41.443 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-14T23:31:41.443 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-14T23:31:41.443 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-14T23:31:41.443 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-14T23:31:41.443 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-14T23:31:41.443 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-14T23:31:41.443 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-14T23:31:41.443 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-14T23:31:41.444 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-14T23:31:41.444 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-14T23:31:41.444 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-14T23:31:41.444 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-14T23:31:41.444 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-14T23:31:41.444 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-14T23:31:41.444 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-14T23:31:41.444 INFO:teuthology.orchestra.run.smithi191.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-14T23:31:41.444 INFO:teuthology.orchestra.run.smithi191.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-14T23:31:41.444 INFO:teuthology.orchestra.run.smithi191.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-14T23:31:41.444 INFO:teuthology.orchestra.run.smithi191.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-14T23:31:41.444 INFO:teuthology.orchestra.run.smithi191.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-14T23:31:41.444 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-14T23:31:41.444 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-14T23:31:41.445 INFO:teuthology.orchestra.run.smithi191.stdout:Installing weak dependencies: 2024-04-14T23:31:41.445 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-14T23:31:41.445 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:31:41.445 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-14T23:31:41.445 INFO:teuthology.orchestra.run.smithi191.stdout:========================================================================================= 2024-04-14T23:31:41.445 INFO:teuthology.orchestra.run.smithi191.stdout:Install 150 Packages 2024-04-14T23:31:41.445 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrade 24 Packages 2024-04-14T23:31:41.445 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:31:41.446 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 228 M 2024-04-14T23:31:41.446 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-14T23:31:42.006 INFO:teuthology.orchestra.run.smithi047.stdout:(1/174): ceph-19.0.0-2114.ga9a752df.el7.x86_64. 40 kB/s | 6.6 kB 00:00 2024-04-14T23:31:42.240 INFO:teuthology.orchestra.run.smithi047.stdout:(2/174): ceph-fuse-19.0.0-2114.ga9a752df.el7.x8 3.7 MB/s | 891 kB 00:00 2024-04-14T23:31:42.331 INFO:teuthology.orchestra.run.smithi047.stdout:(3/174): ceph-immutable-object-cache-19.0.0-211 1.5 MB/s | 145 kB 00:00 2024-04-14T23:31:42.384 INFO:teuthology.orchestra.run.smithi191.stdout:(1/174): ceph-19.0.0-2114.ga9a752df.el7.x86_64. 21 kB/s | 6.6 kB 00:00 2024-04-14T23:31:42.424 INFO:teuthology.orchestra.run.smithi047.stdout:(4/174): ceph-base-19.0.0-2114.ga9a752df.el7.x8 9.2 MB/s | 5.3 MB 00:00 2024-04-14T23:31:42.582 INFO:teuthology.orchestra.run.smithi047.stdout:(5/174): ceph-mgr-19.0.0-2114.ga9a752df.el7.x86 9.5 MB/s | 1.5 MB 00:00 2024-04-14T23:31:42.849 INFO:teuthology.orchestra.run.smithi047.stdout:(6/174): ceph-mds-19.0.0-2114.ga9a752df.el7.x86 4.6 MB/s | 2.4 MB 00:00 2024-04-14T23:31:42.991 INFO:teuthology.orchestra.run.smithi047.stdout:(7/174): ceph-mon-19.0.0-2114.ga9a752df.el7.x86 11 MB/s | 4.7 MB 00:00 2024-04-14T23:31:43.234 INFO:teuthology.orchestra.run.smithi191.stdout:(2/174): ceph-fuse-19.0.0-2114.ga9a752df.el7.x8 1.0 MB/s | 891 kB 00:00 2024-04-14T23:31:43.435 INFO:teuthology.orchestra.run.smithi191.stdout:(3/174): ceph-immutable-object-cache-19.0.0-211 724 kB/s | 145 kB 00:00 2024-04-14T23:31:44.024 INFO:teuthology.orchestra.run.smithi047.stdout:(8/174): ceph-radosgw-19.0.0-2114.ga9a752df.el7 9.6 MB/s | 9.9 MB 00:01 2024-04-14T23:31:44.233 INFO:teuthology.orchestra.run.smithi047.stdout:(9/174): ceph-common-19.0.0-2114.ga9a752df.el7. 8.6 MB/s | 21 MB 00:02 2024-04-14T23:31:44.267 INFO:teuthology.orchestra.run.smithi047.stdout:(10/174): ceph-selinux-19.0.0-2114.ga9a752df.el 104 kB/s | 25 kB 00:00 2024-04-14T23:31:44.285 INFO:teuthology.orchestra.run.smithi191.stdout:(4/174): ceph-mds-19.0.0-2114.ga9a752df.el7.x86 2.8 MB/s | 2.4 MB 00:00 2024-04-14T23:31:44.334 INFO:teuthology.orchestra.run.smithi047.stdout:(11/174): cephfs-mirror-19.0.0-2114.ga9a752df.e 3.3 MB/s | 222 kB 00:00 2024-04-14T23:31:44.401 INFO:teuthology.orchestra.run.smithi047.stdout:(12/174): cephfs-shell-19.0.0-2114.ga9a752df.el 406 kB/s | 27 kB 00:00 2024-04-14T23:31:44.476 INFO:teuthology.orchestra.run.smithi047.stdout:(13/174): libcephfs-devel-19.0.0-2114.ga9a752df 423 kB/s | 32 kB 00:00 2024-04-14T23:31:44.635 INFO:teuthology.orchestra.run.smithi047.stdout:(14/174): libcephfs2-19.0.0-2114.ga9a752df.el7. 4.6 MB/s | 746 kB 00:00 2024-04-14T23:31:44.710 INFO:teuthology.orchestra.run.smithi047.stdout:(15/174): libcephsqlite-19.0.0-2114.ga9a752df.e 2.1 MB/s | 164 kB 00:00 2024-04-14T23:31:44.710 INFO:teuthology.orchestra.run.smithi191.stdout:(5/174): ceph-mgr-19.0.0-2114.ga9a752df.el7.x86 3.5 MB/s | 1.5 MB 00:00 2024-04-14T23:31:44.777 INFO:teuthology.orchestra.run.smithi047.stdout:(16/174): librados-devel-19.0.0-2114.ga9a752df. 1.9 MB/s | 127 kB 00:00 2024-04-14T23:31:44.868 INFO:teuthology.orchestra.run.smithi047.stdout:(17/174): libradosstriper1-19.0.0-2114.ga9a752d 5.3 MB/s | 501 kB 00:00 2024-04-14T23:31:45.669 INFO:teuthology.orchestra.run.smithi047.stdout:(18/174): librgw2-19.0.0-2114.ga9a752df.el7.x86 6.5 MB/s | 5.2 MB 00:00 2024-04-14T23:31:45.736 INFO:teuthology.orchestra.run.smithi047.stdout:(19/174): python3-ceph-argparse-19.0.0-2114.ga9 678 kB/s | 45 kB 00:00 2024-04-14T23:31:45.752 INFO:teuthology.orchestra.run.smithi191.stdout:(6/174): ceph-mon-19.0.0-2114.ga9a752df.el7.x86 4.5 MB/s | 4.7 MB 00:01 2024-04-14T23:31:45.811 INFO:teuthology.orchestra.run.smithi047.stdout:(20/174): python3-ceph-common-19.0.0-2114.ga9a7 1.7 MB/s | 131 kB 00:00 2024-04-14T23:31:45.894 INFO:teuthology.orchestra.run.smithi047.stdout:(21/174): python3-cephfs-19.0.0-2114.ga9a752df. 1.9 MB/s | 162 kB 00:00 2024-04-14T23:31:45.986 INFO:teuthology.orchestra.run.smithi047.stdout:(22/174): python3-rados-19.0.0-2114.ga9a752df.e 3.4 MB/s | 320 kB 00:00 2024-04-14T23:31:46.028 INFO:teuthology.orchestra.run.smithi191.stdout:(7/174): ceph-base-19.0.0-2114.ga9a752df.el7.x8 1.4 MB/s | 5.3 MB 00:03 2024-04-14T23:31:46.070 INFO:teuthology.orchestra.run.smithi047.stdout:(23/174): python3-rbd-19.0.0-2114.ga9a752df.el7 3.5 MB/s | 298 kB 00:00 2024-04-14T23:31:46.162 INFO:teuthology.orchestra.run.smithi047.stdout:(24/174): python3-rgw-19.0.0-2114.ga9a752df.el7 1.1 MB/s | 99 kB 00:00 2024-04-14T23:31:46.245 INFO:teuthology.orchestra.run.smithi047.stdout:(25/174): rbd-fuse-19.0.0-2114.ga9a752df.el7.x8 1.0 MB/s | 85 kB 00:00 2024-04-14T23:31:46.779 INFO:teuthology.orchestra.run.smithi047.stdout:(26/174): ceph-osd-19.0.0-2114.ga9a752df.el7.x8 4.3 MB/s | 17 MB 00:03 2024-04-14T23:31:46.838 INFO:teuthology.orchestra.run.smithi047.stdout:(27/174): rbd-mirror-19.0.0-2114.ga9a752df.el7. 5.2 MB/s | 3.1 MB 00:00 2024-04-14T23:31:46.863 INFO:teuthology.orchestra.run.smithi047.stdout:(28/174): rbd-nbd-19.0.0-2114.ga9a752df.el7.x86 2.0 MB/s | 171 kB 00:00 2024-04-14T23:31:46.896 INFO:teuthology.orchestra.run.smithi047.stdout:(29/174): ceph-grafana-dashboards-19.0.0-2114.g 544 kB/s | 32 kB 00:00 2024-04-14T23:31:46.938 INFO:teuthology.orchestra.run.smithi047.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2114.ga9a752d 1.8 MB/s | 139 kB 00:00 2024-04-14T23:31:47.581 INFO:teuthology.orchestra.run.smithi047.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2114.ga9a75 5.1 MB/s | 3.5 MB 00:00 2024-04-14T23:31:47.664 INFO:teuthology.orchestra.run.smithi047.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2114.ga9 2.9 MB/s | 248 kB 00:00 2024-04-14T23:31:47.731 INFO:teuthology.orchestra.run.smithi047.stdout:(33/174): ceph-mgr-rook-19.0.0-2114.ga9a752df.e 741 kB/s | 49 kB 00:00 2024-04-14T23:31:47.798 INFO:teuthology.orchestra.run.smithi047.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2114.ga 230 kB/s | 15 kB 00:00 2024-04-14T23:31:47.890 INFO:teuthology.orchestra.run.smithi047.stdout:(35/174): ceph-volume-19.0.0-2114.ga9a752df.el7 2.8 MB/s | 264 kB 00:00 2024-04-14T23:31:48.032 INFO:teuthology.orchestra.run.smithi047.stdout:(36/174): cephadm-19.0.0-2114.ga9a752df.el7.noa 5.2 MB/s | 749 kB 00:00 2024-04-14T23:31:48.090 INFO:teuthology.orchestra.run.smithi047.stdout:(37/174): cephfs-top-19.0.0-2114.ga9a752df.el7. 312 kB/s | 18 kB 00:00 2024-04-14T23:31:48.120 INFO:teuthology.orchestra.run.smithi191.stdout:(8/174): ceph-osd-19.0.0-2114.ga9a752df.el7.x86 7.1 MB/s | 17 MB 00:02 2024-04-14T23:31:48.174 INFO:teuthology.orchestra.run.smithi047.stdout:(38/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 211 kB/s | 18 kB 00:00 2024-04-14T23:31:48.186 INFO:teuthology.orchestra.run.smithi191.stdout:(9/174): ceph-selinux-19.0.0-2114.ga9a752df.el7 379 kB/s | 25 kB 00:00 2024-04-14T23:31:48.599 INFO:teuthology.orchestra.run.smithi047.stdout:(39/174): ceph-test-19.0.0-2114.ga9a752df.el7.x 11 MB/s | 48 MB 00:04 2024-04-14T23:31:48.725 INFO:teuthology.orchestra.run.smithi047.stdout:(40/174): fuse-2.9.9-15.el9.x86_64.rpm 146 kB/s | 80 kB 00:00 2024-04-14T23:31:48.867 INFO:teuthology.orchestra.run.smithi047.stdout:(41/174): ceph-mgr-diskprediction-local-19.0.0- 3.8 MB/s | 7.4 MB 00:01 2024-04-14T23:31:48.892 INFO:teuthology.orchestra.run.smithi047.stdout:(42/174): jq-1.6-16.el9.x86_64.rpm 641 kB/s | 187 kB 00:00 2024-04-14T23:31:48.976 INFO:teuthology.orchestra.run.smithi047.stdout:(43/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 218 kB 00:00 2024-04-14T23:31:49.001 INFO:teuthology.orchestra.run.smithi047.stdout:(44/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-04-14T23:31:49.060 INFO:teuthology.orchestra.run.smithi047.stdout:(45/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-04-14T23:31:49.085 INFO:teuthology.orchestra.run.smithi047.stdout:(46/174): libquadmath-11.4.1-3.el9.x86_64.rpm 897 kB/s | 195 kB 00:00 2024-04-14T23:31:49.110 INFO:teuthology.orchestra.run.smithi047.stdout:(47/174): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-14T23:31:49.135 INFO:teuthology.orchestra.run.smithi047.stdout:(48/174): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-14T23:31:49.160 INFO:teuthology.orchestra.run.smithi047.stdout:(49/174): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-14T23:31:49.211 INFO:teuthology.orchestra.run.smithi047.stdout:(50/174): python3-cryptography-36.0.1-4.el9.x86 5.9 MB/s | 1.2 MB 00:00 2024-04-14T23:31:49.236 INFO:teuthology.orchestra.run.smithi047.stdout:(51/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-04-14T23:31:49.995 INFO:teuthology.orchestra.run.smithi047.stdout:(52/174): boost-program-options-1.75.0-8.el9.x8 141 kB/s | 107 kB 00:00 2024-04-14T23:31:50.561 INFO:teuthology.orchestra.run.smithi047.stdout:(53/174): elfutils-libelf-devel-0.190-2.el9.x86 38 kB/s | 21 kB 00:00 2024-04-14T23:31:50.662 INFO:teuthology.orchestra.run.smithi047.stdout:(54/174): automake-1.16.2-8.el9.noarch.rpm 459 kB/s | 689 kB 00:01 2024-04-14T23:31:51.087 INFO:teuthology.orchestra.run.smithi047.stdout:(55/174): bison-3.7.4-5.el9.x86_64.rpm 503 kB/s | 943 kB 00:01 2024-04-14T23:31:51.320 INFO:teuthology.orchestra.run.smithi047.stdout:(56/174): flexiblas-3.0.4-8.el9.x86_64.rpm 50 kB/s | 33 kB 00:00 2024-04-14T23:31:51.571 INFO:teuthology.orchestra.run.smithi047.stdout:(57/174): flex-2.6.4-9.el9.x86_64.rpm 311 kB/s | 313 kB 00:01 2024-04-14T23:31:51.745 INFO:teuthology.orchestra.run.smithi191.stdout:(10/174): ceph-radosgw-19.0.0-2114.ga9a752df.el 1.7 MB/s | 9.9 MB 00:05 2024-04-14T23:31:51.871 INFO:teuthology.orchestra.run.smithi047.stdout:(58/174): flexiblas-openblas-openmp-3.0.4-8.el9 35 kB/s | 18 kB 00:00 2024-04-14T23:31:51.945 INFO:teuthology.orchestra.run.smithi191.stdout:(11/174): cephfs-mirror-19.0.0-2114.ga9a752df.e 1.1 MB/s | 222 kB 00:00 2024-04-14T23:31:52.020 INFO:teuthology.orchestra.run.smithi191.stdout:(12/174): cephfs-shell-19.0.0-2114.ga9a752df.el 360 kB/s | 27 kB 00:00 2024-04-14T23:31:52.079 INFO:teuthology.orchestra.run.smithi191.stdout:(13/174): libcephfs-devel-19.0.0-2114.ga9a752df 541 kB/s | 32 kB 00:00 2024-04-14T23:31:52.346 INFO:teuthology.orchestra.run.smithi191.stdout:(14/174): libcephfs2-19.0.0-2114.ga9a752df.el7. 2.7 MB/s | 746 kB 00:00 2024-04-14T23:31:52.379 INFO:teuthology.orchestra.run.smithi047.stdout:(59/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 198 kB/s | 160 kB 00:00 2024-04-14T23:31:52.472 INFO:teuthology.orchestra.run.smithi191.stdout:(15/174): libcephsqlite-19.0.0-2114.ga9a752df.e 1.3 MB/s | 164 kB 00:00 2024-04-14T23:31:52.496 INFO:teuthology.orchestra.run.smithi047.stdout:(60/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 72 kB/s | 45 kB 00:00 2024-04-14T23:31:52.556 INFO:teuthology.orchestra.run.smithi191.stdout:(16/174): librados-devel-19.0.0-2114.ga9a752df. 1.5 MB/s | 127 kB 00:00 2024-04-14T23:31:52.814 INFO:teuthology.orchestra.run.smithi191.stdout:(17/174): libradosstriper1-19.0.0-2114.ga9a752d 1.9 MB/s | 501 kB 00:00 2024-04-14T23:31:53.565 INFO:teuthology.orchestra.run.smithi191.stdout:(18/174): ceph-test-19.0.0-2114.ga9a752df.el7.x 8.9 MB/s | 48 MB 00:05 2024-04-14T23:31:53.765 INFO:teuthology.orchestra.run.smithi191.stdout:(19/174): ceph-common-19.0.0-2114.ga9a752df.el7 1.8 MB/s | 21 MB 00:11 2024-04-14T23:31:53.771 INFO:teuthology.orchestra.run.smithi047.stdout:(61/174): librdkafka-1.6.1-102.el9.x86_64.rpm 476 kB/s | 662 kB 00:01 2024-04-14T23:31:53.782 INFO:teuthology.orchestra.run.smithi191.stdout:(20/174): python3-ceph-argparse-19.0.0-2114.ga9 208 kB/s | 45 kB 00:00 2024-04-14T23:31:53.805 INFO:teuthology.orchestra.run.smithi047.stdout:(62/174): libtool-2.4.6-45.el9.x86_64.rpm 445 kB/s | 582 kB 00:01 2024-04-14T23:31:53.874 INFO:teuthology.orchestra.run.smithi191.stdout:(21/174): python3-cephfs-19.0.0-2114.ga9a752df. 1.7 MB/s | 162 kB 00:00 2024-04-14T23:31:53.916 INFO:teuthology.orchestra.run.smithi191.stdout:(22/174): python3-ceph-common-19.0.0-2114.ga9a7 871 kB/s | 131 kB 00:00 2024-04-14T23:31:53.942 INFO:teuthology.orchestra.run.smithi191.stdout:(23/174): python3-rados-19.0.0-2114.ga9a752df.e 4.7 MB/s | 320 kB 00:00 2024-04-14T23:31:54.084 INFO:teuthology.orchestra.run.smithi191.stdout:(24/174): python3-rgw-19.0.0-2114.ga9a752df.el7 697 kB/s | 99 kB 00:00 2024-04-14T23:31:54.109 INFO:teuthology.orchestra.run.smithi191.stdout:(25/174): python3-rbd-19.0.0-2114.ga9a752df.el7 1.5 MB/s | 298 kB 00:00 2024-04-14T23:31:54.168 INFO:teuthology.orchestra.run.smithi191.stdout:(26/174): rbd-fuse-19.0.0-2114.ga9a752df.el7.x8 1.0 MB/s | 85 kB 00:00 2024-04-14T23:31:54.235 INFO:teuthology.orchestra.run.smithi191.stdout:(27/174): rbd-nbd-19.0.0-2114.ga9a752df.el7.x86 2.5 MB/s | 171 kB 00:00 2024-04-14T23:31:54.311 INFO:teuthology.orchestra.run.smithi191.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2114.g 423 kB/s | 32 kB 00:00 2024-04-14T23:31:54.355 INFO:teuthology.orchestra.run.smithi047.stdout:(63/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 44 kB/s | 25 kB 00:00 2024-04-14T23:31:54.411 INFO:teuthology.orchestra.run.smithi191.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2114.ga9a752d 1.4 MB/s | 139 kB 00:00 2024-04-14T23:31:54.431 INFO:teuthology.orchestra.run.smithi047.stdout:(64/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-04-14T23:31:54.861 INFO:teuthology.orchestra.run.smithi191.stdout:(30/174): librgw2-19.0.0-2114.ga9a752df.el7.x86 2.5 MB/s | 5.2 MB 00:02 2024-04-14T23:31:54.920 INFO:teuthology.orchestra.run.smithi191.stdout:(31/174): rbd-mirror-19.0.0-2114.ga9a752df.el7. 3.8 MB/s | 3.1 MB 00:00 2024-04-14T23:31:54.979 INFO:teuthology.orchestra.run.smithi191.stdout:(32/174): ceph-mgr-dashboard-19.0.0-2114.ga9a75 6.2 MB/s | 3.5 MB 00:00 2024-04-14T23:31:55.013 INFO:teuthology.orchestra.run.smithi191.stdout:(33/174): ceph-mgr-modules-core-19.0.0-2114.ga9 2.6 MB/s | 248 kB 00:00 2024-04-14T23:31:55.029 INFO:teuthology.orchestra.run.smithi191.stdout:(34/174): ceph-mgr-rook-19.0.0-2114.ga9a752df.e 981 kB/s | 49 kB 00:00 2024-04-14T23:31:55.064 INFO:teuthology.orchestra.run.smithi191.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2114.ga 303 kB/s | 15 kB 00:00 2024-04-14T23:31:55.097 INFO:teuthology.orchestra.run.smithi191.stdout:(36/174): ceph-volume-19.0.0-2114.ga9a752df.el7 3.8 MB/s | 264 kB 00:00 2024-04-14T23:31:55.148 INFO:teuthology.orchestra.run.smithi191.stdout:(37/174): cephfs-top-19.0.0-2114.ga9a752df.el7. 364 kB/s | 18 kB 00:00 2024-04-14T23:31:55.215 INFO:teuthology.orchestra.run.smithi191.stdout:(38/174): cephadm-19.0.0-2114.ga9a752df.el7.noa 4.9 MB/s | 749 kB 00:00 2024-04-14T23:31:55.240 INFO:teuthology.orchestra.run.smithi191.stdout:(39/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 191 kB/s | 18 kB 00:00 2024-04-14T23:31:55.297 INFO:teuthology.orchestra.run.smithi047.stdout:(65/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 311 kB/s | 292 kB 00:00 2024-04-14T23:31:55.299 INFO:teuthology.orchestra.run.smithi191.stdout:(40/174): fuse-2.9.9-15.el9.x86_64.rpm 973 kB/s | 80 kB 00:00 2024-04-14T23:31:55.324 INFO:teuthology.orchestra.run.smithi191.stdout:(41/174): jq-1.6-16.el9.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2024-04-14T23:31:55.339 INFO:teuthology.orchestra.run.smithi047.stdout:(66/174): lua-5.4.4-4.el9.x86_64.rpm 207 kB/s | 188 kB 00:00 2024-04-14T23:31:55.391 INFO:teuthology.orchestra.run.smithi191.stdout:(42/174): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-04-14T23:31:55.450 INFO:teuthology.orchestra.run.smithi191.stdout:(43/174): libgfortran-11.4.1-3.el9.x86_64.rpm 5.2 MB/s | 803 kB 00:00 2024-04-14T23:31:55.490 INFO:teuthology.orchestra.run.smithi047.stdout:(67/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 695 kB/s | 3.0 MB 00:04 2024-04-14T23:31:55.517 INFO:teuthology.orchestra.run.smithi191.stdout:(44/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.7 MB/s | 218 kB 00:00 2024-04-14T23:31:55.551 INFO:teuthology.orchestra.run.smithi191.stdout:(45/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-04-14T23:31:55.618 INFO:teuthology.orchestra.run.smithi191.stdout:(46/174): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-14T23:31:55.668 INFO:teuthology.orchestra.run.smithi191.stdout:(47/174): python3-cryptography-36.0.1-4.el9.x86 8.1 MB/s | 1.2 MB 00:00 2024-04-14T23:31:55.711 INFO:teuthology.orchestra.run.smithi191.stdout:(48/174): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-04-14T23:31:55.753 INFO:teuthology.orchestra.run.smithi191.stdout:(49/174): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-04-14T23:31:55.803 INFO:teuthology.orchestra.run.smithi191.stdout:(50/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-04-14T23:31:55.998 INFO:teuthology.orchestra.run.smithi047.stdout:(68/174): openblas-0.3.21-2.el9.x86_64.rpm 50 kB/s | 35 kB 00:00 2024-04-14T23:31:56.028 INFO:teuthology.orchestra.run.smithi191.stdout:(51/174): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-04-14T23:31:56.087 INFO:teuthology.orchestra.run.smithi191.stdout:(52/174): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-04-14T23:31:56.113 INFO:teuthology.orchestra.run.smithi191.stdout:(53/174): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 107 kB 00:00 2024-04-14T23:31:56.146 INFO:teuthology.orchestra.run.smithi191.stdout:(54/174): elfutils-libelf-devel-0.190-2.el9.x86 366 kB/s | 21 kB 00:00 2024-04-14T23:31:56.180 INFO:teuthology.orchestra.run.smithi191.stdout:(55/174): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-04-14T23:31:56.214 INFO:teuthology.orchestra.run.smithi191.stdout:(56/174): flexiblas-3.0.4-8.el9.x86_64.rpm 485 kB/s | 33 kB 00:00 2024-04-14T23:31:56.281 INFO:teuthology.orchestra.run.smithi191.stdout:(57/174): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-04-14T23:31:56.365 INFO:teuthology.orchestra.run.smithi191.stdout:(58/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-04-14T23:31:56.390 INFO:teuthology.orchestra.run.smithi191.stdout:(59/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-04-14T23:31:56.424 INFO:teuthology.orchestra.run.smithi191.stdout:(60/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 768 kB/s | 45 kB 00:00 2024-04-14T23:31:56.475 INFO:teuthology.orchestra.run.smithi191.stdout:(61/174): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-04-14T23:31:56.525 INFO:teuthology.orchestra.run.smithi191.stdout:(62/174): libtool-2.4.6-45.el9.x86_64.rpm 5.7 MB/s | 582 kB 00:00 2024-04-14T23:31:56.542 INFO:teuthology.orchestra.run.smithi191.stdout:(63/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 380 kB/s | 25 kB 00:00 2024-04-14T23:31:56.659 INFO:teuthology.orchestra.run.smithi191.stdout:(64/174): ceph-mgr-diskprediction-local-19.0.0- 4.1 MB/s | 7.4 MB 00:01 2024-04-14T23:31:56.684 INFO:teuthology.orchestra.run.smithi191.stdout:(65/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 298 kB/s | 47 kB 00:00 2024-04-14T23:31:56.726 INFO:teuthology.orchestra.run.smithi191.stdout:(66/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-04-14T23:31:56.777 INFO:teuthology.orchestra.run.smithi191.stdout:(67/174): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-04-14T23:31:56.844 INFO:teuthology.orchestra.run.smithi191.stdout:(68/174): openblas-0.3.21-2.el9.x86_64.rpm 222 kB/s | 35 kB 00:00 2024-04-14T23:31:56.969 INFO:teuthology.orchestra.run.smithi191.stdout:(69/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 22 MB/s | 4.1 MB 00:00 2024-04-14T23:31:57.036 INFO:teuthology.orchestra.run.smithi191.stdout:(70/174): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2024-04-14T23:31:57.103 INFO:teuthology.orchestra.run.smithi191.stdout:(71/174): postgresql-contrib-13.14-1.el9.x86_64 6.7 MB/s | 911 kB 00:00 2024-04-14T23:31:57.129 INFO:teuthology.orchestra.run.smithi191.stdout:(72/174): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-04-14T23:31:57.179 INFO:teuthology.orchestra.run.smithi191.stdout:(73/174): postgresql-13.14-1.el9.x86_64.rpm 4.7 MB/s | 1.6 MB 00:00 2024-04-14T23:31:57.246 INFO:teuthology.orchestra.run.smithi191.stdout:(74/174): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-04-14T23:31:57.272 INFO:teuthology.orchestra.run.smithi191.stdout:(75/174): python3-attrs-20.3.0-7.el9.noarch.rpm 947 kB/s | 87 kB 00:00 2024-04-14T23:31:57.372 INFO:teuthology.orchestra.run.smithi191.stdout:(76/174): postgresql-server-13.14-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-04-14T23:31:57.398 INFO:teuthology.orchestra.run.smithi191.stdout:(77/174): python3-devel-3.9.17-2.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-04-14T23:31:57.440 INFO:teuthology.orchestra.run.smithi191.stdout:(78/174): python3-jinja2-2.11.3-5.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-04-14T23:31:57.457 INFO:teuthology.orchestra.run.smithi191.stdout:(79/174): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-04-14T23:31:57.549 INFO:teuthology.orchestra.run.smithi191.stdout:(80/174): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-04-14T23:31:57.566 INFO:teuthology.orchestra.run.smithi191.stdout:(81/174): python3-jsonpointer-2.0-4.el9.noarch. 152 kB/s | 19 kB 00:00 2024-04-14T23:31:57.591 INFO:teuthology.orchestra.run.smithi191.stdout:(82/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-04-14T23:31:57.608 INFO:teuthology.orchestra.run.smithi191.stdout:(83/174): python3-markupsafe-1.1.1-12.el9.x86_6 590 kB/s | 35 kB 00:00 2024-04-14T23:31:57.667 INFO:teuthology.orchestra.run.smithi191.stdout:(84/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.2 MB/s | 250 kB 00:00 2024-04-14T23:31:57.692 INFO:teuthology.orchestra.run.smithi191.stdout:(85/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-04-14T23:31:57.768 INFO:teuthology.orchestra.run.smithi191.stdout:(86/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 5.1 MB 00:00 2024-04-14T23:31:57.802 INFO:teuthology.orchestra.run.smithi191.stdout:(87/174): python3-packaging-20.9-5.el9.noarch.r 575 kB/s | 77 kB 00:00 2024-04-14T23:31:57.827 INFO:teuthology.orchestra.run.smithi191.stdout:(88/174): python3-prettytable-0.7.2-27.el9.noar 314 kB/s | 42 kB 00:00 2024-04-14T23:31:57.852 INFO:teuthology.orchestra.run.smithi191.stdout:(89/174): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 269 kB 00:00 2024-04-14T23:31:57.878 INFO:teuthology.orchestra.run.smithi191.stdout:(90/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 159 kB 00:00 2024-04-14T23:31:57.912 INFO:teuthology.orchestra.run.smithi191.stdout:(91/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-04-14T23:31:57.937 INFO:teuthology.orchestra.run.smithi191.stdout:(92/174): python3-pytz-2021.1-5.el9.noarch.rpm 606 kB/s | 51 kB 00:00 2024-04-14T23:31:57.962 INFO:teuthology.orchestra.run.smithi191.stdout:(93/174): python3-requests-oauthlib-1.3.0-12.el 637 kB/s | 54 kB 00:00 2024-04-14T23:31:58.013 INFO:teuthology.orchestra.run.smithi191.stdout:(94/174): python3-toml-0.10.2-6.el9.noarch.rpm 551 kB/s | 42 kB 00:00 2024-04-14T23:31:58.038 INFO:teuthology.orchestra.run.smithi191.stdout:(95/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 585 kB/s | 44 kB 00:00 2024-04-14T23:31:58.089 INFO:teuthology.orchestra.run.smithi191.stdout:(96/174): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-04-14T23:31:58.114 INFO:teuthology.orchestra.run.smithi191.stdout:(97/174): qatlib-service-24.02.0-1.el9.x86_64.r 475 kB/s | 36 kB 00:00 2024-04-14T23:31:58.156 INFO:teuthology.orchestra.run.smithi191.stdout:(98/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 706 kB/s | 47 kB 00:00 2024-04-14T23:31:58.215 INFO:teuthology.orchestra.run.smithi191.stdout:(99/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-04-14T23:31:58.240 INFO:teuthology.orchestra.run.smithi191.stdout:(100/174): uuid-1.6.2-55.el9.x86_64.rpm 689 kB/s | 58 kB 00:00 2024-04-14T23:31:58.408 INFO:teuthology.orchestra.run.smithi191.stdout:(101/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-04-14T23:31:58.433 INFO:teuthology.orchestra.run.smithi191.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 431 kB/s | 94 kB 00:00 2024-04-14T23:31:58.450 INFO:teuthology.orchestra.run.smithi191.stdout:(103/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 304 kB/s | 64 kB 00:00 2024-04-14T23:31:58.467 INFO:teuthology.orchestra.run.smithi191.stdout:(104/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 767 kB/s | 45 kB 00:00 2024-04-14T23:31:58.525 INFO:teuthology.orchestra.run.smithi191.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 241 kB/s | 22 kB 00:00 2024-04-14T23:31:58.608 INFO:teuthology.orchestra.run.smithi047.stdout:(69/174): postgresql-13.14-1.el9.x86_64.rpm 623 kB/s | 1.6 MB 00:02 2024-04-14T23:31:58.734 INFO:teuthology.orchestra.run.smithi191.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.4 MB/s | 309 kB 00:00 2024-04-14T23:31:58.759 INFO:teuthology.orchestra.run.smithi191.stdout:(107/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.8 MB/s | 548 kB 00:00 2024-04-14T23:31:58.776 INFO:teuthology.orchestra.run.smithi191.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 465 kB/s | 19 kB 00:00 2024-04-14T23:31:58.810 INFO:teuthology.orchestra.run.smithi191.stdout:(109/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-04-14T23:31:58.827 INFO:teuthology.orchestra.run.smithi191.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 513 kB/s | 26 kB 00:00 2024-04-14T23:31:58.895 INFO:teuthology.orchestra.run.smithi191.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.5 MB/s | 67 kB 00:00 2024-04-14T23:31:58.953 INFO:teuthology.orchestra.run.smithi191.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-04-14T23:31:58.970 INFO:teuthology.orchestra.run.smithi191.stdout:(113/174): liboath-2.6.7-2.el9.x86_64.rpm 304 kB/s | 49 kB 00:00 2024-04-14T23:31:59.279 INFO:teuthology.orchestra.run.smithi191.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 1.7 MB/s | 548 kB 00:00 2024-04-14T23:31:59.313 INFO:teuthology.orchestra.run.smithi191.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.3 MB/s | 838 kB 00:00 2024-04-14T23:31:59.338 INFO:teuthology.orchestra.run.smithi191.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 742 kB/s | 43 kB 00:00 2024-04-14T23:31:59.364 INFO:teuthology.orchestra.run.smithi191.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 637 kB/s | 32 kB 00:00 2024-04-14T23:31:59.389 INFO:teuthology.orchestra.run.smithi191.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 295 kB/s | 15 kB 00:00 2024-04-14T23:31:59.431 INFO:teuthology.orchestra.run.smithi191.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-04-14T23:31:59.515 INFO:teuthology.orchestra.run.smithi191.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-04-14T23:31:59.540 INFO:teuthology.orchestra.run.smithi191.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-04-14T23:31:59.566 INFO:teuthology.orchestra.run.smithi191.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 698 kB/s | 35 kB 00:00 2024-04-14T23:31:59.674 INFO:teuthology.orchestra.run.smithi191.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 1.5 MB/s | 203 kB 00:00 2024-04-14T23:31:59.833 INFO:teuthology.orchestra.run.smithi191.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 912 kB/s | 144 kB 00:00 2024-04-14T23:31:59.875 INFO:teuthology.orchestra.run.smithi191.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 256 kB/s | 11 kB 00:00 2024-04-14T23:31:59.909 INFO:teuthology.orchestra.run.smithi191.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 530 kB/s | 18 kB 00:00 2024-04-14T23:31:59.959 INFO:teuthology.orchestra.run.smithi191.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-04-14T23:32:00.010 INFO:teuthology.orchestra.run.smithi191.stdout:(128/174): python3-grpcio-1.46.7-10.el9.x86_64. 4.6 MB/s | 2.0 MB 00:00 2024-04-14T23:32:00.027 INFO:teuthology.orchestra.run.smithi191.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 290 kB/s | 19 kB 00:00 2024-04-14T23:32:00.044 INFO:teuthology.orchestra.run.smithi191.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 584 kB/s | 20 kB 00:00 2024-04-14T23:32:00.078 INFO:teuthology.orchestra.run.smithi191.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-04-14T23:32:00.120 INFO:teuthology.orchestra.run.smithi191.stdout:(132/174): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-04-14T23:32:00.162 INFO:teuthology.orchestra.run.smithi191.stdout:(133/174): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-04-14T23:32:00.237 INFO:teuthology.orchestra.run.smithi191.stdout:(134/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-14T23:32:00.279 INFO:teuthology.orchestra.run.smithi191.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 393 kB/s | 16 kB 00:00 2024-04-14T23:32:00.321 INFO:teuthology.orchestra.run.smithi191.stdout:(136/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-04-14T23:32:00.332 INFO:teuthology.orchestra.run.smithi047.stdout:(70/174): postgresql-contrib-13.14-1.el9.x86_64 528 kB/s | 911 kB 00:01 2024-04-14T23:32:00.364 INFO:teuthology.orchestra.run.smithi191.stdout:(137/174): python3-pyperclip-1.8.2-2.el9.noarch 672 kB/s | 28 kB 00:00 2024-04-14T23:32:00.406 INFO:teuthology.orchestra.run.smithi191.stdout:(138/174): python3-repoze-lru-0.7-16.el9.noarch 735 kB/s | 31 kB 00:00 2024-04-14T23:32:00.465 INFO:teuthology.orchestra.run.smithi191.stdout:(139/174): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-04-14T23:32:00.507 INFO:teuthology.orchestra.run.smithi191.stdout:(140/174): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-04-14T23:32:00.549 INFO:teuthology.orchestra.run.smithi191.stdout:(141/174): python3-tempora-5.0.0-2.el9.noarch.r 856 kB/s | 36 kB 00:00 2024-04-14T23:32:00.591 INFO:teuthology.orchestra.run.smithi191.stdout:(142/174): python3-typing-extensions-4.4.0-2.el 1.2 MB/s | 51 kB 00:00 2024-04-14T23:32:00.666 INFO:teuthology.orchestra.run.smithi191.stdout:(143/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-14T23:32:00.708 INFO:teuthology.orchestra.run.smithi191.stdout:(144/174): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-04-14T23:32:00.817 INFO:teuthology.orchestra.run.smithi191.stdout:(145/174): python3-kubernetes-26.1.0-2.el9.noar 1.3 MB/s | 1.0 MB 00:00 2024-04-14T23:32:00.843 INFO:teuthology.orchestra.run.smithi191.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-04-14T23:32:00.868 INFO:teuthology.orchestra.run.smithi191.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 395 kB/s | 20 kB 00:00 2024-04-14T23:32:00.944 INFO:teuthology.orchestra.run.smithi191.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-14T23:32:01.090 INFO:teuthology.orchestra.run.smithi047.stdout:(71/174): postgresql-private-libs-13.14-1.el9.x 176 kB/s | 133 kB 00:00 2024-04-14T23:32:01.216 INFO:teuthology.orchestra.run.smithi047.stdout:(72/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 739 kB/s | 4.1 MB 00:05 2024-04-14T23:32:01.636 INFO:teuthology.orchestra.run.smithi191.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 2.1 MB/s | 1.6 MB 00:00 2024-04-14T23:32:01.816 INFO:teuthology.orchestra.run.smithi047.stdout:(73/174): openblas-openmp-0.3.21-2.el9.x86_64.r 749 kB/s | 4.7 MB 00:06 2024-04-14T23:32:02.270 INFO:teuthology.orchestra.run.smithi191.stdout:(150/174): libarrow-9.0.0-10.el9.x86_64.rpm 1.3 MB/s | 4.4 MB 00:03 2024-04-14T23:32:02.328 INFO:teuthology.orchestra.run.smithi191.stdout:(151/174): librados2-19.0.0-2114.ga9a752df.el7. 2.4 MB/s | 3.4 MB 00:01 2024-04-14T23:32:02.470 INFO:teuthology.orchestra.run.smithi191.stdout:(152/174): NetworkManager-1.47.4-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-04-14T23:32:02.512 INFO:teuthology.orchestra.run.smithi191.stdout:(153/174): NetworkManager-libnm-1.47.4-1.el9.x8 10 MB/s | 1.8 MB 00:00 2024-04-14T23:32:02.524 INFO:teuthology.orchestra.run.smithi047.stdout:(74/174): python3-attrs-20.3.0-7.el9.noarch.rpm 123 kB/s | 87 kB 00:00 2024-04-14T23:32:02.554 INFO:teuthology.orchestra.run.smithi191.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 499 kB/s | 42 kB 00:00 2024-04-14T23:32:02.605 INFO:teuthology.orchestra.run.smithi191.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 2.6 MB/s | 249 kB 00:00 2024-04-14T23:32:02.630 INFO:teuthology.orchestra.run.smithi191.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 947 kB/s | 71 kB 00:00 2024-04-14T23:32:02.706 INFO:teuthology.orchestra.run.smithi191.stdout:(157/174): librbd1-19.0.0-2114.ga9a752df.el7.x8 2.9 MB/s | 3.1 MB 00:01 2024-04-14T23:32:02.731 INFO:teuthology.orchestra.run.smithi191.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 289 kB/s | 36 kB 00:00 2024-04-14T23:32:02.781 INFO:teuthology.orchestra.run.smithi191.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.2 MB/s | 192 kB 00:00 2024-04-14T23:32:02.807 INFO:teuthology.orchestra.run.smithi191.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 305 kB/s | 23 kB 00:00 2024-04-14T23:32:02.832 INFO:teuthology.orchestra.run.smithi191.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.0 MB/s | 256 kB 00:00 2024-04-14T23:32:02.874 INFO:teuthology.orchestra.run.smithi191.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 108 kB 00:00 2024-04-14T23:32:02.916 INFO:teuthology.orchestra.run.smithi191.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 155 kB 00:00 2024-04-14T23:32:02.941 INFO:teuthology.orchestra.run.smithi191.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 1.2 MB/s | 136 kB 00:00 2024-04-14T23:32:02.967 INFO:teuthology.orchestra.run.smithi191.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 690 kB/s | 64 kB 00:00 2024-04-14T23:32:02.992 INFO:teuthology.orchestra.run.smithi191.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 378 kB/s | 29 kB 00:00 2024-04-14T23:32:03.076 INFO:teuthology.orchestra.run.smithi191.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 9.0 MB/s | 1.2 MB 00:00 2024-04-14T23:32:03.141 INFO:teuthology.orchestra.run.smithi047.stdout:(75/174): protobuf-3.14.0-13.el9.x86_64.rpm 537 kB/s | 1.0 MB 00:01 2024-04-14T23:32:03.151 INFO:teuthology.orchestra.run.smithi191.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 12 MB/s | 2.2 MB 00:00 2024-04-14T23:32:03.202 INFO:teuthology.orchestra.run.smithi191.stdout:(169/174): util-linux-2.37.4-18.el9.x86_64.rpm 11 MB/s | 2.3 MB 00:00 2024-04-14T23:32:03.253 INFO:teuthology.orchestra.run.smithi191.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 2.6 MB/s | 465 kB 00:00 2024-04-14T23:32:03.279 INFO:teuthology.orchestra.run.smithi191.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 245 kB/s | 31 kB 00:00 2024-04-14T23:32:03.329 INFO:teuthology.orchestra.run.smithi191.stdout:(172/174): xfsdump-3.1.12-4.el9.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2024-04-14T23:32:03.396 INFO:teuthology.orchestra.run.smithi191.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 7.5 MB/s | 1.1 MB 00:00 2024-04-14T23:32:03.480 INFO:teuthology.orchestra.run.smithi191.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 370 kB/s | 74 kB 00:00 2024-04-14T23:32:03.486 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-14T23:32:03.486 INFO:teuthology.orchestra.run.smithi191.stdout:Total 10 MB/s | 228 MB 00:22 2024-04-14T23:32:04.033 INFO:teuthology.orchestra.run.smithi047.stdout:(76/174): python3-devel-3.9.17-2.el9.x86_64.rpm 275 kB/s | 245 kB 00:00 2024-04-14T23:32:04.791 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-14T23:32:04.925 INFO:teuthology.orchestra.run.smithi047.stdout:(77/174): python3-jinja2-2.11.3-5.el9.noarch.rp 278 kB/s | 248 kB 00:00 2024-04-14T23:32:05.078 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-14T23:32:05.078 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-14T23:32:05.500 INFO:teuthology.orchestra.run.smithi047.stdout:(78/174): python3-jsonpatch-1.21-16.el9.noarch. 45 kB/s | 26 kB 00:00 2024-04-14T23:32:06.042 INFO:teuthology.orchestra.run.smithi047.stdout:(79/174): python3-jsonpointer-2.0-4.el9.noarch. 35 kB/s | 19 kB 00:00 2024-04-14T23:32:06.934 INFO:teuthology.orchestra.run.smithi047.stdout:(80/174): python3-mako-1.1.4-6.el9.noarch.rpm 193 kB/s | 172 kB 00:00 2024-04-14T23:32:07.263 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-14T23:32:07.263 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-14T23:32:07.534 INFO:teuthology.orchestra.run.smithi047.stdout:(81/174): python3-markupsafe-1.1.1-12.el9.x86_6 58 kB/s | 35 kB 00:00 2024-04-14T23:32:09.109 INFO:teuthology.orchestra.run.smithi047.stdout:(82/174): postgresql-server-13.14-1.el9.x86_64. 738 kB/s | 5.8 MB 00:08 2024-04-14T23:32:10.026 INFO:teuthology.orchestra.run.smithi047.stdout:(83/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 274 kB/s | 250 kB 00:00 2024-04-14T23:32:10.527 INFO:teuthology.orchestra.run.smithi047.stdout:(84/174): python3-babel-2.9.1-2.el9.noarch.rpm 763 kB/s | 6.0 MB 00:08 2024-04-14T23:32:11.002 INFO:teuthology.orchestra.run.smithi047.stdout:(85/174): python3-oauthlib-3.1.1-5.el9.noarch.r 228 kB/s | 222 kB 00:00 2024-04-14T23:32:11.235 INFO:teuthology.orchestra.run.smithi047.stdout:(86/174): python3-packaging-20.9-5.el9.noarch.r 109 kB/s | 77 kB 00:00 2024-04-14T23:32:11.635 INFO:teuthology.orchestra.run.smithi047.stdout:(87/174): python3-prettytable-0.7.2-27.el9.noar 67 kB/s | 42 kB 00:00 2024-04-14T23:32:12.194 INFO:teuthology.orchestra.run.smithi047.stdout:(88/174): python3-protobuf-3.14.0-13.el9.noarch 289 kB/s | 269 kB 00:00 2024-04-14T23:32:12.469 INFO:teuthology.orchestra.run.smithi047.stdout:(89/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 190 kB/s | 159 kB 00:00 2024-04-14T23:32:13.128 INFO:teuthology.orchestra.run.smithi047.stdout:(90/174): python3-pyasn1-modules-0.4.8-6.el9.no 299 kB/s | 279 kB 00:00 2024-04-14T23:32:13.153 INFO:teuthology.orchestra.run.smithi047.stdout:(91/174): python3-pytz-2021.1-5.el9.noarch.rpm 75 kB/s | 51 kB 00:00 2024-04-14T23:32:13.795 INFO:teuthology.orchestra.run.smithi047.stdout:(92/174): python3-requests-oauthlib-1.3.0-12.el 80 kB/s | 54 kB 00:00 2024-04-14T23:32:14.420 INFO:teuthology.orchestra.run.smithi047.stdout:(93/174): python3-toml-0.10.2-6.el9.noarch.rpm 67 kB/s | 42 kB 00:00 2024-04-14T23:32:14.567 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-14T23:32:14.670 INFO:teuthology.orchestra.run.smithi047.stdout:(94/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 731 kB/s | 5.1 MB 00:07 2024-04-14T23:32:14.682 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-14T23:32:14.736 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-14T23:32:14.773 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T23:32:14.783 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T23:32:14.838 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-14T23:32:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-14T23:32:14.927 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-14T23:32:14.969 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-14T23:32:15.021 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-14T23:32:15.079 INFO:teuthology.orchestra.run.smithi047.stdout:(95/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 67 kB/s | 44 kB 00:00 2024-04-14T23:32:15.348 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-14T23:32:15.412 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 10/198 2024-04-14T23:32:15.532 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 10/198 2024-04-14T23:32:15.563 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/198 2024-04-14T23:32:15.571 INFO:teuthology.orchestra.run.smithi047.stdout:(96/174): qatlib-24.02.0-1.el9.x86_64.rpm 253 kB/s | 221 kB 00:00 2024-04-14T23:32:15.645 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/198 2024-04-14T23:32:15.676 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 12/198 2024-04-14T23:32:15.688 INFO:teuthology.orchestra.run.smithi047.stdout:(97/174): qatlib-service-24.02.0-1.el9.x86_64.r 59 kB/s | 36 kB 00:00 2024-04-14T23:32:15.731 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-14T23:32:15.941 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-14T23:32:15.991 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-14T23:32:16.019 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 16/198 2024-04-14T23:32:16.122 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 16/198 2024-04-14T23:32:16.145 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 17/198 2024-04-14T23:32:16.196 INFO:teuthology.orchestra.run.smithi047.stdout:(98/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-04-14T23:32:16.210 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 17/198 2024-04-14T23:32:16.249 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-14T23:32:16.271 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T23:32:16.287 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T23:32:16.464 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T23:32:16.501 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T23:32:16.534 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-14T23:32:16.697 INFO:teuthology.orchestra.run.smithi047.stdout:(99/174): socat-1.7.4.1-5.el9.x86_64.rpm 302 kB/s | 305 kB 00:01 2024-04-14T23:32:16.730 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-14T23:32:16.855 INFO:teuthology.orchestra.run.smithi047.stdout:(100/174): uuid-1.6.2-55.el9.x86_64.rpm 88 kB/s | 58 kB 00:00 2024-04-14T23:32:16.869 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T23:32:16.913 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T23:32:17.010 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T23:32:17.073 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T23:32:17.289 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T23:32:17.395 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-14T23:32:17.439 INFO:teuthology.orchestra.run.smithi047.stdout:(101/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 126 kB/s | 94 kB 00:00 2024-04-14T23:32:17.490 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-14T23:32:17.519 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-14T23:32:17.556 INFO:teuthology.orchestra.run.smithi047.stdout:(102/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 91 kB/s | 64 kB 00:00 2024-04-14T23:32:17.562 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-14T23:32:17.635 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-04-14T23:32:17.656 INFO:teuthology.orchestra.run.smithi047.stdout:(103/174): lua-devel-5.4.4-4.el9.x86_64.rpm 224 kB/s | 22 kB 00:00 2024-04-14T23:32:17.678 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-04-14T23:32:17.721 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-04-14T23:32:17.755 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-04-14T23:32:17.782 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-04-14T23:32:17.790 INFO:teuthology.orchestra.run.smithi047.stdout:(104/174): protobuf-compiler-3.14.0-13.el9.x86_ 6.3 MB/s | 863 kB 00:00 2024-04-14T23:32:17.851 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-04-14T23:32:17.904 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-04-14T23:32:17.944 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-04-14T23:32:17.995 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-04-14T23:32:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-04-14T23:32:18.090 INFO:teuthology.orchestra.run.smithi047.stdout:(105/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 69 kB/s | 45 kB 00:00 2024-04-14T23:32:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 39/198 2024-04-14T23:32:18.149 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 40/198 2024-04-14T23:32:18.178 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 41/198 2024-04-14T23:32:18.248 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-14T23:32:18.265 INFO:teuthology.orchestra.run.smithi047.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-04-14T23:32:18.293 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-14T23:32:18.332 INFO:teuthology.orchestra.run.smithi047.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 292 kB/s | 19 kB 00:00 2024-04-14T23:32:18.366 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-14T23:32:18.507 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-14T23:32:18.516 INFO:teuthology.orchestra.run.smithi047.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 726 kB/s | 309 kB 00:00 2024-04-14T23:32:18.562 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-14T23:32:18.591 INFO:teuthology.orchestra.run.smithi047.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 347 kB/s | 26 kB 00:00 2024-04-14T23:32:18.666 INFO:teuthology.orchestra.run.smithi047.stdout:(110/174): libarrow-9.0.0-10.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-04-14T23:32:18.694 INFO:teuthology.orchestra.run.smithi047.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 471 kB/s | 49 kB 00:00 2024-04-14T23:32:18.742 INFO:teuthology.orchestra.run.smithi047.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 896 kB/s | 67 kB 00:00 2024-04-14T23:32:18.784 INFO:teuthology.orchestra.run.smithi047.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.7 MB/s | 151 kB 00:00 2024-04-14T23:32:18.826 INFO:teuthology.orchestra.run.smithi047.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 9.8 MB/s | 838 kB 00:00 2024-04-14T23:32:18.901 INFO:teuthology.orchestra.run.smithi047.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 580 kB/s | 43 kB 00:00 2024-04-14T23:32:18.926 INFO:teuthology.orchestra.run.smithi047.stdout:(116/174): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-04-14T23:32:18.977 INFO:teuthology.orchestra.run.smithi047.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 428 kB/s | 32 kB 00:00 2024-04-14T23:32:19.002 INFO:teuthology.orchestra.run.smithi047.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-04-14T23:32:19.052 INFO:teuthology.orchestra.run.smithi047.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-14T23:32:19.083 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-14T23:32:19.094 INFO:teuthology.orchestra.run.smithi047.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-04-14T23:32:19.128 INFO:teuthology.orchestra.run.smithi047.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-04-14T23:32:19.165 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-14T23:32:19.170 INFO:teuthology.orchestra.run.smithi047.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 470 kB/s | 35 kB 00:00 2024-04-14T23:32:19.203 INFO:teuthology.orchestra.run.smithi047.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-04-14T23:32:19.261 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-14T23:32:19.278 INFO:teuthology.orchestra.run.smithi047.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-04-14T23:32:19.302 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T23:32:19.311 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T23:32:19.343 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-14T23:32:19.362 INFO:teuthology.orchestra.run.smithi047.stdout:(125/174): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-04-14T23:32:19.387 INFO:teuthology.orchestra.run.smithi047.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2024-04-14T23:32:19.408 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-14T23:32:19.438 INFO:teuthology.orchestra.run.smithi047.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-04-14T23:32:19.446 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 53/198 2024-04-14T23:32:19.463 INFO:teuthology.orchestra.run.smithi047.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-04-14T23:32:19.477 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-14T23:32:19.505 INFO:teuthology.orchestra.run.smithi047.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 289 kB/s | 19 kB 00:00 2024-04-14T23:32:19.531 INFO:teuthology.orchestra.run.smithi047.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 294 kB/s | 20 kB 00:00 2024-04-14T23:32:19.597 INFO:teuthology.orchestra.run.smithi047.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-04-14T23:32:19.614 INFO:teuthology.orchestra.run.smithi047.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 554 kB/s | 46 kB 00:00 2024-04-14T23:32:19.673 INFO:teuthology.orchestra.run.smithi047.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-04-14T23:32:19.690 INFO:teuthology.orchestra.run.smithi047.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 768 kB/s | 58 kB 00:00 2024-04-14T23:32:19.748 INFO:teuthology.orchestra.run.smithi047.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-04-14T23:32:19.761 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-14T23:32:19.765 INFO:teuthology.orchestra.run.smithi047.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-04-14T23:32:19.824 INFO:teuthology.orchestra.run.smithi047.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-14T23:32:19.841 INFO:teuthology.orchestra.run.smithi047.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 375 kB/s | 28 kB 00:00 2024-04-14T23:32:19.891 INFO:teuthology.orchestra.run.smithi047.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 460 kB/s | 31 kB 00:00 2024-04-14T23:32:19.916 INFO:teuthology.orchestra.run.smithi047.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-14T23:32:19.958 INFO:teuthology.orchestra.run.smithi047.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 884 kB/s | 59 kB 00:00 2024-04-14T23:32:19.975 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-14T23:32:19.983 INFO:teuthology.orchestra.run.smithi047.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 537 kB/s | 36 kB 00:00 2024-04-14T23:32:20.026 INFO:teuthology.orchestra.run.smithi047.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 763 kB/s | 51 kB 00:00 2024-04-14T23:32:20.059 INFO:teuthology.orchestra.run.smithi047.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-14T23:32:20.061 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-14T23:32:20.113 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-14T23:32:20.131 INFO:teuthology.orchestra.run.smithi047.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 856 kB/s | 90 kB 00:00 2024-04-14T23:32:20.160 INFO:teuthology.orchestra.run.smithi047.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-04-14T23:32:20.193 INFO:teuthology.orchestra.run.smithi047.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 321 kB/s | 20 kB 00:00 2024-04-14T23:32:20.235 INFO:teuthology.orchestra.run.smithi047.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-14T23:32:20.268 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-14T23:32:20.294 INFO:teuthology.orchestra.run.smithi047.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-14T23:32:20.325 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-14T23:32:20.379 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-14T23:32:20.443 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-14T23:32:20.483 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-14T23:32:20.520 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-14T23:32:20.566 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-14T23:32:20.602 INFO:teuthology.orchestra.run.smithi047.stdout:(150/174): librbd1-19.0.0-2114.ga9a752df.el7.x8 10 MB/s | 3.1 MB 00:00 2024-04-14T23:32:20.603 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-14T23:32:20.646 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-14T23:32:20.688 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-14T23:32:20.711 INFO:teuthology.orchestra.run.smithi047.stdout:(151/174): librados2-19.0.0-2114.ga9a752df.el7. 7.1 MB/s | 3.4 MB 00:00 2024-04-14T23:32:20.830 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-14T23:32:20.893 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-14T23:32:20.924 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-14T23:32:20.965 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-14T23:32:21.058 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-14T23:32:21.107 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-14T23:32:21.147 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-14T23:32:21.173 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-14T23:32:21.198 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-14T23:32:21.238 INFO:teuthology.orchestra.run.smithi047.stdout:(152/174): NetworkManager-libnm-1.47.4-1.el9.x8 3.5 MB/s | 1.8 MB 00:00 2024-04-14T23:32:21.275 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-14T23:32:21.311 INFO:teuthology.orchestra.run.smithi047.stdout:(153/174): NetworkManager-1.47.4-1.el9.x86_64.r 3.3 MB/s | 2.3 MB 00:00 2024-04-14T23:32:21.337 INFO:teuthology.orchestra.run.smithi047.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 417 kB/s | 42 kB 00:00 2024-04-14T23:32:21.396 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-14T23:32:21.404 INFO:teuthology.orchestra.run.smithi047.stdout:(155/174): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2024-04-14T23:32:21.429 INFO:teuthology.orchestra.run.smithi047.stdout:(156/174): NetworkManager-tui-1.47.4-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-04-14T23:32:21.438 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-14T23:32:21.454 INFO:teuthology.orchestra.run.smithi047.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 726 kB/s | 36 kB 00:00 2024-04-14T23:32:21.466 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-04-14T23:32:21.500 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-04-14T23:32:21.513 INFO:teuthology.orchestra.run.smithi047.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.3 MB/s | 192 kB 00:00 2024-04-14T23:32:21.538 INFO:teuthology.orchestra.run.smithi047.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-04-14T23:32:21.539 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-04-14T23:32:21.564 INFO:teuthology.orchestra.run.smithi047.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 458 kB/s | 23 kB 00:00 2024-04-14T23:32:21.571 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-04-14T23:32:21.589 INFO:teuthology.orchestra.run.smithi047.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-04-14T23:32:21.601 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-04-14T23:32:21.636 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-04-14T23:32:21.639 INFO:teuthology.orchestra.run.smithi047.stdout:(162/174): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 136 kB 00:00 2024-04-14T23:32:21.664 INFO:teuthology.orchestra.run.smithi047.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.5 MB/s | 155 kB 00:00 2024-04-14T23:32:21.678 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-04-14T23:32:21.681 INFO:teuthology.orchestra.run.smithi047.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 64 kB 00:00 2024-04-14T23:32:21.707 INFO:teuthology.orchestra.run.smithi047.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 686 kB/s | 29 kB 00:00 2024-04-14T23:32:21.718 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-04-14T23:32:21.754 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-04-14T23:32:21.839 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-04-14T23:32:21.883 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-04-14T23:32:21.923 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-04-14T23:32:21.987 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-04-14T23:32:21.990 INFO:teuthology.orchestra.run.smithi047.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 3.9 MB/s | 1.2 MB 00:00 2024-04-14T23:32:22.082 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-04-14T23:32:22.133 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-04-14T23:32:22.207 INFO:teuthology.orchestra.run.smithi047.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 4.3 MB/s | 2.2 MB 00:00 2024-04-14T23:32:22.316 INFO:teuthology.orchestra.run.smithi047.stdout:(168/174): util-linux-core-2.37.4-18.el9.x86_64 4.2 MB/s | 465 kB 00:00 2024-04-14T23:32:22.358 INFO:teuthology.orchestra.run.smithi047.stdout:(169/174): util-linux-user-2.37.4-18.el9.x86_64 747 kB/s | 31 kB 00:00 2024-04-14T23:32:22.441 INFO:teuthology.orchestra.run.smithi047.stdout:(170/174): xfsdump-3.1.12-4.el9.x86_64.rpm 3.8 MB/s | 323 kB 00:00 2024-04-14T23:32:22.508 INFO:teuthology.orchestra.run.smithi047.stdout:(171/174): util-linux-2.37.4-18.el9.x86_64.rpm 4.4 MB/s | 2.3 MB 00:00 2024-04-14T23:32:22.708 INFO:teuthology.orchestra.run.smithi047.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 4.0 MB/s | 1.1 MB 00:00 2024-04-14T23:32:23.021 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-04-14T23:32:23.072 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-04-14T23:32:23.114 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-04-14T23:32:23.184 INFO:teuthology.orchestra.run.smithi047.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 110 kB/s | 74 kB 00:00 2024-04-14T23:32:23.211 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-04-14T23:32:23.272 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-04-14T23:32:23.350 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-04-14T23:32:23.391 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-04-14T23:32:23.609 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-04-14T23:32:23.647 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-04-14T23:32:23.725 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-04-14T23:32:24.366 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-04-14T23:32:24.486 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-04-14T23:32:25.712 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-04-14T23:32:25.809 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-04-14T23:32:25.836 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-04-14T23:32:26.155 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-04-14T23:32:26.191 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 112/198 2024-04-14T23:32:26.265 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 112/198 2024-04-14T23:32:26.296 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 113/198 2024-04-14T23:32:26.332 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-04-14T23:32:26.790 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T23:32:26.819 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 116/198 2024-04-14T23:32:26.890 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 116/198 2024-04-14T23:32:26.912 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 117/198 2024-04-14T23:32:29.156 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 118/198 2024-04-14T23:32:29.192 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 118/198 2024-04-14T23:32:29.736 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 118/198 2024-04-14T23:32:29.779 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 119/198 2024-04-14T23:32:29.857 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 119/198 2024-04-14T23:32:29.857 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-14T23:32:29.857 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-14T23:32:29.857 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:32:29.897 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 120/198 2024-04-14T23:32:33.946 INFO:teuthology.orchestra.run.smithi047.stdout:(174/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 800 kB/s | 16 MB 00:20 2024-04-14T23:32:33.951 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-14T23:32:33.951 INFO:teuthology.orchestra.run.smithi047.stdout:Total 4.3 MB/s | 228 MB 00:52 2024-04-14T23:32:35.269 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-14T23:32:35.574 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-14T23:32:35.574 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-14T23:32:37.863 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-14T23:32:37.864 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-14T23:32:41.754 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 120/198 2024-04-14T23:32:41.754 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /sys 2024-04-14T23:32:41.754 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /proc 2024-04-14T23:32:41.754 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /mnt 2024-04-14T23:32:41.754 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /var/tmp 2024-04-14T23:32:41.754 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /home 2024-04-14T23:32:41.755 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /root 2024-04-14T23:32:41.755 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /tmp 2024-04-14T23:32:41.755 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:32:41.917 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 121/198 2024-04-14T23:32:41.931 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 121/198 2024-04-14T23:32:41.932 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:32:41.932 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-14T23:32:41.932 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:32:43.452 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 122/198 2024-04-14T23:32:43.478 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 122/198 2024-04-14T23:32:43.478 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:32:43.478 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-14T23:32:43.478 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T23:32:43.478 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T23:32:43.478 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:32:43.712 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 123/198 2024-04-14T23:32:43.735 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 123/198 2024-04-14T23:32:43.735 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:32:43.735 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-14T23:32:43.736 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T23:32:43.736 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T23:32:43.736 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:32:44.189 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 124/198 2024-04-14T23:32:44.211 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 124/198 2024-04-14T23:32:44.211 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:32:44.211 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-14T23:32:44.211 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T23:32:44.211 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T23:32:44.212 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:32:44.328 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-04-14T23:32:44.378 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-04-14T23:32:44.441 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-04-14T23:32:44.632 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-04-14T23:32:44.682 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-04-14T23:32:44.768 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-04-14T23:32:44.864 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-04-14T23:32:44.997 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-04-14T23:32:45.057 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 133/198 2024-04-14T23:32:45.098 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-04-14T23:32:45.129 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-04-14T23:32:45.162 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-14T23:32:45.165 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-04-14T23:32:45.193 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-04-14T23:32:45.255 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-14T23:32:45.289 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-14T23:32:45.328 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T23:32:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T23:32:45.388 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-14T23:32:45.441 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-14T23:32:45.481 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-14T23:32:45.515 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-14T23:32:45.572 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-14T23:32:45.593 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 138/198 2024-04-14T23:32:45.624 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 138/198 2024-04-14T23:32:45.656 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 139/198 2024-04-14T23:32:45.716 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 140/198 2024-04-14T23:32:45.739 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 141/198 2024-04-14T23:32:45.919 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-14T23:32:45.966 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 10/198 2024-04-14T23:32:46.081 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 10/198 2024-04-14T23:32:46.234 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/198 2024-04-14T23:32:46.328 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/198 2024-04-14T23:32:46.355 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 12/198 2024-04-14T23:32:46.390 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-14T23:32:46.602 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-14T23:32:46.645 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-14T23:32:46.672 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 16/198 2024-04-14T23:32:46.766 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 141/198 2024-04-14T23:32:46.768 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 16/198 2024-04-14T23:32:46.798 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 17/198 2024-04-14T23:32:46.808 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 142/198 2024-04-14T23:32:46.846 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 17/198 2024-04-14T23:32:46.885 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-14T23:32:46.910 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T23:32:46.925 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T23:32:47.101 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T23:32:47.133 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T23:32:47.156 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-14T23:32:47.331 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-14T23:32:47.449 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T23:32:47.493 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T23:32:47.589 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T23:32:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T23:32:47.768 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 142/198 2024-04-14T23:32:47.800 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 143/198 2024-04-14T23:32:47.855 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T23:32:47.899 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 143/198 2024-04-14T23:32:47.980 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-14T23:32:48.054 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 144/198 2024-04-14T23:32:48.077 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 145/198 2024-04-14T23:32:48.093 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-14T23:32:48.099 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 145/198 2024-04-14T23:32:48.100 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:32:48.100 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-14T23:32:48.100 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T23:32:48.100 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T23:32:48.100 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:32:48.124 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-14T23:32:48.153 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 146/198 2024-04-14T23:32:48.159 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-14T23:32:48.163 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 146/198 2024-04-14T23:32:48.225 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-04-14T23:32:48.261 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 147/198 2024-04-14T23:32:48.290 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-04-14T23:32:48.452 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-04-14T23:32:48.627 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-04-14T23:32:48.654 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-04-14T23:32:48.733 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-04-14T23:32:48.794 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-04-14T23:32:48.827 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-04-14T23:32:48.870 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-04-14T23:32:48.945 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-04-14T23:32:48.978 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 39/198 2024-04-14T23:32:49.031 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 40/198 2024-04-14T23:32:49.058 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 41/198 2024-04-14T23:32:49.132 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-14T23:32:49.182 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-14T23:32:49.259 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-14T23:32:49.404 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-14T23:32:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-14T23:32:50.035 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-14T23:32:50.115 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-14T23:32:50.214 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-14T23:32:50.274 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T23:32:50.283 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T23:32:50.321 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-14T23:32:50.372 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-14T23:32:50.409 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 53/198 2024-04-14T23:32:50.440 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-14T23:32:50.740 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-14T23:32:50.929 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-14T23:32:51.009 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-14T23:32:51.053 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-14T23:32:51.196 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-14T23:32:51.247 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-14T23:32:51.304 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-14T23:32:51.377 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-14T23:32:51.414 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-14T23:32:51.451 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-14T23:32:51.498 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-14T23:32:51.533 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-14T23:32:51.578 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-14T23:32:51.628 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-14T23:32:51.767 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-14T23:32:51.807 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-14T23:32:51.838 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-14T23:32:51.880 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-14T23:32:51.978 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-14T23:32:52.012 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-14T23:32:52.053 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-14T23:32:52.078 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-14T23:32:52.102 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-14T23:32:52.181 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-14T23:32:52.310 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-14T23:32:52.344 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-14T23:32:52.397 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-04-14T23:32:52.431 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-04-14T23:32:52.470 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-04-14T23:32:52.502 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-04-14T23:32:52.540 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-04-14T23:32:52.574 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-04-14T23:32:52.610 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-04-14T23:32:52.650 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-04-14T23:32:52.671 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 148/198 2024-04-14T23:32:52.683 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-04-14T23:32:52.747 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 149/198 2024-04-14T23:32:52.773 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-04-14T23:32:52.823 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-04-14T23:32:52.853 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-04-14T23:32:52.910 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-04-14T23:32:53.019 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-04-14T23:32:53.073 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-04-14T23:32:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-04-14T23:32:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 151/198 2024-04-14T23:32:53.673 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 151/198 2024-04-14T23:32:53.674 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:32:53.674 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-14T23:32:53.674 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T23:32:53.674 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T23:32:53.674 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:32:53.727 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 152/198 2024-04-14T23:32:53.749 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 152/198 2024-04-14T23:32:53.749 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:32:53.749 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-14T23:32:53.749 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:32:53.794 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 153/198 2024-04-14T23:32:53.816 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 153/198 2024-04-14T23:32:53.816 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:32:53.816 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-14T23:32:53.817 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T23:32:53.817 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T23:32:53.817 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:32:53.839 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-04-14T23:32:53.885 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-04-14T23:32:53.911 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-04-14T23:32:54.013 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-04-14T23:32:54.070 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-04-14T23:32:54.128 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 154/198 2024-04-14T23:32:54.150 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 154/198 2024-04-14T23:32:54.151 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:32:54.151 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-14T23:32:54.151 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T23:32:54.151 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T23:32:54.151 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:32:54.158 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-04-14T23:32:54.196 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-04-14T23:32:54.202 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 155/198 2024-04-14T23:32:54.241 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 156/198 2024-04-14T23:32:54.277 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-04-14T23:32:54.381 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-04-14T23:32:54.418 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-04-14T23:32:54.459 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 158/198 2024-04-14T23:32:54.491 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-04-14T23:32:54.517 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/198 2024-04-14T23:32:54.567 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-14T23:32:54.641 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-14T23:32:54.692 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-14T23:32:54.733 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 163/198 2024-04-14T23:32:54.774 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-14T23:32:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-14T23:32:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-14T23:32:54.946 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-14T23:32:54.995 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-14T23:32:55.177 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-04-14T23:32:55.296 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-04-14T23:32:55.585 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T23:32:55.634 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T23:32:55.653 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T23:32:56.466 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 170/198 2024-04-14T23:32:56.562 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-14T23:32:56.593 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-04-14T23:32:56.647 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-04-14T23:32:56.673 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-04-14T23:32:56.681 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-04-14T23:32:56.700 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-04-14T23:32:56.707 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-04-14T23:32:56.740 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-14T23:32:56.771 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-14T23:32:56.801 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-14T23:32:56.801 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T23:32:56.897 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T23:32:56.927 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-14T23:32:56.927 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T23:32:57.019 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T23:32:57.037 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-04-14T23:32:57.046 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-14T23:32:57.063 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 112/198 2024-04-14T23:32:57.079 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-14T23:32:57.104 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-14T23:32:57.130 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-14T23:32:57.138 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 112/198 2024-04-14T23:32:57.163 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-14T23:32:57.169 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 113/198 2024-04-14T23:32:57.201 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-14T23:32:57.205 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-04-14T23:32:57.251 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-14T23:32:57.276 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-14T23:32:57.301 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-14T23:32:57.327 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-14T23:32:57.352 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-14T23:32:57.358 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T23:32:57.358 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T23:32:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T23:32:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T23:32:57.621 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T23:32:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-14T23:32:57.678 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-14T23:32:57.691 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T23:32:57.706 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-14T23:32:57.716 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 116/198 2024-04-14T23:32:57.730 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-14T23:32:57.788 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 116/198 2024-04-14T23:32:57.796 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T23:32:57.810 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 117/198 2024-04-14T23:33:00.154 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 118/198 2024-04-14T23:33:00.190 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 118/198 2024-04-14T23:33:00.763 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 118/198 2024-04-14T23:33:00.793 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 119/198 2024-04-14T23:33:00.867 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 119/198 2024-04-14T23:33:00.867 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-14T23:33:00.867 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-14T23:33:00.867 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:00.902 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 120/198 2024-04-14T23:33:03.707 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T23:33:03.707 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 1/198 2024-04-14T23:33:03.707 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2/198 2024-04-14T23:33:03.707 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 3/198 2024-04-14T23:33:03.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 4/198 2024-04-14T23:33:03.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 5/198 2024-04-14T23:33:03.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 6/198 2024-04-14T23:33:03.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 7/198 2024-04-14T23:33:03.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 8/198 2024-04-14T23:33:03.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 9/198 2024-04-14T23:33:03.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 10/198 2024-04-14T23:33:03.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 11/198 2024-04-14T23:33:03.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 12/198 2024-04-14T23:33:03.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 13/198 2024-04-14T23:33:03.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 14/198 2024-04-14T23:33:03.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 15/198 2024-04-14T23:33:03.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 16/198 2024-04-14T23:33:03.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 17/198 2024-04-14T23:33:03.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 18/198 2024-04-14T23:33:03.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 19/198 2024-04-14T23:33:03.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 20/198 2024-04-14T23:33:03.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 21/198 2024-04-14T23:33:03.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 22/198 2024-04-14T23:33:03.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 23/198 2024-04-14T23:33:03.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 24/198 2024-04-14T23:33:03.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 25/198 2024-04-14T23:33:03.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 26/198 2024-04-14T23:33:03.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 27/198 2024-04-14T23:33:03.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 28/198 2024-04-14T23:33:03.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 29/198 2024-04-14T23:33:03.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 30/198 2024-04-14T23:33:03.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 31/198 2024-04-14T23:33:03.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 32/198 2024-04-14T23:33:03.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 33/198 2024-04-14T23:33:03.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 34/198 2024-04-14T23:33:03.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 35/198 2024-04-14T23:33:03.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 36/198 2024-04-14T23:33:03.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 37/198 2024-04-14T23:33:03.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 38/198 2024-04-14T23:33:03.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 39/198 2024-04-14T23:33:03.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-04-14T23:33:03.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-04-14T23:33:03.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-04-14T23:33:03.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-04-14T23:33:03.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-04-14T23:33:03.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-04-14T23:33:03.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-04-14T23:33:03.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-04-14T23:33:03.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-04-14T23:33:03.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-04-14T23:33:03.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-04-14T23:33:03.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-04-14T23:33:03.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-04-14T23:33:03.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-04-14T23:33:03.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-04-14T23:33:03.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-04-14T23:33:03.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-04-14T23:33:03.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-04-14T23:33:03.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-04-14T23:33:03.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-04-14T23:33:03.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-04-14T23:33:03.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-04-14T23:33:03.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-04-14T23:33:03.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-04-14T23:33:03.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-04-14T23:33:03.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-04-14T23:33:03.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-04-14T23:33:03.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-04-14T23:33:03.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-04-14T23:33:03.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-04-14T23:33:03.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-04-14T23:33:03.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-13.14-1.el9.x86_64 71/198 2024-04-14T23:33:03.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 72/198 2024-04-14T23:33:03.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 73/198 2024-04-14T23:33:03.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 74/198 2024-04-14T23:33:03.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-04-14T23:33:03.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-04-14T23:33:03.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-04-14T23:33:03.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-04-14T23:33:03.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-04-14T23:33:03.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-04-14T23:33:03.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-04-14T23:33:03.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-04-14T23:33:03.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-04-14T23:33:03.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-04-14T23:33:03.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-04-14T23:33:03.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-04-14T23:33:03.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-04-14T23:33:03.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-04-14T23:33:03.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-04-14T23:33:03.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-04-14T23:33:03.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-04-14T23:33:03.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-04-14T23:33:03.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-04-14T23:33:03.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-04-14T23:33:03.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-04-14T23:33:03.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-04-14T23:33:03.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/198 2024-04-14T23:33:03.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/198 2024-04-14T23:33:03.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/198 2024-04-14T23:33:03.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-04-14T23:33:03.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-04-14T23:33:03.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-04-14T23:33:03.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-04-14T23:33:03.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-04-14T23:33:03.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-14T23:33:03.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-14T23:33:03.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-14T23:33:03.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-14T23:33:03.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-14T23:33:03.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-14T23:33:03.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-14T23:33:03.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-14T23:33:03.716 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-14T23:33:03.716 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-14T23:33:03.716 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T23:33:03.716 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-14T23:33:03.716 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-14T23:33:03.716 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-14T23:33:03.716 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-14T23:33:03.716 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-14T23:33:03.716 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-14T23:33:03.716 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-14T23:33:03.716 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-14T23:33:03.716 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-14T23:33:03.716 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-14T23:33:03.716 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-14T23:33:03.716 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-14T23:33:03.717 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-14T23:33:03.717 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-14T23:33:03.717 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-14T23:33:03.717 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-14T23:33:03.717 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-14T23:33:03.717 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-14T23:33:03.717 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-14T23:33:03.717 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-14T23:33:03.717 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-14T23:33:03.717 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-14T23:33:03.717 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-14T23:33:03.717 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-14T23:33:03.717 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-14T23:33:03.717 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-14T23:33:03.717 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-14T23:33:03.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-14T23:33:03.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-14T23:33:03.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-14T23:33:03.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-14T23:33:03.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-14T23:33:03.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-14T23:33:03.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-14T23:33:03.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-14T23:33:03.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 151/198 2024-04-14T23:33:03.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-14T23:33:03.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 153/198 2024-04-14T23:33:03.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-14T23:33:03.718 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-14T23:33:03.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-14T23:33:03.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-14T23:33:03.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-14T23:33:03.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-14T23:33:03.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-14T23:33:03.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-14T23:33:03.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-14T23:33:03.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-04-14T23:33:03.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-04-14T23:33:03.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-04-14T23:33:03.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-04-14T23:33:03.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-04-14T23:33:03.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-04-14T23:33:03.719 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-04-14T23:33:03.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-04-14T23:33:03.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-04-14T23:33:03.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-04-14T23:33:03.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-04-14T23:33:03.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-04-14T23:33:03.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-04-14T23:33:03.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-04-14T23:33:03.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-04-14T23:33:03.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-04-14T23:33:03.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-04-14T23:33:03.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-04-14T23:33:03.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-04-14T23:33:03.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-04-14T23:33:03.720 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-04-14T23:33:03.721 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-04-14T23:33:03.721 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-04-14T23:33:03.721 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-04-14T23:33:03.721 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-04-14T23:33:03.721 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-04-14T23:33:03.721 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-04-14T23:33:03.721 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-04-14T23:33:03.721 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-04-14T23:33:03.721 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-04-14T23:33:03.721 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-04-14T23:33:03.721 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-04-14T23:33:03.721 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-14T23:33:03.721 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-14T23:33:03.721 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-14T23:33:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-14T23:33:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:06.869 INFO:teuthology.orchestra.run.smithi191.stdout:Upgraded: 2024-04-14T23:33:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-14T23:33:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-14T23:33:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-14T23:33:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-14T23:33:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: acl-2.3.1-4.el9.x86_64 2024-04-14T23:33:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-14T23:33:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-14T23:33:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-14T23:33:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-14T23:33:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-14T23:33:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-14T23:33:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-14T23:33:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-14T23:33:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-14T23:33:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-14T23:33:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-14T23:33:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-14T23:33:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-14T23:33:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-14T23:33:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-14T23:33:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-14T23:33:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-14T23:33:06.871 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-14T23:33:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-14T23:33:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: automake-1.16.2-8.el9.noarch 2024-04-14T23:33:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: bison-3.7.4-5.el9.x86_64 2024-04-14T23:33:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-14T23:33:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-14T23:33:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: flex-2.6.4-9.el9.x86_64 2024-04-14T23:33:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-14T23:33:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-14T23:33:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-14T23:33:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-14T23:33:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-14T23:33:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-14T23:33:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: jq-1.6-16.el9.x86_64 2024-04-14T23:33:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-14T23:33:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-14T23:33:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-14T23:33:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-14T23:33:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-14T23:33:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-14T23:33:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-14T23:33:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-14T23:33:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-14T23:33:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-14T23:33:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-14T23:33:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-14T23:33:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-14T23:33:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-14T23:33:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: lua-5.4.4-4.el9.x86_64 2024-04-14T23:33:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-14T23:33:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-14T23:33:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-14T23:33:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-14T23:33:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-14T23:33:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-14T23:33:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-14T23:33:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-13.14-1.el9.x86_64 2024-04-14T23:33:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-14T23:33:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-14T23:33:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-14T23:33:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-14T23:33:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-14T23:33:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-14T23:33:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-14T23:33:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-14T23:33:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-14T23:33:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-14T23:33:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-14T23:33:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-14T23:33:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-14T23:33:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-14T23:33:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-14T23:33:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-14T23:33:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-14T23:33:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-14T23:33:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-14T23:33:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-14T23:33:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-14T23:33:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-14T23:33:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-14T23:33:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-14T23:33:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-14T23:33:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-14T23:33:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-14T23:33:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-14T23:33:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-14T23:33:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-14T23:33:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-14T23:33:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-14T23:33:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-14T23:33:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-14T23:33:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-14T23:33:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-14T23:33:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-14T23:33:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-14T23:33:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-14T23:33:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-14T23:33:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply-3.11-14.el9.noarch 2024-04-14T23:33:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-14T23:33:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-14T23:33:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-14T23:33:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-14T23:33:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-14T23:33:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-14T23:33:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-14T23:33:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-14T23:33:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-14T23:33:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-14T23:33:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-14T23:33:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-14T23:33:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-14T23:33:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-14T23:33:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-14T23:33:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-14T23:33:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-14T23:33:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-14T23:33:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-14T23:33:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-14T23:33:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-14T23:33:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-14T23:33:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-14T23:33:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-14T23:33:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-14T23:33:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-14T23:33:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-14T23:33:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: re2-1:20211101-3.el9.x86_64 2024-04-14T23:33:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-14T23:33:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-14T23:33:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-14T23:33:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-14T23:33:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-14T23:33:06.882 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-14T23:33:06.882 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:06.882 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-14T23:33:07.424 DEBUG:teuthology.parallel:result is None 2024-04-14T23:33:13.024 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 120/198 2024-04-14T23:33:13.024 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-04-14T23:33:13.025 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-04-14T23:33:13.025 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-04-14T23:33:13.025 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-04-14T23:33:13.025 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-04-14T23:33:13.025 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /root 2024-04-14T23:33:13.025 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-04-14T23:33:13.025 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:13.198 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 121/198 2024-04-14T23:33:13.213 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 121/198 2024-04-14T23:33:13.213 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:33:13.213 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-14T23:33:13.213 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:14.751 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 122/198 2024-04-14T23:33:14.776 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 122/198 2024-04-14T23:33:14.777 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:33:14.777 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-14T23:33:14.777 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T23:33:14.777 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T23:33:14.777 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:15.018 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 123/198 2024-04-14T23:33:15.040 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 123/198 2024-04-14T23:33:15.040 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:33:15.041 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-14T23:33:15.041 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T23:33:15.041 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T23:33:15.041 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:15.502 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 124/198 2024-04-14T23:33:15.525 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 124/198 2024-04-14T23:33:15.525 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:33:15.525 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-14T23:33:15.525 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T23:33:15.525 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T23:33:15.525 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:15.642 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-04-14T23:33:15.700 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-04-14T23:33:15.770 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-04-14T23:33:15.964 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-04-14T23:33:16.021 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-04-14T23:33:16.110 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-04-14T23:33:16.206 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-04-14T23:33:16.348 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-04-14T23:33:16.392 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 133/198 2024-04-14T23:33:16.428 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-04-14T23:33:16.460 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-04-14T23:33:16.495 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-04-14T23:33:16.523 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-04-14T23:33:16.857 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 138/198 2024-04-14T23:33:16.888 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 138/198 2024-04-14T23:33:16.920 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 139/198 2024-04-14T23:33:16.982 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 140/198 2024-04-14T23:33:17.011 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 141/198 2024-04-14T23:33:18.103 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 141/198 2024-04-14T23:33:18.146 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 142/198 2024-04-14T23:33:19.162 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 142/198 2024-04-14T23:33:19.196 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 143/198 2024-04-14T23:33:19.305 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 143/198 2024-04-14T23:33:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 144/198 2024-04-14T23:33:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 145/198 2024-04-14T23:33:19.529 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 145/198 2024-04-14T23:33:19.529 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:33:19.529 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-14T23:33:19.530 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T23:33:19.530 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T23:33:19.530 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:19.574 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 146/198 2024-04-14T23:33:19.585 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 146/198 2024-04-14T23:33:19.687 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 147/198 2024-04-14T23:33:24.348 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 148/198 2024-04-14T23:33:24.418 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 149/198 2024-04-14T23:33:25.324 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-04-14T23:33:25.358 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 151/198 2024-04-14T23:33:25.381 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 151/198 2024-04-14T23:33:25.381 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:33:25.381 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-14T23:33:25.381 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T23:33:25.381 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T23:33:25.381 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:25.426 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 152/198 2024-04-14T23:33:25.447 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 152/198 2024-04-14T23:33:25.447 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:33:25.447 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-14T23:33:25.448 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:25.493 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 153/198 2024-04-14T23:33:25.515 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 153/198 2024-04-14T23:33:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:33:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-14T23:33:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T23:33:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T23:33:25.515 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:25.836 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 154/198 2024-04-14T23:33:25.857 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 154/198 2024-04-14T23:33:25.857 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T23:33:25.858 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-14T23:33:25.858 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T23:33:25.858 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T23:33:25.858 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:25.911 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 155/198 2024-04-14T23:33:25.940 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 156/198 2024-04-14T23:33:25.968 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-04-14T23:33:26.160 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 158/198 2024-04-14T23:33:26.224 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/198 2024-04-14T23:33:26.285 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-14T23:33:26.348 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-14T23:33:26.391 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-14T23:33:26.416 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 163/198 2024-04-14T23:33:26.448 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-14T23:33:26.486 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-14T23:33:26.554 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-14T23:33:26.625 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-14T23:33:26.660 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-14T23:33:27.247 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T23:33:27.283 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T23:33:27.302 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T23:33:28.184 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 170/198 2024-04-14T23:33:28.287 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-14T23:33:28.394 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-04-14T23:33:28.431 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-04-14T23:33:28.456 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-04-14T23:33:28.481 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-14T23:33:28.506 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-14T23:33:28.533 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-14T23:33:28.533 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T23:33:28.605 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T23:33:28.634 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-14T23:33:28.634 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T23:33:28.719 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T23:33:28.745 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-14T23:33:28.778 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-14T23:33:28.803 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-14T23:33:28.828 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-14T23:33:28.863 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-14T23:33:28.909 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-14T23:33:28.950 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-14T23:33:28.975 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-14T23:33:29.000 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-14T23:33:29.025 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-14T23:33:29.051 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-14T23:33:29.057 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T23:33:29.058 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T23:33:29.254 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T23:33:29.255 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T23:33:29.337 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T23:33:29.362 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-14T23:33:29.393 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-14T23:33:29.421 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-14T23:33:29.446 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-14T23:33:29.514 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T23:33:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T23:33:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 1/198 2024-04-14T23:33:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2/198 2024-04-14T23:33:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 3/198 2024-04-14T23:33:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 4/198 2024-04-14T23:33:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 5/198 2024-04-14T23:33:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 6/198 2024-04-14T23:33:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 7/198 2024-04-14T23:33:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 8/198 2024-04-14T23:33:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 9/198 2024-04-14T23:33:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 10/198 2024-04-14T23:33:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 11/198 2024-04-14T23:33:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 12/198 2024-04-14T23:33:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 13/198 2024-04-14T23:33:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 14/198 2024-04-14T23:33:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 15/198 2024-04-14T23:33:34.837 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 16/198 2024-04-14T23:33:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 17/198 2024-04-14T23:33:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 18/198 2024-04-14T23:33:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 19/198 2024-04-14T23:33:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 20/198 2024-04-14T23:33:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 21/198 2024-04-14T23:33:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 22/198 2024-04-14T23:33:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 23/198 2024-04-14T23:33:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 24/198 2024-04-14T23:33:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 25/198 2024-04-14T23:33:34.838 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 26/198 2024-04-14T23:33:34.854 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 27/198 2024-04-14T23:33:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 28/198 2024-04-14T23:33:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 29/198 2024-04-14T23:33:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 30/198 2024-04-14T23:33:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 31/198 2024-04-14T23:33:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 32/198 2024-04-14T23:33:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 33/198 2024-04-14T23:33:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 34/198 2024-04-14T23:33:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 35/198 2024-04-14T23:33:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 36/198 2024-04-14T23:33:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 37/198 2024-04-14T23:33:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 38/198 2024-04-14T23:33:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 39/198 2024-04-14T23:33:34.855 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-04-14T23:33:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-04-14T23:33:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-04-14T23:33:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-04-14T23:33:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-04-14T23:33:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-04-14T23:33:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-04-14T23:33:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-04-14T23:33:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-04-14T23:33:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-04-14T23:33:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-04-14T23:33:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-04-14T23:33:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-04-14T23:33:34.856 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-04-14T23:33:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-04-14T23:33:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-04-14T23:33:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-04-14T23:33:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-04-14T23:33:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-04-14T23:33:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-04-14T23:33:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-04-14T23:33:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-04-14T23:33:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-04-14T23:33:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-04-14T23:33:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-04-14T23:33:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-04-14T23:33:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-04-14T23:33:34.857 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-04-14T23:33:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-04-14T23:33:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-04-14T23:33:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-04-14T23:33:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-13.14-1.el9.x86_64 71/198 2024-04-14T23:33:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 72/198 2024-04-14T23:33:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 73/198 2024-04-14T23:33:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 74/198 2024-04-14T23:33:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-04-14T23:33:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-04-14T23:33:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-04-14T23:33:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-04-14T23:33:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-04-14T23:33:34.858 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-04-14T23:33:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-04-14T23:33:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-04-14T23:33:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-04-14T23:33:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-04-14T23:33:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-04-14T23:33:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-04-14T23:33:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-04-14T23:33:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-04-14T23:33:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-04-14T23:33:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-04-14T23:33:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-04-14T23:33:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-04-14T23:33:34.859 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-04-14T23:33:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-04-14T23:33:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-04-14T23:33:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-04-14T23:33:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/198 2024-04-14T23:33:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/198 2024-04-14T23:33:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/198 2024-04-14T23:33:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-04-14T23:33:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-04-14T23:33:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-04-14T23:33:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-04-14T23:33:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-04-14T23:33:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-14T23:33:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-14T23:33:34.860 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-14T23:33:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-14T23:33:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-14T23:33:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-14T23:33:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-14T23:33:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-14T23:33:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-14T23:33:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-14T23:33:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T23:33:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-14T23:33:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-14T23:33:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-14T23:33:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-14T23:33:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-14T23:33:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-14T23:33:34.861 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-14T23:33:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-14T23:33:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-14T23:33:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-14T23:33:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-14T23:33:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-14T23:33:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-14T23:33:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-14T23:33:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-14T23:33:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-14T23:33:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-14T23:33:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-14T23:33:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-14T23:33:34.862 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-14T23:33:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-14T23:33:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-14T23:33:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-14T23:33:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-14T23:33:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-14T23:33:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-14T23:33:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-14T23:33:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-14T23:33:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-14T23:33:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-14T23:33:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-14T23:33:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-14T23:33:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-14T23:33:34.863 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-14T23:33:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-14T23:33:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 151/198 2024-04-14T23:33:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-14T23:33:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 153/198 2024-04-14T23:33:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-14T23:33:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-14T23:33:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-14T23:33:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-14T23:33:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-14T23:33:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-14T23:33:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-14T23:33:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-14T23:33:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-14T23:33:34.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-04-14T23:33:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-04-14T23:33:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-04-14T23:33:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-04-14T23:33:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-04-14T23:33:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-04-14T23:33:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-04-14T23:33:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-04-14T23:33:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-04-14T23:33:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-04-14T23:33:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-04-14T23:33:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-04-14T23:33:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-04-14T23:33:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-04-14T23:33:34.865 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-04-14T23:33:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-04-14T23:33:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-04-14T23:33:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-04-14T23:33:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-04-14T23:33:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-04-14T23:33:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-04-14T23:33:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-04-14T23:33:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-04-14T23:33:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-04-14T23:33:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-04-14T23:33:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-04-14T23:33:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-04-14T23:33:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-04-14T23:33:34.866 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-04-14T23:33:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-04-14T23:33:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-04-14T23:33:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-04-14T23:33:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-14T23:33:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-14T23:33:34.867 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-14T23:33:37.548 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-14T23:33:37.548 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:37.548 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-04-14T23:33:37.548 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-14T23:33:37.548 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-14T23:33:37.548 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-14T23:33:37.548 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-14T23:33:37.549 INFO:teuthology.orchestra.run.smithi047.stdout: acl-2.3.1-4.el9.x86_64 2024-04-14T23:33:37.549 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-14T23:33:37.549 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-14T23:33:37.549 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-14T23:33:37.549 INFO:teuthology.orchestra.run.smithi047.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-14T23:33:37.549 INFO:teuthology.orchestra.run.smithi047.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-14T23:33:37.549 INFO:teuthology.orchestra.run.smithi047.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-14T23:33:37.549 INFO:teuthology.orchestra.run.smithi047.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-14T23:33:37.549 INFO:teuthology.orchestra.run.smithi047.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-14T23:33:37.549 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.549 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.549 INFO:teuthology.orchestra.run.smithi047.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-14T23:33:37.549 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-14T23:33:37.550 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-14T23:33:37.550 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-14T23:33:37.550 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-14T23:33:37.550 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-14T23:33:37.550 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-14T23:33:37.550 INFO:teuthology.orchestra.run.smithi047.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-14T23:33:37.550 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-14T23:33:37.550 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-14T23:33:37.550 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-14T23:33:37.550 INFO:teuthology.orchestra.run.smithi047.stdout: automake-1.16.2-8.el9.noarch 2024-04-14T23:33:37.550 INFO:teuthology.orchestra.run.smithi047.stdout: bison-3.7.4-5.el9.x86_64 2024-04-14T23:33:37.550 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-14T23:33:37.550 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:37.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:37.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:37.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:37.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:37.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:37.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.551 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:37.552 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.552 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.552 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.552 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:37.552 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:37.552 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.552 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-shell-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.552 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-14T23:33:37.552 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-14T23:33:37.552 INFO:teuthology.orchestra.run.smithi047.stdout: flex-2.6.4-9.el9.x86_64 2024-04-14T23:33:37.552 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-14T23:33:37.552 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-14T23:33:37.552 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-14T23:33:37.553 INFO:teuthology.orchestra.run.smithi047.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-14T23:33:37.553 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-14T23:33:37.553 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-14T23:33:37.553 INFO:teuthology.orchestra.run.smithi047.stdout: jq-1.6-16.el9.x86_64 2024-04-14T23:33:37.553 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-14T23:33:37.553 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-14T23:33:37.553 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-14T23:33:37.553 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.553 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.553 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.553 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-14T23:33:37.553 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-14T23:33:37.553 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-14T23:33:37.553 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-14T23:33:37.554 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-14T23:33:37.554 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.554 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.554 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-14T23:33:37.554 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.554 INFO:teuthology.orchestra.run.smithi047.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-14T23:33:37.554 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-14T23:33:37.554 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-14T23:33:37.554 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-14T23:33:37.554 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-14T23:33:37.554 INFO:teuthology.orchestra.run.smithi047.stdout: lua-5.4.4-4.el9.x86_64 2024-04-14T23:33:37.554 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-14T23:33:37.554 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-14T23:33:37.554 INFO:teuthology.orchestra.run.smithi047.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-14T23:33:37.555 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-14T23:33:37.555 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-14T23:33:37.555 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-14T23:33:37.555 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-14T23:33:37.555 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-13.14-1.el9.x86_64 2024-04-14T23:33:37.555 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-14T23:33:37.555 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-14T23:33:37.555 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-14T23:33:37.555 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-14T23:33:37.556 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-14T23:33:37.556 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-14T23:33:37.556 INFO:teuthology.orchestra.run.smithi047.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-14T23:33:37.556 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-14T23:33:37.556 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-14T23:33:37.556 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-14T23:33:37.556 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.556 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.556 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.556 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-14T23:33:37.556 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-14T23:33:37.556 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-14T23:33:37.557 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-14T23:33:37.557 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-14T23:33:37.557 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-14T23:33:37.557 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-14T23:33:37.557 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-14T23:33:37.557 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-14T23:33:37.557 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-14T23:33:37.557 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-14T23:33:37.557 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-14T23:33:37.557 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-14T23:33:37.558 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-14T23:33:37.558 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-14T23:33:37.558 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-14T23:33:37.558 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-14T23:33:37.558 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-14T23:33:37.558 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-14T23:33:37.558 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-14T23:33:37.558 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-14T23:33:37.558 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-14T23:33:37.558 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-14T23:33:37.558 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-14T23:33:37.558 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-14T23:33:37.558 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-14T23:33:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-14T23:33:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-14T23:33:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-14T23:33:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-14T23:33:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply-3.11-14.el9.noarch 2024-04-14T23:33:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-14T23:33:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-14T23:33:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-14T23:33:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-14T23:33:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-14T23:33:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-14T23:33:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-14T23:33:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-14T23:33:37.559 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-14T23:33:37.560 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.560 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.560 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-14T23:33:37.560 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-14T23:33:37.560 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-14T23:33:37.560 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.560 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-14T23:33:37.560 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-14T23:33:37.560 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-14T23:33:37.560 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-14T23:33:37.560 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-14T23:33:37.560 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-14T23:33:37.560 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-14T23:33:37.560 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-14T23:33:37.561 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-14T23:33:37.561 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-14T23:33:37.561 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-14T23:33:37.561 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-14T23:33:37.561 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-14T23:33:37.561 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-14T23:33:37.561 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-14T23:33:37.561 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.561 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.561 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-14T23:33:37.561 INFO:teuthology.orchestra.run.smithi047.stdout: re2-1:20211101-3.el9.x86_64 2024-04-14T23:33:37.561 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-14T23:33:37.561 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-14T23:33:37.562 INFO:teuthology.orchestra.run.smithi047.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-14T23:33:37.562 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-14T23:33:37.562 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-14T23:33:37.562 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-14T23:33:37.562 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:37.562 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-14T23:33:38.069 DEBUG:teuthology.parallel:result is None 2024-04-14T23:33:38.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-14T23:33:38.211 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-14T23:33:38.233 INFO:teuthology.orchestra.run.smithi047.stdout:19.0.0-2114.ga9a752df.el7 2024-04-14T23:33:38.234 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2114.ga9a752df.el7 2024-04-14T23:33:38.234 INFO:teuthology.task.install:The correct ceph version 19.0.0-2114.ga9a752df is installed. 2024-04-14T23:33:38.236 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-14T23:33:38.371 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-14T23:33:38.397 INFO:teuthology.orchestra.run.smithi191.stdout:19.0.0-2114.ga9a752df.el7 2024-04-14T23:33:38.397 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2114.ga9a752df.el7 2024-04-14T23:33:38.397 INFO:teuthology.task.install:The correct ceph version 19.0.0-2114.ga9a752df is installed. 2024-04-14T23:33:38.399 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-14T23:33:38.399 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:33:38.400 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-14T23:33:38.431 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:33:38.431 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-14T23:33:38.470 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-14T23:33:38.471 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:33:38.471 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-04-14T23:33:38.499 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-14T23:33:38.567 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:33:38.567 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2024-04-14T23:33:38.598 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-14T23:33:38.667 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-14T23:33:38.668 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:33:38.668 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-14T23:33:38.695 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-14T23:33:38.763 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:33:38.763 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-14T23:33:38.791 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-14T23:33:38.861 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-14T23:33:38.861 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:33:38.862 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-04-14T23:33:38.888 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-14T23:33:38.955 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:33:38.955 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/stdin-killer 2024-04-14T23:33:38.982 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-14T23:33:39.050 INFO:teuthology.run_tasks:Running task ceph... 2024-04-14T23:33:39.145 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-14T23:33:39.145 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /var/log/ceph 2024-04-14T23:33:39.147 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /var/log/ceph 2024-04-14T23:33:39.175 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-14T23:33:39.175 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-14T23:33:39.215 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-14T23:33:39.243 INFO:tasks.ceph:Creating extra log directories... 2024-04-14T23:33:39.243 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-14T23:33:39.282 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-14T23:33:39.330 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-14T23:33:39.330 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-14T23:33:39.331 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-14T23:33:39.331 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:33:39.331 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-14T23:33:39.361 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-14T23:33:39.481 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-14T23:33:39.508 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:33:39.508 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-14T23:33:39.523 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-14T23:33:39.643 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-14T23:33:39.675 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-14T23:33:39.675 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-14T23:33:39.676 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7656575', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 840, 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'sleep_before_teardown': 0, 'subset': '427/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi047.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKE+7PwwSPHx0pg3eybHBwJH86XWGlwSGUIAoWEFJ89XbWsDW0QXYZQHAsOHXL7QUD5dbt1Dvjle5oC88MtThvQ=', 'smithi191.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPcdOqrFBD0geKGsRwrHJKXb0W+6HG8gpQV5Ix8r6jNxVv2Er7gpP29gUFi8Z5QJOEqUfD2tJ2flEcP0fRCFnHc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-14_21:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-14T23:33:39.676 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-14T23:33:39.679 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-14T23:33:39.725 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/run/ceph 2024-04-14T23:33:39.734 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/run/ceph 2024-04-14T23:33:39.791 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:33:39.792 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-04-14T23:33:39.813 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-14T23:33:39.813 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-04-14T23:33:39.868 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-14T23:33:39.868 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T23:33:39.868 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-14T23:33:39.868 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T23:33:39.868 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T23:33:39.868 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-14 23:33:29.861515168 +0000 2024-04-14T23:33:39.868 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-14 23:30:54.631587954 +0000 2024-04-14T23:33:39.868 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-14 23:30:54.631587954 +0000 2024-04-14T23:33:39.869 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-14 23:30:54.631587954 +0000 2024-04-14T23:33:39.869 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-14T23:33:39.933 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-14T23:33:39.934 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-14T23:33:39.934 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 9.3845e-05 s, 5.5 MB/s 2024-04-14T23:33:39.935 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-14T23:33:39.991 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-04-14T23:33:40.045 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-14T23:33:40.046 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T23:33:40.046 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-14T23:33:40.046 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T23:33:40.046 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T23:33:40.046 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-14 23:33:29.861515168 +0000 2024-04-14T23:33:40.046 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-14 23:30:54.964580363 +0000 2024-04-14T23:33:40.046 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-14 23:30:54.964580363 +0000 2024-04-14T23:33:40.046 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-14 23:30:54.964580363 +0000 2024-04-14T23:33:40.046 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-14T23:33:40.110 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-14T23:33:40.110 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-14T23:33:40.111 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.00010649 s, 4.8 MB/s 2024-04-14T23:33:40.111 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-14T23:33:40.166 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-04-14T23:33:40.222 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-14T23:33:40.222 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T23:33:40.222 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-14T23:33:40.222 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T23:33:40.222 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T23:33:40.223 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-14 23:33:29.862515146 +0000 2024-04-14T23:33:40.223 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-14 23:30:55.306572568 +0000 2024-04-14T23:33:40.223 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-14 23:30:55.306572568 +0000 2024-04-14T23:33:40.223 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-14 23:30:55.306572568 +0000 2024-04-14T23:33:40.223 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-14T23:33:40.288 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-14T23:33:40.288 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-14T23:33:40.288 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 9.6075e-05 s, 5.3 MB/s 2024-04-14T23:33:40.289 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-14T23:33:40.345 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-04-14T23:33:40.399 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-14T23:33:40.399 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T23:33:40.400 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-14T23:33:40.400 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T23:33:40.400 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T23:33:40.400 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-14 23:33:29.862515146 +0000 2024-04-14T23:33:40.400 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-14 23:30:55.638565000 +0000 2024-04-14T23:33:40.400 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-14 23:30:55.638565000 +0000 2024-04-14T23:33:40.401 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-14 23:30:55.638565000 +0000 2024-04-14T23:33:40.401 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-14T23:33:40.465 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-14T23:33:40.465 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-14T23:33:40.465 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 9.3158e-05 s, 5.5 MB/s 2024-04-14T23:33:40.466 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-14T23:33:40.522 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T23:33:40.522 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:33:40.522 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2024-04-14T23:33:40.539 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-14T23:33:40.539 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2024-04-14T23:33:40.594 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-14T23:33:40.594 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T23:33:40.595 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-14T23:33:40.595 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T23:33:40.595 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T23:33:40.595 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-14 23:32:58.132257108 +0000 2024-04-14T23:33:40.595 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-14 23:30:53.273770675 +0000 2024-04-14T23:33:40.595 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-14 23:30:53.273770675 +0000 2024-04-14T23:33:40.595 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-14 23:30:53.273770675 +0000 2024-04-14T23:33:40.595 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-14T23:33:40.661 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-14T23:33:40.661 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-14T23:33:40.661 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000205207 s, 2.5 MB/s 2024-04-14T23:33:40.662 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-14T23:33:40.720 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2024-04-14T23:33:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-14T23:33:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T23:33:40.775 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-14T23:33:40.775 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T23:33:40.775 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T23:33:40.775 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-14 23:32:58.132257108 +0000 2024-04-14T23:33:40.775 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-14 23:30:53.626764375 +0000 2024-04-14T23:33:40.775 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-14 23:30:53.626764375 +0000 2024-04-14T23:33:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-14 23:30:53.626764375 +0000 2024-04-14T23:33:40.775 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-14T23:33:40.840 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-14T23:33:40.840 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-14T23:33:40.840 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000177647 s, 2.9 MB/s 2024-04-14T23:33:40.841 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-14T23:33:40.896 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2024-04-14T23:33:40.951 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-14T23:33:40.951 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T23:33:40.952 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-14T23:33:40.952 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T23:33:40.952 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T23:33:40.952 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-14 23:32:58.133257091 +0000 2024-04-14T23:33:40.952 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-14 23:30:53.956758484 +0000 2024-04-14T23:33:40.952 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-14 23:30:53.956758484 +0000 2024-04-14T23:33:40.952 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-14 23:30:53.956758484 +0000 2024-04-14T23:33:40.952 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-14T23:33:41.017 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-14T23:33:41.017 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-14T23:33:41.017 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000185762 s, 2.8 MB/s 2024-04-14T23:33:41.018 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-14T23:33:41.073 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2024-04-14T23:33:41.128 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-14T23:33:41.129 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T23:33:41.129 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-14T23:33:41.129 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T23:33:41.129 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T23:33:41.129 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-14 23:32:58.133257091 +0000 2024-04-14T23:33:41.129 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-14 23:30:54.305752255 +0000 2024-04-14T23:33:41.129 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-14 23:30:54.305752255 +0000 2024-04-14T23:33:41.129 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-14 23:30:54.305752255 +0000 2024-04-14T23:33:41.129 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-14T23:33:41.194 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-14T23:33:41.194 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-14T23:33:41.195 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000225371 s, 2.3 MB/s 2024-04-14T23:33:41.196 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-14T23:33:41.251 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T23:33:41.251 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-14T23:33:41.252 INFO:tasks.ceph:Generating config... 2024-04-14T23:33:41.253 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-14T23:33:41.253 INFO:tasks.ceph:[client] debug client = 20 2024-04-14T23:33:41.253 INFO:tasks.ceph:[client] debug ms = 1 2024-04-14T23:33:41.253 INFO:tasks.ceph:[client] pid file = 2024-04-14T23:33:41.253 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-14T23:33:41.253 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-14T23:33:41.253 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-14T23:33:41.253 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-14T23:33:41.254 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-14T23:33:41.254 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-14T23:33:41.254 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-14T23:33:41.254 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-14T23:33:41.254 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-14T23:33:41.254 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-14T23:33:41.254 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-14T23:33:41.254 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-14T23:33:41.254 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-14T23:33:41.254 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-14T23:33:41.254 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-14T23:33:41.254 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-14T23:33:41.254 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-14T23:33:41.255 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-14T23:33:41.255 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-14T23:33:41.255 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-14T23:33:41.255 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-14T23:33:41.255 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-14T23:33:41.255 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-14T23:33:41.255 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-14T23:33:41.255 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-14T23:33:41.255 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-14T23:33:41.255 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-14T23:33:41.255 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-14T23:33:41.255 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-14T23:33:41.255 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-14T23:33:41.255 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-14T23:33:41.255 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-14T23:33:41.256 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-14T23:33:41.256 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-14T23:33:41.256 INFO:tasks.ceph:Setting up mon.a... 2024-04-14T23:33:41.256 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-14T23:33:41.310 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.keyring 2024-04-14T23:33:41.313 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-14T23:33:41.359 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-14T23:33:41.387 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.47'), ('mon.b', '172.21.15.191'), ('mon.c', '[v2:172.21.15.191:3301,v1:172.21.15.191:6790]')] 2024-04-14T23:33:41.387 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.47,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-14T23:33:41.388 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:33:41.388 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-14T23:33:41.443 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.47 --add b 172.21.15.191 --addv c '[v2:172.21.15.191:3301,v1:172.21.15.191:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:33:41.529 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:33:41.529 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: generated fsid 4f54965e-64cf-4502-8b02-6c5af72b63aa 2024-04-14T23:33:41.529 INFO:teuthology.orchestra.run.smithi047.stdout:setting min_mon_release = quincy 2024-04-14T23:33:41.529 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 0 2024-04-14T23:33:41.530 INFO:teuthology.orchestra.run.smithi047.stdout:fsid 4f54965e-64cf-4502-8b02-6c5af72b63aa 2024-04-14T23:33:41.530 INFO:teuthology.orchestra.run.smithi047.stdout:last_changed 2024-04-14T23:33:41.527819+0000 2024-04-14T23:33:41.530 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-04-14T23:33:41.527819+0000 2024-04-14T23:33:41.530 INFO:teuthology.orchestra.run.smithi047.stdout:min_mon_release 17 (quincy) 2024-04-14T23:33:41.530 INFO:teuthology.orchestra.run.smithi047.stdout:election_strategy: 1 2024-04-14T23:33:41.530 INFO:teuthology.orchestra.run.smithi047.stdout:0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-04-14T23:33:41.530 INFO:teuthology.orchestra.run.smithi047.stdout:1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-04-14T23:33:41.530 INFO:teuthology.orchestra.run.smithi047.stdout:2: [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] mon.c 2024-04-14T23:33:41.530 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-14T23:33:41.532 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-14T23:33:41.547 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4f54965e-64cf-4502-8b02-6c5af72b63aa... 2024-04-14T23:33:41.548 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-14T23:33:41.590 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-14T23:33:41.637 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-04-14T23:33:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-04-14T23:33:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-14T23:33:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-04-14T23:33:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-04-14T23:33:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-04-14T23:33:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-04-14T23:33:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-04-14T23:33:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-04-14T23:33:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-04-14T23:33:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-14T23:33:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-04-14T23:33:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-04-14T23:33:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-14T23:33:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-04-14T23:33:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-04-14T23:33:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-04-14T23:33:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-04-14T23:33:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-04-14T23:33:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-04-14T23:33:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-04-14T23:33:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-04-14T23:33:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-14T23:33:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-14T23:33:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-04-14T23:33:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-14T23:33:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-04-14T23:33:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-04-14T23:33:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-04-14T23:33:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-04-14T23:33:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-04-14T23:33:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = "172.21.15.47,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2024-04-14T23:33:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on skipped message = False 2024-04-14T23:33:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 4f54965e-64cf-4502-8b02-6c5af72b63aa 2024-04-14T23:33:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.641 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-04-14T23:33:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-04-14T23:33:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-04-14T23:33:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-04-14T23:33:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-04-14T23:33:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-04-14T23:33:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-04-14T23:33:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-04-14T23:33:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-04-14T23:33:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-04-14T23:33:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug trim objects = true 2024-04-14T23:33:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-04-14T23:33:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-04-14T23:33:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-04-14T23:33:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-04-14T23:33:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-04-14T23:33:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-04-14T23:33:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-04-14T23:33:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-04-14T23:33:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-04-14T23:33:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore block size = 96636764160 2024-04-14T23:33:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore fsck on mount = True 2024-04-14T23:33:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluefs = 20 2024-04-14T23:33:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluestore = 20 2024-04-14T23:33:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-14T23:33:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-04-14T23:33:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: debug rocksdb = 10 2024-04-14T23:33:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd backfillfull_ratio = 0.85 2024-04-14T23:33:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd full ratio = 0.9 2024-04-14T23:33:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd nearfull ratio = 0.8 2024-04-14T23:33:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: osd failsafe full ratio = 0.95 2024-04-14T23:33:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = bluestore 2024-04-14T23:33:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-04-14T23:33:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.644 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-04-14T23:33:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-14T23:33:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-04-14T23:33:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-04-14T23:33:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-04-14T23:33:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-04-14T23:33:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-04-14T23:33:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-04-14T23:33:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-04-14T23:33:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.645 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-04-14T23:33:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-14T23:33:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-04-14T23:33:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-04-14T23:33:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-04-14T23:33:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-04-14T23:33:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-04-14T23:33:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-04-14T23:33:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-04-14T23:33:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-04-14T23:33:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-04-14T23:33:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-14T23:33:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-04-14T23:33:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-04-14T23:33:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-04-14T23:33:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-14T23:33:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-14T23:33:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-04-14T23:33:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-04-14T23:33:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-04-14T23:33:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: mon down mkfs grace = 300 2024-04-14T23:33:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: mon op complaint time = 120 2024-04-14T23:33:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:33:41.647 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-04-14T23:33:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-04-14T23:33:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-04-14T23:33:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-04-14T23:33:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-14T23:33:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-14T23:33:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: client mount timeout = 600 2024-04-14T23:33:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-04-14T23:33:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-14T23:33:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = "" 2024-04-14T23:33:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-04-14T23:33:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-04-14T23:33:41.647 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-04-14T23:33:41.648 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.b] 2024-04-14T23:33:41.648 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.c] 2024-04-14T23:33:41.648 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-04-14T23:33:41.648 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-04-14T23:33:41.648 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-04-14T23:33:41.648 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-04-14T23:33:41.648 INFO:teuthology.orchestra.run.smithi047.stdout:[mds] 2024-04-14T23:33:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds = 20 2024-04-14T23:33:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds balancer = 20 2024-04-14T23:33:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-14T23:33:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug frag = True 2024-04-14T23:33:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug scatterstat = True 2024-04-14T23:33:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: mds op complaint time = 180 2024-04-14T23:33:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: mds verify scatter = True 2024-04-14T23:33:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-04-14T23:33:41.649 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-04-14T23:33:41.649 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-04-14T23:33:41.649 INFO:teuthology.orchestra.run.smithi191.stdout:[global] 2024-04-14T23:33:41.649 INFO:teuthology.orchestra.run.smithi191.stdout: chdir = "" 2024-04-14T23:33:41.649 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-14T23:33:41.649 INFO:teuthology.orchestra.run.smithi191.stdout: auth supported = cephx 2024-04-14T23:33:41.649 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.649 INFO:teuthology.orchestra.run.smithi191.stdout: filestore xattr use omap = true 2024-04-14T23:33:41.649 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.649 INFO:teuthology.orchestra.run.smithi191.stdout: mon clock drift allowed = 1.000 2024-04-14T23:33:41.650 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.650 INFO:teuthology.orchestra.run.smithi191.stdout: osd crush chooseleaf type = 0 2024-04-14T23:33:41.650 INFO:teuthology.orchestra.run.smithi191.stdout: auth debug = true 2024-04-14T23:33:41.650 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.650 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on old message = true 2024-04-14T23:33:41.650 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on bug = true 2024-04-14T23:33:41.650 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.650 INFO:teuthology.orchestra.run.smithi191.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-14T23:33:41.650 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn max object skew = 0 2024-04-14T23:33:41.650 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.650 INFO:teuthology.orchestra.run.smithi191.stdout: # disable pg_autoscaler by default for new pools 2024-04-14T23:33:41.650 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-14T23:33:41.650 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.650 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default size = 2 2024-04-14T23:33:41.651 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.651 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow primary affinity = true 2024-04-14T23:33:41.651 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow pg remap = true 2024-04-14T23:33:41.651 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on legacy crush tunables = false 2024-04-14T23:33:41.651 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on crush straw calc version zero = false 2024-04-14T23:33:41.651 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on no sortbitwise = false 2024-04-14T23:33:41.651 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = false 2024-04-14T23:33:41.651 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on too few osds = false 2024-04-14T23:33:41.651 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-14T23:33:41.651 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-14T23:33:41.651 INFO:teuthology.orchestra.run.smithi191.stdout: mon_allow_pool_size_one = true 2024-04-14T23:33:41.651 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.651 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-14T23:33:41.651 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.652 INFO:teuthology.orchestra.run.smithi191.stdout: osd default data pool replay window = 5 2024-04-14T23:33:41.652 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.652 INFO:teuthology.orchestra.run.smithi191.stdout: mon allow pool delete = true 2024-04-14T23:33:41.652 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.652 INFO:teuthology.orchestra.run.smithi191.stdout: mon cluster log file level = debug 2024-04-14T23:33:41.652 INFO:teuthology.orchestra.run.smithi191.stdout: debug asserts on shutdown = true 2024-04-14T23:33:41.652 INFO:teuthology.orchestra.run.smithi191.stdout: mon health detail to clog = false 2024-04-14T23:33:41.652 INFO:teuthology.orchestra.run.smithi191.stdout: mon host = "172.21.15.47,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2024-04-14T23:33:41.652 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on skipped message = False 2024-04-14T23:33:41.652 INFO:teuthology.orchestra.run.smithi191.stdout: fsid = 4f54965e-64cf-4502-8b02-6c5af72b63aa 2024-04-14T23:33:41.652 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.652 INFO:teuthology.orchestra.run.smithi191.stdout:[osd] 2024-04-14T23:33:41.653 INFO:teuthology.orchestra.run.smithi191.stdout: osd journal size = 100 2024-04-14T23:33:41.653 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.653 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub load threshold = 5.0 2024-04-14T23:33:41.653 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub max interval = 600 2024-04-14T23:33:41.653 INFO:teuthology.orchestra.run.smithi191.stdout: osd mclock profile = high_recovery_ops 2024-04-14T23:33:41.653 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.653 INFO:teuthology.orchestra.run.smithi191.stdout: osd recover clone overlap = true 2024-04-14T23:33:41.653 INFO:teuthology.orchestra.run.smithi191.stdout: osd recovery max chunk = 1048576 2024-04-14T23:33:41.653 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.653 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug shutdown = true 2024-04-14T23:33:41.653 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug op order = true 2024-04-14T23:33:41.653 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify stray on activate = true 2024-04-14T23:33:41.653 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug trim objects = true 2024-04-14T23:33:41.653 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.653 INFO:teuthology.orchestra.run.smithi191.stdout: osd open classes on start = true 2024-04-14T23:33:41.654 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug pg log writeout = true 2024-04-14T23:33:41.654 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.654 INFO:teuthology.orchestra.run.smithi191.stdout: osd deep scrub update digest min age = 30 2024-04-14T23:33:41.654 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.654 INFO:teuthology.orchestra.run.smithi191.stdout: osd map max advance = 10 2024-04-14T23:33:41.654 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.654 INFO:teuthology.orchestra.run.smithi191.stdout: journal zero on create = true 2024-04-14T23:33:41.654 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.654 INFO:teuthology.orchestra.run.smithi191.stdout: filestore ondisk finisher threads = 3 2024-04-14T23:33:41.654 INFO:teuthology.orchestra.run.smithi191.stdout: filestore apply finisher threads = 3 2024-04-14T23:33:41.654 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.655 INFO:teuthology.orchestra.run.smithi191.stdout: bdev debug aio = true 2024-04-14T23:33:41.655 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug misdirected ops = true 2024-04-14T23:33:41.655 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore block size = 96636764160 2024-04-14T23:33:41.655 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore fsck on mount = True 2024-04-14T23:33:41.655 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluefs = 20 2024-04-14T23:33:41.655 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluestore = 20 2024-04-14T23:33:41.655 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-14T23:33:41.655 INFO:teuthology.orchestra.run.smithi191.stdout: debug osd = 20 2024-04-14T23:33:41.655 INFO:teuthology.orchestra.run.smithi191.stdout: debug rocksdb = 10 2024-04-14T23:33:41.655 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd backfillfull_ratio = 0.85 2024-04-14T23:33:41.655 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd full ratio = 0.9 2024-04-14T23:33:41.655 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd nearfull ratio = 0.8 2024-04-14T23:33:41.656 INFO:teuthology.orchestra.run.smithi191.stdout: osd failsafe full ratio = 0.95 2024-04-14T23:33:41.656 INFO:teuthology.orchestra.run.smithi191.stdout: osd objectstore = bluestore 2024-04-14T23:33:41.656 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2024-04-14T23:33:41.656 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.656 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr] 2024-04-14T23:33:41.656 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-14T23:33:41.656 INFO:teuthology.orchestra.run.smithi191.stdout: debug mgr = 20 2024-04-14T23:33:41.656 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2024-04-14T23:33:41.656 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2024-04-14T23:33:41.656 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2024-04-14T23:33:41.656 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2024-04-14T23:33:41.656 INFO:teuthology.orchestra.run.smithi191.stdout: mgr/telemetry/nag = false 2024-04-14T23:33:41.656 INFO:teuthology.orchestra.run.smithi191.stdout: debug client = 20 2024-04-14T23:33:41.657 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.657 INFO:teuthology.orchestra.run.smithi191.stdout:[mon] 2024-04-14T23:33:41.657 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-14T23:33:41.657 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2024-04-14T23:33:41.657 INFO:teuthology.orchestra.run.smithi191.stdout: debug paxos = 20 2024-04-14T23:33:41.657 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2024-04-14T23:33:41.657 INFO:teuthology.orchestra.run.smithi191.stdout: mon data avail warn = 5 2024-04-14T23:33:41.657 INFO:teuthology.orchestra.run.smithi191.stdout: mon mgr mkfs grace = 240 2024-04-14T23:33:41.657 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2024-04-14T23:33:41.657 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd reporter subtree level = osd 2024-04-14T23:33:41.657 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd prime pg temp = true 2024-04-14T23:33:41.657 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2024-04-14T23:33:41.657 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.657 INFO:teuthology.orchestra.run.smithi191.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-14T23:33:41.657 INFO:teuthology.orchestra.run.smithi191.stdout: auth mon ticket ttl = 660 # 11m 2024-04-14T23:33:41.658 INFO:teuthology.orchestra.run.smithi191.stdout: auth service ticket ttl = 240 # 4m 2024-04-14T23:33:41.658 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.658 INFO:teuthology.orchestra.run.smithi191.stdout: # don't complain about insecure global_id in the test suite 2024-04-14T23:33:41.658 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-14T23:33:41.658 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-14T23:33:41.658 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.658 INFO:teuthology.orchestra.run.smithi191.stdout: # 1m isn't quite enough 2024-04-14T23:33:41.658 INFO:teuthology.orchestra.run.smithi191.stdout: mon_down_mkfs_grace = 2m 2024-04-14T23:33:41.658 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.658 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_filestore_osds = false 2024-04-14T23:33:41.658 INFO:teuthology.orchestra.run.smithi191.stdout: mon down mkfs grace = 300 2024-04-14T23:33:41.658 INFO:teuthology.orchestra.run.smithi191.stdout: mon op complaint time = 120 2024-04-14T23:33:41.658 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-14T23:33:41.658 INFO:teuthology.orchestra.run.smithi191.stdout:[client] 2024-04-14T23:33:41.659 INFO:teuthology.orchestra.run.smithi191.stdout: rgw cache enabled = true 2024-04-14T23:33:41.659 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable ops log = true 2024-04-14T23:33:41.659 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable usage log = true 2024-04-14T23:33:41.659 INFO:teuthology.orchestra.run.smithi191.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-14T23:33:41.659 INFO:teuthology.orchestra.run.smithi191.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-14T23:33:41.659 INFO:teuthology.orchestra.run.smithi191.stdout: client mount timeout = 600 2024-04-14T23:33:41.659 INFO:teuthology.orchestra.run.smithi191.stdout: debug client = 20 2024-04-14T23:33:41.659 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-14T23:33:41.659 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = "" 2024-04-14T23:33:41.659 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2024-04-14T23:33:41.659 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2024-04-14T23:33:41.659 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.a] 2024-04-14T23:33:41.659 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.b] 2024-04-14T23:33:41.659 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.c] 2024-04-14T23:33:41.659 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2024-04-14T23:33:41.660 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.c] 2024-04-14T23:33:41.660 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.b] 2024-04-14T23:33:41.660 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.d] 2024-04-14T23:33:41.660 INFO:teuthology.orchestra.run.smithi191.stdout:[mds] 2024-04-14T23:33:41.660 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds = 20 2024-04-14T23:33:41.660 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds balancer = 20 2024-04-14T23:33:41.660 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-14T23:33:41.660 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug frag = True 2024-04-14T23:33:41.660 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug scatterstat = True 2024-04-14T23:33:41.660 INFO:teuthology.orchestra.run.smithi191.stdout: mds op complaint time = 180 2024-04-14T23:33:41.660 INFO:teuthology.orchestra.run.smithi191.stdout: mds verify scatter = True 2024-04-14T23:33:41.660 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2024-04-14T23:33:41.660 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2024-04-14T23:33:41.660 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2024-04-14T23:33:41.662 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-14T23:33:41.662 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-14T23:33:41.759 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-14T23:33:41.761 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:33:41.761 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-14T23:33:41.775 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:33:41.775 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-14T23:33:41.829 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi047.front.sepia.ceph.com 2024-04-14T23:33:41.829 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:33:41.830 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-14T23:33:41.830 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-14T23:33:41.908 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:33:41.908 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:33:41.963 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi191.front.sepia.ceph.com 2024-04-14T23:33:41.963 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:33:41.963 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-14T23:33:41.963 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-14T23:33:42.003 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:33:42.003 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:33:42.058 INFO:tasks.ceph:Setting up mon nodes... 2024-04-14T23:33:42.058 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-14T23:33:42.059 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-14T23:33:42.112 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-14T23:33:42.115 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-14T23:33:42.180 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-14T23:33:42.182 INFO:tasks.ceph:Setting up mds nodes... 2024-04-14T23:33:42.182 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-14T23:33:42.237 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-14T23:33:42.239 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-14T23:33:42.265 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-14T23:33:42.359 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-14T23:33:42.362 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-14T23:33:42.388 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-14T23:33:42.443 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-14T23:33:42.446 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-14T23:33:42.472 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-14T23:33:42.567 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-14T23:33:42.569 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-14T23:33:42.595 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-14T23:33:42.596 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-14T23:33:42.638 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-14T23:33:42.653 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-14T23:33:42.735 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-14T23:33:42.750 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-14T23:33:42.792 INFO:teuthology.orchestra.run.smithi191.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-14T23:33:42.808 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-14T23:33:42.890 INFO:teuthology.orchestra.run.smithi191.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-14T23:33:42.906 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-14T23:33:42.906 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-14T23:33:42.906 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-14T23:33:42.933 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T23:33:42.933 INFO:tasks.ceph:role: osd.0 2024-04-14T23:33:42.933 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-14T23:33:42.933 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-14T23:33:42.999 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T23:33:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T23:33:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T23:33:42.999 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T23:33:43.000 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T23:33:43.000 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-04-14T23:33:43.000 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T23:33:43.000 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T23:33:43.000 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T23:33:43.000 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T23:33:43.035 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-04-14T23:33:43.036 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-04-14T23:33:43.037 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-14T23:33:43.109 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-14T23:33:43.180 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-14T23:33:43.248 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T23:33:43.248 INFO:tasks.ceph:role: osd.1 2024-04-14T23:33:43.248 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-14T23:33:43.248 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-14T23:33:43.315 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T23:33:43.315 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T23:33:43.315 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T23:33:43.315 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T23:33:43.315 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T23:33:43.315 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-04-14T23:33:43.315 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T23:33:43.315 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T23:33:43.315 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T23:33:43.315 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T23:33:43.351 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-04-14T23:33:43.354 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-04-14T23:33:43.354 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-14T23:33:43.435 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-14T23:33:43.506 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-14T23:33:43.574 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T23:33:43.574 INFO:tasks.ceph:role: osd.2 2024-04-14T23:33:43.574 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-14T23:33:43.574 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-14T23:33:43.641 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T23:33:43.641 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T23:33:43.641 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T23:33:43.641 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T23:33:43.641 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T23:33:43.641 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-04-14T23:33:43.642 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T23:33:43.642 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T23:33:43.642 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T23:33:43.642 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T23:33:43.677 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-04-14T23:33:43.679 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-04-14T23:33:43.679 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-14T23:33:43.750 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-14T23:33:43.820 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-14T23:33:43.887 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T23:33:43.887 INFO:tasks.ceph:role: osd.3 2024-04-14T23:33:43.887 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-14T23:33:43.888 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-14T23:33:43.954 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T23:33:43.954 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T23:33:43.954 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T23:33:43.954 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T23:33:43.954 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T23:33:43.954 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-04-14T23:33:43.954 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T23:33:43.954 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T23:33:43.954 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T23:33:43.954 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T23:33:43.990 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-04-14T23:33:43.992 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-04-14T23:33:43.992 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-14T23:33:44.062 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-14T23:33:44.132 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:33:44.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:44.226+0000 7f7e412bf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-14T23:33:44.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:44.226+0000 7f7e412bf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-14T23:33:44.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:44.226+0000 7f7e412bf640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-14T23:33:44.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:44.226+0000 7f7e412bf640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-14T23:33:44.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:44.226+0000 7f7e412bf640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-14T23:33:44.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:44.226+0000 7f7e412bf640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-14T23:33:47.079 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-14T23:33:47.111 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:33:47.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:47.199+0000 7f4fc580d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-14T23:33:47.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:47.200+0000 7f4fc580d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-14T23:33:47.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:47.200+0000 7f4fc580d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-14T23:33:47.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:47.200+0000 7f4fc580d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-14T23:33:47.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:47.200+0000 7f4fc580d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-14T23:33:47.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:47.200+0000 7f4fc580d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-14T23:33:50.056 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-14T23:33:50.087 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:33:50.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:50.175+0000 7f0f1c349640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-14T23:33:50.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:50.176+0000 7f0f1c349640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-14T23:33:50.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:50.176+0000 7f0f1c349640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-14T23:33:50.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:50.176+0000 7f0f1c349640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-14T23:33:50.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:50.176+0000 7f0f1c349640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-14T23:33:50.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:50.176+0000 7f0f1c349640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-14T23:33:53.025 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-14T23:33:53.056 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:33:53.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:53.220+0000 7ffa44c0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-14T23:33:53.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:53.220+0000 7ffa44c0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-14T23:33:53.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:53.220+0000 7ffa44c0d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-14T23:33:53.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:53.220+0000 7ffa44c0d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-14T23:33:53.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:53.220+0000 7ffa44c0d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-14T23:33:53.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:33:53.220+0000 7ffa44c0d640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-14T23:33:56.066 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-14T23:33:56.097 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-14T23:33:56.129 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T23:33:56.129 INFO:tasks.ceph:role: osd.4 2024-04-14T23:33:56.129 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-14T23:33:56.129 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-14T23:33:56.208 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T23:33:56.208 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T23:33:56.208 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T23:33:56.208 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T23:33:56.208 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T23:33:56.208 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2024-04-14T23:33:56.208 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T23:33:56.208 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T23:33:56.208 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T23:33:56.208 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T23:33:56.697 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2024-04-14T23:33:56.699 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2024-04-14T23:33:56.699 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-14T23:33:56.821 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-14T23:33:56.856 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-14T23:33:56.925 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T23:33:56.925 INFO:tasks.ceph:role: osd.5 2024-04-14T23:33:56.925 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-14T23:33:56.925 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-14T23:33:57.001 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T23:33:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T23:33:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T23:33:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T23:33:57.001 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T23:33:57.001 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2024-04-14T23:33:57.001 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T23:33:57.002 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T23:33:57.002 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T23:33:57.002 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T23:33:57.459 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2024-04-14T23:33:57.461 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2024-04-14T23:33:57.461 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-14T23:33:57.553 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-14T23:33:57.585 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-14T23:33:57.653 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T23:33:57.653 INFO:tasks.ceph:role: osd.6 2024-04-14T23:33:57.653 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-14T23:33:57.653 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-14T23:33:57.728 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T23:33:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T23:33:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T23:33:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T23:33:57.728 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T23:33:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2024-04-14T23:33:57.728 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T23:33:57.728 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T23:33:57.728 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T23:33:57.728 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T23:33:58.207 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2024-04-14T23:33:58.209 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2024-04-14T23:33:58.209 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-14T23:33:58.329 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-14T23:33:58.361 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-14T23:33:58.428 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T23:33:58.428 INFO:tasks.ceph:role: osd.7 2024-04-14T23:33:58.428 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-14T23:33:58.429 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-14T23:33:58.503 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T23:33:58.503 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T23:33:58.503 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T23:33:58.503 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T23:33:58.503 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T23:33:58.503 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2024-04-14T23:33:58.503 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T23:33:58.504 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T23:33:58.504 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T23:33:58.504 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T23:33:58.999 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2024-04-14T23:33:59.001 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2024-04-14T23:33:59.001 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-14T23:33:59.132 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-14T23:33:59.166 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:33:59.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:33:59.262+0000 7f8d413e1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-14T23:33:59.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:33:59.262+0000 7f8d413e1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-14T23:33:59.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:33:59.262+0000 7f8d413e1640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-14T23:33:59.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:33:59.262+0000 7f8d413e1640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-14T23:33:59.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:33:59.262+0000 7f8d413e1640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-14T23:33:59.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:33:59.263+0000 7f8d413e1640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-14T23:34:02.111 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-14T23:34:02.143 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:34:02.237 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:02.234+0000 7f58cb413640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-14T23:34:02.237 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:02.234+0000 7f58cb413640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-14T23:34:02.237 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:02.234+0000 7f58cb413640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-14T23:34:02.237 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:02.234+0000 7f58cb413640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-14T23:34:02.237 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:02.234+0000 7f58cb413640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-14T23:34:02.238 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:02.235+0000 7f58cb413640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-14T23:34:05.079 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-14T23:34:05.110 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:34:05.202 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:05.199+0000 7ffb3936d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-14T23:34:05.202 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:05.199+0000 7ffb3936d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-14T23:34:05.202 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:05.200+0000 7ffb3936d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-14T23:34:05.203 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:05.200+0000 7ffb3936d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-14T23:34:05.203 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:05.200+0000 7ffb3936d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-14T23:34:05.203 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:05.200+0000 7ffb3936d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-14T23:34:08.046 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-14T23:34:08.076 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:34:08.170 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:08.165+0000 7fc87da11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-14T23:34:08.171 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:08.165+0000 7fc87da11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-14T23:34:08.171 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:08.165+0000 7fc87da11640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-14T23:34:08.171 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:08.165+0000 7fc87da11640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-14T23:34:08.171 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:08.165+0000 7fc87da11640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-14T23:34:08.171 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:08.165+0000 7fc87da11640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-14T23:34:09.678 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T23:34:09.681 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T23:34:11.021 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-14T23:34:11.052 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-14T23:34:11.052 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:34:11.052 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-14T23:34:11.085 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:34:11.085 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-14T23:34:11.156 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:34:11.156 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-14T23:34:11.226 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:34:11.227 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-14T23:34:11.295 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:34:11.295 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-14T23:34:11.364 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:34:11.365 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-14T23:34:11.432 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:34:11.432 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-14T23:34:11.500 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:34:11.500 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-14T23:34:11.532 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:34:11.532 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-14T23:34:11.604 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:34:11.604 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-14T23:34:11.676 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:34:11.676 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-14T23:34:11.748 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:34:11.748 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-14T23:34:11.819 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:34:11.819 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-14T23:34:11.888 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:34:11.888 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-14T23:34:11.957 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:34:11.957 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-14T23:34:11.975 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:34:11.975 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-14T23:34:12.032 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:34:12.032 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-14T23:34:12.049 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:34:12.049 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-14T23:34:12.105 INFO:tasks.ceph:Adding keys to all mons... 2024-04-14T23:34:12.106 DEBUG:teuthology.orchestra.run.smithi047:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-14T23:34:12.108 DEBUG:teuthology.orchestra.run.smithi191:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-14T23:34:12.148 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.y] 2024-04-14T23:34:12.149 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDWZxxm75ejBhAAT8GiGRCz7/8g9T/KyXUeIg== 2024-04-14T23:34:12.149 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-04-14T23:34:12.149 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDWZxxmIAEODhAAAJ7ut52z2zNaFKmMHZxmkw== 2024-04-14T23:34:12.149 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-04-14T23:34:12.149 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDWZxxmdHxYFRAAovKdQJ+cgMZn/KSzfRz2Ow== 2024-04-14T23:34:12.149 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.0] 2024-04-14T23:34:12.149 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDYZxxm8RiJDRAAdJFBPX+r5fbuL8t5r3Nw3g== 2024-04-14T23:34:12.149 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.1] 2024-04-14T23:34:12.149 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDbZxxmNhT8CxAAcLDXRk5caiheaLL9StKOAQ== 2024-04-14T23:34:12.149 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.2] 2024-04-14T23:34:12.149 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDeZxxmZC2KChAAyRouhk0xNx7wWCGV7yOFbw== 2024-04-14T23:34:12.149 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.3] 2024-04-14T23:34:12.150 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDhZxxm8aQhDRAAsiW9p0OQxUW4z6EbVD7jAw== 2024-04-14T23:34:12.150 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.x] 2024-04-14T23:34:12.150 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDWZxxmv+ioChAA3fthTqbeyofQNPB+DE5jTA== 2024-04-14T23:34:12.150 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-04-14T23:34:12.150 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDWZxxmuaNZGhAALbJpai62YAqZS9Zq+pbmZw== 2024-04-14T23:34:12.150 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-04-14T23:34:12.150 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDWZxxmq9m3IRAAQP8PjhXcIgnNpXKBz/sfaQ== 2024-04-14T23:34:12.150 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.4] 2024-04-14T23:34:12.150 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDnZxxmwlyvDxAAbif2xde0Gy1vNEuSm6En+A== 2024-04-14T23:34:12.150 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.5] 2024-04-14T23:34:12.150 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDqZxxmblsFDhAAqtF0YqXtN6wwpxti2krNqw== 2024-04-14T23:34:12.150 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.6] 2024-04-14T23:34:12.150 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDtZxxmtM3zCxAAyGfuAZX8EW8TOM8yiif/3g== 2024-04-14T23:34:12.151 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.7] 2024-04-14T23:34:12.151 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDwZxxmzx7iCRAAhkGucA54qt0BaAKFM607FQ== 2024-04-14T23:34:12.151 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-04-14T23:34:12.151 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDWZxxmvmX2JRAAIQq0oHP9ehuYsHlAvadMIw== 2024-04-14T23:34:12.151 INFO:teuthology.orchestra.run.smithi047.stdout:[client.2] 2024-04-14T23:34:12.151 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDWZxxmRcLAKxAAZKcKL40+FoLLTr5sF8fb3A== 2024-04-14T23:34:12.151 INFO:teuthology.orchestra.run.smithi047.stdout:[client.1] 2024-04-14T23:34:12.151 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDWZxxmh10rLxAAhPQt4kcMSDmwD+SSnOpnGw== 2024-04-14T23:34:12.151 INFO:teuthology.orchestra.run.smithi047.stdout:[client.3] 2024-04-14T23:34:12.151 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDWZxxmKHUDNRAAREpHyKZBtVbpmh15Nu2TgQ== 2024-04-14T23:34:12.172 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr.y] 2024-04-14T23:34:12.173 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDWZxxm75ejBhAAT8GiGRCz7/8g9T/KyXUeIg== 2024-04-14T23:34:12.173 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2024-04-14T23:34:12.173 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDWZxxmIAEODhAAAJ7ut52z2zNaFKmMHZxmkw== 2024-04-14T23:34:12.173 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.c] 2024-04-14T23:34:12.173 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDWZxxmdHxYFRAAovKdQJ+cgMZn/KSzfRz2Ow== 2024-04-14T23:34:12.173 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.0] 2024-04-14T23:34:12.173 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDYZxxm8RiJDRAAdJFBPX+r5fbuL8t5r3Nw3g== 2024-04-14T23:34:12.173 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.1] 2024-04-14T23:34:12.173 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDbZxxmNhT8CxAAcLDXRk5caiheaLL9StKOAQ== 2024-04-14T23:34:12.173 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.2] 2024-04-14T23:34:12.173 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDeZxxmZC2KChAAyRouhk0xNx7wWCGV7yOFbw== 2024-04-14T23:34:12.173 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.3] 2024-04-14T23:34:12.173 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDhZxxm8aQhDRAAsiW9p0OQxUW4z6EbVD7jAw== 2024-04-14T23:34:12.174 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr.x] 2024-04-14T23:34:12.174 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDWZxxmv+ioChAA3fthTqbeyofQNPB+DE5jTA== 2024-04-14T23:34:12.174 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.b] 2024-04-14T23:34:12.174 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDWZxxmuaNZGhAALbJpai62YAqZS9Zq+pbmZw== 2024-04-14T23:34:12.174 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.d] 2024-04-14T23:34:12.174 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDWZxxmq9m3IRAAQP8PjhXcIgnNpXKBz/sfaQ== 2024-04-14T23:34:12.174 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.4] 2024-04-14T23:34:12.174 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDnZxxmwlyvDxAAbif2xde0Gy1vNEuSm6En+A== 2024-04-14T23:34:12.174 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.5] 2024-04-14T23:34:12.174 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDqZxxmblsFDhAAqtF0YqXtN6wwpxti2krNqw== 2024-04-14T23:34:12.174 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.6] 2024-04-14T23:34:12.174 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDtZxxmtM3zCxAAyGfuAZX8EW8TOM8yiif/3g== 2024-04-14T23:34:12.174 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.7] 2024-04-14T23:34:12.174 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDwZxxmzx7iCRAAhkGucA54qt0BaAKFM607FQ== 2024-04-14T23:34:12.175 INFO:teuthology.orchestra.run.smithi191.stdout:[client.0] 2024-04-14T23:34:12.175 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDWZxxmvmX2JRAAIQq0oHP9ehuYsHlAvadMIw== 2024-04-14T23:34:12.175 INFO:teuthology.orchestra.run.smithi191.stdout:[client.2] 2024-04-14T23:34:12.175 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDWZxxmRcLAKxAAZKcKL40+FoLLTr5sF8fb3A== 2024-04-14T23:34:12.175 INFO:teuthology.orchestra.run.smithi191.stdout:[client.1] 2024-04-14T23:34:12.175 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDWZxxmh10rLxAAhPQt4kcMSDmwD+SSnOpnGw== 2024-04-14T23:34:12.175 INFO:teuthology.orchestra.run.smithi191.stdout:[client.3] 2024-04-14T23:34:12.175 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDWZxxmKHUDNRAAREpHyKZBtVbpmh15Nu2TgQ== 2024-04-14T23:34:12.176 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-14T23:34:12.195 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-14T23:34:12.272 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T23:34:12.274 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T23:34:12.330 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T23:34:12.333 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T23:34:12.387 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T23:34:12.389 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T23:34:12.442 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T23:34:12.444 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T23:34:12.495 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T23:34:12.498 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T23:34:12.550 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T23:34:12.552 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T23:34:12.604 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-14T23:34:12.607 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-14T23:34:12.659 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T23:34:12.661 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T23:34:12.716 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T23:34:12.719 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T23:34:12.773 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T23:34:12.775 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T23:34:12.827 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T23:34:12.830 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T23:34:12.882 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T23:34:12.884 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T23:34:12.936 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T23:34:12.938 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T23:34:12.991 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T23:34:12.993 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T23:34:13.048 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T23:34:13.051 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T23:34:13.106 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T23:34:13.109 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T23:34:13.163 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T23:34:13.166 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T23:34:13.221 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-14T23:34:13.221 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-14T23:34:13.247 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-14T23:34:13.344 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-14T23:34:13.371 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-14T23:34:13.398 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-14T23:34:13.495 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-14T23:34:13.522 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-14T23:34:13.589 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-14T23:34:13.688 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-14T23:34:13.717 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:34:13.722 DEBUG:teuthology.orchestra.run.smithi191:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-14T23:34:13.778 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-14T23:34:13.778 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-14T23:34:13.779 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-14T23:34:13.782 INFO:tasks.ceph.mon.a:Started 2024-04-14T23:34:13.782 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-14T23:34:13.782 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-14T23:34:13.821 INFO:tasks.ceph.mon.b:Started 2024-04-14T23:34:13.821 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-14T23:34:13.822 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-14T23:34:13.824 INFO:tasks.ceph.mon.c:Started 2024-04-14T23:34:13.824 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-14T23:34:13.824 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-14T23:34:13.825 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-14T23:34:13.828 INFO:tasks.ceph.mgr.y:Started 2024-04-14T23:34:13.828 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-14T23:34:13.828 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-14T23:34:13.831 INFO:tasks.ceph.mgr.x:Started 2024-04-14T23:34:13.831 INFO:tasks.ceph:Setting crush tunables to default 2024-04-14T23:34:13.831 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd crush tunables default 2024-04-14T23:34:13.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:13.932+0000 7f054dcc4640 1 Processor -- start 2024-04-14T23:34:13.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:13.932+0000 7f054dcc4640 1 -- start start 2024-04-14T23:34:13.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:13.933+0000 7f054dcc4640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0548071e00 0x7f0548166d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:13.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:13.933+0000 7f054dcc4640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0548160810 con 0x7f05480ce180 2024-04-14T23:34:13.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:13.933+0000 7f054dcc4640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05480ce7d0 con 0x7f054815f9b0 2024-04-14T23:34:13.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:13.933+0000 7f054dcc4640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f05480cf3e0 con 0x7f0548071e00 2024-04-14T23:34:13.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:13.933+0000 7f053effd640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f05480ce180 0x7f054815fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:36222/0 (socket says 172.21.15.47:36222) 2024-04-14T23:34:13.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:13.933+0000 7f053effd640 1 -- 172.21.15.47:0/3706045483 learned_addr learned my addr 172.21.15.47:0/3706045483 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:13.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:13.933+0000 7f0547fff640 1 --2- 172.21.15.47:0/3706045483 >> v2:172.21.15.191:3300/0 conn(0x7f0548071e00 0x7f0548166d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:13.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:13.933+0000 7f0547fff640 1 -- 172.21.15.47:0/3706045483 >> v2:172.21.15.191:3300/0 conn(0x7f0548071e00 msgr2=0x7f0548166d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-14T23:34:13.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:13.933+0000 7f0547fff640 1 -- 172.21.15.47:0/3706045483 >> v2:172.21.15.191:3300/0 conn(0x7f0548071e00 msgr2=0x7f0548166d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-14T23:34:13.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:13.933+0000 7f0547fff640 1 --2- 172.21.15.47:0/3706045483 >> v2:172.21.15.191:3300/0 conn(0x7f0548071e00 0x7f0548166d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T23:34:13.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:13.933+0000 7f0547fff640 1 --2- 172.21.15.47:0/3706045483 >> v2:172.21.15.191:3300/0 conn(0x7f0548071e00 0x7f0548166d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T23:34:14.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.087+0000 7f0546ffd640 1 -- 172.21.15.47:0/3706045483 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2241439635 0 0) 0x7f0530001110 con 0x7f05480ce180 2024-04-14T23:34:14.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.087+0000 7f0546ffd640 1 -- 172.21.15.47:0/3706045483 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0534003520 con 0x7f05480ce180 2024-04-14T23:34:14.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.087+0000 7f0546ffd640 1 -- 172.21.15.47:0/3706045483 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 150422861 0 0) 0x7f0534003520 con 0x7f05480ce180 2024-04-14T23:34:14.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.087+0000 7f0546ffd640 1 -- 172.21.15.47:0/3706045483 >> v2:172.21.15.191:3300/0 conn(0x7f0548071e00 msgr2=0x7f0548166d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T23:34:14.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.087+0000 7f0546ffd640 1 --2- 172.21.15.47:0/3706045483 >> v2:172.21.15.191:3300/0 conn(0x7f0548071e00 0x7f0548166d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.087+0000 7f0546ffd640 1 -- 172.21.15.47:0/3706045483 >> v1:172.21.15.191:6789/0 conn(0x7f054815f9b0 legacy=0x7f0548141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:14.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.087+0000 7f0546ffd640 1 -- 172.21.15.47:0/3706045483 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05480ceab0 con 0x7f05480ce180 2024-04-14T23:34:14.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.087+0000 7f0546ffd640 1 -- 172.21.15.47:0/3706045483 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f0530001840 con 0x7f05480ce180 2024-04-14T23:34:14.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.087+0000 7f0546ffd640 1 -- 172.21.15.47:0/3706045483 >> v1:172.21.15.47:6789/0 conn(0x7f05480ce180 legacy=0x7f054815fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:14.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.088+0000 7f0546ffd640 1 --2- 172.21.15.47:0/3706045483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05340039b0 0x7f0534003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.088+0000 7f0546ffd640 1 --2- 172.21.15.47:0/3706045483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0534004800 0x7f0534004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.088+0000 7f0546ffd640 1 --2- 172.21.15.47:0/3706045483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05340052e0 0x7f053400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.088+0000 7f0546ffd640 1 -- 172.21.15.47:0/3706045483 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f05480cf3e0 con 0x7f0534004800 2024-04-14T23:34:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.088+0000 7f0546ffd640 1 -- 172.21.15.47:0/3706045483 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f053400c1b0 con 0x7f05340039b0 2024-04-14T23:34:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.088+0000 7f0546ffd640 1 -- 172.21.15.47:0/3706045483 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f053400c3b0 con 0x7f05340052e0 2024-04-14T23:34:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.088+0000 7f053effd640 1 --2- 172.21.15.47:0/3706045483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0534004800 0x7f0534004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.088+0000 7f0547fff640 1 --2- 172.21.15.47:0/3706045483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05340052e0 0x7f053400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.088+0000 7f05477fe640 1 --2- 172.21.15.47:0/3706045483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05340039b0 0x7f0534003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.088+0000 7f053effd640 1 -- 172.21.15.47:0/3706045483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05340052e0 msgr2=0x7f053400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.088+0000 7f053effd640 1 --2- 172.21.15.47:0/3706045483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05340052e0 0x7f053400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.088+0000 7f053effd640 1 -- 172.21.15.47:0/3706045483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05340039b0 msgr2=0x7f0534003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.088+0000 7f053effd640 1 --2- 172.21.15.47:0/3706045483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05340039b0 0x7f0534003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.088+0000 7f053effd640 1 -- 172.21.15.47:0/3706045483 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0534003520 con 0x7f0534004800 2024-04-14T23:34:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.088+0000 7f0547fff640 1 -- 172.21.15.47:0/3706045483 reap_dead start 2024-04-14T23:34:14.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.089+0000 7f053effd640 1 --2- 172.21.15.47:0/3706045483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0534004800 0x7f0534004c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f053000c490 tx=0x7f0534005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454c304404ba0d56 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:14.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.089+0000 7f0546ffd640 1 -- 172.21.15.47:0/3706045483 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053000c0e0 con 0x7f0534004800 2024-04-14T23:34:14.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.089+0000 7f0546ffd640 1 -- 172.21.15.47:0/3706045483 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0530030070 con 0x7f0534004800 2024-04-14T23:34:14.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.089+0000 7f0546ffd640 1 -- 172.21.15.47:0/3706045483 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05300058d0 con 0x7f0534004800 2024-04-14T23:34:14.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.090+0000 7f054dcc4640 1 -- 172.21.15.47:0/3706045483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0534004800 msgr2=0x7f0534004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:14.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.090+0000 7f054dcc4640 1 --2- 172.21.15.47:0/3706045483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0534004800 0x7f0534004c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f053000c490 tx=0x7f0534005830 comp rx=0 tx=0).stop 2024-04-14T23:34:14.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.090+0000 7f054dcc4640 1 -- 172.21.15.47:0/3706045483 shutdown_connections 2024-04-14T23:34:14.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.090+0000 7f054dcc4640 1 --2- 172.21.15.47:0/3706045483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0534004800 0x7f0534004c80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.090+0000 7f054dcc4640 1 -- 172.21.15.47:0/3706045483 >> 172.21.15.47:0/3706045483 conn(0x7f05480b1770 msgr2=0x7f05480b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.090+0000 7f054dcc4640 1 -- 172.21.15.47:0/3706045483 shutdown_connections 2024-04-14T23:34:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.090+0000 7f054dcc4640 1 -- 172.21.15.47:0/3706045483 wait complete. 2024-04-14T23:34:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.091+0000 7f054dcc4640 1 Processor -- start 2024-04-14T23:34:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.091+0000 7f054dcc4640 1 -- start start 2024-04-14T23:34:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f054dcc4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0534004800 0x7f054813e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f054dcc4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05481e7230 0x7f05481537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f054dcc4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05481594d0 0x7f0548159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f054dcc4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f054813f0d0 con 0x7f05481594d0 2024-04-14T23:34:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f054dcc4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f05480cf070 con 0x7f0534004800 2024-04-14T23:34:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f054dcc4640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f054813f250 con 0x7f05481e7230 2024-04-14T23:34:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f0547fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05481594d0 0x7f0548159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f0547fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05481594d0 0x7f0548159950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60124/0 (socket says 172.21.15.47:60124) 2024-04-14T23:34:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f0547fff640 1 -- 172.21.15.47:0/347843780 learned_addr learned my addr 172.21.15.47:0/347843780 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f05477fe640 1 --2- 172.21.15.47:0/347843780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0534004800 0x7f054813e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f053effd640 1 --2- 172.21.15.47:0/347843780 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05481e7230 0x7f05481537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f0547fff640 1 -- 172.21.15.47:0/347843780 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05481e7230 msgr2=0x7f05481537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f0547fff640 1 --2- 172.21.15.47:0/347843780 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05481e7230 0x7f05481537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f0547fff640 1 -- 172.21.15.47:0/347843780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0534004800 msgr2=0x7f054813e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f0547fff640 1 --2- 172.21.15.47:0/347843780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0534004800 0x7f054813e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f0547fff640 1 -- 172.21.15.47:0/347843780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0548159e90 con 0x7f05481594d0 2024-04-14T23:34:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f05477fe640 1 --2- 172.21.15.47:0/347843780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0534004800 0x7f054813e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f053effd640 1 --2- 172.21.15.47:0/347843780 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05481e7230 0x7f05481537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f0547fff640 1 --2- 172.21.15.47:0/347843780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05481594d0 0x7f0548159950 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0548072270 tx=0x7f054000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f0544ff9640 1 -- 172.21.15.47:0/347843780 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054001b070 con 0x7f05481594d0 2024-04-14T23:34:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f0544ff9640 1 -- 172.21.15.47:0/347843780 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0540003bd0 con 0x7f05481594d0 2024-04-14T23:34:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f0544ff9640 1 -- 172.21.15.47:0/347843780 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054000fe50 con 0x7f05481594d0 2024-04-14T23:34:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.092+0000 7f054dcc4640 1 -- 172.21.15.47:0/347843780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05481e77d0 con 0x7f05481594d0 2024-04-14T23:34:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.093+0000 7f054dcc4640 1 -- 172.21.15.47:0/347843780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05481e7d90 con 0x7f05481594d0 2024-04-14T23:34:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.093+0000 7f0544ff9640 1 -- 172.21.15.47:0/347843780 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f05400043c0 con 0x7f05481594d0 2024-04-14T23:34:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.093+0000 7f0544ff9640 1 -- 172.21.15.47:0/347843780 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0540014730 con 0x7f05481594d0 2024-04-14T23:34:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.093+0000 7f054dcc4640 1 -- 172.21.15.47:0/347843780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0548073f50 con 0x7f05481594d0 2024-04-14T23:34:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.096+0000 7f0544ff9640 1 -- 172.21.15.47:0/347843780 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f05400047f0 con 0x7f05481594d0 2024-04-14T23:34:14.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.165+0000 7f054dcc4640 1 -- 172.21.15.47:0/347843780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f05480d0600 con 0x7f05481594d0 2024-04-14T23:34:14.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.167+0000 7f0544ff9640 1 -- 172.21.15.47:0/347843780 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f0540014980 con 0x7f05481594d0 2024-04-14T23:34:14.169 INFO:teuthology.orchestra.run.smithi047.stderr:adjusted tunables profile to default 2024-04-14T23:34:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.168+0000 7f054dcc4640 1 -- 172.21.15.47:0/347843780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05481594d0 msgr2=0x7f0548159950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.168+0000 7f054dcc4640 1 --2- 172.21.15.47:0/347843780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05481594d0 0x7f0548159950 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0548072270 tx=0x7f054000f520 comp rx=0 tx=0).stop 2024-04-14T23:34:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.168+0000 7f054dcc4640 1 -- 172.21.15.47:0/347843780 shutdown_connections 2024-04-14T23:34:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.168+0000 7f054dcc4640 1 --2- 172.21.15.47:0/347843780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05481594d0 0x7f0548159950 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.168+0000 7f054dcc4640 1 --2- 172.21.15.47:0/347843780 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05481e7230 0x7f05481537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.168+0000 7f054dcc4640 1 --2- 172.21.15.47:0/347843780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0534004800 0x7f054813e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.168+0000 7f054dcc4640 1 -- 172.21.15.47:0/347843780 >> 172.21.15.47:0/347843780 conn(0x7f05480b1770 msgr2=0x7f054815f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:14.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.168+0000 7f054dcc4640 1 -- 172.21.15.47:0/347843780 shutdown_connections 2024-04-14T23:34:14.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:14.168+0000 7f054dcc4640 1 -- 172.21.15.47:0/347843780 wait complete. 2024-04-14T23:34:14.181 INFO:tasks.ceph:check_enable_crimson: False 2024-04-14T23:34:14.181 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-14T23:34:14.182 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:34:14.182 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-14T23:34:14.208 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:34:14.208 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-14T23:34:14.277 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:34:14.277 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-14T23:34:14.344 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:34:14.345 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-14T23:34:14.411 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:34:14.411 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-14T23:34:14.440 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:34:14.440 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-14T23:34:14.510 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:34:14.510 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-14T23:34:14.565 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:14.562+0000 7fcab564c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-14T23:34:14.571 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:14.569+0000 7f14d4242040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-14T23:34:14.579 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:34:14.579 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-14T23:34:14.621 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:14.618+0000 7fcab564c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-14T23:34:14.627 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:14.625+0000 7f14d4242040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-14T23:34:14.648 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 159e3b22-9f83-451b-bac4-25fdaab508e0 0 2024-04-14T23:34:14.791 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.788+0000 7f7adb91e640 1 Processor -- start 2024-04-14T23:34:14.792 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.788+0000 7f7adb91e640 1 -- start start 2024-04-14T23:34:14.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.789+0000 7f7adb91e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad4071dc0 0x7f7ad40721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:14.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.789+0000 7f7adb91e640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7ad406e380 0x7f7ad406e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:14.795 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.789+0000 7f7adb91e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ad40726e0 con 0x7f7ad40cec40 2024-04-14T23:34:14.796 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.789+0000 7f7adb91e640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f7ad406def0 con 0x7f7ad406e380 2024-04-14T23:34:14.796 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.789+0000 7f7adb91e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad40cc400 con 0x7f7ad4071dc0 2024-04-14T23:34:14.796 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.789+0000 7f7ad96ba640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad4071dc0 0x7f7ad40721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:14.796 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.789+0000 7f7ad9ebb640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7ad406e380 0x7f7ad406e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:14.796 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.789+0000 7f7ad9ebb640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7ad406e380 0x7f7ad406e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:57420/0 (socket says 172.21.15.191:57420) 2024-04-14T23:34:14.796 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.789+0000 7f7ad96ba640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad4071dc0 0x7f7ad40721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:39160/0 (socket says 172.21.15.191:39160) 2024-04-14T23:34:14.796 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.789+0000 7f7ad9ebb640 1 -- 172.21.15.191:0/4141753122 learned_addr learned my addr 172.21.15.191:0/4141753122 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-14T23:34:14.796 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.789+0000 7f7ad9ebb640 1 -- 172.21.15.191:0/4141753122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad4071dc0 msgr2=0x7f7ad40721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:14.796 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.789+0000 7f7ad9ebb640 1 --2- 172.21.15.191:0/4141753122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad4071dc0 0x7f7ad40721a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.797 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.789+0000 7f7ad9ebb640 1 -- 172.21.15.191:0/4141753122 >> v1:172.21.15.47:6789/0 conn(0x7f7ad40cec40 legacy=0x7f7ad40cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:14.797 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.789+0000 7f7ad9ebb640 1 -- 172.21.15.191:0/4141753122 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad40cc6e0 con 0x7f7ad406e380 2024-04-14T23:34:14.797 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.789+0000 7f7ad96ba640 1 --2- 172.21.15.191:0/4141753122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad4071dc0 0x7f7ad40721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:14.797 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.790+0000 7f7ad9ebb640 1 --2- 172.21.15.191:0/4141753122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ad406e380 0x7f7ad406e810 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00d150 tx=0x7f7acc02e0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4220ac23d5893730 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:14.797 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.790+0000 7f7acbfff640 1 -- 172.21.15.191:0/4141753122 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc02ea80 con 0x7f7ad406e380 2024-04-14T23:34:14.797 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.790+0000 7f7acbfff640 1 -- 172.21.15.191:0/4141753122 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7acc02ec20 con 0x7f7ad406e380 2024-04-14T23:34:14.797 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.790+0000 7f7acbfff640 1 -- 172.21.15.191:0/4141753122 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc009600 con 0x7f7ad406e380 2024-04-14T23:34:14.797 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.790+0000 7f7adb91e640 1 -- 172.21.15.191:0/4141753122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ad406e380 msgr2=0x7f7ad406e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:14.797 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.790+0000 7f7adb91e640 1 --2- 172.21.15.191:0/4141753122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ad406e380 0x7f7ad406e810 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00d150 tx=0x7f7acc02e0e0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.797 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.791+0000 7f7adb91e640 1 -- 172.21.15.191:0/4141753122 shutdown_connections 2024-04-14T23:34:14.798 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.791+0000 7f7adb91e640 1 --2- 172.21.15.191:0/4141753122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ad406e380 0x7f7ad406e810 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.798 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.791+0000 7f7adb91e640 1 --2- 172.21.15.191:0/4141753122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad4071dc0 0x7f7ad40721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.798 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.791+0000 7f7adb91e640 1 -- 172.21.15.191:0/4141753122 >> 172.21.15.191:0/4141753122 conn(0x7f7ad40d0c40 msgr2=0x7f7ad40d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:14.798 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.791+0000 7f7adb91e640 1 -- 172.21.15.191:0/4141753122 shutdown_connections 2024-04-14T23:34:14.798 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.791+0000 7f7adb91e640 1 -- 172.21.15.191:0/4141753122 wait complete. 2024-04-14T23:34:14.801 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.792+0000 7f7adb91e640 1 Processor -- start 2024-04-14T23:34:14.802 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.793+0000 7f7adb91e640 1 -- start start 2024-04-14T23:34:14.802 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7adb91e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad406e380 0x7f7ad40c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:14.802 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7adb91e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ad4071dc0 0x7f7ad41f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:14.802 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7adb91e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ad40cec40 0x7f7ad40b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:14.802 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7adb91e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad415b310 con 0x7f7ad4071dc0 2024-04-14T23:34:14.802 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7adb91e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad40ccca0 con 0x7f7ad40cec40 2024-04-14T23:34:14.802 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7adb91e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad40cc0a0 con 0x7f7ad406e380 2024-04-14T23:34:14.802 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7ad96ba640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad406e380 0x7f7ad40c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:14.802 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7ad96ba640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad406e380 0x7f7ad40c4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:39172/0 (socket says 172.21.15.191:39172) 2024-04-14T23:34:14.802 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7ad96ba640 1 -- 172.21.15.191:0/287399670 learned_addr learned my addr 172.21.15.191:0/287399670 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-14T23:34:14.803 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7ad9ebb640 1 --2- 172.21.15.191:0/287399670 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ad40cec40 0x7f7ad40b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:14.803 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7ad8eb9640 1 --2- 172.21.15.191:0/287399670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ad4071dc0 0x7f7ad41f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:14.803 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7ad9ebb640 1 -- 172.21.15.191:0/287399670 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad406e380 msgr2=0x7f7ad40c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:14.803 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7ad9ebb640 1 --2- 172.21.15.191:0/287399670 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad406e380 0x7f7ad40c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.803 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7ad9ebb640 1 -- 172.21.15.191:0/287399670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ad4071dc0 msgr2=0x7f7ad41f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:14.803 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7ad9ebb640 1 --2- 172.21.15.191:0/287399670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ad4071dc0 0x7f7ad41f35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.803 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7ad9ebb640 1 -- 172.21.15.191:0/287399670 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad41f4d90 con 0x7f7ad40cec40 2024-04-14T23:34:14.803 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7ad9ebb640 1 --2- 172.21.15.191:0/287399670 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ad40cec40 0x7f7ad40b4d60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7acc034000 tx=0x7f7acc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:14.803 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7ac9ffb640 1 -- 172.21.15.191:0/287399670 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc045020 con 0x7f7ad40cec40 2024-04-14T23:34:14.804 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7ac9ffb640 1 -- 172.21.15.191:0/287399670 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7acc009e50 con 0x7f7ad40cec40 2024-04-14T23:34:14.804 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7adb91e640 1 -- 172.21.15.191:0/287399670 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad41f4210 con 0x7f7ad40cec40 2024-04-14T23:34:14.804 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.794+0000 7f7ac9ffb640 1 -- 172.21.15.191:0/287399670 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc02ea80 con 0x7f7ad40cec40 2024-04-14T23:34:14.804 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.795+0000 7f7adb91e640 1 -- 172.21.15.191:0/287399670 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad41f47d0 con 0x7f7ad40cec40 2024-04-14T23:34:14.804 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.795+0000 7f7ac9ffb640 1 -- 172.21.15.191:0/287399670 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7acc048020 con 0x7f7ad40cec40 2024-04-14T23:34:14.804 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.795+0000 7f7ac9ffb640 1 -- 172.21.15.191:0/287399670 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f7acc04a700 con 0x7f7ad40cec40 2024-04-14T23:34:14.804 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.796+0000 7f7adb91e640 1 -- 172.21.15.191:0/287399670 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad40681f0 con 0x7f7ad40cec40 2024-04-14T23:34:14.804 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.798+0000 7f7ac9ffb640 1 -- 172.21.15.191:0/287399670 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7acc04f030 con 0x7f7ad40cec40 2024-04-14T23:34:14.874 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.870+0000 7f7adb91e640 1 -- 172.21.15.191:0/287399670 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd new", "uuid": "159e3b22-9f83-451b-bac4-25fdaab508e0", "id": 0} v 0) -- 0x7f7ad40c92c0 con 0x7f7ad40cec40 2024-04-14T23:34:14.877 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.873+0000 7f7ac9ffb640 1 -- 172.21.15.191:0/287399670 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "159e3b22-9f83-451b-bac4-25fdaab508e0", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f7acc04a950 con 0x7f7ad40cec40 2024-04-14T23:34:14.877 INFO:teuthology.orchestra.run.smithi191.stdout:0 2024-04-14T23:34:14.878 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.874+0000 7f7adb91e640 1 -- 172.21.15.191:0/287399670 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ad40cec40 msgr2=0x7f7ad40b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:14.878 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.874+0000 7f7adb91e640 1 --2- 172.21.15.191:0/287399670 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ad40cec40 0x7f7ad40b4d60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7acc034000 tx=0x7f7acc004a40 comp rx=0 tx=0).stop 2024-04-14T23:34:14.878 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.874+0000 7f7adb91e640 1 -- 172.21.15.191:0/287399670 shutdown_connections 2024-04-14T23:34:14.879 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.874+0000 7f7adb91e640 1 --2- 172.21.15.191:0/287399670 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ad40cec40 0x7f7ad40b4d60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.879 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.874+0000 7f7adb91e640 1 --2- 172.21.15.191:0/287399670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ad4071dc0 0x7f7ad41f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.879 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.874+0000 7f7adb91e640 1 --2- 172.21.15.191:0/287399670 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad406e380 0x7f7ad40c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:14.879 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.874+0000 7f7adb91e640 1 -- 172.21.15.191:0/287399670 >> 172.21.15.191:0/287399670 conn(0x7f7ad40d0c40 msgr2=0x7f7ad40d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:14.879 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.874+0000 7f7adb91e640 1 -- 172.21.15.191:0/287399670 shutdown_connections 2024-04-14T23:34:14.879 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.874+0000 7f7adb91e640 1 -- 172.21.15.191:0/287399670 wait complete. 2024-04-14T23:34:14.888 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 8833077b-5072-40e7-8944-cf46f9b92f49 1 2024-04-14T23:34:14.991 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.987+0000 7f32b2f5d640 1 Processor -- start 2024-04-14T23:34:14.991 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.987+0000 7f32b2f5d640 1 -- start start 2024-04-14T23:34:14.992 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.988+0000 7f32b2f5d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32ac0ce810 0x7f32ac0cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:14.992 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.988+0000 7f32b2f5d640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ac0d0580 con 0x7f32ac06b200 2024-04-14T23:34:14.992 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.988+0000 7f32b2f5d640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ac0d0860 con 0x7f32ac0b02e0 2024-04-14T23:34:14.992 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.988+0000 7f32b2f5d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f32ac0cbee0 con 0x7f32ac0ce810 2024-04-14T23:34:14.993 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.988+0000 7f32b14fa640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32ac0ce810 0x7f32ac0cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:14.993 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.988+0000 7f32abfff640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f32ac0b02e0 0x7f32ac0cb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:56680/0 (socket says 172.21.15.191:56680) 2024-04-14T23:34:14.993 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.988+0000 7f32abfff640 1 -- 172.21.15.191:0/2513236198 learned_addr learned my addr 172.21.15.191:0/2513236198 (peer_addr_for_me v1:172.21.15.191:0/0) 2024-04-14T23:34:14.993 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.988+0000 7f32b14fa640 1 -- 172.21.15.191:0/2513236198 >> v1:172.21.15.191:6789/0 conn(0x7f32ac0b02e0 legacy=0x7f32ac0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:14.993 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.988+0000 7f32b14fa640 1 -- 172.21.15.191:0/2513236198 >> v1:172.21.15.47:6789/0 conn(0x7f32ac06b200 legacy=0x7f32ac06b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:14.993 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.988+0000 7f32ab7fe640 1 -- 172.21.15.191:0/2513236198 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 978297590 0 0) 0x7f32ac0d0860 con 0x7f32ac0b02e0 2024-04-14T23:34:14.993 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.988+0000 7f32b14fa640 1 -- 172.21.15.191:0/2513236198 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ac071f60 con 0x7f32ac0ce810 2024-04-14T23:34:14.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.989+0000 7f32b14fa640 1 --2- 172.21.15.191:0/2513236198 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32ac0ce810 0x7f32ac0cb9a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f329c0097d0 tx=0x7f329c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=689c37ee2dc866c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:14.999 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.989+0000 7f32ab7fe640 1 -- 172.21.15.191:0/2513236198 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c035020 con 0x7f32ac0ce810 2024-04-14T23:34:15.000 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.989+0000 7f32ab7fe640 1 -- 172.21.15.191:0/2513236198 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c031890 con 0x7f32ac0ce810 2024-04-14T23:34:15.000 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.989+0000 7f32ab7fe640 1 -- 172.21.15.191:0/2513236198 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c031c60 con 0x7f32ac0ce810 2024-04-14T23:34:15.000 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.990+0000 7f32b2f5d640 1 -- 172.21.15.191:0/2513236198 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32ac0ce810 msgr2=0x7f32ac0cb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.000 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.990+0000 7f32b2f5d640 1 --2- 172.21.15.191:0/2513236198 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32ac0ce810 0x7f32ac0cb9a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f329c0097d0 tx=0x7f329c02b930 comp rx=0 tx=0).stop 2024-04-14T23:34:15.000 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.990+0000 7f32b2f5d640 1 -- 172.21.15.191:0/2513236198 shutdown_connections 2024-04-14T23:34:15.000 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.990+0000 7f32b2f5d640 1 --2- 172.21.15.191:0/2513236198 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32ac0ce810 0x7f32ac0cb9a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.000 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.990+0000 7f32b2f5d640 1 -- 172.21.15.191:0/2513236198 >> 172.21.15.191:0/2513236198 conn(0x7f32ac0d0c40 msgr2=0x7f32ac0d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:15.000 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.990+0000 7f32b2f5d640 1 -- 172.21.15.191:0/2513236198 shutdown_connections 2024-04-14T23:34:15.000 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.990+0000 7f32b2f5d640 1 -- 172.21.15.191:0/2513236198 wait complete. 2024-04-14T23:34:15.001 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.991+0000 7f32b2f5d640 1 Processor -- start 2024-04-14T23:34:15.001 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.991+0000 7f32b2f5d640 1 -- start start 2024-04-14T23:34:15.001 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.992+0000 7f32b2f5d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32ac06b200 0x7f32ac0c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.001 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.992+0000 7f32b2f5d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32ac0b02e0 0x7f32ac0c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.001 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.992+0000 7f32b2f5d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32ac0ce810 0x7f32ac0c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.001 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.992+0000 7f32b2f5d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac0ccae0 con 0x7f32ac06b200 2024-04-14T23:34:15.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.992+0000 7f32b2f5d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac0722d0 con 0x7f32ac0b02e0 2024-04-14T23:34:15.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.992+0000 7f32b2f5d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f32ac0ccc60 con 0x7f32ac0ce810 2024-04-14T23:34:15.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.992+0000 7f32abfff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32ac0b02e0 0x7f32ac0c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.992+0000 7f32b14fa640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32ac0ce810 0x7f32ac0c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.992+0000 7f32abfff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32ac0b02e0 0x7f32ac0c7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:57434/0 (socket says 172.21.15.191:57434) 2024-04-14T23:34:15.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.992+0000 7f32b14fa640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32ac0ce810 0x7f32ac0c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:39186/0 (socket says 172.21.15.191:39186) 2024-04-14T23:34:15.002 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.992+0000 7f32abfff640 1 -- 172.21.15.191:0/3453966304 learned_addr learned my addr 172.21.15.191:0/3453966304 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-14T23:34:15.003 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.992+0000 7f32b0cf9640 1 --2- 172.21.15.191:0/3453966304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32ac06b200 0x7f32ac0c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.003 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.993+0000 7f32b14fa640 1 -- 172.21.15.191:0/3453966304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32ac0b02e0 msgr2=0x7f32ac0c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.003 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.993+0000 7f32b14fa640 1 --2- 172.21.15.191:0/3453966304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32ac0b02e0 0x7f32ac0c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.003 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.993+0000 7f32b14fa640 1 -- 172.21.15.191:0/3453966304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32ac06b200 msgr2=0x7f32ac0c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.003 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.993+0000 7f32b14fa640 1 --2- 172.21.15.191:0/3453966304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32ac06b200 0x7f32ac0c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.003 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.993+0000 7f32b14fa640 1 -- 172.21.15.191:0/3453966304 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ac0c8940 con 0x7f32ac0ce810 2024-04-14T23:34:15.004 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.993+0000 7f32b14fa640 1 --2- 172.21.15.191:0/3453966304 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32ac0ce810 0x7f32ac0c8250 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f329c033000 tx=0x7f329c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:15.004 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.993+0000 7f32a97fa640 1 -- 172.21.15.191:0/3453966304 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c035040 con 0x7f32ac0ce810 2024-04-14T23:34:15.004 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.993+0000 7f32a97fa640 1 -- 172.21.15.191:0/3453966304 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c046480 con 0x7f32ac0ce810 2024-04-14T23:34:15.004 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.993+0000 7f32b2f5d640 1 -- 172.21.15.191:0/3453966304 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ac0c8c20 con 0x7f32ac0ce810 2024-04-14T23:34:15.004 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.993+0000 7f32a97fa640 1 -- 172.21.15.191:0/3453966304 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c030e60 con 0x7f32ac0ce810 2024-04-14T23:34:15.004 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.993+0000 7f32b2f5d640 1 -- 172.21.15.191:0/3453966304 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ac0c48a0 con 0x7f32ac0ce810 2024-04-14T23:34:15.004 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.993+0000 7f32a97fa640 1 -- 172.21.15.191:0/3453966304 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f329c038020 con 0x7f32ac0ce810 2024-04-14T23:34:15.004 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.993+0000 7f32a97fa640 1 -- 172.21.15.191:0/3453966304 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f329c03b930 con 0x7f32ac0ce810 2024-04-14T23:34:15.004 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.994+0000 7f32b2f5d640 1 -- 172.21.15.191:0/3453966304 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ac0681f0 con 0x7f32ac0ce810 2024-04-14T23:34:15.005 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:14.996+0000 7f32a97fa640 1 -- 172.21.15.191:0/3453966304 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f329c02d040 con 0x7f32ac0ce810 2024-04-14T23:34:15.071 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.067+0000 7f32b2f5d640 1 -- 172.21.15.191:0/3453966304 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8833077b-5072-40e7-8944-cf46f9b92f49", "id": 1} v 0) -- 0x7f32ac0c4550 con 0x7f32ac0ce810 2024-04-14T23:34:15.074 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.070+0000 7f32a97fa640 1 -- 172.21.15.191:0/3453966304 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8833077b-5072-40e7-8944-cf46f9b92f49", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f329c031820 con 0x7f32ac0ce810 2024-04-14T23:34:15.074 INFO:teuthology.orchestra.run.smithi191.stdout:1 2024-04-14T23:34:15.075 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.071+0000 7f32b2f5d640 1 -- 172.21.15.191:0/3453966304 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32ac0ce810 msgr2=0x7f32ac0c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.075 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.071+0000 7f32b2f5d640 1 --2- 172.21.15.191:0/3453966304 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32ac0ce810 0x7f32ac0c8250 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f329c033000 tx=0x7f329c0046c0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.075 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.071+0000 7f32b2f5d640 1 -- 172.21.15.191:0/3453966304 shutdown_connections 2024-04-14T23:34:15.075 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.071+0000 7f32b2f5d640 1 --2- 172.21.15.191:0/3453966304 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32ac0ce810 0x7f32ac0c8250 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.075 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.071+0000 7f32b2f5d640 1 --2- 172.21.15.191:0/3453966304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32ac0b02e0 0x7f32ac0c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.075 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.071+0000 7f32b2f5d640 1 --2- 172.21.15.191:0/3453966304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32ac06b200 0x7f32ac0c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.075 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.071+0000 7f32b2f5d640 1 -- 172.21.15.191:0/3453966304 >> 172.21.15.191:0/3453966304 conn(0x7f32ac0d0c40 msgr2=0x7f32ac1e54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:15.076 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.072+0000 7f32b2f5d640 1 -- 172.21.15.191:0/3453966304 shutdown_connections 2024-04-14T23:34:15.076 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.072+0000 7f32b2f5d640 1 -- 172.21.15.191:0/3453966304 wait complete. 2024-04-14T23:34:15.086 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 793bed0d-8bfc-4f11-964c-910e5bd1b0a6 2 2024-04-14T23:34:15.175 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:15.173+0000 7f14d4242040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-14T23:34:15.189 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.185+0000 7f38d0236640 1 Processor -- start 2024-04-14T23:34:15.189 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.185+0000 7f38d0236640 1 -- start start 2024-04-14T23:34:15.190 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.186+0000 7f38d0236640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f38c80ced50 0x7f38c80d2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.190 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.186+0000 7f38d0236640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38c80cf840 0x7f38c80cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.186+0000 7f38d0236640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38c80cc7f0 con 0x7f38c815c080 2024-04-14T23:34:15.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.186+0000 7f38d0236640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f38c80cfd40 con 0x7f38c80ced50 2024-04-14T23:34:15.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.186+0000 7f38d0236640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f38c80cca90 con 0x7f38c80cf840 2024-04-14T23:34:15.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.186+0000 7f38ce7d3640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38c80cf840 0x7f38c80cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.186+0000 7f38ce7d3640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38c80cf840 0x7f38c80cd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:39202/0 (socket says 172.21.15.191:39202) 2024-04-14T23:34:15.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.186+0000 7f38ce7d3640 1 -- 172.21.15.191:0/1776763689 learned_addr learned my addr 172.21.15.191:0/1776763689 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-14T23:34:15.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.186+0000 7f38cd7d1640 1 --2- 172.21.15.191:0/1776763689 >> v2:172.21.15.47:3300/0 conn(0x7f38c80ced50 0x7f38c80d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.187+0000 7f38ce7d3640 1 -- 172.21.15.191:0/1776763689 >> v2:172.21.15.47:3300/0 conn(0x7f38c80ced50 msgr2=0x7f38c80d2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:15.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.187+0000 7f38ce7d3640 1 --2- 172.21.15.191:0/1776763689 >> v2:172.21.15.47:3300/0 conn(0x7f38c80ced50 0x7f38c80d2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.187+0000 7f38ce7d3640 1 -- 172.21.15.191:0/1776763689 >> v1:172.21.15.47:6789/0 conn(0x7f38c815c080 legacy=0x7f38c80ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.191 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.187+0000 7f38ce7d3640 1 -- 172.21.15.191:0/1776763689 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c80ccd70 con 0x7f38c80cf840 2024-04-14T23:34:15.191 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:15.187+0000 7fcab564c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-14T23:34:15.193 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.187+0000 7f38ce7d3640 1 --2- 172.21.15.191:0/1776763689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38c80cf840 0x7f38c80cd850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009e50 tx=0x7f38c002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9106b13458c6719 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:15.193 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.187+0000 7f38ccfd0640 1 -- 172.21.15.191:0/1776763689 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c002cb00 con 0x7f38c80cf840 2024-04-14T23:34:15.193 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.188+0000 7f38ccfd0640 1 -- 172.21.15.191:0/1776763689 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c002cca0 con 0x7f38c80cf840 2024-04-14T23:34:15.193 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.188+0000 7f38ccfd0640 1 -- 172.21.15.191:0/1776763689 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c0034610 con 0x7f38c80cf840 2024-04-14T23:34:15.193 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.188+0000 7f38d0236640 1 -- 172.21.15.191:0/1776763689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38c80cf840 msgr2=0x7f38c80cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.193 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.188+0000 7f38d0236640 1 --2- 172.21.15.191:0/1776763689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38c80cf840 0x7f38c80cd850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009e50 tx=0x7f38c002bf60 comp rx=0 tx=0).stop 2024-04-14T23:34:15.193 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.188+0000 7f38d0236640 1 -- 172.21.15.191:0/1776763689 shutdown_connections 2024-04-14T23:34:15.193 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.188+0000 7f38d0236640 1 --2- 172.21.15.191:0/1776763689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38c80cf840 0x7f38c80cd850 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.193 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.188+0000 7f38d0236640 1 --2- 172.21.15.191:0/1776763689 >> v2:172.21.15.47:3300/0 conn(0x7f38c80ced50 0x7f38c80d2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.193 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.188+0000 7f38d0236640 1 -- 172.21.15.191:0/1776763689 >> 172.21.15.191:0/1776763689 conn(0x7f38c80d1c70 msgr2=0x7f38c80d2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:15.193 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.188+0000 7f38d0236640 1 -- 172.21.15.191:0/1776763689 shutdown_connections 2024-04-14T23:34:15.193 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.188+0000 7f38d0236640 1 -- 172.21.15.191:0/1776763689 wait complete. 2024-04-14T23:34:15.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.189+0000 7f38d0236640 1 Processor -- start 2024-04-14T23:34:15.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.189+0000 7f38d0236640 1 -- start start 2024-04-14T23:34:15.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.190+0000 7f38d0236640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38c80ced50 0x7f38c806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.190+0000 7f38d0236640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38c80cf840 0x7f38c815a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.190+0000 7f38d0236640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38c815c080 0x7f38c80b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.190+0000 7f38d0236640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f38c815c460 con 0x7f38c815c080 2024-04-14T23:34:15.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.190+0000 7f38d0236640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f38c80cd330 con 0x7f38c80ced50 2024-04-14T23:34:15.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.190+0000 7f38d0236640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f38c80b0d80 con 0x7f38c80cf840 2024-04-14T23:34:15.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.190+0000 7f38cd7d1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38c80cf840 0x7f38c815a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.190+0000 7f38cdfd2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38c80ced50 0x7f38c806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.190+0000 7f38cd7d1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38c80cf840 0x7f38c815a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:39216/0 (socket says 172.21.15.191:39216) 2024-04-14T23:34:15.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.190+0000 7f38cdfd2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38c80ced50 0x7f38c806ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:57442/0 (socket says 172.21.15.191:57442) 2024-04-14T23:34:15.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.190+0000 7f38cd7d1640 1 -- 172.21.15.191:0/863381973 learned_addr learned my addr 172.21.15.191:0/863381973 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-14T23:34:15.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.190+0000 7f38ce7d3640 1 --2- 172.21.15.191:0/863381973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38c815c080 0x7f38c80b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.191+0000 7f38cdfd2640 1 -- 172.21.15.191:0/863381973 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38c80cf840 msgr2=0x7f38c815a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.191+0000 7f38cdfd2640 1 --2- 172.21.15.191:0/863381973 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38c80cf840 0x7f38c815a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.191+0000 7f38cdfd2640 1 -- 172.21.15.191:0/863381973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38c815c080 msgr2=0x7f38c80b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.191+0000 7f38cdfd2640 1 --2- 172.21.15.191:0/863381973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38c815c080 0x7f38c80b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.191+0000 7f38cdfd2640 1 -- 172.21.15.191:0/863381973 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c80b7590 con 0x7f38c80ced50 2024-04-14T23:34:15.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.191+0000 7f38cd7d1640 1 --2- 172.21.15.191:0/863381973 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38c80cf840 0x7f38c815a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:15.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.191+0000 7f38ce7d3640 1 --2- 172.21.15.191:0/863381973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38c815c080 0x7f38c80b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:15.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.191+0000 7f38cdfd2640 1 --2- 172.21.15.191:0/863381973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38c80ced50 0x7f38c806ccd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f38c400c340 tx=0x7f38c400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:15.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.191+0000 7f38be7fc640 1 -- 172.21.15.191:0/863381973 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c40052d0 con 0x7f38c80ced50 2024-04-14T23:34:15.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.191+0000 7f38be7fc640 1 -- 172.21.15.191:0/863381973 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c4005490 con 0x7f38c80ced50 2024-04-14T23:34:15.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.191+0000 7f38d0236640 1 -- 172.21.15.191:0/863381973 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c80b3ae0 con 0x7f38c80ced50 2024-04-14T23:34:15.198 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.191+0000 7f38be7fc640 1 -- 172.21.15.191:0/863381973 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4007260 con 0x7f38c80ced50 2024-04-14T23:34:15.198 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.191+0000 7f38d0236640 1 -- 172.21.15.191:0/863381973 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c806df70 con 0x7f38c80ced50 2024-04-14T23:34:15.198 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.191+0000 7f38be7fc640 1 -- 172.21.15.191:0/863381973 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f38c4007400 con 0x7f38c80ced50 2024-04-14T23:34:15.198 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.191+0000 7f38be7fc640 1 -- 172.21.15.191:0/863381973 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f38c4011590 con 0x7f38c80ced50 2024-04-14T23:34:15.198 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.192+0000 7f38d0236640 1 -- 172.21.15.191:0/863381973 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c80681f0 con 0x7f38c80ced50 2024-04-14T23:34:15.198 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.194+0000 7f38be7fc640 1 -- 172.21.15.191:0/863381973 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f38c4003aa0 con 0x7f38c80ced50 2024-04-14T23:34:15.231 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:15.229+0000 7f14d4242040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-14T23:34:15.248 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:15.244+0000 7fcab564c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-14T23:34:15.270 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.266+0000 7f38d0236640 1 -- 172.21.15.191:0/863381973 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd new", "uuid": "793bed0d-8bfc-4f11-964c-910e5bd1b0a6", "id": 2} v 0) -- 0x7f38c80ce690 con 0x7f38c80ced50 2024-04-14T23:34:15.273 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.270+0000 7f38be7fc640 1 -- 172.21.15.191:0/863381973 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "793bed0d-8bfc-4f11-964c-910e5bd1b0a6", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f38c4003610 con 0x7f38c80ced50 2024-04-14T23:34:15.273 INFO:teuthology.orchestra.run.smithi191.stdout:2 2024-04-14T23:34:15.275 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.271+0000 7f38d0236640 1 -- 172.21.15.191:0/863381973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38c80ced50 msgr2=0x7f38c806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.275 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.271+0000 7f38d0236640 1 --2- 172.21.15.191:0/863381973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38c80ced50 0x7f38c806ccd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f38c400c340 tx=0x7f38c400c800 comp rx=0 tx=0).stop 2024-04-14T23:34:15.275 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.271+0000 7f38d0236640 1 -- 172.21.15.191:0/863381973 shutdown_connections 2024-04-14T23:34:15.275 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.271+0000 7f38d0236640 1 --2- 172.21.15.191:0/863381973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38c815c080 0x7f38c80b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.275 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.271+0000 7f38d0236640 1 --2- 172.21.15.191:0/863381973 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38c80cf840 0x7f38c815a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.275 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.271+0000 7f38d0236640 1 --2- 172.21.15.191:0/863381973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38c80ced50 0x7f38c806ccd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.275 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.271+0000 7f38d0236640 1 -- 172.21.15.191:0/863381973 >> 172.21.15.191:0/863381973 conn(0x7f38c80d1c70 msgr2=0x7f38c80cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:15.275 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.271+0000 7f38d0236640 1 -- 172.21.15.191:0/863381973 shutdown_connections 2024-04-14T23:34:15.275 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.271+0000 7f38d0236640 1 -- 172.21.15.191:0/863381973 wait complete. 2024-04-14T23:34:15.279 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:15.276+0000 7f14d4242040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-14T23:34:15.285 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new fb724059-a31c-464b-95a7-52ed0f16ac0f 3 2024-04-14T23:34:15.295 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:15.292+0000 7fcab564c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-14T23:34:15.334 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:15.331+0000 7f14d4242040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-14T23:34:15.352 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:15.349+0000 7fcab564c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-14T23:34:15.378 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:15.375+0000 7f14d4242040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-14T23:34:15.386 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.383+0000 7ff657cb0640 1 Processor -- start 2024-04-14T23:34:15.386 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.383+0000 7ff657cb0640 1 -- start start 2024-04-14T23:34:15.388 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.384+0000 7ff657cb0640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff65015e240 0x7ff6500ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.388 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.384+0000 7ff657cb0640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6500ced50 con 0x7ff65006b910 2024-04-14T23:34:15.388 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.384+0000 7ff657cb0640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff65006f530 con 0x7ff650072cd0 2024-04-14T23:34:15.388 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.384+0000 7ff657cb0640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7ff6500d0580 con 0x7ff65015e240 2024-04-14T23:34:15.388 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.384+0000 7ff655a4c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff65015e240 0x7ff6500ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.388 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.384+0000 7ff65524b640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7ff650072cd0 0x7ff65006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:56688/0 (socket says 172.21.15.191:56688) 2024-04-14T23:34:15.388 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.384+0000 7ff655a4c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff65015e240 0x7ff6500ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:57458/0 (socket says 172.21.15.191:57458) 2024-04-14T23:34:15.388 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.384+0000 7ff65524b640 1 -- 172.21.15.191:0/3946365356 learned_addr learned my addr 172.21.15.191:0/3946365356 (peer_addr_for_me v1:172.21.15.191:0/0) 2024-04-14T23:34:15.388 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.384+0000 7ff655a4c640 1 -- 172.21.15.191:0/3946365356 >> v1:172.21.15.191:6789/0 conn(0x7ff650072cd0 legacy=0x7ff65006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.388 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.384+0000 7ff655a4c640 1 -- 172.21.15.191:0/3946365356 >> v1:172.21.15.47:6789/0 conn(0x7ff65006b910 legacy=0x7ff6500cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.388 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.384+0000 7ff655a4c640 1 -- 172.21.15.191:0/3946365356 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6500d0860 con 0x7ff65015e240 2024-04-14T23:34:15.389 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.385+0000 7ff655a4c640 1 --2- 172.21.15.191:0/3946365356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff65015e240 0x7ff6500ce810 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff6400097a0 tx=0x7ff64002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3ca26652a1831ed server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:15.390 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.385+0000 7ff654a4a640 1 -- 172.21.15.191:0/3946365356 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640035020 con 0x7ff65015e240 2024-04-14T23:34:15.390 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.385+0000 7ff654a4a640 1 -- 172.21.15.191:0/3946365356 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff640031830 con 0x7ff65015e240 2024-04-14T23:34:15.390 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.385+0000 7ff654a4a640 1 -- 172.21.15.191:0/3946365356 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640031c00 con 0x7ff65015e240 2024-04-14T23:34:15.390 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.386+0000 7ff657cb0640 1 -- 172.21.15.191:0/3946365356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff65015e240 msgr2=0x7ff6500ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.390 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.386+0000 7ff657cb0640 1 --2- 172.21.15.191:0/3946365356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff65015e240 0x7ff6500ce810 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff6400097a0 tx=0x7ff64002b8d0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.390 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.386+0000 7ff657cb0640 1 -- 172.21.15.191:0/3946365356 shutdown_connections 2024-04-14T23:34:15.390 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.386+0000 7ff657cb0640 1 --2- 172.21.15.191:0/3946365356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff65015e240 0x7ff6500ce810 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.390 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.386+0000 7ff657cb0640 1 -- 172.21.15.191:0/3946365356 >> 172.21.15.191:0/3946365356 conn(0x7ff6500d0c40 msgr2=0x7ff6500d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:15.390 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.386+0000 7ff657cb0640 1 -- 172.21.15.191:0/3946365356 shutdown_connections 2024-04-14T23:34:15.390 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.386+0000 7ff657cb0640 1 -- 172.21.15.191:0/3946365356 wait complete. 2024-04-14T23:34:15.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.387+0000 7ff657cb0640 1 Processor -- start 2024-04-14T23:34:15.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.387+0000 7ff657cb0640 1 -- start start 2024-04-14T23:34:15.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff657cb0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff65006b910 0x7ff650160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff657cb0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff650072cd0 0x7ff6500ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.393 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff657cb0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff65015e240 0x7ff650147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff657cb0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff65006f190 con 0x7ff650072cd0 2024-04-14T23:34:15.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff657cb0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff65015e620 con 0x7ff65006b910 2024-04-14T23:34:15.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff657cb0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff65006f310 con 0x7ff65015e240 2024-04-14T23:34:15.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff655a4c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff65006b910 0x7ff650160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff65624d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff65015e240 0x7ff650147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff655a4c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff65006b910 0x7ff650160ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:57466/0 (socket says 172.21.15.191:57466) 2024-04-14T23:34:15.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff655a4c640 1 -- 172.21.15.191:0/3015373608 learned_addr learned my addr 172.21.15.191:0/3015373608 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-14T23:34:15.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff65524b640 1 --2- 172.21.15.191:0/3015373608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff650072cd0 0x7ff6500ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff655a4c640 1 -- 172.21.15.191:0/3015373608 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff65015e240 msgr2=0x7ff650147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff655a4c640 1 --2- 172.21.15.191:0/3015373608 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff65015e240 0x7ff650147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff655a4c640 1 -- 172.21.15.191:0/3015373608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff650072cd0 msgr2=0x7ff6500ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff655a4c640 1 --2- 172.21.15.191:0/3015373608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff650072cd0 0x7ff6500ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff655a4c640 1 -- 172.21.15.191:0/3015373608 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff650160220 con 0x7ff65006b910 2024-04-14T23:34:15.394 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff655a4c640 1 --2- 172.21.15.191:0/3015373608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff65006b910 0x7ff650160ce0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff640000c00 tx=0x7ff6400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:15.395 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff6467fc640 1 -- 172.21.15.191:0/3015373608 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640040070 con 0x7ff65006b910 2024-04-14T23:34:15.395 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff6467fc640 1 -- 172.21.15.191:0/3015373608 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff640039a00 con 0x7ff65006b910 2024-04-14T23:34:15.395 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.388+0000 7ff657cb0640 1 -- 172.21.15.191:0/3015373608 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6501584c0 con 0x7ff65006b910 2024-04-14T23:34:15.395 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.389+0000 7ff6467fc640 1 -- 172.21.15.191:0/3015373608 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640035040 con 0x7ff65006b910 2024-04-14T23:34:15.395 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.389+0000 7ff657cb0640 1 -- 172.21.15.191:0/3015373608 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6501604e0 con 0x7ff65006b910 2024-04-14T23:34:15.395 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.389+0000 7ff6467fc640 1 -- 172.21.15.191:0/3015373608 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff64004b060 con 0x7ff65006b910 2024-04-14T23:34:15.395 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.389+0000 7ff6467fc640 1 -- 172.21.15.191:0/3015373608 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7ff64003a8b0 con 0x7ff65006b910 2024-04-14T23:34:15.395 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.389+0000 7ff657cb0640 1 -- 172.21.15.191:0/3015373608 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6500d1940 con 0x7ff65006b910 2024-04-14T23:34:15.395 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.391+0000 7ff6467fc640 1 -- 172.21.15.191:0/3015373608 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff6500d1940 con 0x7ff65006b910 2024-04-14T23:34:15.398 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:15.395+0000 7fcab564c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-14T23:34:15.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.464+0000 7ff657cb0640 1 -- 172.21.15.191:0/3015373608 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fb724059-a31c-464b-95a7-52ed0f16ac0f", "id": 3} v 0) -- 0x7ff6500681f0 con 0x7ff65006b910 2024-04-14T23:34:15.470 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.467+0000 7ff6467fc640 1 -- 172.21.15.191:0/3015373608 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb724059-a31c-464b-95a7-52ed0f16ac0f", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7ff64003ab90 con 0x7ff65006b910 2024-04-14T23:34:15.470 INFO:teuthology.orchestra.run.smithi191.stdout:3 2024-04-14T23:34:15.471 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.468+0000 7ff657cb0640 1 -- 172.21.15.191:0/3015373608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff65006b910 msgr2=0x7ff650160ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.471 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.468+0000 7ff657cb0640 1 --2- 172.21.15.191:0/3015373608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff65006b910 0x7ff650160ce0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff640000c00 tx=0x7ff6400046c0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.472 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.468+0000 7ff657cb0640 1 -- 172.21.15.191:0/3015373608 shutdown_connections 2024-04-14T23:34:15.472 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.468+0000 7ff657cb0640 1 --2- 172.21.15.191:0/3015373608 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff65015e240 0x7ff650147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.472 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.468+0000 7ff657cb0640 1 --2- 172.21.15.191:0/3015373608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff650072cd0 0x7ff6500ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.472 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.468+0000 7ff657cb0640 1 --2- 172.21.15.191:0/3015373608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff65006b910 0x7ff650160ce0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.472 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.468+0000 7ff657cb0640 1 -- 172.21.15.191:0/3015373608 >> 172.21.15.191:0/3015373608 conn(0x7ff6500d0c40 msgr2=0x7ff6500b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:15.472 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.468+0000 7ff657cb0640 1 -- 172.21.15.191:0/3015373608 shutdown_connections 2024-04-14T23:34:15.472 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.468+0000 7ff657cb0640 1 -- 172.21.15.191:0/3015373608 wait complete. 2024-04-14T23:34:15.481 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b 4 2024-04-14T23:34:15.499 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:15.496+0000 7f14d4242040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-14T23:34:15.519 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:15.516+0000 7fcab564c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-14T23:34:15.572 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:15.569+0000 7f14d4242040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-14T23:34:15.593 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:15.590+0000 7fcab564c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-14T23:34:15.619 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:15.617+0000 7f14d4242040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-14T23:34:15.620 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.617+0000 7fec7d511640 1 Processor -- start 2024-04-14T23:34:15.620 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.617+0000 7fec7d511640 1 -- start start 2024-04-14T23:34:15.622 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.618+0000 7fec7d511640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fec78160330 0x7fec78166f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.622 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.618+0000 7fec7d511640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec7815f9b0 con 0x7fec780d0ac0 2024-04-14T23:34:15.622 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.618+0000 7fec7d511640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec780cfa20 con 0x7fec7815f5d0 2024-04-14T23:34:15.622 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.618+0000 7fec7d511640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fec780cfd00 con 0x7fec78160330 2024-04-14T23:34:15.622 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.618+0000 7fec76ffd640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fec7815f5d0 0x7fec780cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:56694/0 (socket says 172.21.15.191:56694) 2024-04-14T23:34:15.622 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.618+0000 7fec76ffd640 1 -- 172.21.15.191:0/2032569359 learned_addr learned my addr 172.21.15.191:0/2032569359 (peer_addr_for_me v1:172.21.15.191:0/0) 2024-04-14T23:34:15.622 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.618+0000 7fec777fe640 1 --2- 172.21.15.191:0/2032569359 >> v2:172.21.15.47:3300/0 conn(0x7fec78160330 0x7fec78166f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.622 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.618+0000 7fec75ffb640 1 -- 172.21.15.191:0/2032569359 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3284739463 0 0) 0x7fec780cfa20 con 0x7fec7815f5d0 2024-04-14T23:34:15.622 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.618+0000 7fec75ffb640 1 -- 172.21.15.191:0/2032569359 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec60003520 con 0x7fec7815f5d0 2024-04-14T23:34:15.622 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.618+0000 7fec777fe640 1 -- 172.21.15.191:0/2032569359 >> v1:172.21.15.191:6789/0 conn(0x7fec7815f5d0 legacy=0x7fec780cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.623 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.618+0000 7fec777fe640 1 -- 172.21.15.191:0/2032569359 >> v1:172.21.15.47:6789/0 conn(0x7fec780d0ac0 legacy=0x7fec7815fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.623 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.618+0000 7fec777fe640 1 -- 172.21.15.191:0/2032569359 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec780cffe0 con 0x7fec78160330 2024-04-14T23:34:15.624 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.619+0000 7fec777fe640 1 --2- 172.21.15.191:0/2032569359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec78160330 0x7fec78166f50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fec70009d90 tx=0x7fec7002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb77bc78f6113376 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:15.624 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.619+0000 7fec75ffb640 1 -- 172.21.15.191:0/2032569359 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec70039070 con 0x7fec78160330 2024-04-14T23:34:15.624 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.619+0000 7fec75ffb640 1 -- 172.21.15.191:0/2032569359 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec7002cc60 con 0x7fec78160330 2024-04-14T23:34:15.624 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.619+0000 7fec75ffb640 1 -- 172.21.15.191:0/2032569359 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec70034640 con 0x7fec78160330 2024-04-14T23:34:15.624 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.620+0000 7fec7d511640 1 -- 172.21.15.191:0/2032569359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec78160330 msgr2=0x7fec78166f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.624 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.620+0000 7fec7d511640 1 --2- 172.21.15.191:0/2032569359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec78160330 0x7fec78166f50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fec70009d90 tx=0x7fec7002beb0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.624 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.620+0000 7fec7d511640 1 -- 172.21.15.191:0/2032569359 shutdown_connections 2024-04-14T23:34:15.624 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.620+0000 7fec7d511640 1 --2- 172.21.15.191:0/2032569359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec78160330 0x7fec78166f50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.624 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.620+0000 7fec7d511640 1 -- 172.21.15.191:0/2032569359 >> 172.21.15.191:0/2032569359 conn(0x7fec780d1db0 msgr2=0x7fec780d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:15.624 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.620+0000 7fec7d511640 1 -- 172.21.15.191:0/2032569359 shutdown_connections 2024-04-14T23:34:15.624 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.620+0000 7fec7d511640 1 -- 172.21.15.191:0/2032569359 wait complete. 2024-04-14T23:34:15.625 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.621+0000 7fec7d511640 1 Processor -- start 2024-04-14T23:34:15.625 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.621+0000 7fec7d511640 1 -- start start 2024-04-14T23:34:15.627 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.622+0000 7fec7d511640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec780d0ac0 0x7fec7814f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.627 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.622+0000 7fec7d511640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec7815f5d0 0x7fec781f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.627 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.622+0000 7fec7d511640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fec78160330 0x7fec780c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.627 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.622+0000 7fec7d511640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fec780d2bd0 con 0x7fec7815f5d0 2024-04-14T23:34:15.627 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.622+0000 7fec7d511640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fec780d05a0 con 0x7fec780d0ac0 2024-04-14T23:34:15.627 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.622+0000 7fec7d511640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fec780cdbe0 con 0x7fec78160330 2024-04-14T23:34:15.627 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.622+0000 7fec76ffd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec780d0ac0 0x7fec7814f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.628 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.622+0000 7fec76ffd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec780d0ac0 0x7fec7814f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:57476/0 (socket says 172.21.15.191:57476) 2024-04-14T23:34:15.628 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.622+0000 7fec777fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fec78160330 0x7fec780c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.628 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.622+0000 7fec76ffd640 1 -- 172.21.15.191:0/266569721 learned_addr learned my addr 172.21.15.191:0/266569721 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-14T23:34:15.628 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.622+0000 7fec767fc640 1 --2- 172.21.15.191:0/266569721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec7815f5d0 0x7fec781f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.628 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.622+0000 7fec777fe640 1 -- 172.21.15.191:0/266569721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec780d0ac0 msgr2=0x7fec7814f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.628 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.622+0000 7fec777fe640 1 --2- 172.21.15.191:0/266569721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec780d0ac0 0x7fec7814f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.628 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.622+0000 7fec777fe640 1 -- 172.21.15.191:0/266569721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec7815f5d0 msgr2=0x7fec781f74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.628 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.622+0000 7fec777fe640 1 --2- 172.21.15.191:0/266569721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec7815f5d0 0x7fec781f74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.628 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.623+0000 7fec777fe640 1 -- 172.21.15.191:0/266569721 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec781f7e90 con 0x7fec78160330 2024-04-14T23:34:15.628 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.623+0000 7fec76ffd640 1 --2- 172.21.15.191:0/266569721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec780d0ac0 0x7fec7814f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:15.628 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.623+0000 7fec767fc640 1 --2- 172.21.15.191:0/266569721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec7815f5d0 0x7fec781f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:15.628 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.623+0000 7fec777fe640 1 --2- 172.21.15.191:0/266569721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fec78160330 0x7fec780c7b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fec70033000 tx=0x7fec70004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:15.628 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.623+0000 7fec5f7fe640 1 -- 172.21.15.191:0/266569721 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec70044020 con 0x7fec78160330 2024-04-14T23:34:15.628 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.623+0000 7fec5f7fe640 1 -- 172.21.15.191:0/266569721 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec7003a040 con 0x7fec78160330 2024-04-14T23:34:15.628 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.623+0000 7fec7d511640 1 -- 172.21.15.191:0/266569721 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec781f8170 con 0x7fec78160330 2024-04-14T23:34:15.629 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.623+0000 7fec5f7fe640 1 -- 172.21.15.191:0/266569721 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec70039050 con 0x7fec78160330 2024-04-14T23:34:15.629 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.623+0000 7fec7d511640 1 -- 172.21.15.191:0/266569721 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7814f630 con 0x7fec78160330 2024-04-14T23:34:15.629 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.623+0000 7fec5f7fe640 1 -- 172.21.15.191:0/266569721 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fec70003b90 con 0x7fec78160330 2024-04-14T23:34:15.629 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.623+0000 7fec5f7fe640 1 -- 172.21.15.191:0/266569721 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fec70004800 con 0x7fec78160330 2024-04-14T23:34:15.629 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.624+0000 7fec7d511640 1 -- 172.21.15.191:0/266569721 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec780681f0 con 0x7fec78160330 2024-04-14T23:34:15.629 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.626+0000 7fec5f7fe640 1 -- 172.21.15.191:0/266569721 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fec7004e020 con 0x7fec78160330 2024-04-14T23:34:15.643 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:15.639+0000 7fcab564c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-14T23:34:15.674 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:15.671+0000 7f14d4242040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-14T23:34:15.697 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:15.694+0000 7fcab564c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-14T23:34:15.702 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.699+0000 7fec7d511640 1 -- 172.21.15.191:0/266569721 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b", "id": 4} v 0) -- 0x7fec780731a0 con 0x7fec78160330 2024-04-14T23:34:15.706 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.702+0000 7fec5f7fe640 1 -- 172.21.15.191:0/266569721 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fec70003fc0 con 0x7fec78160330 2024-04-14T23:34:15.706 INFO:teuthology.orchestra.run.smithi191.stdout:4 2024-04-14T23:34:15.707 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.703+0000 7fec7d511640 1 -- 172.21.15.191:0/266569721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fec78160330 msgr2=0x7fec780c7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.707 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.703+0000 7fec7d511640 1 --2- 172.21.15.191:0/266569721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fec78160330 0x7fec780c7b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fec70033000 tx=0x7fec70004a40 comp rx=0 tx=0).stop 2024-04-14T23:34:15.707 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.703+0000 7fec7d511640 1 -- 172.21.15.191:0/266569721 shutdown_connections 2024-04-14T23:34:15.707 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.703+0000 7fec7d511640 1 --2- 172.21.15.191:0/266569721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fec78160330 0x7fec780c7b80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.707 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.703+0000 7fec7d511640 1 --2- 172.21.15.191:0/266569721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec7815f5d0 0x7fec781f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.707 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.703+0000 7fec7d511640 1 --2- 172.21.15.191:0/266569721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec780d0ac0 0x7fec7814f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.707 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.703+0000 7fec7d511640 1 -- 172.21.15.191:0/266569721 >> 172.21.15.191:0/266569721 conn(0x7fec780d1db0 msgr2=0x7fec780cd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:15.707 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.703+0000 7fec7d511640 1 -- 172.21.15.191:0/266569721 shutdown_connections 2024-04-14T23:34:15.708 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.703+0000 7fec7d511640 1 -- 172.21.15.191:0/266569721 wait complete. 2024-04-14T23:34:15.717 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac 5 2024-04-14T23:34:15.724 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:15.721+0000 7f14d4242040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-14T23:34:15.749 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:15.745+0000 7fcab564c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-14T23:34:15.819 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.816+0000 7f3b1a0de640 1 Processor -- start 2024-04-14T23:34:15.819 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.816+0000 7f3b1a0de640 1 -- start start 2024-04-14T23:34:15.821 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.816+0000 7f3b1a0de640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f3b140ceca0 0x7f3b1406c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.821 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.816+0000 7f3b1a0de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b140d0c00 0x7f3b1406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.821 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.817+0000 7f3b1a0de640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b140b11b0 con 0x7f3b1406d260 2024-04-14T23:34:15.821 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.817+0000 7f3b1a0de640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f3b1406d6d0 con 0x7f3b140ceca0 2024-04-14T23:34:15.821 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.817+0000 7f3b1a0de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f3b140d13f0 con 0x7f3b140d0c00 2024-04-14T23:34:15.821 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.817+0000 7f3b137fe640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f3b140ceca0 0x7f3b1406c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.822 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.817+0000 7f3b12ffd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b140d0c00 0x7f3b1406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.822 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.817+0000 7f3b137fe640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f3b140ceca0 0x7f3b1406c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:57484/0 (socket says 172.21.15.191:57484) 2024-04-14T23:34:15.822 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.817+0000 7f3b12ffd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b140d0c00 0x7f3b1406cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:39250/0 (socket says 172.21.15.191:39250) 2024-04-14T23:34:15.822 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.817+0000 7f3b137fe640 1 -- 172.21.15.191:0/3991263076 learned_addr learned my addr 172.21.15.191:0/3991263076 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-14T23:34:15.822 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.817+0000 7f3b12ffd640 1 -- 172.21.15.191:0/3991263076 >> v2:172.21.15.191:3300/0 conn(0x7f3b140ceca0 msgr2=0x7f3b1406c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:15.822 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.817+0000 7f3b12ffd640 1 --2- 172.21.15.191:0/3991263076 >> v2:172.21.15.191:3300/0 conn(0x7f3b140ceca0 0x7f3b1406c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.822 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.817+0000 7f3b12ffd640 1 -- 172.21.15.191:0/3991263076 >> v1:172.21.15.47:6789/0 conn(0x7f3b1406d260 legacy=0x7f3b1415da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.822 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.817+0000 7f3b12ffd640 1 -- 172.21.15.191:0/3991263076 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b140b1470 con 0x7f3b140d0c00 2024-04-14T23:34:15.822 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.817+0000 7f3b137fe640 1 --2- 172.21.15.191:0/3991263076 >> v2:172.21.15.191:3300/0 conn(0x7f3b140ceca0 0x7f3b1406c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:15.826 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.818+0000 7f3b12ffd640 1 --2- 172.21.15.191:0/3991263076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b140d0c00 0x7f3b1406cd20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3b080097a0 tx=0x7f3b0802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71971822a7085e3b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:15.826 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.818+0000 7f3b127fc640 1 -- 172.21.15.191:0/3991263076 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08035020 con 0x7f3b140d0c00 2024-04-14T23:34:15.826 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.818+0000 7f3b127fc640 1 -- 172.21.15.191:0/3991263076 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b08031830 con 0x7f3b140d0c00 2024-04-14T23:34:15.826 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.818+0000 7f3b127fc640 1 -- 172.21.15.191:0/3991263076 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08031c00 con 0x7f3b140d0c00 2024-04-14T23:34:15.826 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.819+0000 7f3b1a0de640 1 -- 172.21.15.191:0/3991263076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b140d0c00 msgr2=0x7f3b1406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.826 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.819+0000 7f3b1a0de640 1 --2- 172.21.15.191:0/3991263076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b140d0c00 0x7f3b1406cd20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3b080097a0 tx=0x7f3b0802b8d0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.826 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.819+0000 7f3b1a0de640 1 -- 172.21.15.191:0/3991263076 shutdown_connections 2024-04-14T23:34:15.826 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.819+0000 7f3b1a0de640 1 --2- 172.21.15.191:0/3991263076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b140d0c00 0x7f3b1406cd20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.826 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.819+0000 7f3b1a0de640 1 --2- 172.21.15.191:0/3991263076 >> v2:172.21.15.191:3300/0 conn(0x7f3b140ceca0 0x7f3b1406c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.819+0000 7f3b1a0de640 1 -- 172.21.15.191:0/3991263076 >> 172.21.15.191:0/3991263076 conn(0x7f3b140d1db0 msgr2=0x7f3b140d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:15.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.819+0000 7f3b1a0de640 1 -- 172.21.15.191:0/3991263076 shutdown_connections 2024-04-14T23:34:15.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.819+0000 7f3b1a0de640 1 -- 172.21.15.191:0/3991263076 wait complete. 2024-04-14T23:34:15.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.820+0000 7f3b1a0de640 1 Processor -- start 2024-04-14T23:34:15.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.820+0000 7f3b1a0de640 1 -- start start 2024-04-14T23:34:15.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b1a0de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b1406d260 0x7f3b1409c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b1a0de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b140ceca0 0x7f3b1409ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b1a0de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b140d0c00 0x7f3b140b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:15.827 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b1a0de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3b140cf080 con 0x7f3b140ceca0 2024-04-14T23:34:15.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b1a0de640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3b140b1a30 con 0x7f3b1406d260 2024-04-14T23:34:15.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b1a0de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f3b140d1020 con 0x7f3b140d0c00 2024-04-14T23:34:15.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b137fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b1406d260 0x7f3b1409c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b13fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b140d0c00 0x7f3b140b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b137fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b1406d260 0x7f3b1409c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:57498/0 (socket says 172.21.15.191:57498) 2024-04-14T23:34:15.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b13fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b140d0c00 0x7f3b140b71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:39260/0 (socket says 172.21.15.191:39260) 2024-04-14T23:34:15.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b137fe640 1 -- 172.21.15.191:0/465750852 learned_addr learned my addr 172.21.15.191:0/465750852 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-14T23:34:15.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b12ffd640 1 --2- 172.21.15.191:0/465750852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b140ceca0 0x7f3b1409ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:15.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b137fe640 1 -- 172.21.15.191:0/465750852 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b140d0c00 msgr2=0x7f3b140b71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b137fe640 1 --2- 172.21.15.191:0/465750852 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b140d0c00 0x7f3b140b71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b137fe640 1 -- 172.21.15.191:0/465750852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b140ceca0 msgr2=0x7f3b1409ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b137fe640 1 --2- 172.21.15.191:0/465750852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b140ceca0 0x7f3b1409ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b137fe640 1 -- 172.21.15.191:0/465750852 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1409d260 con 0x7f3b1406d260 2024-04-14T23:34:15.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b13fff640 1 --2- 172.21.15.191:0/465750852 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b140d0c00 0x7f3b140b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:15.828 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.821+0000 7f3b137fe640 1 --2- 172.21.15.191:0/465750852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b1406d260 0x7f3b1409c960 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400e9b0 tx=0x7f3b0400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:15.829 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.822+0000 7f3afbfff640 1 -- 172.21.15.191:0/465750852 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b04017070 con 0x7f3b1406d260 2024-04-14T23:34:15.829 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.822+0000 7f3afbfff640 1 -- 172.21.15.191:0/465750852 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b0400c9a0 con 0x7f3b1406d260 2024-04-14T23:34:15.829 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.822+0000 7f3b1a0de640 1 -- 172.21.15.191:0/465750852 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1409d540 con 0x7f3b1406d260 2024-04-14T23:34:15.829 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.822+0000 7f3afbfff640 1 -- 172.21.15.191:0/465750852 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0400cd50 con 0x7f3b1406d260 2024-04-14T23:34:15.829 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.822+0000 7f3b1a0de640 1 -- 172.21.15.191:0/465750852 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1409db00 con 0x7f3b1406d260 2024-04-14T23:34:15.829 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.822+0000 7f3afbfff640 1 -- 172.21.15.191:0/465750852 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3b0401a070 con 0x7f3b1406d260 2024-04-14T23:34:15.829 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.822+0000 7f3afbfff640 1 -- 172.21.15.191:0/465750852 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f3b0401c9d0 con 0x7f3b1406d260 2024-04-14T23:34:15.829 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.823+0000 7f3b1a0de640 1 -- 172.21.15.191:0/465750852 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b140cfa20 con 0x7f3b1406d260 2024-04-14T23:34:15.829 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.825+0000 7f3afbfff640 1 -- 172.21.15.191:0/465750852 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3b140cfa20 con 0x7f3b1406d260 2024-04-14T23:34:15.900 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.896+0000 7f3b1a0de640 1 -- 172.21.15.191:0/465750852 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac", "id": 5} v 0) -- 0x7f3b140681f0 con 0x7f3b1406d260 2024-04-14T23:34:15.903 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.899+0000 7f3afbfff640 1 -- 172.21.15.191:0/465750852 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f3b0401c450 con 0x7f3b1406d260 2024-04-14T23:34:15.903 INFO:teuthology.orchestra.run.smithi191.stdout:5 2024-04-14T23:34:15.905 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.900+0000 7f3b1a0de640 1 -- 172.21.15.191:0/465750852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b1406d260 msgr2=0x7f3b1409c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:15.905 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.900+0000 7f3b1a0de640 1 --2- 172.21.15.191:0/465750852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b1406d260 0x7f3b1409c960 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400e9b0 tx=0x7f3b0400ee70 comp rx=0 tx=0).stop 2024-04-14T23:34:15.905 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.900+0000 7f3b1a0de640 1 -- 172.21.15.191:0/465750852 shutdown_connections 2024-04-14T23:34:15.905 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.900+0000 7f3b1a0de640 1 --2- 172.21.15.191:0/465750852 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b140d0c00 0x7f3b140b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.906 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.900+0000 7f3b1a0de640 1 --2- 172.21.15.191:0/465750852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b140ceca0 0x7f3b1409ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.906 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.900+0000 7f3b1a0de640 1 --2- 172.21.15.191:0/465750852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b1406d260 0x7f3b1409c960 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:15.906 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.900+0000 7f3b1a0de640 1 -- 172.21.15.191:0/465750852 >> 172.21.15.191:0/465750852 conn(0x7f3b140d1db0 msgr2=0x7f3b1406c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:15.906 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.900+0000 7f3b1a0de640 1 -- 172.21.15.191:0/465750852 shutdown_connections 2024-04-14T23:34:15.907 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:15.900+0000 7f3b1a0de640 1 -- 172.21.15.191:0/465750852 wait complete. 2024-04-14T23:34:15.914 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 35440fb9-9183-43f6-aded-5490aa4076ae 6 2024-04-14T23:34:16.056 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.053+0000 7fbfa1cde640 1 Processor -- start 2024-04-14T23:34:16.057 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.053+0000 7fbfa1cde640 1 -- start start 2024-04-14T23:34:16.059 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.054+0000 7fbfa1cde640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbf9c0d0ac0 0x7fbf9c15fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:16.060 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.054+0000 7fbfa1cde640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf9c15f9b0 con 0x7fbf9c160160 2024-04-14T23:34:16.060 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.054+0000 7fbfa1cde640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf9c0cfa20 con 0x7fbf9c15f5d0 2024-04-14T23:34:16.060 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.054+0000 7fbfa1cde640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fbf9c1605b0 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.060 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.054+0000 7fbf9affd640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbf9c0d0ac0 0x7fbf9c15fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:16.060 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.054+0000 7fbf9affd640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbf9c0d0ac0 0x7fbf9c15fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:57502/0 (socket says 172.21.15.191:57502) 2024-04-14T23:34:16.060 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.054+0000 7fbf9affd640 1 -- 172.21.15.191:0/493088535 learned_addr learned my addr 172.21.15.191:0/493088535 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-14T23:34:16.060 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.054+0000 7fbf9b7fe640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fbf9c15f5d0 0x7fbf9c0cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:56702/0 (socket says 172.21.15.191:56702) 2024-04-14T23:34:16.060 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.054+0000 7fbf9affd640 1 -- 172.21.15.191:0/493088535 >> v1:172.21.15.191:6789/0 conn(0x7fbf9c15f5d0 legacy=0x7fbf9c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:16.060 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.054+0000 7fbf9affd640 1 -- 172.21.15.191:0/493088535 >> v1:172.21.15.47:6789/0 conn(0x7fbf9c160160 legacy=0x7fbf9c0b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:16.060 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.054+0000 7fbf9a7fc640 1 -- 172.21.15.191:0/493088535 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3084961534 0 0) 0x7fbf9c0cfa20 con 0x7fbf9c15f5d0 2024-04-14T23:34:16.060 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.054+0000 7fbf9affd640 1 -- 172.21.15.191:0/493088535 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9c0cfd00 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.060 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.055+0000 7fbf9affd640 1 --2- 172.21.15.191:0/493088535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf9c0d0ac0 0x7fbf9c15fc20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009870 tx=0x7fbf9002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bbeb9449df03b0f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:16.061 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.055+0000 7fbf9a7fc640 1 -- 172.21.15.191:0/493088535 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90034070 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.061 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.055+0000 7fbf9a7fc640 1 -- 172.21.15.191:0/493088535 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf90030860 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.061 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.055+0000 7fbf9a7fc640 1 -- 172.21.15.191:0/493088535 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90030c30 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.061 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.055+0000 7fbfa1cde640 1 -- 172.21.15.191:0/493088535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf9c0d0ac0 msgr2=0x7fbf9c15fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:16.061 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.055+0000 7fbfa1cde640 1 --2- 172.21.15.191:0/493088535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf9c0d0ac0 0x7fbf9c15fc20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009870 tx=0x7fbf9002b9a0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.061 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.055+0000 7fbfa1cde640 1 -- 172.21.15.191:0/493088535 shutdown_connections 2024-04-14T23:34:16.061 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.055+0000 7fbfa1cde640 1 --2- 172.21.15.191:0/493088535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf9c0d0ac0 0x7fbf9c15fc20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.061 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.055+0000 7fbfa1cde640 1 -- 172.21.15.191:0/493088535 >> 172.21.15.191:0/493088535 conn(0x7fbf9c0d1db0 msgr2=0x7fbf9c0d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:16.061 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.056+0000 7fbfa1cde640 1 -- 172.21.15.191:0/493088535 shutdown_connections 2024-04-14T23:34:16.061 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.056+0000 7fbfa1cde640 1 -- 172.21.15.191:0/493088535 wait complete. 2024-04-14T23:34:16.064 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.057+0000 7fbfa1cde640 1 Processor -- start 2024-04-14T23:34:16.064 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.057+0000 7fbfa1cde640 1 -- start start 2024-04-14T23:34:16.064 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbfa1cde640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf9c0d0ac0 0x7fbf9c0c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:16.064 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbfa1cde640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9c15f5d0 0x7fbf9c0c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:16.064 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbfa1cde640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf9c160160 0x7fbf9c0c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:16.064 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbfa1cde640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c0d05a0 con 0x7fbf9c15f5d0 2024-04-14T23:34:16.064 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbfa1cde640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c0d02c0 con 0x7fbf9c160160 2024-04-14T23:34:16.064 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbfa1cde640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbf9c0d2bd0 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.064 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbf9b7fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf9c0d0ac0 0x7fbf9c0c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:16.064 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbf9bfff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf9c160160 0x7fbf9c0c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:16.064 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbf9b7fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf9c0d0ac0 0x7fbf9c0c48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:39272/0 (socket says 172.21.15.191:39272) 2024-04-14T23:34:16.065 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbf9b7fe640 1 -- 172.21.15.191:0/999517629 learned_addr learned my addr 172.21.15.191:0/999517629 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-14T23:34:16.065 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbf9affd640 1 --2- 172.21.15.191:0/999517629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9c15f5d0 0x7fbf9c0c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:16.065 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbf9b7fe640 1 -- 172.21.15.191:0/999517629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf9c160160 msgr2=0x7fbf9c0c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:16.065 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbf9b7fe640 1 --2- 172.21.15.191:0/999517629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf9c160160 0x7fbf9c0c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.065 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbf9b7fe640 1 -- 172.21.15.191:0/999517629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9c15f5d0 msgr2=0x7fbf9c0c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:16.065 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbf9b7fe640 1 --2- 172.21.15.191:0/999517629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9c15f5d0 0x7fbf9c0c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.065 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbf9b7fe640 1 -- 172.21.15.191:0/999517629 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9c0c9780 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.065 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbf9bfff640 1 --2- 172.21.15.191:0/999517629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf9c160160 0x7fbf9c0c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:16.065 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbf9b7fe640 1 --2- 172.21.15.191:0/999517629 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf9c0d0ac0 0x7fbf9c0c48e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00c3f0 tx=0x7fbf8c00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:16.065 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbf83fff640 1 -- 172.21.15.191:0/999517629 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c0074e0 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.065 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbf83fff640 1 -- 172.21.15.191:0/999517629 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf8c0047e0 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.065 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbf83fff640 1 -- 172.21.15.191:0/999517629 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c004c10 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.065 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbfa1cde640 1 -- 172.21.15.191:0/999517629 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf9c0c9a60 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.065 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.058+0000 7fbfa1cde640 1 -- 172.21.15.191:0/999517629 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf9c0ca020 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.065 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.059+0000 7fbf83fff640 1 -- 172.21.15.191:0/999517629 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbf8c011070 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.066 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.059+0000 7fbf83fff640 1 -- 172.21.15.191:0/999517629 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fbf8c0139b0 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.066 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.059+0000 7fbfa1cde640 1 -- 172.21.15.191:0/999517629 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf9c0681f0 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.066 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.061+0000 7fbf83fff640 1 -- 172.21.15.191:0/999517629 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fbf8c004db0 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.117 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:16.114+0000 7f14d4242040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-14T23:34:16.143 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.136+0000 7fbfa1cde640 1 -- 172.21.15.191:0/999517629 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "35440fb9-9183-43f6-aded-5490aa4076ae", "id": 6} v 0) -- 0x7fbf9c0b7550 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.143 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.139+0000 7fbf83fff640 1 -- 172.21.15.191:0/999517629 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35440fb9-9183-43f6-aded-5490aa4076ae", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fbf8c013da0 con 0x7fbf9c0d0ac0 2024-04-14T23:34:16.143 INFO:teuthology.orchestra.run.smithi191.stdout:6 2024-04-14T23:34:16.145 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.140+0000 7fbfa1cde640 1 -- 172.21.15.191:0/999517629 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf9c0d0ac0 msgr2=0x7fbf9c0c48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:16.145 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.140+0000 7fbfa1cde640 1 --2- 172.21.15.191:0/999517629 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf9c0d0ac0 0x7fbf9c0c48e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00c3f0 tx=0x7fbf8c00c8b0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.145 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.140+0000 7fbfa1cde640 1 -- 172.21.15.191:0/999517629 shutdown_connections 2024-04-14T23:34:16.145 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.140+0000 7fbfa1cde640 1 --2- 172.21.15.191:0/999517629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf9c160160 0x7fbf9c0c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.145 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.140+0000 7fbfa1cde640 1 --2- 172.21.15.191:0/999517629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf9c15f5d0 0x7fbf9c0c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.145 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.140+0000 7fbfa1cde640 1 --2- 172.21.15.191:0/999517629 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf9c0d0ac0 0x7fbf9c0c48e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.145 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.140+0000 7fbfa1cde640 1 -- 172.21.15.191:0/999517629 >> 172.21.15.191:0/999517629 conn(0x7fbf9c0d1db0 msgr2=0x7fbf9c15b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:16.145 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.141+0000 7fbfa1cde640 1 -- 172.21.15.191:0/999517629 shutdown_connections 2024-04-14T23:34:16.145 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.141+0000 7fbfa1cde640 1 -- 172.21.15.191:0/999517629 wait complete. 2024-04-14T23:34:16.149 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:16.146+0000 7fcab564c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-14T23:34:16.155 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 3b40b787-0eb0-4fe8-b1c0-bd24c42a700d 7 2024-04-14T23:34:16.256 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.252+0000 7f92e19e0640 1 Processor -- start 2024-04-14T23:34:16.256 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.252+0000 7f92e19e0640 1 -- start start 2024-04-14T23:34:16.258 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.253+0000 7f92e19e0640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f92dc0b0eb0 0x7f92dc0d2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:16.258 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.253+0000 7f92e19e0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f92dc15e440 0x7f92dc0d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:16.258 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.253+0000 7f92e19e0640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92dc0b1420 con 0x7f92dc15e060 2024-04-14T23:34:16.258 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.253+0000 7f92e19e0640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f92dc0b1700 con 0x7f92dc15e440 2024-04-14T23:34:16.258 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.253+0000 7f92e19e0640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f92dc0b19e0 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.258 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.253+0000 7f92daffd640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f92dc15e060 0x7f92dc0b4f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:56710/0 (socket says 172.21.15.191:56710) 2024-04-14T23:34:16.258 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.253+0000 7f92daffd640 1 -- 172.21.15.191:0/1556656819 learned_addr learned my addr 172.21.15.191:0/1556656819 (peer_addr_for_me v1:172.21.15.191:0/0) 2024-04-14T23:34:16.258 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.253+0000 7f92da7fc640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f92dc0b0eb0 0x7f92dc0d2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:16.258 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.253+0000 7f92db7fe640 1 --2- 172.21.15.191:0/1556656819 >> v2:172.21.15.47:3300/0 conn(0x7f92dc15e440 0x7f92dc0d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:16.258 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.253+0000 7f92da7fc640 1 -- 172.21.15.191:0/1556656819 >> v2:172.21.15.47:3300/0 conn(0x7f92dc15e440 msgr2=0x7f92dc0d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:16.258 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.253+0000 7f92da7fc640 1 --2- 172.21.15.191:0/1556656819 >> v2:172.21.15.47:3300/0 conn(0x7f92dc15e440 0x7f92dc0d29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.259 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.253+0000 7f92da7fc640 1 -- 172.21.15.191:0/1556656819 >> v1:172.21.15.191:6789/0 conn(0x7f92dc15e060 legacy=0x7f92dc0b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:16.259 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.253+0000 7f92da7fc640 1 -- 172.21.15.191:0/1556656819 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92dc0b1cc0 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.259 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.254+0000 7f92da7fc640 1 --2- 172.21.15.191:0/1556656819 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92dc0b0eb0 0x7f92dc0d2480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f92dc0d2150 tx=0x7f92cc02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=661e1f136e9da721 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:16.259 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.254+0000 7f92d9ffb640 1 -- 172.21.15.191:0/1556656819 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc0315a0 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.259 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.254+0000 7f92d9ffb640 1 -- 172.21.15.191:0/1556656819 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92cc037070 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.259 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.254+0000 7f92d9ffb640 1 -- 172.21.15.191:0/1556656819 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc031960 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.259 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:16.255+0000 7f14d4242040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-14T23:34:16.262 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.255+0000 7f92e19e0640 1 -- 172.21.15.191:0/1556656819 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92dc0b0eb0 msgr2=0x7f92dc0d2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:16.262 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.255+0000 7f92e19e0640 1 --2- 172.21.15.191:0/1556656819 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92dc0b0eb0 0x7f92dc0d2480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f92dc0d2150 tx=0x7f92cc02b840 comp rx=0 tx=0).stop 2024-04-14T23:34:16.262 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.255+0000 7f92e19e0640 1 -- 172.21.15.191:0/1556656819 shutdown_connections 2024-04-14T23:34:16.262 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.255+0000 7f92e19e0640 1 --2- 172.21.15.191:0/1556656819 >> v2:172.21.15.47:3300/0 conn(0x7f92dc15e440 0x7f92dc0d29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.262 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.255+0000 7f92e19e0640 1 --2- 172.21.15.191:0/1556656819 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92dc0b0eb0 0x7f92dc0d2480 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.262 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.255+0000 7f92e19e0640 1 -- 172.21.15.191:0/1556656819 >> 172.21.15.191:0/1556656819 conn(0x7f92dc067940 msgr2=0x7f92dc09d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:16.263 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.255+0000 7f92e19e0640 1 -- 172.21.15.191:0/1556656819 shutdown_connections 2024-04-14T23:34:16.263 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.255+0000 7f92e19e0640 1 -- 172.21.15.191:0/1556656819 wait complete. 2024-04-14T23:34:16.263 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.256+0000 7f92e19e0640 1 Processor -- start 2024-04-14T23:34:16.263 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.256+0000 7f92e19e0640 1 -- start start 2024-04-14T23:34:16.263 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92e19e0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92dc0b0eb0 0x7f92dc14e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:16.263 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92e19e0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92dc15e060 0x7f92dc0cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:16.263 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92e19e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92dc15e440 0x7f92dc15e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:16.263 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92e19e0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f92dc0b24c0 con 0x7f92dc15e440 2024-04-14T23:34:16.263 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92e19e0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f92dc0ceaf0 con 0x7f92dc15e060 2024-04-14T23:34:16.263 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92e19e0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f92dc0b2640 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.263 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92daffd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92dc0b0eb0 0x7f92dc14e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:16.263 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92daffd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92dc0b0eb0 0x7f92dc14e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:39274/0 (socket says 172.21.15.191:39274) 2024-04-14T23:34:16.263 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92da7fc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92dc15e060 0x7f92dc0cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:16.263 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92daffd640 1 -- 172.21.15.191:0/4200331947 learned_addr learned my addr 172.21.15.191:0/4200331947 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-14T23:34:16.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92db7fe640 1 --2- 172.21.15.191:0/4200331947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92dc15e440 0x7f92dc15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:16.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92daffd640 1 -- 172.21.15.191:0/4200331947 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92dc15e060 msgr2=0x7f92dc0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:16.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92daffd640 1 --2- 172.21.15.191:0/4200331947 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92dc15e060 0x7f92dc0cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92daffd640 1 -- 172.21.15.191:0/4200331947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92dc15e440 msgr2=0x7f92dc15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:16.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92daffd640 1 --2- 172.21.15.191:0/4200331947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92dc15e440 0x7f92dc15e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92daffd640 1 -- 172.21.15.191:0/4200331947 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92dc0c8880 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92da7fc640 1 --2- 172.21.15.191:0/4200331947 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92dc15e060 0x7f92dc0cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:16.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.257+0000 7f92daffd640 1 --2- 172.21.15.191:0/4200331947 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92dc0b0eb0 0x7f92dc14e240 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f92d000c430 tx=0x7f92d000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:16.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.258+0000 7f92c3fff640 1 -- 172.21.15.191:0/4200331947 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0017070 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.258+0000 7f92c3fff640 1 -- 172.21.15.191:0/4200331947 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d0005ce0 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.258+0000 7f92c3fff640 1 -- 172.21.15.191:0/4200331947 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d00072f0 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.258+0000 7f92e19e0640 1 -- 172.21.15.191:0/4200331947 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92dc0c8b60 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.258+0000 7f92e19e0640 1 -- 172.21.15.191:0/4200331947 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f92dc0c9120 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.258+0000 7f92c3fff640 1 -- 172.21.15.191:0/4200331947 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f92d001a070 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.258+0000 7f92c3fff640 1 -- 172.21.15.191:0/4200331947 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f92d0012a60 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.259+0000 7f92e19e0640 1 -- 172.21.15.191:0/4200331947 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92dc073f50 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.261+0000 7f92c3fff640 1 -- 172.21.15.191:0/4200331947 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f92d0021020 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.291 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:16.288+0000 7fcab564c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-14T23:34:16.337 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.333+0000 7f92e19e0640 1 -- 172.21.15.191:0/4200331947 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3b40b787-0eb0-4fe8-b1c0-bd24c42a700d", "id": 7} v 0) -- 0x7f92dc0b66f0 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.340 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.337+0000 7f92c3fff640 1 -- 172.21.15.191:0/4200331947 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3b40b787-0eb0-4fe8-b1c0-bd24c42a700d", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f92d0007640 con 0x7f92dc0b0eb0 2024-04-14T23:34:16.341 INFO:teuthology.orchestra.run.smithi191.stdout:7 2024-04-14T23:34:16.342 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.338+0000 7f92e19e0640 1 -- 172.21.15.191:0/4200331947 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92dc0b0eb0 msgr2=0x7f92dc14e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:16.342 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.338+0000 7f92e19e0640 1 --2- 172.21.15.191:0/4200331947 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92dc0b0eb0 0x7f92dc14e240 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f92d000c430 tx=0x7f92d000c8f0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.342 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.338+0000 7f92e19e0640 1 -- 172.21.15.191:0/4200331947 shutdown_connections 2024-04-14T23:34:16.342 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.338+0000 7f92e19e0640 1 --2- 172.21.15.191:0/4200331947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92dc15e440 0x7f92dc15e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.342 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.338+0000 7f92e19e0640 1 --2- 172.21.15.191:0/4200331947 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92dc15e060 0x7f92dc0cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.342 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.338+0000 7f92e19e0640 1 --2- 172.21.15.191:0/4200331947 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92dc0b0eb0 0x7f92dc14e240 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.342 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.338+0000 7f92e19e0640 1 -- 172.21.15.191:0/4200331947 >> 172.21.15.191:0/4200331947 conn(0x7f92dc067940 msgr2=0x7f92dc15c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:16.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.338+0000 7f92e19e0640 1 -- 172.21.15.191:0/4200331947 shutdown_connections 2024-04-14T23:34:16.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:34:16.338+0000 7f92e19e0640 1 -- 172.21.15.191:0/4200331947 wait complete. 2024-04-14T23:34:16.352 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-14T23:34:16.353 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-14T23:34:16.355 INFO:tasks.ceph.osd.0:Started 2024-04-14T23:34:16.355 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-14T23:34:16.355 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-14T23:34:16.359 INFO:tasks.ceph.osd.1:Started 2024-04-14T23:34:16.359 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-14T23:34:16.359 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-14T23:34:16.361 INFO:tasks.ceph.osd.2:Started 2024-04-14T23:34:16.361 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-14T23:34:16.362 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-14T23:34:16.364 INFO:tasks.ceph.osd.3:Started 2024-04-14T23:34:16.364 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-14T23:34:16.364 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-14T23:34:16.366 INFO:tasks.ceph.osd.4:Started 2024-04-14T23:34:16.366 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-14T23:34:16.367 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-14T23:34:16.368 INFO:tasks.ceph.osd.5:Started 2024-04-14T23:34:16.369 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-14T23:34:16.369 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-14T23:34:16.371 INFO:tasks.ceph.osd.6:Started 2024-04-14T23:34:16.371 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-14T23:34:16.371 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-14T23:34:16.372 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:16.369+0000 7f14d4242040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-14T23:34:16.373 INFO:tasks.ceph.osd.7:Started 2024-04-14T23:34:16.373 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:34:16.424 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:16.420+0000 7fcab564c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-14T23:34:16.448 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:16.446+0000 7f14d4242040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-14T23:34:16.485 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:16.482+0000 7fcab564c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-14T23:34:16.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.500+0000 7eff49d11640 1 Processor -- start 2024-04-14T23:34:16.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.500+0000 7eff49d11640 1 -- start start 2024-04-14T23:34:16.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.501+0000 7eff49d11640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7eff4415e8c0 0x7eff440c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:16.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.501+0000 7eff49d11640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff44071e20 0x7eff440722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:16.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.501+0000 7eff49d11640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff440cc2a0 con 0x7eff441447b0 2024-04-14T23:34:16.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.501+0000 7eff49d11640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7eff440cfe20 con 0x7eff4415e8c0 2024-04-14T23:34:16.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.501+0000 7eff49d11640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7eff44144b90 con 0x7eff44071e20 2024-04-14T23:34:16.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.501+0000 7eff437fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7eff441447b0 0x7eff4415bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:36252/0 (socket says 172.21.15.47:36252) 2024-04-14T23:34:16.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.501+0000 7eff437fe640 1 -- 172.21.15.47:0/2236339060 learned_addr learned my addr 172.21.15.47:0/2236339060 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:16.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.501+0000 7eff42ffd640 1 --2- 172.21.15.47:0/2236339060 >> v2:172.21.15.47:3300/0 conn(0x7eff4415e8c0 0x7eff440c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:16.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.502+0000 7eff43fff640 1 --2- 172.21.15.47:0/2236339060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff44071e20 0x7eff440722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:16.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.502+0000 7eff43fff640 1 -- 172.21.15.47:0/2236339060 >> v2:172.21.15.47:3300/0 conn(0x7eff4415e8c0 msgr2=0x7eff440c5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:16.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.502+0000 7eff43fff640 1 --2- 172.21.15.47:0/2236339060 >> v2:172.21.15.47:3300/0 conn(0x7eff4415e8c0 0x7eff440c5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.502+0000 7eff43fff640 1 -- 172.21.15.47:0/2236339060 >> v1:172.21.15.47:6789/0 conn(0x7eff441447b0 legacy=0x7eff4415bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:16.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.502+0000 7eff43fff640 1 -- 172.21.15.47:0/2236339060 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4415ed60 con 0x7eff44071e20 2024-04-14T23:34:16.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.502+0000 7eff42ffd640 1 --2- 172.21.15.47:0/2236339060 >> v2:172.21.15.47:3300/0 conn(0x7eff4415e8c0 0x7eff440c5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:16.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.503+0000 7eff43fff640 1 --2- 172.21.15.47:0/2236339060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff44071e20 0x7eff440722b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009d90 tx=0x7eff3c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18e6da45546d03c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:16.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.503+0000 7eff427fc640 1 -- 172.21.15.47:0/2236339060 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c039070 con 0x7eff44071e20 2024-04-14T23:34:16.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.503+0000 7eff427fc640 1 -- 172.21.15.47:0/2236339060 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff3c02cc50 con 0x7eff44071e20 2024-04-14T23:34:16.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.503+0000 7eff427fc640 1 -- 172.21.15.47:0/2236339060 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c034440 con 0x7eff44071e20 2024-04-14T23:34:16.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.503+0000 7eff49d11640 1 -- 172.21.15.47:0/2236339060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff44071e20 msgr2=0x7eff440722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:16.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.503+0000 7eff49d11640 1 --2- 172.21.15.47:0/2236339060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff44071e20 0x7eff440722b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009d90 tx=0x7eff3c02bea0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.503+0000 7eff49d11640 1 -- 172.21.15.47:0/2236339060 shutdown_connections 2024-04-14T23:34:16.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.503+0000 7eff49d11640 1 --2- 172.21.15.47:0/2236339060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff44071e20 0x7eff440722b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.503+0000 7eff49d11640 1 --2- 172.21.15.47:0/2236339060 >> v2:172.21.15.47:3300/0 conn(0x7eff4415e8c0 0x7eff440c5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.503+0000 7eff49d11640 1 -- 172.21.15.47:0/2236339060 >> 172.21.15.47:0/2236339060 conn(0x7eff440d0c50 msgr2=0x7eff440d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:16.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.503+0000 7eff49d11640 1 -- 172.21.15.47:0/2236339060 shutdown_connections 2024-04-14T23:34:16.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.503+0000 7eff49d11640 1 -- 172.21.15.47:0/2236339060 wait complete. 2024-04-14T23:34:16.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.505+0000 7eff49d11640 1 Processor -- start 2024-04-14T23:34:16.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.505+0000 7eff49d11640 1 -- start start 2024-04-14T23:34:16.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.505+0000 7eff49d11640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff44071e20 0x7eff4415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:16.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.505+0000 7eff49d11640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff441447b0 0x7eff4413e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:16.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.505+0000 7eff49d11640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff4415e8c0 0x7eff4415d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:16.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.506+0000 7eff437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff44071e20 0x7eff4415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:16.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.506+0000 7eff437fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff44071e20 0x7eff4415bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60184/0 (socket says 172.21.15.47:60184) 2024-04-14T23:34:16.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.506+0000 7eff437fe640 1 -- 172.21.15.47:0/113146064 learned_addr learned my addr 172.21.15.47:0/113146064 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:16.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.506+0000 7eff49d11640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7eff4415f600 con 0x7eff44071e20 2024-04-14T23:34:16.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.506+0000 7eff49d11640 1 -- 172.21.15.47:0/113146064 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7eff4415f320 con 0x7eff4415e8c0 2024-04-14T23:34:16.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.506+0000 7eff42ffd640 1 --2- 172.21.15.47:0/113146064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff441447b0 0x7eff4413e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:16.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.506+0000 7eff43fff640 1 --2- 172.21.15.47:0/113146064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff4415e8c0 0x7eff4415d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:16.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.506+0000 7eff49d11640 1 -- 172.21.15.47:0/113146064 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7eff440cc760 con 0x7eff441447b0 2024-04-14T23:34:16.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.506+0000 7eff437fe640 1 -- 172.21.15.47:0/113146064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff441447b0 msgr2=0x7eff4413e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:16.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.506+0000 7eff437fe640 1 --2- 172.21.15.47:0/113146064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff441447b0 0x7eff4413e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.506+0000 7eff437fe640 1 -- 172.21.15.47:0/113146064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff4415e8c0 msgr2=0x7eff4415d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:16.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.506+0000 7eff437fe640 1 --2- 172.21.15.47:0/113146064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff4415e8c0 0x7eff4415d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.506+0000 7eff437fe640 1 -- 172.21.15.47:0/113146064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4406e9b0 con 0x7eff44071e20 2024-04-14T23:34:16.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.506+0000 7eff437fe640 1 --2- 172.21.15.47:0/113146064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff44071e20 0x7eff4415bc50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7eff3800c400 tx=0x7eff3800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:16.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.506+0000 7eff2bfff640 1 -- 172.21.15.47:0/113146064 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38017070 con 0x7eff44071e20 2024-04-14T23:34:16.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.506+0000 7eff2bfff640 1 -- 172.21.15.47:0/113146064 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff38005ce0 con 0x7eff44071e20 2024-04-14T23:34:16.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.507+0000 7eff49d11640 1 -- 172.21.15.47:0/113146064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff4406ec90 con 0x7eff44071e20 2024-04-14T23:34:16.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.507+0000 7eff2bfff640 1 -- 172.21.15.47:0/113146064 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff380072f0 con 0x7eff44071e20 2024-04-14T23:34:16.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.507+0000 7eff49d11640 1 -- 172.21.15.47:0/113146064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff4406f250 con 0x7eff44071e20 2024-04-14T23:34:16.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.507+0000 7eff2bfff640 1 -- 172.21.15.47:0/113146064 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7eff3801a070 con 0x7eff44071e20 2024-04-14T23:34:16.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.507+0000 7eff2bfff640 1 -- 172.21.15.47:0/113146064 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7eff38007490 con 0x7eff44071e20 2024-04-14T23:34:16.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.507+0000 7eff49d11640 1 -- 172.21.15.47:0/113146064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff44075430 con 0x7eff44071e20 2024-04-14T23:34:16.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.510+0000 7eff2bfff640 1 -- 172.21.15.47:0/113146064 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7eff38021070 con 0x7eff44071e20 2024-04-14T23:34:16.571 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:16.568+0000 7f14d4242040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-14T23:34:16.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.572+0000 7eff49d11640 1 -- 172.21.15.47:0/113146064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff44070670 con 0x7eff44071e20 2024-04-14T23:34:16.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.572+0000 7eff2bfff640 1 -- 172.21.15.47:0/113146064 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7eff38021070 con 0x7eff44071e20 2024-04-14T23:34:16.575 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:16.575 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":10,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:16.336568+0000","last_up_change":"0.000000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:34:16.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.573+0000 7eff49d11640 1 -- 172.21.15.47:0/113146064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff44071e20 msgr2=0x7eff4415bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:16.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.573+0000 7eff49d11640 1 --2- 172.21.15.47:0/113146064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff44071e20 0x7eff4415bc50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7eff3800c400 tx=0x7eff3800c8c0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.573+0000 7eff49d11640 1 -- 172.21.15.47:0/113146064 shutdown_connections 2024-04-14T23:34:16.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.573+0000 7eff49d11640 1 --2- 172.21.15.47:0/113146064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff4415e8c0 0x7eff4415d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.573+0000 7eff49d11640 1 --2- 172.21.15.47:0/113146064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff441447b0 0x7eff4413e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.573+0000 7eff49d11640 1 --2- 172.21.15.47:0/113146064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff44071e20 0x7eff4415bc50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:16.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.573+0000 7eff49d11640 1 -- 172.21.15.47:0/113146064 >> 172.21.15.47:0/113146064 conn(0x7eff440d0c50 msgr2=0x7eff4406ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:16.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.573+0000 7eff49d11640 1 -- 172.21.15.47:0/113146064 shutdown_connections 2024-04-14T23:34:16.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:16.573+0000 7eff49d11640 1 -- 172.21.15.47:0/113146064 wait complete. 2024-04-14T23:34:16.586 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-14T23:34:16.587 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-14T23:34:16.597 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:16.594+0000 7fcab564c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-14T23:34:16.671 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:16.668+0000 7f14d4242040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-14T23:34:16.690 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:16.687+0000 7fcab564c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-14T23:34:16.832 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:16.829+0000 7f14d4242040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-14T23:34:16.846 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:16.843+0000 7fcab564c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-14T23:34:16.876 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:16.873+0000 7f14d4242040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-14T23:34:16.888 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:16.885+0000 7fcab564c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-14T23:34:16.963 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-04-14T23:34:16.960+0000 7f89d42a4640 -1 Falling back to public interface 2024-04-14T23:34:16.972 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-04-14T23:34:16.970+0000 7ff78388b640 -1 Falling back to public interface 2024-04-14T23:34:16.975 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-14T23:34:16.971+0000 7f79819aa640 -1 Falling back to public interface 2024-04-14T23:34:16.975 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-14T23:34:16.971+0000 7f3f9960c640 -1 Falling back to public interface 2024-04-14T23:34:16.976 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-14T23:34:16.971+0000 7f79805fd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-14T23:34:16.976 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-14T23:34:16.971+0000 7f3f97bfd640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6802/0: (98) Address already in use 2024-04-14T23:34:16.977 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-14T23:34:16.972+0000 7f3f97bfd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6805/0: (98) Address already in use 2024-04-14T23:34:16.980 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-04-14T23:34:16.977+0000 7f1be4d73640 -1 Falling back to public interface 2024-04-14T23:34:16.985 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-04-14T23:34:16.982+0000 7f0f8ca11640 -1 Falling back to public interface 2024-04-14T23:34:16.991 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-14T23:34:16.987+0000 7fb101f0f640 -1 Falling back to public interface 2024-04-14T23:34:16.992 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-14T23:34:16.988+0000 7f7723973640 -1 Falling back to public interface 2024-04-14T23:34:17.042 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:17.039+0000 7f14d4242040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-14T23:34:17.049 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:17.046+0000 7fcab564c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-14T23:34:17.392 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-14T23:34:17.483 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.480+0000 7f2aa0b00640 1 Processor -- start 2024-04-14T23:34:17.484 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.481+0000 7f2aa0b00640 1 -- start start 2024-04-14T23:34:17.485 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.482+0000 7f2aa0b00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2a9c0aed80 0x7f2a9c15c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:17.485 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.482+0000 7f2aa0b00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a9c0b00c0 con 0x7f2a9c06f710 2024-04-14T23:34:17.485 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.482+0000 7f2aa0b00640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a9c15cbc0 con 0x7f2a9c0afc30 2024-04-14T23:34:17.485 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.482+0000 7f2aa0b00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2a9c15cea0 con 0x7f2a9c0aed80 2024-04-14T23:34:17.486 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.482+0000 7f2a9a59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2a9c0aed80 0x7f2a9c15c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:17.486 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.482+0000 7f2a9ad9d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f2a9c06f710 0x7f2a9c0b5250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:36258/0 (socket says 172.21.15.47:36258) 2024-04-14T23:34:17.486 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.482+0000 7f2a9ad9d640 1 -- 172.21.15.47:0/523869943 learned_addr learned my addr 172.21.15.47:0/523869943 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:17.486 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.482+0000 7f2a9a59c640 1 -- 172.21.15.47:0/523869943 >> v1:172.21.15.191:6789/0 conn(0x7f2a9c0afc30 legacy=0x7f2a9c0b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:17.486 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.482+0000 7f2a9a59c640 1 -- 172.21.15.47:0/523869943 >> v1:172.21.15.47:6789/0 conn(0x7f2a9c06f710 legacy=0x7f2a9c0b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:17.486 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.482+0000 7f2a9a59c640 1 -- 172.21.15.47:0/523869943 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9c15d180 con 0x7f2a9c0aed80 2024-04-14T23:34:17.487 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.483+0000 7f2a9a59c640 1 --2- 172.21.15.47:0/523869943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a9c0aed80 0x7f2a9c15c570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2a900097a0 tx=0x7f2a9002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7271b2594325254 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:17.487 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.483+0000 7f2a9959a640 1 -- 172.21.15.47:0/523869943 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a900315a0 con 0x7f2a9c0aed80 2024-04-14T23:34:17.487 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.483+0000 7f2a9959a640 1 -- 172.21.15.47:0/523869943 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a90037070 con 0x7f2a9c0aed80 2024-04-14T23:34:17.487 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.483+0000 7f2a9959a640 1 -- 172.21.15.47:0/523869943 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90031960 con 0x7f2a9c0aed80 2024-04-14T23:34:17.488 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.484+0000 7f2aa0b00640 1 -- 172.21.15.47:0/523869943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a9c0aed80 msgr2=0x7f2a9c15c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:17.488 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.484+0000 7f2aa0b00640 1 --2- 172.21.15.47:0/523869943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a9c0aed80 0x7f2a9c15c570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2a900097a0 tx=0x7f2a9002b840 comp rx=0 tx=0).stop 2024-04-14T23:34:17.488 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.484+0000 7f2aa0b00640 1 -- 172.21.15.47:0/523869943 shutdown_connections 2024-04-14T23:34:17.488 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.484+0000 7f2aa0b00640 1 --2- 172.21.15.47:0/523869943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a9c0aed80 0x7f2a9c15c570 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:17.488 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.484+0000 7f2aa0b00640 1 -- 172.21.15.47:0/523869943 >> 172.21.15.47:0/523869943 conn(0x7f2a9c071840 msgr2=0x7f2a9c071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:17.488 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.484+0000 7f2aa0b00640 1 -- 172.21.15.47:0/523869943 shutdown_connections 2024-04-14T23:34:17.488 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.484+0000 7f2aa0b00640 1 -- 172.21.15.47:0/523869943 wait complete. 2024-04-14T23:34:17.488 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.485+0000 7f2aa0b00640 1 Processor -- start 2024-04-14T23:34:17.489 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.486+0000 7f2aa0b00640 1 -- start start 2024-04-14T23:34:17.491 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.486+0000 7f2aa0b00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a9c06f710 0x7f2a9c13d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:17.491 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.486+0000 7f2aa0b00640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a9c0aed80 0x7f2a9c15b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:17.491 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.486+0000 7f2aa0b00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a9c0afc30 0x7f2a9c15b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:17.491 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.486+0000 7f2aa0b00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c0b3dc0 con 0x7f2a9c0afc30 2024-04-14T23:34:17.491 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.486+0000 7f2aa0b00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c0b4d30 con 0x7f2a9c06f710 2024-04-14T23:34:17.491 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.486+0000 7f2aa0b00640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f2a9c0af160 con 0x7f2a9c0aed80 2024-04-14T23:34:17.491 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.486+0000 7f2a9ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a9c0afc30 0x7f2a9c15b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:17.491 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.486+0000 7f2a9ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a9c0afc30 0x7f2a9c15b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:60212/0 (socket says 172.21.15.47:60212) 2024-04-14T23:34:17.491 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.486+0000 7f2a9ad9d640 1 -- 172.21.15.47:0/1625967562 learned_addr learned my addr 172.21.15.47:0/1625967562 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:17.491 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.486+0000 7f2a9a59c640 1 --2- 172.21.15.47:0/1625967562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a9c06f710 0x7f2a9c13d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:17.491 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.486+0000 7f2a99d9b640 1 --2- 172.21.15.47:0/1625967562 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a9c0aed80 0x7f2a9c15b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:17.492 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.487+0000 7f2a9ad9d640 1 -- 172.21.15.47:0/1625967562 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a9c0aed80 msgr2=0x7f2a9c15b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:17.492 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.487+0000 7f2a9ad9d640 1 --2- 172.21.15.47:0/1625967562 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a9c0aed80 0x7f2a9c15b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:17.492 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.487+0000 7f2a9ad9d640 1 -- 172.21.15.47:0/1625967562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a9c06f710 msgr2=0x7f2a9c13d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:17.492 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.487+0000 7f2a9ad9d640 1 --2- 172.21.15.47:0/1625967562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a9c06f710 0x7f2a9c13d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:17.492 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.487+0000 7f2a9ad9d640 1 -- 172.21.15.47:0/1625967562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9c140150 con 0x7f2a9c0afc30 2024-04-14T23:34:17.492 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.487+0000 7f2a9ad9d640 1 --2- 172.21.15.47:0/1625967562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a9c0afc30 0x7f2a9c15b780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400cbc0 tx=0x7f2a9400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:17.492 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.487+0000 7f2a8affd640 1 -- 172.21.15.47:0/1625967562 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a94017070 con 0x7f2a9c0afc30 2024-04-14T23:34:17.492 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.487+0000 7f2a8affd640 1 -- 172.21.15.47:0/1625967562 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a9400ad40 con 0x7f2a9c0afc30 2024-04-14T23:34:17.492 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.487+0000 7f2a8affd640 1 -- 172.21.15.47:0/1625967562 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a94012600 con 0x7f2a9c0afc30 2024-04-14T23:34:17.492 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.487+0000 7f2aa0b00640 1 -- 172.21.15.47:0/1625967562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9c140430 con 0x7f2a9c0afc30 2024-04-14T23:34:17.492 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.487+0000 7f2aa0b00640 1 -- 172.21.15.47:0/1625967562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a9c1409f0 con 0x7f2a9c0afc30 2024-04-14T23:34:17.492 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.487+0000 7f2a8affd640 1 -- 172.21.15.47:0/1625967562 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2a9401a070 con 0x7f2a9c0afc30 2024-04-14T23:34:17.492 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.487+0000 7f2a8affd640 1 -- 172.21.15.47:0/1625967562 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f2a94007070 con 0x7f2a9c0afc30 2024-04-14T23:34:17.492 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.488+0000 7f2aa0b00640 1 -- 172.21.15.47:0/1625967562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a9c06c8f0 con 0x7f2a9c0afc30 2024-04-14T23:34:17.493 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.490+0000 7f2a8affd640 1 -- 172.21.15.47:0/1625967562 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f2a9401c440 con 0x7f2a9c0afc30 2024-04-14T23:34:17.555 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.552+0000 7f2aa0b00640 1 -- 172.21.15.47:0/1625967562 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a9c140c30 con 0x7f2a9c0afc30 2024-04-14T23:34:17.556 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.553+0000 7f2a8affd640 1 -- 172.21.15.47:0/1625967562 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f2a9401c950 con 0x7f2a9c0afc30 2024-04-14T23:34:17.556 INFO:teuthology.misc.health.smithi047.stdout: 2024-04-14T23:34:17.556 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":10,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:16.336568+0000","last_up_change":"0.000000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:34:17.557 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.554+0000 7f2aa0b00640 1 -- 172.21.15.47:0/1625967562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a9c0afc30 msgr2=0x7f2a9c15b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:17.557 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.554+0000 7f2aa0b00640 1 --2- 172.21.15.47:0/1625967562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a9c0afc30 0x7f2a9c15b780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400cbc0 tx=0x7f2a9400a430 comp rx=0 tx=0).stop 2024-04-14T23:34:17.557 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.554+0000 7f2aa0b00640 1 -- 172.21.15.47:0/1625967562 shutdown_connections 2024-04-14T23:34:17.557 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.554+0000 7f2aa0b00640 1 --2- 172.21.15.47:0/1625967562 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a9c0afc30 0x7f2a9c15b780 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:17.557 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.554+0000 7f2aa0b00640 1 --2- 172.21.15.47:0/1625967562 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a9c0aed80 0x7f2a9c15b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:17.557 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.554+0000 7f2aa0b00640 1 --2- 172.21.15.47:0/1625967562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a9c06f710 0x7f2a9c13d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:17.557 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.554+0000 7f2aa0b00640 1 -- 172.21.15.47:0/1625967562 >> 172.21.15.47:0/1625967562 conn(0x7f2a9c071840 msgr2=0x7f2a9c0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:17.557 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.554+0000 7f2aa0b00640 1 -- 172.21.15.47:0/1625967562 shutdown_connections 2024-04-14T23:34:17.558 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:17.554+0000 7f2aa0b00640 1 -- 172.21.15.47:0/1625967562 wait complete. 2024-04-14T23:34:17.566 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-14T23:34:17.899 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:17.895+0000 7fcab564c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-14T23:34:17.915 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:17.913+0000 7f14d4242040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-14T23:34:18.179 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:18.176+0000 7fcab564c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-14T23:34:18.204 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:18.202+0000 7f14d4242040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-14T23:34:18.230 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:18.227+0000 7fcab564c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-14T23:34:18.258 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:18.255+0000 7f14d4242040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-14T23:34:18.347 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:18.343+0000 7fcab564c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-14T23:34:18.381 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-14T23:34:18.378+0000 7f14d4242040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-14T23:34:19.363 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:19.360+0000 7fca56108640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-14T23:34:19.364 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-14T23:34:19.360+0000 7fca56108640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-14T23:34:20.435 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-04-14T23:34:20.431+0000 7f89d42a4640 -1 osd.0 0 log_to_monitors true 2024-04-14T23:34:20.477 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-14T23:34:20.473+0000 7f79819aa640 -1 osd.4 0 log_to_monitors true 2024-04-14T23:34:20.486 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-04-14T23:34:20.483+0000 7f1be4d73640 -1 osd.3 0 log_to_monitors true 2024-04-14T23:34:20.502 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-04-14T23:34:20.500+0000 7ff78388b640 -1 osd.2 0 log_to_monitors true 2024-04-14T23:34:20.509 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-04-14T23:34:20.506+0000 7f0f8ca11640 -1 osd.1 0 log_to_monitors true 2024-04-14T23:34:20.509 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-14T23:34:20.505+0000 7f3f9960c640 -1 osd.6 0 log_to_monitors true 2024-04-14T23:34:20.518 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-14T23:34:20.514+0000 7fb101f0f640 -1 osd.5 0 log_to_monitors true 2024-04-14T23:34:20.532 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-14T23:34:20.528+0000 7f7723973640 -1 osd.7 0 log_to_monitors true 2024-04-14T23:34:23.842 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-04-14T23:34:23.839+0000 7f89cfff7640 -1 osd.0 0 waiting for initial osdmap 2024-04-14T23:34:23.860 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-04-14T23:34:23.858+0000 7f89c7e28640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T23:34:23.897 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-04-14T23:34:23.894+0000 7ff77f5f7640 -1 osd.2 0 waiting for initial osdmap 2024-04-14T23:34:23.911 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-04-14T23:34:23.908+0000 7f0f885f7640 -1 osd.1 0 waiting for initial osdmap 2024-04-14T23:34:23.913 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-04-14T23:34:23.911+0000 7ff777428640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T23:34:23.915 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-04-14T23:34:23.913+0000 7f1be09f7640 -1 osd.3 0 waiting for initial osdmap 2024-04-14T23:34:23.929 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-04-14T23:34:23.926+0000 7f0f80480640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T23:34:23.929 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-04-14T23:34:23.926+0000 7f1bd8880640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T23:34:24.373 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-14T23:34:24.466 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-14T23:34:24.464+0000 7f797d5f7640 -1 osd.4 0 waiting for initial osdmap 2024-04-14T23:34:24.470 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.467+0000 7fe0d9a6d640 1 Processor -- start 2024-04-14T23:34:24.470 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.467+0000 7fe0d9a6d640 1 -- start start 2024-04-14T23:34:24.471 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.468+0000 7fe0d9a6d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0d4161960 0x7fe0d40cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:24.472 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.468+0000 7fe0d9a6d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe0d40b4320 0x7fe0d40d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:24.472 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.468+0000 7fe0d9a6d640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0d40b31f0 con 0x7fe0d40b37b0 2024-04-14T23:34:24.472 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.468+0000 7fe0d9a6d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe0d40d2f00 con 0x7fe0d40b4320 2024-04-14T23:34:24.472 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.468+0000 7fe0d9a6d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d40d3120 con 0x7fe0d4161960 2024-04-14T23:34:24.472 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.468+0000 7fe0d3fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe0d40b4320 0x7fe0d40d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:24.472 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.468+0000 7fe0d3fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe0d40b4320 0x7fe0d40d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47772/0 (socket says 172.21.15.47:47772) 2024-04-14T23:34:24.472 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.468+0000 7fe0d3fff640 1 -- 172.21.15.47:0/270216667 learned_addr learned my addr 172.21.15.47:0/270216667 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:24.472 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.468+0000 7fe0d37fe640 1 --2- 172.21.15.47:0/270216667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0d4161960 0x7fe0d40cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:24.472 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.468+0000 7fe0d3fff640 1 -- 172.21.15.47:0/270216667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0d4161960 msgr2=0x7fe0d40cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:24.472 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.469+0000 7fe0d3fff640 1 --2- 172.21.15.47:0/270216667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0d4161960 0x7fe0d40cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:24.472 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.469+0000 7fe0d3fff640 1 -- 172.21.15.47:0/270216667 >> v1:172.21.15.191:6789/0 conn(0x7fe0d40b37b0 legacy=0x7fe0d40b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:24.472 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.469+0000 7fe0d3fff640 1 -- 172.21.15.47:0/270216667 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d40b34d0 con 0x7fe0d40b4320 2024-04-14T23:34:24.474 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.469+0000 7fe0d3fff640 1 --2- 172.21.15.47:0/270216667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d40b4320 0x7fe0d40d0570 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009e50 tx=0x7fe0cc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2668ec43cb3b80b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:24.474 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.469+0000 7fe0d27fc640 1 -- 172.21.15.47:0/270216667 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc02ca70 con 0x7fe0d40b4320 2024-04-14T23:34:24.474 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.469+0000 7fe0d27fc640 1 -- 172.21.15.47:0/270216667 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc02cc10 con 0x7fe0d40b4320 2024-04-14T23:34:24.474 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.469+0000 7fe0d27fc640 1 -- 172.21.15.47:0/270216667 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0343f0 con 0x7fe0d40b4320 2024-04-14T23:34:24.474 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.470+0000 7fe0d9a6d640 1 -- 172.21.15.47:0/270216667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d40b4320 msgr2=0x7fe0d40d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:24.474 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.470+0000 7fe0d9a6d640 1 --2- 172.21.15.47:0/270216667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d40b4320 0x7fe0d40d0570 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009e50 tx=0x7fe0cc02bed0 comp rx=0 tx=0).stop 2024-04-14T23:34:24.474 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.470+0000 7fe0d9a6d640 1 -- 172.21.15.47:0/270216667 shutdown_connections 2024-04-14T23:34:24.474 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.470+0000 7fe0d9a6d640 1 --2- 172.21.15.47:0/270216667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d40b4320 0x7fe0d40d0570 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:24.475 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.470+0000 7fe0d9a6d640 1 --2- 172.21.15.47:0/270216667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0d4161960 0x7fe0d40cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:24.475 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.470+0000 7fe0d9a6d640 1 -- 172.21.15.47:0/270216667 >> 172.21.15.47:0/270216667 conn(0x7fe0d40d3ff0 msgr2=0x7fe0d40d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:24.475 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.470+0000 7fe0d9a6d640 1 -- 172.21.15.47:0/270216667 shutdown_connections 2024-04-14T23:34:24.475 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.470+0000 7fe0d9a6d640 1 -- 172.21.15.47:0/270216667 wait complete. 2024-04-14T23:34:24.475 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.471+0000 7fe0d9a6d640 1 Processor -- start 2024-04-14T23:34:24.475 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.471+0000 7fe0d9a6d640 1 -- start start 2024-04-14T23:34:24.477 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.472+0000 7fe0d9a6d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d40b37b0 0x7fe0d415a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:24.477 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.472+0000 7fe0d9a6d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0d40b4320 0x7fe0d40b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:24.477 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.472+0000 7fe0d9a6d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0d4161960 0x7fe0d41f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:24.477 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.472+0000 7fe0d9a6d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d4161d40 con 0x7fe0d40b37b0 2024-04-14T23:34:24.477 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.472+0000 7fe0d9a6d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d40b2fa0 con 0x7fe0d40b4320 2024-04-14T23:34:24.477 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.472+0000 7fe0d9a6d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d4161ec0 con 0x7fe0d4161960 2024-04-14T23:34:24.477 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.472+0000 7fe0d37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d40b37b0 0x7fe0d415a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:24.477 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.472+0000 7fe0d37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d40b37b0 0x7fe0d415a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47778/0 (socket says 172.21.15.47:47778) 2024-04-14T23:34:24.477 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.472+0000 7fe0d37fe640 1 -- 172.21.15.47:0/2046501219 learned_addr learned my addr 172.21.15.47:0/2046501219 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:24.477 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.472+0000 7fe0d2ffd640 1 --2- 172.21.15.47:0/2046501219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0d40b4320 0x7fe0d40b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:24.477 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.472+0000 7fe0d3fff640 1 --2- 172.21.15.47:0/2046501219 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0d4161960 0x7fe0d41f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:24.477 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.473+0000 7fe0d37fe640 1 -- 172.21.15.47:0/2046501219 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0d4161960 msgr2=0x7fe0d41f74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:24.478 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.473+0000 7fe0d37fe640 1 --2- 172.21.15.47:0/2046501219 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0d4161960 0x7fe0d41f74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:24.478 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.473+0000 7fe0d37fe640 1 -- 172.21.15.47:0/2046501219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0d40b4320 msgr2=0x7fe0d40b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:24.478 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.473+0000 7fe0d37fe640 1 --2- 172.21.15.47:0/2046501219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0d40b4320 0x7fe0d40b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:24.478 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.473+0000 7fe0d37fe640 1 -- 172.21.15.47:0/2046501219 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d40b6130 con 0x7fe0d40b37b0 2024-04-14T23:34:24.478 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.473+0000 7fe0d2ffd640 1 --2- 172.21.15.47:0/2046501219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0d40b4320 0x7fe0d40b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:24.478 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.473+0000 7fe0d37fe640 1 --2- 172.21.15.47:0/2046501219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d40b37b0 0x7fe0d415a020 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400d5f0 tx=0x7fe0c400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:24.478 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.473+0000 7fe0bbfff640 1 -- 172.21.15.47:0/2046501219 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40125f0 con 0x7fe0d40b37b0 2024-04-14T23:34:24.478 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.473+0000 7fe0bbfff640 1 -- 172.21.15.47:0/2046501219 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c4019070 con 0x7fe0d40b37b0 2024-04-14T23:34:24.478 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.473+0000 7fe0d9a6d640 1 -- 172.21.15.47:0/2046501219 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d40b5090 con 0x7fe0d40b37b0 2024-04-14T23:34:24.478 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.473+0000 7fe0bbfff640 1 -- 172.21.15.47:0/2046501219 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40129d0 con 0x7fe0d40b37b0 2024-04-14T23:34:24.478 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.473+0000 7fe0d9a6d640 1 -- 172.21.15.47:0/2046501219 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d40b5650 con 0x7fe0d40b37b0 2024-04-14T23:34:24.478 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.474+0000 7fe0d9a6d640 1 -- 172.21.15.47:0/2046501219 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d4068b20 con 0x7fe0d40b37b0 2024-04-14T23:34:24.478 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.474+0000 7fe0bbfff640 1 -- 172.21.15.47:0/2046501219 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) ==== 90098+0+0 (secure 0 0 0) 0x7fe0c4012b70 con 0x7fe0d40b37b0 2024-04-14T23:34:24.479 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.475+0000 7fe0bbfff640 1 --2- 172.21.15.47:0/2046501219 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe0c006b900 0x7fe0c006ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:24.479 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.475+0000 7fe0bbfff640 1 -- 172.21.15.47:0/2046501219 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fe0c4089d60 con 0x7fe0d40b37b0 2024-04-14T23:34:24.479 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.475+0000 7fe0d2ffd640 1 --2- 172.21.15.47:0/2046501219 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe0c006b900 0x7fe0c006ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:24.479 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.476+0000 7fe0d2ffd640 1 --2- 172.21.15.47:0/2046501219 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe0c006b900 0x7fe0c006ddc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40b6a60 tx=0x7fe0c8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:24.481 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-14T23:34:24.479+0000 7f7975480640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T23:34:24.482 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-14T23:34:24.479+0000 7f3f953f8640 -1 osd.6 0 waiting for initial osdmap 2024-04-14T23:34:24.482 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.480+0000 7fe0bbfff640 1 -- 172.21.15.47:0/2046501219 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe0c40597e0 con 0x7fe0d40b37b0 2024-04-14T23:34:24.498 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-14T23:34:24.496+0000 7f3f8ca80640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T23:34:24.504 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-14T23:34:24.501+0000 7fb0fe3f8640 -1 osd.5 0 waiting for initial osdmap 2024-04-14T23:34:24.509 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-14T23:34:24.507+0000 7f771f5f7640 -1 osd.7 0 waiting for initial osdmap 2024-04-14T23:34:24.525 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-14T23:34:24.522+0000 7fb0f5a80640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T23:34:24.525 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-14T23:34:24.522+0000 7f7717480640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T23:34:24.668 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.665+0000 7fe0d9a6d640 1 -- 172.21.15.47:0/2046501219 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0d40b3cb0 con 0x7fe0d40b37b0 2024-04-14T23:34:24.669 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.666+0000 7fe0bbfff640 1 -- 172.21.15.47:0/2046501219 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fe0c40590e0 con 0x7fe0d40b37b0 2024-04-14T23:34:24.669 INFO:teuthology.misc.health.smithi047.stdout: 2024-04-14T23:34:24.669 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":12,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:22.365963+0000","last_up_change":"0.000000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:34:24.671 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.668+0000 7fe0d9a6d640 1 -- 172.21.15.47:0/2046501219 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe0c006b900 msgr2=0x7fe0c006ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:24.671 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.668+0000 7fe0d9a6d640 1 --2- 172.21.15.47:0/2046501219 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe0c006b900 0x7fe0c006ddc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40b6a60 tx=0x7fe0c8009040 comp rx=0 tx=0).stop 2024-04-14T23:34:24.671 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.668+0000 7fe0d9a6d640 1 -- 172.21.15.47:0/2046501219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d40b37b0 msgr2=0x7fe0d415a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:24.671 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.668+0000 7fe0d9a6d640 1 --2- 172.21.15.47:0/2046501219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d40b37b0 0x7fe0d415a020 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400d5f0 tx=0x7fe0c400dab0 comp rx=0 tx=0).stop 2024-04-14T23:34:24.672 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.668+0000 7fe0d9a6d640 1 -- 172.21.15.47:0/2046501219 shutdown_connections 2024-04-14T23:34:24.672 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.668+0000 7fe0d9a6d640 1 --2- 172.21.15.47:0/2046501219 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe0c006b900 0x7fe0c006ddc0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:24.672 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.668+0000 7fe0d9a6d640 1 --2- 172.21.15.47:0/2046501219 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0d4161960 0x7fe0d41f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:24.672 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.668+0000 7fe0d9a6d640 1 --2- 172.21.15.47:0/2046501219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0d40b4320 0x7fe0d40b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:24.672 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.668+0000 7fe0d9a6d640 1 --2- 172.21.15.47:0/2046501219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d40b37b0 0x7fe0d415a020 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:24.672 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.668+0000 7fe0d9a6d640 1 -- 172.21.15.47:0/2046501219 >> 172.21.15.47:0/2046501219 conn(0x7fe0d40d3ff0 msgr2=0x7fe0d415f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:24.672 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.668+0000 7fe0d9a6d640 1 -- 172.21.15.47:0/2046501219 shutdown_connections 2024-04-14T23:34:24.672 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:24.668+0000 7fe0d9a6d640 1 -- 172.21.15.47:0/2046501219 wait complete. 2024-04-14T23:34:24.680 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-14T23:34:31.487 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-14T23:34:31.589 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.586+0000 7f57e7bcc640 1 Processor -- start 2024-04-14T23:34:31.589 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.586+0000 7f57e7bcc640 1 -- start start 2024-04-14T23:34:31.590 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.587+0000 7f57e7bcc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f57e0161960 0x7f57e00cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:31.590 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.587+0000 7f57e7bcc640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57e00b31f0 con 0x7f57e00b37b0 2024-04-14T23:34:31.590 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.587+0000 7f57e7bcc640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57e00b34d0 con 0x7f57e00b4320 2024-04-14T23:34:31.590 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.587+0000 7f57e7bcc640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f57e00d2f00 con 0x7f57e0161960 2024-04-14T23:34:31.590 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.587+0000 7f57e5968640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f57e0161960 0x7f57e00cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:31.590 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.587+0000 7f57e5167640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f57e00b37b0 0x7f57e00b3c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60462/0 (socket says 172.21.15.47:60462) 2024-04-14T23:34:31.590 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.587+0000 7f57e5167640 1 -- 172.21.15.47:0/4028623474 learned_addr learned my addr 172.21.15.47:0/4028623474 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:31.591 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.587+0000 7f57e5968640 1 -- 172.21.15.47:0/4028623474 >> v1:172.21.15.191:6789/0 conn(0x7f57e00b4320 legacy=0x7f57e00d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:31.591 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.587+0000 7f57e5968640 1 -- 172.21.15.47:0/4028623474 >> v1:172.21.15.47:6789/0 conn(0x7f57e00b37b0 legacy=0x7f57e00b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:31.591 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.587+0000 7f57e5968640 1 -- 172.21.15.47:0/4028623474 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e00cf890 con 0x7f57e0161960 2024-04-14T23:34:31.592 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.588+0000 7f57e5968640 1 --2- 172.21.15.47:0/4028623474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57e0161960 0x7f57e00cfdb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0097a0 tx=0x7f57dc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64247c491e26f711 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:31.592 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.588+0000 7f57e4966640 1 -- 172.21.15.47:0/4028623474 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc034070 con 0x7f57e0161960 2024-04-14T23:34:31.592 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.588+0000 7f57e4966640 1 -- 172.21.15.47:0/4028623474 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57dc030610 con 0x7f57e0161960 2024-04-14T23:34:31.592 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.588+0000 7f57e4966640 1 -- 172.21.15.47:0/4028623474 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0309e0 con 0x7f57e0161960 2024-04-14T23:34:31.592 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.589+0000 7f57e7bcc640 1 -- 172.21.15.47:0/4028623474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57e0161960 msgr2=0x7f57e00cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:31.592 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.589+0000 7f57e7bcc640 1 --2- 172.21.15.47:0/4028623474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57e0161960 0x7f57e00cfdb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0097a0 tx=0x7f57dc02b960 comp rx=0 tx=0).stop 2024-04-14T23:34:31.592 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.589+0000 7f57e7bcc640 1 -- 172.21.15.47:0/4028623474 shutdown_connections 2024-04-14T23:34:31.592 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.589+0000 7f57e7bcc640 1 --2- 172.21.15.47:0/4028623474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57e0161960 0x7f57e00cfdb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:31.592 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.589+0000 7f57e7bcc640 1 -- 172.21.15.47:0/4028623474 >> 172.21.15.47:0/4028623474 conn(0x7f57e00d3ff0 msgr2=0x7f57e00d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:31.592 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.589+0000 7f57e7bcc640 1 -- 172.21.15.47:0/4028623474 shutdown_connections 2024-04-14T23:34:31.593 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.589+0000 7f57e7bcc640 1 -- 172.21.15.47:0/4028623474 wait complete. 2024-04-14T23:34:31.593 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.590+0000 7f57e7bcc640 1 Processor -- start 2024-04-14T23:34:31.593 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.590+0000 7f57e7bcc640 1 -- start start 2024-04-14T23:34:31.597 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e7bcc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57e00b37b0 0x7f57e00cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:31.597 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e7bcc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57e00b4320 0x7f57e00cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:31.597 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e7bcc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57e0161960 0x7f57e014efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:31.597 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e7bcc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f57e00b2fa0 con 0x7f57e0161960 2024-04-14T23:34:31.597 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e7bcc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f57e00d0c80 con 0x7f57e00b4320 2024-04-14T23:34:31.597 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e7bcc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f57e00d0e00 con 0x7f57e00b37b0 2024-04-14T23:34:31.597 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e6169640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57e0161960 0x7f57e014efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:31.597 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e6169640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57e0161960 0x7f57e014efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47788/0 (socket says 172.21.15.47:47788) 2024-04-14T23:34:31.597 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e6169640 1 -- 172.21.15.47:0/1637639941 learned_addr learned my addr 172.21.15.47:0/1637639941 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:31.597 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e5968640 1 --2- 172.21.15.47:0/1637639941 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57e00b37b0 0x7f57e00cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:31.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e5167640 1 --2- 172.21.15.47:0/1637639941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57e00b4320 0x7f57e00cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:31.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e6169640 1 -- 172.21.15.47:0/1637639941 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57e00b37b0 msgr2=0x7f57e00cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:31.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e6169640 1 --2- 172.21.15.47:0/1637639941 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57e00b37b0 0x7f57e00cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:31.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e6169640 1 -- 172.21.15.47:0/1637639941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57e00b4320 msgr2=0x7f57e00cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:31.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e6169640 1 --2- 172.21.15.47:0/1637639941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57e00b4320 0x7f57e00cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:31.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e6169640 1 -- 172.21.15.47:0/1637639941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e00cc3b0 con 0x7f57e0161960 2024-04-14T23:34:31.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.591+0000 7f57e6169640 1 --2- 172.21.15.47:0/1637639941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57e0161960 0x7f57e014efa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f57d800c7b0 tx=0x7f57d800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:31.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.592+0000 7f57d67fc640 1 -- 172.21.15.47:0/1637639941 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d800ce60 con 0x7f57e0161960 2024-04-14T23:34:31.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.592+0000 7f57d67fc640 1 -- 172.21.15.47:0/1637639941 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d8004b10 con 0x7f57e0161960 2024-04-14T23:34:31.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.592+0000 7f57d67fc640 1 -- 172.21.15.47:0/1637639941 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d800a850 con 0x7f57e0161960 2024-04-14T23:34:31.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.592+0000 7f57e7bcc640 1 -- 172.21.15.47:0/1637639941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e00c7c50 con 0x7f57e0161960 2024-04-14T23:34:31.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.592+0000 7f57e7bcc640 1 -- 172.21.15.47:0/1637639941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e00c8210 con 0x7f57e0161960 2024-04-14T23:34:31.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.593+0000 7f57e7bcc640 1 -- 172.21.15.47:0/1637639941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e008e000 con 0x7f57e0161960 2024-04-14T23:34:31.598 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.593+0000 7f57d67fc640 1 -- 172.21.15.47:0/1637639941 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f57d800a9f0 con 0x7f57e0161960 2024-04-14T23:34:31.599 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.593+0000 7f57d67fc640 1 --2- 172.21.15.47:0/1637639941 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f57c406b990 0x7f57c406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:31.599 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.594+0000 7f57d67fc640 1 -- 172.21.15.47:0/1637639941 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f57d808a6a0 con 0x7f57e0161960 2024-04-14T23:34:31.599 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.594+0000 7f57e5968640 1 --2- 172.21.15.47:0/1637639941 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f57c406b990 0x7f57c406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:31.599 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.594+0000 7f57e5968640 1 --2- 172.21.15.47:0/1637639941 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f57c406b990 0x7f57c406de50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f57dc036000 tx=0x7f57dc03b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:31.601 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.598+0000 7f57d67fc640 1 -- 172.21.15.47:0/1637639941 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f57e008e000 con 0x7f57e0161960 2024-04-14T23:34:31.783 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.781+0000 7f57e7bcc640 1 -- 172.21.15.47:0/1637639941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57e0068b20 con 0x7f57e0161960 2024-04-14T23:34:31.784 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.781+0000 7f57d67fc640 1 -- 172.21.15.47:0/1637639941 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7f57d8020070 con 0x7f57e0161960 2024-04-14T23:34:31.784 INFO:teuthology.misc.health.smithi047.stdout: 2024-04-14T23:34:31.784 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":16,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:28.472699+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:34:31.786 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.783+0000 7f57e7bcc640 1 -- 172.21.15.47:0/1637639941 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f57c406b990 msgr2=0x7f57c406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:31.786 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.783+0000 7f57e7bcc640 1 --2- 172.21.15.47:0/1637639941 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f57c406b990 0x7f57c406de50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f57dc036000 tx=0x7f57dc03b040 comp rx=0 tx=0).stop 2024-04-14T23:34:31.786 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.783+0000 7f57e7bcc640 1 -- 172.21.15.47:0/1637639941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57e0161960 msgr2=0x7f57e014efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:31.787 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.783+0000 7f57e7bcc640 1 --2- 172.21.15.47:0/1637639941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57e0161960 0x7f57e014efa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f57d800c7b0 tx=0x7f57d800cc70 comp rx=0 tx=0).stop 2024-04-14T23:34:31.787 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.783+0000 7f57e7bcc640 1 -- 172.21.15.47:0/1637639941 shutdown_connections 2024-04-14T23:34:31.787 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.783+0000 7f57e7bcc640 1 --2- 172.21.15.47:0/1637639941 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f57c406b990 0x7f57c406de50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:31.787 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.783+0000 7f57e7bcc640 1 --2- 172.21.15.47:0/1637639941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57e0161960 0x7f57e014efa0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:31.787 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.783+0000 7f57e7bcc640 1 --2- 172.21.15.47:0/1637639941 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57e00b4320 0x7f57e00cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:31.787 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.783+0000 7f57e7bcc640 1 --2- 172.21.15.47:0/1637639941 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57e00b37b0 0x7f57e00cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:31.787 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.783+0000 7f57e7bcc640 1 -- 172.21.15.47:0/1637639941 >> 172.21.15.47:0/1637639941 conn(0x7f57e00d3ff0 msgr2=0x7f57e00cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:31.787 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.783+0000 7f57e7bcc640 1 -- 172.21.15.47:0/1637639941 shutdown_connections 2024-04-14T23:34:31.787 INFO:teuthology.misc.health.smithi047.stderr:2024-04-14T23:34:31.783+0000 7f57e7bcc640 1 -- 172.21.15.47:0/1637639941 wait complete. 2024-04-14T23:34:31.796 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-14T23:34:31.796 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-14T23:34:31.797 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-14T23:34:31.797 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-14T23:34:31.800 INFO:tasks.ceph.mds.a:Started 2024-04-14T23:34:31.800 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-14T23:34:31.800 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-14T23:34:31.802 INFO:tasks.ceph.mds.c:Started 2024-04-14T23:34:31.802 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-14T23:34:31.802 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-14T23:34:31.805 INFO:tasks.ceph.mds.b:Started 2024-04-14T23:34:31.805 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-14T23:34:31.805 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-14T23:34:31.807 INFO:tasks.ceph.mds.d:Started 2024-04-14T23:34:31.807 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-14T23:34:31.808 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:34:31.877 INFO:tasks.ceph.mds.a.smithi047.stdout:starting mds.a at 2024-04-14T23:34:31.879 INFO:tasks.ceph.mds.c.smithi047.stdout:starting mds.c at 2024-04-14T23:34:31.891 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2024-04-14T23:34:31.892 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2024-04-14T23:34:31.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.913+0000 7f96a7511640 1 Processor -- start 2024-04-14T23:34:31.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.913+0000 7f96a7511640 1 -- start start 2024-04-14T23:34:31.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.914+0000 7f96a7511640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f96a015e270 0x7f96a00d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:31.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.914+0000 7f96a7511640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96a00d1450 0x7f96a00b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:31.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.914+0000 7f96a7511640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a00b39d0 con 0x7f96a00d1e00 2024-04-14T23:34:31.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.914+0000 7f96a7511640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f96a00b4300 con 0x7f96a015e270 2024-04-14T23:34:31.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.914+0000 7f96a7511640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f96a00b3cb0 con 0x7f96a00d1450 2024-04-14T23:34:31.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.914+0000 7f96a52ad640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f96a015e270 0x7f96a00d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:31.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.914+0000 7f96a52ad640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f96a015e270 0x7f96a00d0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47816/0 (socket says 172.21.15.47:47816) 2024-04-14T23:34:31.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.914+0000 7f96a52ad640 1 -- 172.21.15.47:0/3108305743 learned_addr learned my addr 172.21.15.47:0/3108305743 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:31.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.914+0000 7f96a5aae640 1 --2- 172.21.15.47:0/3108305743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96a00d1450 0x7f96a00b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:31.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.914+0000 7f96a52ad640 1 -- 172.21.15.47:0/3108305743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96a00d1450 msgr2=0x7f96a00b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:31.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.914+0000 7f96a52ad640 1 --2- 172.21.15.47:0/3108305743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96a00d1450 0x7f96a00b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:31.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.914+0000 7f96a52ad640 1 -- 172.21.15.47:0/3108305743 >> v1:172.21.15.191:6789/0 conn(0x7f96a00d1e00 legacy=0x7f96a00d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:31.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.914+0000 7f96a52ad640 1 -- 172.21.15.47:0/3108305743 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a00b3f90 con 0x7f96a015e270 2024-04-14T23:34:31.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.914+0000 7f96a5aae640 1 --2- 172.21.15.47:0/3108305743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96a00d1450 0x7f96a00b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:31.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.915+0000 7f96a52ad640 1 --2- 172.21.15.47:0/3108305743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a015e270 0x7f96a00d0f10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f969c009870 tx=0x7f969c02ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7073368af638a0c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:31.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.915+0000 7f9697fff640 1 -- 172.21.15.47:0/3108305743 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c02f830 con 0x7f96a015e270 2024-04-14T23:34:31.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.915+0000 7f9697fff640 1 -- 172.21.15.47:0/3108305743 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969c02f9d0 con 0x7f96a015e270 2024-04-14T23:34:31.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.915+0000 7f9697fff640 1 -- 172.21.15.47:0/3108305743 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c02fda0 con 0x7f96a015e270 2024-04-14T23:34:31.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.916+0000 7f96a7511640 1 -- 172.21.15.47:0/3108305743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a015e270 msgr2=0x7f96a00d0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:31.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.916+0000 7f96a7511640 1 --2- 172.21.15.47:0/3108305743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a015e270 0x7f96a00d0f10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f969c009870 tx=0x7f969c02ba10 comp rx=0 tx=0).stop 2024-04-14T23:34:31.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.916+0000 7f96a7511640 1 -- 172.21.15.47:0/3108305743 shutdown_connections 2024-04-14T23:34:31.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.916+0000 7f96a7511640 1 --2- 172.21.15.47:0/3108305743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96a00d1450 0x7f96a00b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:31.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.916+0000 7f96a7511640 1 --2- 172.21.15.47:0/3108305743 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a015e270 0x7f96a00d0f10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.916+0000 7f96a7511640 1 -- 172.21.15.47:0/3108305743 >> 172.21.15.47:0/3108305743 conn(0x7f96a00d3ed0 msgr2=0x7f96a00d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.916+0000 7f96a7511640 1 -- 172.21.15.47:0/3108305743 shutdown_connections 2024-04-14T23:34:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.916+0000 7f96a7511640 1 -- 172.21.15.47:0/3108305743 wait complete. 2024-04-14T23:34:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.917+0000 7f96a7511640 1 Processor -- start 2024-04-14T23:34:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.917+0000 7f96a7511640 1 -- start start 2024-04-14T23:34:31.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a7511640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a00d1450 0x7f96a0153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:31.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a7511640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96a00d1e00 0x7f96a00b9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:31.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a7511640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96a015e270 0x7f96a00b98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:31.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a7511640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f96a015e7d0 con 0x7f96a00d1450 2024-04-14T23:34:31.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a7511640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f96a015e650 con 0x7f96a015e270 2024-04-14T23:34:31.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a7511640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f96a00d2910 con 0x7f96a00d1e00 2024-04-14T23:34:31.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a52ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a00d1450 0x7f96a0153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:31.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a52ad640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a00d1450 0x7f96a0153510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47824/0 (socket says 172.21.15.47:47824) 2024-04-14T23:34:31.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a52ad640 1 -- 172.21.15.47:0/329362106 learned_addr learned my addr 172.21.15.47:0/329362106 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:31.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a4aac640 1 --2- 172.21.15.47:0/329362106 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96a00d1e00 0x7f96a00b9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:31.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a5aae640 1 --2- 172.21.15.47:0/329362106 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96a015e270 0x7f96a00b98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:31.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a52ad640 1 -- 172.21.15.47:0/329362106 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96a00d1e00 msgr2=0x7f96a00b9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:31.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a52ad640 1 --2- 172.21.15.47:0/329362106 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96a00d1e00 0x7f96a00b9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:31.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a52ad640 1 -- 172.21.15.47:0/329362106 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96a015e270 msgr2=0x7f96a00b98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:31.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a52ad640 1 --2- 172.21.15.47:0/329362106 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96a015e270 0x7f96a00b98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:31.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a52ad640 1 -- 172.21.15.47:0/329362106 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a00cc630 con 0x7f96a00d1450 2024-04-14T23:34:31.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a52ad640 1 --2- 172.21.15.47:0/329362106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a00d1450 0x7f96a0153510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f969c000c00 tx=0x7f969c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:31.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f9695ffb640 1 -- 172.21.15.47:0/329362106 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c037d10 con 0x7f96a00d1450 2024-04-14T23:34:31.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f9695ffb640 1 -- 172.21.15.47:0/329362106 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969c046070 con 0x7f96a00d1450 2024-04-14T23:34:31.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.918+0000 7f96a7511640 1 -- 172.21.15.47:0/329362106 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a00b6d20 con 0x7f96a00d1450 2024-04-14T23:34:31.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.919+0000 7f9695ffb640 1 -- 172.21.15.47:0/329362106 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c041640 con 0x7f96a00d1450 2024-04-14T23:34:31.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.919+0000 7f96a7511640 1 -- 172.21.15.47:0/329362106 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a00b72e0 con 0x7f96a00d1450 2024-04-14T23:34:31.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.920+0000 7f96a7511640 1 -- 172.21.15.47:0/329362106 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a0075430 con 0x7f96a00d1450 2024-04-14T23:34:31.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.920+0000 7f9695ffb640 1 -- 172.21.15.47:0/329362106 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f969c040070 con 0x7f96a00d1450 2024-04-14T23:34:31.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.920+0000 7f9695ffb640 1 --2- 172.21.15.47:0/329362106 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f968406b990 0x7f968406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:31.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.921+0000 7f9695ffb640 1 -- 172.21.15.47:0/329362106 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f969c0acac0 con 0x7f96a00d1450 2024-04-14T23:34:31.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.921+0000 7f96a4aac640 1 --2- 172.21.15.47:0/329362106 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f968406b990 0x7f968406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:31.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.921+0000 7f96a4aac640 1 --2- 172.21.15.47:0/329362106 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f968406b990 0x7f968406de50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f96a00a1fb0 tx=0x7f9690009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:31.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:31.925+0000 7f9695ffb640 1 -- 172.21.15.47:0/329362106 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f969c033030 con 0x7f96a00d1450 2024-04-14T23:34:32.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.107+0000 7f96a7511640 1 -- 172.21.15.47:0/329362106 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96a00d2480 con 0x7f96a00d1450 2024-04-14T23:34:32.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.108+0000 7f9695ffb640 1 -- 172.21.15.47:0/329362106 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7f969c07bab0 con 0x7f96a00d1450 2024-04-14T23:34:32.111 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:32.111 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":16,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:28.472699+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:34:32.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.110+0000 7f96a7511640 1 -- 172.21.15.47:0/329362106 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f968406b990 msgr2=0x7f968406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:32.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.110+0000 7f96a7511640 1 --2- 172.21.15.47:0/329362106 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f968406b990 0x7f968406de50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f96a00a1fb0 tx=0x7f9690009040 comp rx=0 tx=0).stop 2024-04-14T23:34:32.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.110+0000 7f96a7511640 1 -- 172.21.15.47:0/329362106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a00d1450 msgr2=0x7f96a0153510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:32.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.110+0000 7f96a7511640 1 --2- 172.21.15.47:0/329362106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a00d1450 0x7f96a0153510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f969c000c00 tx=0x7f969c004730 comp rx=0 tx=0).stop 2024-04-14T23:34:32.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.110+0000 7f96a7511640 1 -- 172.21.15.47:0/329362106 shutdown_connections 2024-04-14T23:34:32.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.110+0000 7f96a7511640 1 --2- 172.21.15.47:0/329362106 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f968406b990 0x7f968406de50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.110+0000 7f96a7511640 1 --2- 172.21.15.47:0/329362106 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96a015e270 0x7f96a00b98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.110+0000 7f96a7511640 1 --2- 172.21.15.47:0/329362106 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96a00d1e00 0x7f96a00b9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.110+0000 7f96a7511640 1 --2- 172.21.15.47:0/329362106 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a00d1450 0x7f96a0153510 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.110+0000 7f96a7511640 1 -- 172.21.15.47:0/329362106 >> 172.21.15.47:0/329362106 conn(0x7f96a00d3ed0 msgr2=0x7f96a00d0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:32.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.110+0000 7f96a7511640 1 -- 172.21.15.47:0/329362106 shutdown_connections 2024-04-14T23:34:32.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.110+0000 7f96a7511640 1 -- 172.21.15.47:0/329362106 wait complete. 2024-04-14T23:34:32.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T23:34:32.124 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:34:32.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.225+0000 7f64f991e640 1 Processor -- start 2024-04-14T23:34:32.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.225+0000 7f64f991e640 1 -- start start 2024-04-14T23:34:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.225+0000 7f64f991e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f64f41615f0 0x7f64f406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.225+0000 7f64f991e640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f64f40d2840 0x7f64f40cc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.226+0000 7f64f991e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64f40cef40 con 0x7f64f41619d0 2024-04-14T23:34:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.226+0000 7f64f991e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f64f40cf220 con 0x7f64f41615f0 2024-04-14T23:34:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.226+0000 7f64f991e640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f64f40cf500 con 0x7f64f40d2840 2024-04-14T23:34:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.226+0000 7f64f2ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f64f41615f0 0x7f64f406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.226+0000 7f64f2ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f64f41615f0 0x7f64f406f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47836/0 (socket says 172.21.15.47:47836) 2024-04-14T23:34:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.226+0000 7f64f27fc640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f64f41619d0 0x7f64f40d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60482/0 (socket says 172.21.15.47:60482) 2024-04-14T23:34:32.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.226+0000 7f64f2ffd640 1 -- 172.21.15.47:0/3457204543 learned_addr learned my addr 172.21.15.47:0/3457204543 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:32.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.226+0000 7f64f37fe640 1 --2- 172.21.15.47:0/3457204543 >> v2:172.21.15.191:3300/0 conn(0x7f64f40d2840 0x7f64f40cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:32.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.226+0000 7f64f2ffd640 1 -- 172.21.15.47:0/3457204543 >> v2:172.21.15.191:3300/0 conn(0x7f64f40d2840 msgr2=0x7f64f40cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:32.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.226+0000 7f64f2ffd640 1 --2- 172.21.15.47:0/3457204543 >> v2:172.21.15.191:3300/0 conn(0x7f64f40d2840 0x7f64f40cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.226+0000 7f64f2ffd640 1 -- 172.21.15.47:0/3457204543 >> v1:172.21.15.47:6789/0 conn(0x7f64f41619d0 legacy=0x7f64f40d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:32.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.226+0000 7f64f2ffd640 1 -- 172.21.15.47:0/3457204543 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f40d0200 con 0x7f64f41615f0 2024-04-14T23:34:32.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.226+0000 7f64f1ffb640 1 -- 172.21.15.47:0/3457204543 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1020711392 0 0) 0x7f64f40cef40 con 0x7f64f41619d0 2024-04-14T23:34:32.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.227+0000 7f64f2ffd640 1 --2- 172.21.15.47:0/3457204543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f41615f0 0x7f64f406f0e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f64f40c5790 tx=0x7f64e402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b576f65a5695b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:32.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.227+0000 7f64f1ffb640 1 -- 172.21.15.47:0/3457204543 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e4034070 con 0x7f64f41615f0 2024-04-14T23:34:32.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.227+0000 7f64f1ffb640 1 -- 172.21.15.47:0/3457204543 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e4030860 con 0x7f64f41615f0 2024-04-14T23:34:32.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.227+0000 7f64f1ffb640 1 -- 172.21.15.47:0/3457204543 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e4030c30 con 0x7f64f41615f0 2024-04-14T23:34:32.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.227+0000 7f64f991e640 1 -- 172.21.15.47:0/3457204543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f41615f0 msgr2=0x7f64f406f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:32.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.227+0000 7f64f991e640 1 --2- 172.21.15.47:0/3457204543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f41615f0 0x7f64f406f0e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f64f40c5790 tx=0x7f64e402b9a0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.227+0000 7f64f991e640 1 -- 172.21.15.47:0/3457204543 shutdown_connections 2024-04-14T23:34:32.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.227+0000 7f64f991e640 1 --2- 172.21.15.47:0/3457204543 >> v2:172.21.15.191:3300/0 conn(0x7f64f40d2840 0x7f64f40cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.227+0000 7f64f991e640 1 --2- 172.21.15.47:0/3457204543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f41615f0 0x7f64f406f0e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.227+0000 7f64f991e640 1 -- 172.21.15.47:0/3457204543 >> 172.21.15.47:0/3457204543 conn(0x7f64f40d1cb0 msgr2=0x7f64f40d20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:32.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.227+0000 7f64f991e640 1 -- 172.21.15.47:0/3457204543 shutdown_connections 2024-04-14T23:34:32.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.227+0000 7f64f991e640 1 -- 172.21.15.47:0/3457204543 wait complete. 2024-04-14T23:34:32.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.228+0000 7f64f991e640 1 Processor -- start 2024-04-14T23:34:32.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.229+0000 7f64f991e640 1 -- start start 2024-04-14T23:34:32.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.229+0000 7f64f991e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64f40d2840 0x7f64f415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:32.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.229+0000 7f64f991e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f41615f0 0x7f64f415f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:32.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.229+0000 7f64f991e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f41619d0 0x7f64f415f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:32.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.229+0000 7f64f991e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f64f40d1110 con 0x7f64f41619d0 2024-04-14T23:34:32.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.229+0000 7f64f991e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f64f40cfe90 con 0x7f64f41615f0 2024-04-14T23:34:32.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.229+0000 7f64f991e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f64f40cc840 con 0x7f64f40d2840 2024-04-14T23:34:32.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.230+0000 7f64f37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f41619d0 0x7f64f415f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:32.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.230+0000 7f64f37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f41619d0 0x7f64f415f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47844/0 (socket says 172.21.15.47:47844) 2024-04-14T23:34:32.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.230+0000 7f64f37fe640 1 -- 172.21.15.47:0/3404247594 learned_addr learned my addr 172.21.15.47:0/3404247594 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:32.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.230+0000 7f64f2ffd640 1 --2- 172.21.15.47:0/3404247594 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64f40d2840 0x7f64f415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:32.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.230+0000 7f64f27fc640 1 --2- 172.21.15.47:0/3404247594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f41615f0 0x7f64f415f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:32.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.230+0000 7f64f37fe640 1 -- 172.21.15.47:0/3404247594 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64f40d2840 msgr2=0x7f64f415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:32.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.230+0000 7f64f37fe640 1 --2- 172.21.15.47:0/3404247594 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64f40d2840 0x7f64f415b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.230+0000 7f64f37fe640 1 -- 172.21.15.47:0/3404247594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f41615f0 msgr2=0x7f64f415f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:32.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.230+0000 7f64f37fe640 1 --2- 172.21.15.47:0/3404247594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f41615f0 0x7f64f415f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.230+0000 7f64f37fe640 1 -- 172.21.15.47:0/3404247594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f40c78d0 con 0x7f64f41619d0 2024-04-14T23:34:32.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.230+0000 7f64f37fe640 1 --2- 172.21.15.47:0/3404247594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f41619d0 0x7f64f415f800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f64ec00cda0 tx=0x7f64ec00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:32.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.230+0000 7f64dbfff640 1 -- 172.21.15.47:0/3404247594 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec003b90 con 0x7f64f41619d0 2024-04-14T23:34:32.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.230+0000 7f64dbfff640 1 -- 172.21.15.47:0/3404247594 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ec003d30 con 0x7f64f41619d0 2024-04-14T23:34:32.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.230+0000 7f64f991e640 1 -- 172.21.15.47:0/3404247594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64f40c6830 con 0x7f64f41619d0 2024-04-14T23:34:32.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.230+0000 7f64dbfff640 1 -- 172.21.15.47:0/3404247594 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec004240 con 0x7f64f41619d0 2024-04-14T23:34:32.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.230+0000 7f64f991e640 1 -- 172.21.15.47:0/3404247594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64f40c6df0 con 0x7f64f41619d0 2024-04-14T23:34:32.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.231+0000 7f64f991e640 1 -- 172.21.15.47:0/3404247594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64f4073f50 con 0x7f64f41619d0 2024-04-14T23:34:32.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.232+0000 7f64dbfff640 1 -- 172.21.15.47:0/3404247594 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f64ec0043e0 con 0x7f64f41619d0 2024-04-14T23:34:32.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.232+0000 7f64dbfff640 1 --2- 172.21.15.47:0/3404247594 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f64e006b990 0x7f64e006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.232+0000 7f64dbfff640 1 -- 172.21.15.47:0/3404247594 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f64ec08aed0 con 0x7f64f41619d0 2024-04-14T23:34:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.232+0000 7f64f2ffd640 1 --2- 172.21.15.47:0/3404247594 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f64e006b990 0x7f64e006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.233+0000 7f64f2ffd640 1 --2- 172.21.15.47:0/3404247594 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f64e006b990 0x7f64e006de50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f64e4036000 tx=0x7f64e4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:32.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.236+0000 7f64dbfff640 1 -- 172.21.15.47:0/3404247594 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f64f40c78d0 con 0x7f64f41619d0 2024-04-14T23:34:32.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.418+0000 7f64f991e640 1 -- 172.21.15.47:0/3404247594 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f64f406bef0 con 0x7f64f41619d0 2024-04-14T23:34:32.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.419+0000 7f64dbfff640 1 -- 172.21.15.47:0/3404247594 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f64ec0597e0 con 0x7f64f41619d0 2024-04-14T23:34:32.422 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:34:32.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.421+0000 7f64f991e640 1 -- 172.21.15.47:0/3404247594 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f64e006b990 msgr2=0x7f64e006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:32.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.421+0000 7f64f991e640 1 --2- 172.21.15.47:0/3404247594 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f64e006b990 0x7f64e006de50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f64e4036000 tx=0x7f64e4008030 comp rx=0 tx=0).stop 2024-04-14T23:34:32.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.421+0000 7f64f991e640 1 -- 172.21.15.47:0/3404247594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f41619d0 msgr2=0x7f64f415f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:32.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.421+0000 7f64f991e640 1 --2- 172.21.15.47:0/3404247594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f41619d0 0x7f64f415f800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f64ec00cda0 tx=0x7f64ec00a660 comp rx=0 tx=0).stop 2024-04-14T23:34:32.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.421+0000 7f64f991e640 1 -- 172.21.15.47:0/3404247594 shutdown_connections 2024-04-14T23:34:32.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.421+0000 7f64f991e640 1 --2- 172.21.15.47:0/3404247594 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f64e006b990 0x7f64e006de50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.421+0000 7f64f991e640 1 --2- 172.21.15.47:0/3404247594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f41619d0 0x7f64f415f800 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.421+0000 7f64f991e640 1 --2- 172.21.15.47:0/3404247594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f41615f0 0x7f64f415f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.421+0000 7f64f991e640 1 --2- 172.21.15.47:0/3404247594 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64f40d2840 0x7f64f415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.421+0000 7f64f991e640 1 -- 172.21.15.47:0/3404247594 >> 172.21.15.47:0/3404247594 conn(0x7f64f40d1cb0 msgr2=0x7f64f406c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:32.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.421+0000 7f64f991e640 1 -- 172.21.15.47:0/3404247594 shutdown_connections 2024-04-14T23:34:32.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.421+0000 7f64f991e640 1 -- 172.21.15.47:0/3404247594 wait complete. 2024-04-14T23:34:32.434 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T23:34:32.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.533+0000 7fdf2a808640 1 Processor -- start 2024-04-14T23:34:32.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.533+0000 7fdf2a808640 1 -- start start 2024-04-14T23:34:32.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.533+0000 7fdf2a808640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdf2415e270 0x7fdf240d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:32.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.533+0000 7fdf2a808640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdf240d1e00 0x7fdf240d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.533+0000 7fdf2a808640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf240b57a0 con 0x7fdf240d1450 2024-04-14T23:34:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.533+0000 7fdf2a808640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fdf240b4300 con 0x7fdf2415e270 2024-04-14T23:34:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.533+0000 7fdf2a808640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fdf240b39d0 con 0x7fdf240d1e00 2024-04-14T23:34:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.533+0000 7fdf23fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdf2415e270 0x7fdf240d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.534+0000 7fdf23fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdf2415e270 0x7fdf240d0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47858/0 (socket says 172.21.15.47:47858) 2024-04-14T23:34:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.534+0000 7fdf23fff640 1 -- 172.21.15.47:0/2374027660 learned_addr learned my addr 172.21.15.47:0/2374027660 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.534+0000 7fdf237fe640 1 --2- 172.21.15.47:0/2374027660 >> v2:172.21.15.191:3300/0 conn(0x7fdf240d1e00 0x7fdf240d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.534+0000 7fdf23fff640 1 -- 172.21.15.47:0/2374027660 >> v2:172.21.15.191:3300/0 conn(0x7fdf240d1e00 msgr2=0x7fdf240d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.534+0000 7fdf23fff640 1 --2- 172.21.15.47:0/2374027660 >> v2:172.21.15.191:3300/0 conn(0x7fdf240d1e00 0x7fdf240d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.534+0000 7fdf23fff640 1 -- 172.21.15.47:0/2374027660 >> v1:172.21.15.191:6789/0 conn(0x7fdf240d1450 legacy=0x7fdf240ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.534+0000 7fdf23fff640 1 -- 172.21.15.47:0/2374027660 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf240b3cb0 con 0x7fdf2415e270 2024-04-14T23:34:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.534+0000 7fdf237fe640 1 --2- 172.21.15.47:0/2374027660 >> v2:172.21.15.191:3300/0 conn(0x7fdf240d1e00 0x7fdf240d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.535+0000 7fdf23fff640 1 --2- 172.21.15.47:0/2374027660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2415e270 0x7fdf240d0f10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdf240b4480 tx=0x7fdf1402b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7c010fee64d6c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:32.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.535+0000 7fdf22ffd640 1 -- 172.21.15.47:0/2374027660 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14034070 con 0x7fdf2415e270 2024-04-14T23:34:32.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.535+0000 7fdf22ffd640 1 -- 172.21.15.47:0/2374027660 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf14030850 con 0x7fdf2415e270 2024-04-14T23:34:32.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.535+0000 7fdf22ffd640 1 -- 172.21.15.47:0/2374027660 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14030c20 con 0x7fdf2415e270 2024-04-14T23:34:32.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.535+0000 7fdf2a808640 1 -- 172.21.15.47:0/2374027660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2415e270 msgr2=0x7fdf240d0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:32.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.535+0000 7fdf2a808640 1 --2- 172.21.15.47:0/2374027660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2415e270 0x7fdf240d0f10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdf240b4480 tx=0x7fdf1402b990 comp rx=0 tx=0).stop 2024-04-14T23:34:32.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.535+0000 7fdf2a808640 1 -- 172.21.15.47:0/2374027660 shutdown_connections 2024-04-14T23:34:32.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.535+0000 7fdf2a808640 1 --2- 172.21.15.47:0/2374027660 >> v2:172.21.15.191:3300/0 conn(0x7fdf240d1e00 0x7fdf240d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.535+0000 7fdf2a808640 1 --2- 172.21.15.47:0/2374027660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf2415e270 0x7fdf240d0f10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.535+0000 7fdf2a808640 1 -- 172.21.15.47:0/2374027660 >> 172.21.15.47:0/2374027660 conn(0x7fdf240d3ed0 msgr2=0x7fdf240d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:32.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.535+0000 7fdf2a808640 1 -- 172.21.15.47:0/2374027660 shutdown_connections 2024-04-14T23:34:32.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.535+0000 7fdf2a808640 1 -- 172.21.15.47:0/2374027660 wait complete. 2024-04-14T23:34:32.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.536+0000 7fdf2a808640 1 Processor -- start 2024-04-14T23:34:32.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.537+0000 7fdf2a808640 1 -- start start 2024-04-14T23:34:32.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.537+0000 7fdf2a808640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf240d1450 0x7fdf240cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:32.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.537+0000 7fdf2a808640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf240d1e00 0x7fdf2415e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:32.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.537+0000 7fdf2a808640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf2415e270 0x7fdf2415ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:32.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.537+0000 7fdf2a808640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2415e650 con 0x7fdf240d1e00 2024-04-14T23:34:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.537+0000 7fdf2a808640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdf240b0c60 con 0x7fdf2415e270 2024-04-14T23:34:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.537+0000 7fdf2a808640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fdf2415e7d0 con 0x7fdf240d1450 2024-04-14T23:34:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.537+0000 7fdf237fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf240d1e00 0x7fdf2415e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.537+0000 7fdf237fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf240d1e00 0x7fdf2415e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47860/0 (socket says 172.21.15.47:47860) 2024-04-14T23:34:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.537+0000 7fdf237fe640 1 -- 172.21.15.47:0/1909925182 learned_addr learned my addr 172.21.15.47:0/1909925182 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.537+0000 7fdf28da5640 1 --2- 172.21.15.47:0/1909925182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf2415e270 0x7fdf2415ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.537+0000 7fdf23fff640 1 --2- 172.21.15.47:0/1909925182 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf240d1450 0x7fdf240cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.538+0000 7fdf237fe640 1 -- 172.21.15.47:0/1909925182 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf240d1450 msgr2=0x7fdf240cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.538+0000 7fdf237fe640 1 --2- 172.21.15.47:0/1909925182 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf240d1450 0x7fdf240cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.538+0000 7fdf237fe640 1 -- 172.21.15.47:0/1909925182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf2415e270 msgr2=0x7fdf2415ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.538+0000 7fdf237fe640 1 --2- 172.21.15.47:0/1909925182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf2415e270 0x7fdf2415ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.538+0000 7fdf237fe640 1 -- 172.21.15.47:0/1909925182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf241613e0 con 0x7fdf240d1e00 2024-04-14T23:34:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.538+0000 7fdf237fe640 1 --2- 172.21.15.47:0/1909925182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf240d1e00 0x7fdf2415e9e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800c7f0 tx=0x7fdf1800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.538+0000 7fdf20ff9640 1 -- 172.21.15.47:0/1909925182 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18004230 con 0x7fdf240d1e00 2024-04-14T23:34:32.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.538+0000 7fdf20ff9640 1 -- 172.21.15.47:0/1909925182 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf180043d0 con 0x7fdf240d1e00 2024-04-14T23:34:32.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.538+0000 7fdf20ff9640 1 -- 172.21.15.47:0/1909925182 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18007a70 con 0x7fdf240d1e00 2024-04-14T23:34:32.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.538+0000 7fdf2a808640 1 -- 172.21.15.47:0/1909925182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf240b6f70 con 0x7fdf240d1e00 2024-04-14T23:34:32.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.538+0000 7fdf2a808640 1 -- 172.21.15.47:0/1909925182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf240b7530 con 0x7fdf240d1e00 2024-04-14T23:34:32.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.539+0000 7fdf2a808640 1 -- 172.21.15.47:0/1909925182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf24075430 con 0x7fdf240d1e00 2024-04-14T23:34:32.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.539+0000 7fdf20ff9640 1 -- 172.21.15.47:0/1909925182 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fdf18007c10 con 0x7fdf240d1e00 2024-04-14T23:34:32.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.540+0000 7fdf20ff9640 1 --2- 172.21.15.47:0/1909925182 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdf1006b990 0x7fdf1006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:32.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.540+0000 7fdf20ff9640 1 -- 172.21.15.47:0/1909925182 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fdf1808a490 con 0x7fdf240d1e00 2024-04-14T23:34:32.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.540+0000 7fdf23fff640 1 --2- 172.21.15.47:0/1909925182 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdf1006b990 0x7fdf1006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:32.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.540+0000 7fdf23fff640 1 --2- 172.21.15.47:0/1909925182 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdf1006b990 0x7fdf1006de50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdf14036000 tx=0x7fdf1403b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:32.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.544+0000 7fdf20ff9640 1 -- 172.21.15.47:0/1909925182 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdf18015020 con 0x7fdf240d1e00 2024-04-14T23:34:32.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.764+0000 7fdf2a808640 1 -- 172.21.15.47:0/1909925182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf240d0930 con 0x7fdf240d1e00 2024-04-14T23:34:32.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.764+0000 7fdf20ff9640 1 -- 172.21.15.47:0/1909925182 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fdf18058da0 con 0x7fdf240d1e00 2024-04-14T23:34:32.767 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:32.767 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/2830978927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2830978927},{"type":"v1","addr":"172.21.15.47:6833","nonce":2830978927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-14T23:34:32.767 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 2 2024-04-14T23:34:32.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.766+0000 7fdf2a808640 1 -- 172.21.15.47:0/1909925182 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdf1006b990 msgr2=0x7fdf1006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:32.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.766+0000 7fdf2a808640 1 --2- 172.21.15.47:0/1909925182 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdf1006b990 0x7fdf1006de50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdf14036000 tx=0x7fdf1403b040 comp rx=0 tx=0).stop 2024-04-14T23:34:32.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.766+0000 7fdf2a808640 1 -- 172.21.15.47:0/1909925182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf240d1e00 msgr2=0x7fdf2415e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:32.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.766+0000 7fdf2a808640 1 --2- 172.21.15.47:0/1909925182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf240d1e00 0x7fdf2415e9e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800c7f0 tx=0x7fdf1800ccb0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.766+0000 7fdf2a808640 1 -- 172.21.15.47:0/1909925182 shutdown_connections 2024-04-14T23:34:32.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.766+0000 7fdf2a808640 1 --2- 172.21.15.47:0/1909925182 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdf1006b990 0x7fdf1006de50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.766+0000 7fdf2a808640 1 --2- 172.21.15.47:0/1909925182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf2415e270 0x7fdf2415ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.766+0000 7fdf2a808640 1 --2- 172.21.15.47:0/1909925182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf240d1e00 0x7fdf2415e9e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.766+0000 7fdf2a808640 1 --2- 172.21.15.47:0/1909925182 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf240d1450 0x7fdf240cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:32.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.766+0000 7fdf2a808640 1 -- 172.21.15.47:0/1909925182 >> 172.21.15.47:0/1909925182 conn(0x7fdf240d3ed0 msgr2=0x7fdf2406d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:32.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.766+0000 7fdf2a808640 1 -- 172.21.15.47:0/1909925182 shutdown_connections 2024-04-14T23:34:32.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:32.766+0000 7fdf2a808640 1 -- 172.21.15.47:0/1909925182 wait complete. 2024-04-14T23:34:34.780 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T23:34:34.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.891+0000 7f066cb1e640 1 Processor -- start 2024-04-14T23:34:34.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.891+0000 7f066cb1e640 1 -- start start 2024-04-14T23:34:34.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.892+0000 7f066cb1e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f06680d2b30 0x7f06680cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:34.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.892+0000 7f066cb1e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06680c83c0 con 0x7f066815e4a0 2024-04-14T23:34:34.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.892+0000 7f066cb1e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06680c86a0 con 0x7f06680d1c40 2024-04-14T23:34:34.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.892+0000 7f066cb1e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f066815e880 con 0x7f06680d2b30 2024-04-14T23:34:34.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.892+0000 7f0665d9b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f06680d2b30 0x7f06680cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:34.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.892+0000 7f066659c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f066815e4a0 0x7f06680d2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:39436/0 (socket says 172.21.15.47:39436) 2024-04-14T23:34:34.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.892+0000 7f066659c640 1 -- 172.21.15.47:0/2606182424 learned_addr learned my addr 172.21.15.47:0/2606182424 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:34.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.892+0000 7f0665d9b640 1 -- 172.21.15.47:0/2606182424 >> v1:172.21.15.191:6789/0 conn(0x7f06680d1c40 legacy=0x7f06680cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:34.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.892+0000 7f0665d9b640 1 -- 172.21.15.47:0/2606182424 >> v1:172.21.15.47:6789/0 conn(0x7f066815e4a0 legacy=0x7f06680d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:34.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.892+0000 7f0665d9b640 1 -- 172.21.15.47:0/2606182424 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06680c8980 con 0x7f06680d2b30 2024-04-14T23:34:34.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.893+0000 7f0665d9b640 1 --2- 172.21.15.47:0/2606182424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06680d2b30 0x7f06680cea70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f065c0097a0 tx=0x7f065c02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88c1707884b4fc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:34.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.893+0000 7f066559a640 1 -- 172.21.15.47:0/2606182424 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c037070 con 0x7f06680d2b30 2024-04-14T23:34:34.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.893+0000 7f066559a640 1 -- 172.21.15.47:0/2606182424 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f065c030710 con 0x7f06680d2b30 2024-04-14T23:34:34.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.893+0000 7f066559a640 1 -- 172.21.15.47:0/2606182424 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c030ae0 con 0x7f06680d2b30 2024-04-14T23:34:34.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.894+0000 7f066cb1e640 1 -- 172.21.15.47:0/2606182424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06680d2b30 msgr2=0x7f06680cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:34.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.894+0000 7f066cb1e640 1 --2- 172.21.15.47:0/2606182424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06680d2b30 0x7f06680cea70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f065c0097a0 tx=0x7f065c02b710 comp rx=0 tx=0).stop 2024-04-14T23:34:34.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.894+0000 7f066cb1e640 1 -- 172.21.15.47:0/2606182424 shutdown_connections 2024-04-14T23:34:34.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.894+0000 7f066cb1e640 1 --2- 172.21.15.47:0/2606182424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06680d2b30 0x7f06680cea70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:34.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.894+0000 7f066cb1e640 1 -- 172.21.15.47:0/2606182424 >> 172.21.15.47:0/2606182424 conn(0x7f06680d3ef0 msgr2=0x7f06680d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:34.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.894+0000 7f066cb1e640 1 -- 172.21.15.47:0/2606182424 shutdown_connections 2024-04-14T23:34:34.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.894+0000 7f066cb1e640 1 -- 172.21.15.47:0/2606182424 wait complete. 2024-04-14T23:34:34.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.895+0000 7f066cb1e640 1 Processor -- start 2024-04-14T23:34:34.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.895+0000 7f066cb1e640 1 -- start start 2024-04-14T23:34:34.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.896+0000 7f066cb1e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06680d1c40 0x7f0668160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:34.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.896+0000 7f066cb1e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06680d2b30 0x7f066815aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:34.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.896+0000 7f066cb1e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066815e4a0 0x7f066815fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:34.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.896+0000 7f066cb1e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0668067bb0 con 0x7f066815e4a0 2024-04-14T23:34:34.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.896+0000 7f066cb1e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f06680c8f40 con 0x7f06680d2b30 2024-04-14T23:34:34.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.896+0000 7f066cb1e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0668067d30 con 0x7f06680d1c40 2024-04-14T23:34:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.896+0000 7f0666d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066815e4a0 0x7f066815fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.896+0000 7f0666d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066815e4a0 0x7f066815fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42346/0 (socket says 172.21.15.47:42346) 2024-04-14T23:34:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.896+0000 7f0666d9d640 1 -- 172.21.15.47:0/3976007709 learned_addr learned my addr 172.21.15.47:0/3976007709 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.896+0000 7f0665d9b640 1 --2- 172.21.15.47:0/3976007709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06680d2b30 0x7f066815aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.896+0000 7f066659c640 1 --2- 172.21.15.47:0/3976007709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06680d1c40 0x7f0668160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.896+0000 7f0666d9d640 1 -- 172.21.15.47:0/3976007709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06680d1c40 msgr2=0x7f0668160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.896+0000 7f0666d9d640 1 --2- 172.21.15.47:0/3976007709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06680d1c40 0x7f0668160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.896+0000 7f0666d9d640 1 -- 172.21.15.47:0/3976007709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06680d2b30 msgr2=0x7f066815aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.896+0000 7f0666d9d640 1 --2- 172.21.15.47:0/3976007709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06680d2b30 0x7f066815aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.897+0000 7f0666d9d640 1 -- 172.21.15.47:0/3976007709 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0668161420 con 0x7f066815e4a0 2024-04-14T23:34:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.897+0000 7f0666d9d640 1 --2- 172.21.15.47:0/3976007709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066815e4a0 0x7f066815fc10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f066000c7b0 tx=0x7f066000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.897+0000 7f0656ffd640 1 -- 172.21.15.47:0/3976007709 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660017070 con 0x7f066815e4a0 2024-04-14T23:34:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.897+0000 7f0656ffd640 1 -- 172.21.15.47:0/3976007709 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0660003da0 con 0x7f066815e4a0 2024-04-14T23:34:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.897+0000 7f066cb1e640 1 -- 172.21.15.47:0/3976007709 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06680b9730 con 0x7f066815e4a0 2024-04-14T23:34:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.897+0000 7f0656ffd640 1 -- 172.21.15.47:0/3976007709 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066000ce60 con 0x7f066815e4a0 2024-04-14T23:34:34.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.897+0000 7f066cb1e640 1 -- 172.21.15.47:0/3976007709 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f066809fc60 con 0x7f066815e4a0 2024-04-14T23:34:34.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.898+0000 7f066cb1e640 1 -- 172.21.15.47:0/3976007709 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06680d21e0 con 0x7f066815e4a0 2024-04-14T23:34:34.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.898+0000 7f0656ffd640 1 -- 172.21.15.47:0/3976007709 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0660006b10 con 0x7f066815e4a0 2024-04-14T23:34:34.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.899+0000 7f0656ffd640 1 --2- 172.21.15.47:0/3976007709 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f064806b990 0x7f064806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:34.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.899+0000 7f0656ffd640 1 -- 172.21.15.47:0/3976007709 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f0660089950 con 0x7f066815e4a0 2024-04-14T23:34:34.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.899+0000 7f066659c640 1 --2- 172.21.15.47:0/3976007709 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f064806b990 0x7f064806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:34.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.900+0000 7f066659c640 1 --2- 172.21.15.47:0/3976007709 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f064806b990 0x7f064806de50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0658000f60 tx=0x7f0658007c60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:34.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:34.903+0000 7f0656ffd640 1 -- 172.21.15.47:0/3976007709 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f06600581d0 con 0x7f066815e4a0 2024-04-14T23:34:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.122+0000 7f066cb1e640 1 -- 172.21.15.47:0/3976007709 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0668075410 con 0x7f066815e4a0 2024-04-14T23:34:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.123+0000 7f0656ffd640 1 -- 172.21.15.47:0/3976007709 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3867 (secure 0 0 0) 0x7f066005c270 con 0x7f066815e4a0 2024-04-14T23:34:35.126 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:35.126 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/416388535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":416388535},{"type":"v1","addr":"172.21.15.191:6837","nonce":416388535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/2830978927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2830978927},{"type":"v1","addr":"172.21.15.47:6833","nonce":2830978927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/4025654680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":4025654680},{"type":"v1","addr":"172.21.15.191:6836","nonce":4025654680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/1169029730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1169029730},{"type":"v1","addr":"172.21.15.47:6835","nonce":1169029730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-14T23:34:35.126 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 3 2024-04-14T23:34:35.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.124+0000 7f066cb1e640 1 -- 172.21.15.47:0/3976007709 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f064806b990 msgr2=0x7f064806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:35.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.124+0000 7f066cb1e640 1 --2- 172.21.15.47:0/3976007709 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f064806b990 0x7f064806de50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0658000f60 tx=0x7f0658007c60 comp rx=0 tx=0).stop 2024-04-14T23:34:35.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.124+0000 7f066cb1e640 1 -- 172.21.15.47:0/3976007709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066815e4a0 msgr2=0x7f066815fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:35.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.124+0000 7f066cb1e640 1 --2- 172.21.15.47:0/3976007709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066815e4a0 0x7f066815fc10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f066000c7b0 tx=0x7f066000cc70 comp rx=0 tx=0).stop 2024-04-14T23:34:35.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.124+0000 7f066cb1e640 1 -- 172.21.15.47:0/3976007709 shutdown_connections 2024-04-14T23:34:35.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.124+0000 7f066cb1e640 1 --2- 172.21.15.47:0/3976007709 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f064806b990 0x7f064806de50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.124+0000 7f066cb1e640 1 --2- 172.21.15.47:0/3976007709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f066815e4a0 0x7f066815fc10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.124+0000 7f066cb1e640 1 --2- 172.21.15.47:0/3976007709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06680d2b30 0x7f066815aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.124+0000 7f066cb1e640 1 --2- 172.21.15.47:0/3976007709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06680d1c40 0x7f0668160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.124+0000 7f066cb1e640 1 -- 172.21.15.47:0/3976007709 >> 172.21.15.47:0/3976007709 conn(0x7f06680d3ef0 msgr2=0x7f066815d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:35.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.125+0000 7f066cb1e640 1 -- 172.21.15.47:0/3976007709 shutdown_connections 2024-04-14T23:34:35.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.125+0000 7f066cb1e640 1 -- 172.21.15.47:0/3976007709 wait complete. 2024-04-14T23:34:35.138 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:34:35.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.236+0000 7f43b8a6d640 1 Processor -- start 2024-04-14T23:34:35.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.236+0000 7f43b8a6d640 1 -- start start 2024-04-14T23:34:35.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.237+0000 7f43b8a6d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f43b415e2b0 0x7f43b40d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.237+0000 7f43b8a6d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f43b40d2be0 0x7f43b40cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.237+0000 7f43b8a6d640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43b415e690 con 0x7f43b40cf2f0 2024-04-14T23:34:35.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.237+0000 7f43b8a6d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f43b40cfb20 con 0x7f43b415e2b0 2024-04-14T23:34:35.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.237+0000 7f43b8a6d640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f43b40cfe00 con 0x7f43b40d2be0 2024-04-14T23:34:35.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.237+0000 7f43b259c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f43b415e2b0 0x7f43b40d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.237+0000 7f43b259c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f43b415e2b0 0x7f43b40d26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42352/0 (socket says 172.21.15.47:42352) 2024-04-14T23:34:35.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.237+0000 7f43b259c640 1 -- 172.21.15.47:0/2284710503 learned_addr learned my addr 172.21.15.47:0/2284710503 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:35.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.237+0000 7f43abfff640 1 --2- 172.21.15.47:0/2284710503 >> v2:172.21.15.191:3300/0 conn(0x7f43b40d2be0 0x7f43b40cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.237+0000 7f43b259c640 1 -- 172.21.15.47:0/2284710503 >> v2:172.21.15.191:3300/0 conn(0x7f43b40d2be0 msgr2=0x7f43b40cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:35.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.237+0000 7f43b259c640 1 --2- 172.21.15.47:0/2284710503 >> v2:172.21.15.191:3300/0 conn(0x7f43b40d2be0 0x7f43b40cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.237+0000 7f43b259c640 1 -- 172.21.15.47:0/2284710503 >> v1:172.21.15.191:6789/0 conn(0x7f43b40cf2f0 legacy=0x7f43b40d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:35.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.237+0000 7f43b259c640 1 -- 172.21.15.47:0/2284710503 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b40d00e0 con 0x7f43b415e2b0 2024-04-14T23:34:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.238+0000 7f43b259c640 1 --2- 172.21.15.47:0/2284710503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b415e2b0 0x7f43b40d26a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f43b406bca0 tx=0x7f43a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318e468f213c4877 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.238+0000 7f43b1d9b640 1 -- 172.21.15.47:0/2284710503 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4035020 con 0x7f43b415e2b0 2024-04-14T23:34:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.238+0000 7f43b1d9b640 1 -- 172.21.15.47:0/2284710503 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a4031870 con 0x7f43b415e2b0 2024-04-14T23:34:35.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.238+0000 7f43b1d9b640 1 -- 172.21.15.47:0/2284710503 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4031c40 con 0x7f43b415e2b0 2024-04-14T23:34:35.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.238+0000 7f43b8a6d640 1 -- 172.21.15.47:0/2284710503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b415e2b0 msgr2=0x7f43b40d26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:35.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.238+0000 7f43b8a6d640 1 --2- 172.21.15.47:0/2284710503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b415e2b0 0x7f43b40d26a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f43b406bca0 tx=0x7f43a402b910 comp rx=0 tx=0).stop 2024-04-14T23:34:35.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.238+0000 7f43b8a6d640 1 -- 172.21.15.47:0/2284710503 shutdown_connections 2024-04-14T23:34:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.238+0000 7f43b8a6d640 1 --2- 172.21.15.47:0/2284710503 >> v2:172.21.15.191:3300/0 conn(0x7f43b40d2be0 0x7f43b40cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.238+0000 7f43b8a6d640 1 --2- 172.21.15.47:0/2284710503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b415e2b0 0x7f43b40d26a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.238+0000 7f43b8a6d640 1 -- 172.21.15.47:0/2284710503 >> 172.21.15.47:0/2284710503 conn(0x7f43b4067940 msgr2=0x7f43b409d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.238+0000 7f43b8a6d640 1 -- 172.21.15.47:0/2284710503 shutdown_connections 2024-04-14T23:34:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.239+0000 7f43b8a6d640 1 -- 172.21.15.47:0/2284710503 wait complete. 2024-04-14T23:34:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.240+0000 7f43b8a6d640 1 Processor -- start 2024-04-14T23:34:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.240+0000 7f43b8a6d640 1 -- start start 2024-04-14T23:34:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.240+0000 7f43b8a6d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b40cf2f0 0x7f43b4151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.240+0000 7f43b8a6d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43b40d2be0 0x7f43b4160c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.240+0000 7f43b8a6d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f43b415e2b0 0x7f43b41611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.240+0000 7f43b8a6d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43b40cf740 con 0x7f43b40cf2f0 2024-04-14T23:34:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.240+0000 7f43b8a6d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f43b40d06a0 con 0x7f43b40d2be0 2024-04-14T23:34:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.240+0000 7f43b8a6d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f43b40cf8c0 con 0x7f43b415e2b0 2024-04-14T23:34:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.241+0000 7f43b259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b40cf2f0 0x7f43b4151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.241+0000 7f43b259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b40cf2f0 0x7f43b4151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42364/0 (socket says 172.21.15.47:42364) 2024-04-14T23:34:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.241+0000 7f43b259c640 1 -- 172.21.15.47:0/2382499863 learned_addr learned my addr 172.21.15.47:0/2382499863 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.241+0000 7f43abfff640 1 --2- 172.21.15.47:0/2382499863 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43b40d2be0 0x7f43b4160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.241+0000 7f43b2d9d640 1 --2- 172.21.15.47:0/2382499863 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f43b415e2b0 0x7f43b41611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.241+0000 7f43b259c640 1 -- 172.21.15.47:0/2382499863 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f43b415e2b0 msgr2=0x7f43b41611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.241+0000 7f43b259c640 1 --2- 172.21.15.47:0/2382499863 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f43b415e2b0 0x7f43b41611b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.241+0000 7f43b259c640 1 -- 172.21.15.47:0/2382499863 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43b40d2be0 msgr2=0x7f43b4160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.241+0000 7f43b259c640 1 --2- 172.21.15.47:0/2382499863 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43b40d2be0 0x7f43b4160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.241+0000 7f43b259c640 1 -- 172.21.15.47:0/2382499863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b415f7c0 con 0x7f43b40cf2f0 2024-04-14T23:34:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.241+0000 7f43b259c640 1 --2- 172.21.15.47:0/2382499863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b40cf2f0 0x7f43b4151730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f43a402b950 tx=0x7f43a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.241+0000 7f43aaffd640 1 -- 172.21.15.47:0/2382499863 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4040070 con 0x7f43b40cf2f0 2024-04-14T23:34:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.241+0000 7f43aaffd640 1 -- 172.21.15.47:0/2382499863 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a403a420 con 0x7f43b40cf2f0 2024-04-14T23:34:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.241+0000 7f43b8a6d640 1 -- 172.21.15.47:0/2382499863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b415faa0 con 0x7f43b40cf2f0 2024-04-14T23:34:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.241+0000 7f43aaffd640 1 -- 172.21.15.47:0/2382499863 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4035040 con 0x7f43b40cf2f0 2024-04-14T23:34:35.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.241+0000 7f43b8a6d640 1 -- 172.21.15.47:0/2382499863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b4160060 con 0x7f43b40cf2f0 2024-04-14T23:34:35.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.242+0000 7f43b8a6d640 1 -- 172.21.15.47:0/2382499863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b4075430 con 0x7f43b40cf2f0 2024-04-14T23:34:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.243+0000 7f43aaffd640 1 -- 172.21.15.47:0/2382499863 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f43a4038020 con 0x7f43b40cf2f0 2024-04-14T23:34:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.243+0000 7f43aaffd640 1 --2- 172.21.15.47:0/2382499863 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f439406b990 0x7f439406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.243+0000 7f43aaffd640 1 -- 172.21.15.47:0/2382499863 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f43a40ac5c0 con 0x7f43b40cf2f0 2024-04-14T23:34:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.243+0000 7f43abfff640 1 --2- 172.21.15.47:0/2382499863 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f439406b990 0x7f439406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.244+0000 7f43abfff640 1 --2- 172.21.15.47:0/2382499863 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f439406b990 0x7f439406de50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f439c006fd0 tx=0x7f439c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:35.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.247+0000 7f43aaffd640 1 -- 172.21.15.47:0/2382499863 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f43a407b490 con 0x7f43b40cf2f0 2024-04-14T23:34:35.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.431+0000 7f43b8a6d640 1 -- 172.21.15.47:0/2382499863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43b40682f0 con 0x7f43b40cf2f0 2024-04-14T23:34:35.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.432+0000 7f43aaffd640 1 -- 172.21.15.47:0/2382499863 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7f43a407ad90 con 0x7f43b40cf2f0 2024-04-14T23:34:35.435 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:35.435 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":16,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:28.472699+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:34:35.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.434+0000 7f43b8a6d640 1 -- 172.21.15.47:0/2382499863 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f439406b990 msgr2=0x7f439406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:35.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.434+0000 7f43b8a6d640 1 --2- 172.21.15.47:0/2382499863 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f439406b990 0x7f439406de50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f439c006fd0 tx=0x7f439c008040 comp rx=0 tx=0).stop 2024-04-14T23:34:35.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.434+0000 7f43b8a6d640 1 -- 172.21.15.47:0/2382499863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b40cf2f0 msgr2=0x7f43b4151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:35.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.434+0000 7f43b8a6d640 1 --2- 172.21.15.47:0/2382499863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b40cf2f0 0x7f43b4151730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f43a402b950 tx=0x7f43a40046c0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.434+0000 7f43b8a6d640 1 -- 172.21.15.47:0/2382499863 shutdown_connections 2024-04-14T23:34:35.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.434+0000 7f43b8a6d640 1 --2- 172.21.15.47:0/2382499863 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f439406b990 0x7f439406de50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.434+0000 7f43b8a6d640 1 --2- 172.21.15.47:0/2382499863 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f43b415e2b0 0x7f43b41611b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.434+0000 7f43b8a6d640 1 --2- 172.21.15.47:0/2382499863 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43b40d2be0 0x7f43b4160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.434+0000 7f43b8a6d640 1 --2- 172.21.15.47:0/2382499863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43b40cf2f0 0x7f43b4151730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.434+0000 7f43b8a6d640 1 -- 172.21.15.47:0/2382499863 >> 172.21.15.47:0/2382499863 conn(0x7f43b4067940 msgr2=0x7f43b409d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:35.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.434+0000 7f43b8a6d640 1 -- 172.21.15.47:0/2382499863 shutdown_connections 2024-04-14T23:34:35.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.434+0000 7f43b8a6d640 1 -- 172.21.15.47:0/2382499863 wait complete. 2024-04-14T23:34:35.448 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T23:34:35.448 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:34:35.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.550+0000 7f1167036640 1 Processor -- start 2024-04-14T23:34:35.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.550+0000 7f1167036640 1 -- start start 2024-04-14T23:34:35.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.550+0000 7f1167036640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f11601615f0 0x7f116006f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.550+0000 7f1167036640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f11600d2840 0x7f11600cc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.550+0000 7f1167036640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11600cef40 con 0x7f11601619d0 2024-04-14T23:34:35.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.550+0000 7f1167036640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f11600cf220 con 0x7f11600d2840 2024-04-14T23:34:35.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.550+0000 7f1167036640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f11600cf500 con 0x7f11601615f0 2024-04-14T23:34:35.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.551+0000 7f11655d3640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f11600d2840 0x7f11600cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.551+0000 7f11655d3640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f11600d2840 0x7f11600cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42370/0 (socket says 172.21.15.47:42370) 2024-04-14T23:34:35.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.551+0000 7f11655d3640 1 -- 172.21.15.47:0/2933007001 learned_addr learned my addr 172.21.15.47:0/2933007001 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:35.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.551+0000 7f1164dd2640 1 --2- 172.21.15.47:0/2933007001 >> v2:172.21.15.191:3300/0 conn(0x7f11601615f0 0x7f116006f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.551+0000 7f11655d3640 1 -- 172.21.15.47:0/2933007001 >> v2:172.21.15.191:3300/0 conn(0x7f11601615f0 msgr2=0x7f116006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:35.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.551+0000 7f11655d3640 1 --2- 172.21.15.47:0/2933007001 >> v2:172.21.15.191:3300/0 conn(0x7f11601615f0 0x7f116006f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.551+0000 7f11655d3640 1 -- 172.21.15.47:0/2933007001 >> v1:172.21.15.191:6789/0 conn(0x7f11601619d0 legacy=0x7f11600d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:35.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.551+0000 7f11655d3640 1 -- 172.21.15.47:0/2933007001 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11600d0200 con 0x7f11600d2840 2024-04-14T23:34:35.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.552+0000 7f11655d3640 1 --2- 172.21.15.47:0/2933007001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11600d2840 0x7f11600cc300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1160071d90 tx=0x7f115802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7ab72ff339f478 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:35.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.552+0000 7f115f7fe640 1 -- 172.21.15.47:0/2933007001 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115802ca80 con 0x7f11600d2840 2024-04-14T23:34:35.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.552+0000 7f115f7fe640 1 -- 172.21.15.47:0/2933007001 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f115802cc20 con 0x7f11600d2840 2024-04-14T23:34:35.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.552+0000 7f115f7fe640 1 -- 172.21.15.47:0/2933007001 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11580343f0 con 0x7f11600d2840 2024-04-14T23:34:35.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.552+0000 7f1167036640 1 -- 172.21.15.47:0/2933007001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11600d2840 msgr2=0x7f11600cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:35.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.552+0000 7f1167036640 1 --2- 172.21.15.47:0/2933007001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11600d2840 0x7f11600cc300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1160071d90 tx=0x7f115802bee0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.552+0000 7f1167036640 1 -- 172.21.15.47:0/2933007001 shutdown_connections 2024-04-14T23:34:35.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.552+0000 7f1167036640 1 --2- 172.21.15.47:0/2933007001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11600d2840 0x7f11600cc300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.552+0000 7f1167036640 1 --2- 172.21.15.47:0/2933007001 >> v2:172.21.15.191:3300/0 conn(0x7f11601615f0 0x7f116006f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.552+0000 7f1167036640 1 -- 172.21.15.47:0/2933007001 >> 172.21.15.47:0/2933007001 conn(0x7f11600d1cb0 msgr2=0x7f11600d20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:35.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.552+0000 7f1167036640 1 -- 172.21.15.47:0/2933007001 shutdown_connections 2024-04-14T23:34:35.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.552+0000 7f1167036640 1 -- 172.21.15.47:0/2933007001 wait complete. 2024-04-14T23:34:35.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.553+0000 7f1167036640 1 Processor -- start 2024-04-14T23:34:35.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.554+0000 7f1167036640 1 -- start start 2024-04-14T23:34:35.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.554+0000 7f1167036640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11600d2840 0x7f11600af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.554+0000 7f1167036640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11601615f0 0x7f11600af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.554+0000 7f1167036640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11601619d0 0x7f116015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.554+0000 7f1167036640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f11600d1110 con 0x7f11601615f0 2024-04-14T23:34:35.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.554+0000 7f1167036640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f11600cfe90 con 0x7f11601619d0 2024-04-14T23:34:35.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.554+0000 7f1167036640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f11600cc840 con 0x7f11600d2840 2024-04-14T23:34:35.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.554+0000 7f115ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11601615f0 0x7f11600af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.555+0000 7f115ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11601615f0 0x7f11600af550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42384/0 (socket says 172.21.15.47:42384) 2024-04-14T23:34:35.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.555+0000 7f115ffff640 1 -- 172.21.15.47:0/3670147588 learned_addr learned my addr 172.21.15.47:0/3670147588 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:35.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.555+0000 7f11655d3640 1 --2- 172.21.15.47:0/3670147588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11601619d0 0x7f116015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.555+0000 7f1164dd2640 1 --2- 172.21.15.47:0/3670147588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11600d2840 0x7f11600af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.555+0000 7f115ffff640 1 -- 172.21.15.47:0/3670147588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11600d2840 msgr2=0x7f11600af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:35.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.555+0000 7f115ffff640 1 --2- 172.21.15.47:0/3670147588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11600d2840 0x7f11600af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.555+0000 7f115ffff640 1 -- 172.21.15.47:0/3670147588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11601619d0 msgr2=0x7f116015f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:35.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.555+0000 7f115ffff640 1 --2- 172.21.15.47:0/3670147588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11601619d0 0x7f116015f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.555+0000 7f115ffff640 1 -- 172.21.15.47:0/3670147588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1160160280 con 0x7f11601615f0 2024-04-14T23:34:35.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.555+0000 7f115ffff640 1 --2- 172.21.15.47:0/3670147588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11601615f0 0x7f11600af550 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f114c00b420 tx=0x7f114c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:35.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.555+0000 7f115d7fa640 1 -- 172.21.15.47:0/3670147588 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c011830 con 0x7f11601615f0 2024-04-14T23:34:35.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.555+0000 7f115d7fa640 1 -- 172.21.15.47:0/3670147588 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f114c016070 con 0x7f11601615f0 2024-04-14T23:34:35.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.555+0000 7f115d7fa640 1 -- 172.21.15.47:0/3670147588 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c011c10 con 0x7f11601615f0 2024-04-14T23:34:35.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.555+0000 7f1167036640 1 -- 172.21.15.47:0/3670147588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1160160560 con 0x7f11601615f0 2024-04-14T23:34:35.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.555+0000 7f1167036640 1 -- 172.21.15.47:0/3670147588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1160160b20 con 0x7f11601615f0 2024-04-14T23:34:35.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.556+0000 7f1167036640 1 -- 172.21.15.47:0/3670147588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1160073f50 con 0x7f11601615f0 2024-04-14T23:34:35.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.557+0000 7f115d7fa640 1 -- 172.21.15.47:0/3670147588 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f114c01b460 con 0x7f11601615f0 2024-04-14T23:34:35.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.557+0000 7f115d7fa640 1 --2- 172.21.15.47:0/3670147588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f114406b9c0 0x7f114406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.557+0000 7f115d7fa640 1 -- 172.21.15.47:0/3670147588 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f114c089d90 con 0x7f11601615f0 2024-04-14T23:34:35.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.557+0000 7f1164dd2640 1 --2- 172.21.15.47:0/3670147588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f114406b9c0 0x7f114406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.558+0000 7f1164dd2640 1 --2- 172.21.15.47:0/3670147588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f114406b9c0 0x7f114406de80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1154006fd0 tx=0x7f1154008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:35.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.561+0000 7f115d7fa640 1 -- 172.21.15.47:0/3670147588 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f114c020020 con 0x7f11601615f0 2024-04-14T23:34:35.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.743+0000 7f1167036640 1 -- 172.21.15.47:0/3670147588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f116015a740 con 0x7f11601615f0 2024-04-14T23:34:35.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.743+0000 7f115d7fa640 1 -- 172.21.15.47:0/3670147588 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f114c058730 con 0x7f11601615f0 2024-04-14T23:34:35.746 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:34:35.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.745+0000 7f1167036640 1 -- 172.21.15.47:0/3670147588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f114406b9c0 msgr2=0x7f114406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.745+0000 7f1167036640 1 --2- 172.21.15.47:0/3670147588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f114406b9c0 0x7f114406de80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1154006fd0 tx=0x7f1154008040 comp rx=0 tx=0).stop 2024-04-14T23:34:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.745+0000 7f1167036640 1 -- 172.21.15.47:0/3670147588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11601615f0 msgr2=0x7f11600af550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.745+0000 7f1167036640 1 --2- 172.21.15.47:0/3670147588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11601615f0 0x7f11600af550 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f114c00b420 tx=0x7f114c00b8e0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.746+0000 7f1167036640 1 -- 172.21.15.47:0/3670147588 shutdown_connections 2024-04-14T23:34:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.746+0000 7f1167036640 1 --2- 172.21.15.47:0/3670147588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f114406b9c0 0x7f114406de80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.746+0000 7f1167036640 1 --2- 172.21.15.47:0/3670147588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11601619d0 0x7f116015f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.746+0000 7f1167036640 1 --2- 172.21.15.47:0/3670147588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11601615f0 0x7f11600af550 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.746+0000 7f1167036640 1 --2- 172.21.15.47:0/3670147588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11600d2840 0x7f11600af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.746+0000 7f1167036640 1 -- 172.21.15.47:0/3670147588 >> 172.21.15.47:0/3670147588 conn(0x7f11600d1cb0 msgr2=0x7f116006eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.746+0000 7f1167036640 1 -- 172.21.15.47:0/3670147588 shutdown_connections 2024-04-14T23:34:35.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.746+0000 7f1167036640 1 -- 172.21.15.47:0/3670147588 wait complete. 2024-04-14T23:34:35.759 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-14T23:34:35.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.857+0000 7fade82c8640 1 Processor -- start 2024-04-14T23:34:35.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.857+0000 7fade82c8640 1 -- start start 2024-04-14T23:34:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.858+0000 7fade82c8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fade015e270 0x7fade00d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.858+0000 7fade82c8640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fade00d1e00 0x7fade00d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.858+0000 7fade82c8640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade00b57a0 con 0x7fade00d1450 2024-04-14T23:34:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.858+0000 7fade82c8640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fade00b4300 con 0x7fade015e270 2024-04-14T23:34:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.858+0000 7fade82c8640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fade00b39d0 con 0x7fade00d1e00 2024-04-14T23:34:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.858+0000 7fade6064640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fade015e270 0x7fade00d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.858+0000 7fade6064640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fade015e270 0x7fade00d0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42394/0 (socket says 172.21.15.47:42394) 2024-04-14T23:34:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.858+0000 7fade6064640 1 -- 172.21.15.47:0/2939166511 learned_addr learned my addr 172.21.15.47:0/2939166511 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.859+0000 7fade5863640 1 --2- 172.21.15.47:0/2939166511 >> v2:172.21.15.191:3300/0 conn(0x7fade00d1e00 0x7fade00d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.859+0000 7fade6064640 1 -- 172.21.15.47:0/2939166511 >> v2:172.21.15.191:3300/0 conn(0x7fade00d1e00 msgr2=0x7fade00d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:35.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.859+0000 7fade6064640 1 --2- 172.21.15.47:0/2939166511 >> v2:172.21.15.191:3300/0 conn(0x7fade00d1e00 0x7fade00d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.859+0000 7fade6064640 1 -- 172.21.15.47:0/2939166511 >> v1:172.21.15.191:6789/0 conn(0x7fade00d1450 legacy=0x7fade00ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:35.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.859+0000 7fade6064640 1 -- 172.21.15.47:0/2939166511 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade00b3cb0 con 0x7fade015e270 2024-04-14T23:34:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.859+0000 7fade6064640 1 --2- 172.21.15.47:0/2939166511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade015e270 0x7fade00d0f10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fade00b4480 tx=0x7faddc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f184746097e1fd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.860+0000 7fade5062640 1 -- 172.21.15.47:0/2939166511 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc034070 con 0x7fade015e270 2024-04-14T23:34:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.860+0000 7fade5062640 1 -- 172.21.15.47:0/2939166511 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faddc030860 con 0x7fade015e270 2024-04-14T23:34:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.860+0000 7fade5062640 1 -- 172.21.15.47:0/2939166511 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc030c30 con 0x7fade015e270 2024-04-14T23:34:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.860+0000 7fade82c8640 1 -- 172.21.15.47:0/2939166511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade015e270 msgr2=0x7fade00d0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.860+0000 7fade82c8640 1 --2- 172.21.15.47:0/2939166511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade015e270 0x7fade00d0f10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fade00b4480 tx=0x7faddc02b9a0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.860+0000 7fade82c8640 1 -- 172.21.15.47:0/2939166511 shutdown_connections 2024-04-14T23:34:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.860+0000 7fade82c8640 1 --2- 172.21.15.47:0/2939166511 >> v2:172.21.15.191:3300/0 conn(0x7fade00d1e00 0x7fade00d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.860+0000 7fade82c8640 1 --2- 172.21.15.47:0/2939166511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade015e270 0x7fade00d0f10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.860+0000 7fade82c8640 1 -- 172.21.15.47:0/2939166511 >> 172.21.15.47:0/2939166511 conn(0x7fade00d3ed0 msgr2=0x7fade00d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.860+0000 7fade82c8640 1 -- 172.21.15.47:0/2939166511 shutdown_connections 2024-04-14T23:34:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.860+0000 7fade82c8640 1 -- 172.21.15.47:0/2939166511 wait complete. 2024-04-14T23:34:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.861+0000 7fade82c8640 1 Processor -- start 2024-04-14T23:34:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.861+0000 7fade82c8640 1 -- start start 2024-04-14T23:34:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.862+0000 7fade82c8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade00d1450 0x7fade0154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.862+0000 7fade82c8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fade00d1e00 0x7fade00b8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.862+0000 7fade82c8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade015e270 0x7fade015e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.862+0000 7fade82c8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fade015e650 con 0x7fade015e270 2024-04-14T23:34:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.862+0000 7fade82c8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fade00b0c60 con 0x7fade00d1450 2024-04-14T23:34:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.862+0000 7fade82c8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fade015e7d0 con 0x7fade00d1e00 2024-04-14T23:34:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.862+0000 7fade6865640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade015e270 0x7fade015e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.862+0000 7fade6865640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade015e270 0x7fade015e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42402/0 (socket says 172.21.15.47:42402) 2024-04-14T23:34:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.862+0000 7fade6865640 1 -- 172.21.15.47:0/632003584 learned_addr learned my addr 172.21.15.47:0/632003584 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.862+0000 7fade6064640 1 --2- 172.21.15.47:0/632003584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade00d1450 0x7fade0154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.862+0000 7fade5863640 1 --2- 172.21.15.47:0/632003584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fade00d1e00 0x7fade00b8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.862+0000 7fade6865640 1 -- 172.21.15.47:0/632003584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fade00d1e00 msgr2=0x7fade00b8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.862+0000 7fade6865640 1 --2- 172.21.15.47:0/632003584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fade00d1e00 0x7fade00b8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.862+0000 7fade6865640 1 -- 172.21.15.47:0/632003584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade00d1450 msgr2=0x7fade0154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.862+0000 7fade6865640 1 --2- 172.21.15.47:0/632003584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade00d1450 0x7fade0154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.862+0000 7fade6865640 1 -- 172.21.15.47:0/632003584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade015f780 con 0x7fade015e270 2024-04-14T23:34:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.863+0000 7fade6865640 1 --2- 172.21.15.47:0/632003584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade015e270 0x7fade015e9e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fadd800c700 tx=0x7fadd800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.863+0000 7fadd6ffd640 1 -- 172.21.15.47:0/632003584 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8016020 con 0x7fade015e270 2024-04-14T23:34:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.863+0000 7fadd6ffd640 1 -- 172.21.15.47:0/632003584 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd800aa50 con 0x7fade015e270 2024-04-14T23:34:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.863+0000 7fade82c8640 1 -- 172.21.15.47:0/632003584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade00b7fe0 con 0x7fade015e270 2024-04-14T23:34:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.863+0000 7fadd6ffd640 1 -- 172.21.15.47:0/632003584 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd800ce10 con 0x7fade015e270 2024-04-14T23:34:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.863+0000 7fade82c8640 1 -- 172.21.15.47:0/632003584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade00b85a0 con 0x7fade015e270 2024-04-14T23:34:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.864+0000 7fade82c8640 1 -- 172.21.15.47:0/632003584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade00681f0 con 0x7fade015e270 2024-04-14T23:34:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.864+0000 7fadd6ffd640 1 -- 172.21.15.47:0/632003584 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fadd8019020 con 0x7fade015e270 2024-04-14T23:34:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.864+0000 7fadd6ffd640 1 --2- 172.21.15.47:0/632003584 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fadc406b990 0x7fadc406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.865+0000 7fadd6ffd640 1 -- 172.21.15.47:0/632003584 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fadd808a7d0 con 0x7fade015e270 2024-04-14T23:34:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.865+0000 7fade6064640 1 --2- 172.21.15.47:0/632003584 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fadc406b990 0x7fadc406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.865+0000 7fade6064640 1 --2- 172.21.15.47:0/632003584 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fadc406b990 0x7fadc406de50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faddc036000 tx=0x7faddc03b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:35.869+0000 7fadd6ffd640 1 -- 172.21.15.47:0/632003584 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fade00681f0 con 0x7fade015e270 2024-04-14T23:34:36.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.051+0000 7fade82c8640 1 -- 172.21.15.47:0/632003584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fade01555e0 con 0x7fade015e270 2024-04-14T23:34:36.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.051+0000 7fadd6ffd640 1 -- 172.21.15.47:0/632003584 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fadd8020020 con 0x7fade015e270 2024-04-14T23:34:36.055 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:36.055 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-04-14T23:34:36.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:34:36.055 INFO:teuthology.orchestra.run.smithi047.stdout: "poolnum": 1, 2024-04-14T23:34:36.055 INFO:teuthology.orchestra.run.smithi047.stdout: "poolname": ".mgr" 2024-04-14T23:34:36.055 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:34:36.055 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-04-14T23:34:36.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.053+0000 7fade82c8640 1 -- 172.21.15.47:0/632003584 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fadc406b990 msgr2=0x7fadc406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:36.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.053+0000 7fade82c8640 1 --2- 172.21.15.47:0/632003584 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fadc406b990 0x7fadc406de50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faddc036000 tx=0x7faddc03b040 comp rx=0 tx=0).stop 2024-04-14T23:34:36.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.053+0000 7fade82c8640 1 -- 172.21.15.47:0/632003584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade015e270 msgr2=0x7fade015e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:36.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.053+0000 7fade82c8640 1 --2- 172.21.15.47:0/632003584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade015e270 0x7fade015e9e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fadd800c700 tx=0x7fadd800cbc0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.053+0000 7fade82c8640 1 -- 172.21.15.47:0/632003584 shutdown_connections 2024-04-14T23:34:36.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.053+0000 7fade82c8640 1 --2- 172.21.15.47:0/632003584 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fadc406b990 0x7fadc406de50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.053+0000 7fade82c8640 1 --2- 172.21.15.47:0/632003584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade015e270 0x7fade015e9e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.053+0000 7fade82c8640 1 --2- 172.21.15.47:0/632003584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fade00d1e00 0x7fade00b8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.053+0000 7fade82c8640 1 --2- 172.21.15.47:0/632003584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade00d1450 0x7fade0154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.053+0000 7fade82c8640 1 -- 172.21.15.47:0/632003584 >> 172.21.15.47:0/632003584 conn(0x7fade00d3ed0 msgr2=0x7fade006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:36.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.053+0000 7fade82c8640 1 -- 172.21.15.47:0/632003584 shutdown_connections 2024-04-14T23:34:36.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.053+0000 7fade82c8640 1 -- 172.21.15.47:0/632003584 wait complete. 2024-04-14T23:34:36.067 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-14T23:34:36.067 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-14T23:34:36.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.169+0000 7f477efd8640 1 Processor -- start 2024-04-14T23:34:36.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.169+0000 7f477efd8640 1 -- start start 2024-04-14T23:34:36.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.170+0000 7f477efd8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f47780b4360 0x7f47780cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:36.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.170+0000 7f477efd8640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f477815fc40 0x7f4778160090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:36.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.170+0000 7f477efd8640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47780cdc30 con 0x7f477815c1c0 2024-04-14T23:34:36.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.170+0000 7f477efd8640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f47780cda00 con 0x7f47780b4360 2024-04-14T23:34:36.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.170+0000 7f477efd8640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f477815c5a0 con 0x7f477815fc40 2024-04-14T23:34:36.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.170+0000 7f4777fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f47780b4360 0x7f47780cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:36.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.170+0000 7f4777fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f47780b4360 0x7f47780cd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42404/0 (socket says 172.21.15.47:42404) 2024-04-14T23:34:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.170+0000 7f477cd74640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f477815c1c0 0x7f47780d05f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:39440/0 (socket says 172.21.15.47:39440) 2024-04-14T23:34:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.170+0000 7f4777fff640 1 -- 172.21.15.47:0/2631320158 learned_addr learned my addr 172.21.15.47:0/2631320158 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.170+0000 7f4777fff640 1 -- 172.21.15.47:0/2631320158 >> v2:172.21.15.191:3300/0 conn(0x7f477815fc40 msgr2=0x7f4778160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.170+0000 7f477d575640 1 --2- 172.21.15.47:0/2631320158 >> v2:172.21.15.191:3300/0 conn(0x7f477815fc40 0x7f4778160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.170+0000 7f4777fff640 1 --2- 172.21.15.47:0/2631320158 >> v2:172.21.15.191:3300/0 conn(0x7f477815fc40 0x7f4778160090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.170+0000 7f47777fe640 1 -- 172.21.15.47:0/2631320158 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3700040385 0 0) 0x7f47780cdc30 con 0x7f477815c1c0 2024-04-14T23:34:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.170+0000 7f4777fff640 1 -- 172.21.15.47:0/2631320158 >> v1:172.21.15.47:6789/0 conn(0x7f477815c1c0 legacy=0x7f47780d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.170+0000 7f4777fff640 1 -- 172.21.15.47:0/2631320158 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47780cfb10 con 0x7f47780b4360 2024-04-14T23:34:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.171+0000 7f4777fff640 1 --2- 172.21.15.47:0/2631320158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47780b4360 0x7f47780cd4c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4778072e00 tx=0x7f476802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4948ea5cff02a7a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.171+0000 7f47777fe640 1 -- 172.21.15.47:0/2631320158 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476802cb20 con 0x7f47780b4360 2024-04-14T23:34:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.171+0000 7f47777fe640 1 -- 172.21.15.47:0/2631320158 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f476802ccc0 con 0x7f47780b4360 2024-04-14T23:34:36.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.171+0000 7f47777fe640 1 -- 172.21.15.47:0/2631320158 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4768034610 con 0x7f47780b4360 2024-04-14T23:34:36.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.172+0000 7f477efd8640 1 -- 172.21.15.47:0/2631320158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47780b4360 msgr2=0x7f47780cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:36.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.172+0000 7f477efd8640 1 --2- 172.21.15.47:0/2631320158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47780b4360 0x7f47780cd4c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4778072e00 tx=0x7f476802bf80 comp rx=0 tx=0).stop 2024-04-14T23:34:36.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.172+0000 7f477efd8640 1 -- 172.21.15.47:0/2631320158 shutdown_connections 2024-04-14T23:34:36.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.172+0000 7f477efd8640 1 --2- 172.21.15.47:0/2631320158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47780b4360 0x7f47780cd4c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.172+0000 7f477efd8640 1 --2- 172.21.15.47:0/2631320158 >> v2:172.21.15.191:3300/0 conn(0x7f477815fc40 0x7f4778160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.172+0000 7f477efd8640 1 -- 172.21.15.47:0/2631320158 >> 172.21.15.47:0/2631320158 conn(0x7f47780b3840 msgr2=0x7f47780b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:36.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.172+0000 7f477efd8640 1 -- 172.21.15.47:0/2631320158 shutdown_connections 2024-04-14T23:34:36.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.172+0000 7f477efd8640 1 -- 172.21.15.47:0/2631320158 wait complete. 2024-04-14T23:34:36.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.173+0000 7f477efd8640 1 Processor -- start 2024-04-14T23:34:36.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.173+0000 7f477efd8640 1 -- start start 2024-04-14T23:34:36.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f477efd8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47780b4360 0x7f47780c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:36.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f477efd8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f477815c1c0 0x7f47780cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:36.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f477efd8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f477815fc40 0x7f47780cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:36.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f477efd8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f47780cf8c0 con 0x7f477815c1c0 2024-04-14T23:34:36.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f477efd8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f47781605d0 con 0x7f47780b4360 2024-04-14T23:34:36.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f477efd8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f47780d0160 con 0x7f477815fc40 2024-04-14T23:34:36.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f4777fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f477815c1c0 0x7f47780cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:36.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f4777fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f477815c1c0 0x7f47780cac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42406/0 (socket says 172.21.15.47:42406) 2024-04-14T23:34:36.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f4777fff640 1 -- 172.21.15.47:0/2588579440 learned_addr learned my addr 172.21.15.47:0/2588579440 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:36.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f477d575640 1 --2- 172.21.15.47:0/2588579440 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f477815fc40 0x7f47780cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:36.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f477cd74640 1 --2- 172.21.15.47:0/2588579440 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47780b4360 0x7f47780c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:36.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f4777fff640 1 -- 172.21.15.47:0/2588579440 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f477815fc40 msgr2=0x7f47780cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:36.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f4777fff640 1 --2- 172.21.15.47:0/2588579440 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f477815fc40 0x7f47780cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f4777fff640 1 -- 172.21.15.47:0/2588579440 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47780b4360 msgr2=0x7f47780c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:36.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f4777fff640 1 --2- 172.21.15.47:0/2588579440 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47780b4360 0x7f47780c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f4777fff640 1 -- 172.21.15.47:0/2588579440 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47780b4900 con 0x7f477815c1c0 2024-04-14T23:34:36.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.174+0000 7f4777fff640 1 --2- 172.21.15.47:0/2588579440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f477815c1c0 0x7f47780cac80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4768000f80 tx=0x7f4768004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:36.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.175+0000 7f47757fa640 1 -- 172.21.15.47:0/2588579440 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4768043020 con 0x7f477815c1c0 2024-04-14T23:34:36.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.175+0000 7f47757fa640 1 -- 172.21.15.47:0/2588579440 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f476803e450 con 0x7f477815c1c0 2024-04-14T23:34:36.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.175+0000 7f477efd8640 1 -- 172.21.15.47:0/2588579440 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47780b4be0 con 0x7f477815c1c0 2024-04-14T23:34:36.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.175+0000 7f47757fa640 1 -- 172.21.15.47:0/2588579440 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476803e840 con 0x7f477815c1c0 2024-04-14T23:34:36.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.175+0000 7f477efd8640 1 -- 172.21.15.47:0/2588579440 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47780ca1f0 con 0x7f477815c1c0 2024-04-14T23:34:36.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.176+0000 7f477efd8640 1 -- 172.21.15.47:0/2588579440 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47780754a0 con 0x7f477815c1c0 2024-04-14T23:34:36.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.176+0000 7f47757fa640 1 -- 172.21.15.47:0/2588579440 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4768046020 con 0x7f477815c1c0 2024-04-14T23:34:36.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.176+0000 7f47757fa640 1 --2- 172.21.15.47:0/2588579440 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f475806b990 0x7f475806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:36.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.176+0000 7f47757fa640 1 -- 172.21.15.47:0/2588579440 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f47680acde0 con 0x7f477815c1c0 2024-04-14T23:34:36.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.176+0000 7f477cd74640 1 --2- 172.21.15.47:0/2588579440 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f475806b990 0x7f475806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:36.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.177+0000 7f477cd74640 1 --2- 172.21.15.47:0/2588579440 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f475806b990 0x7f475806de50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4770000f60 tx=0x7f4770007b50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:36.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.181+0000 7f47757fa640 1 -- 172.21.15.47:0/2588579440 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f476804d030 con 0x7f477815c1c0 2024-04-14T23:34:36.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.362+0000 7f477efd8640 1 -- 172.21.15.47:0/2588579440 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f47780b7c70 con 0x7f477815c1c0 2024-04-14T23:34:36.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.682+0000 7f47757fa640 1 -- 172.21.15.47:0/2588579440 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f476807bdd0 con 0x7f477815c1c0 2024-04-14T23:34:36.685 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' created 2024-04-14T23:34:36.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.685+0000 7f477efd8640 1 -- 172.21.15.47:0/2588579440 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f475806b990 msgr2=0x7f475806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:36.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.685+0000 7f477efd8640 1 --2- 172.21.15.47:0/2588579440 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f475806b990 0x7f475806de50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4770000f60 tx=0x7f4770007b50 comp rx=0 tx=0).stop 2024-04-14T23:34:36.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.685+0000 7f477efd8640 1 -- 172.21.15.47:0/2588579440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f477815c1c0 msgr2=0x7f47780cac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:36.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.685+0000 7f477efd8640 1 --2- 172.21.15.47:0/2588579440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f477815c1c0 0x7f47780cac80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4768000f80 tx=0x7f4768004a40 comp rx=0 tx=0).stop 2024-04-14T23:34:36.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.685+0000 7f477efd8640 1 -- 172.21.15.47:0/2588579440 shutdown_connections 2024-04-14T23:34:36.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.685+0000 7f477efd8640 1 --2- 172.21.15.47:0/2588579440 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f475806b990 0x7f475806de50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.685+0000 7f477efd8640 1 --2- 172.21.15.47:0/2588579440 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f477815fc40 0x7f47780cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.685+0000 7f477efd8640 1 --2- 172.21.15.47:0/2588579440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f477815c1c0 0x7f47780cac80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.685+0000 7f477efd8640 1 --2- 172.21.15.47:0/2588579440 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47780b4360 0x7f47780c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.685+0000 7f477efd8640 1 -- 172.21.15.47:0/2588579440 >> 172.21.15.47:0/2588579440 conn(0x7f47780b3840 msgr2=0x7f477815c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:36.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.685+0000 7f477efd8640 1 -- 172.21.15.47:0/2588579440 shutdown_connections 2024-04-14T23:34:36.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.685+0000 7f477efd8640 1 -- 172.21.15.47:0/2588579440 wait complete. 2024-04-14T23:34:36.703 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-14T23:34:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.810+0000 7f4f6c5bb640 1 Processor -- start 2024-04-14T23:34:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.810+0000 7f4f6c5bb640 1 -- start start 2024-04-14T23:34:36.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f6c5bb640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f641623a0 0x7f4f640d4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f6c5bb640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4f64162850 0x7f4f640b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f6c5bb640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f6415e5a0 con 0x7f4f6415e1c0 2024-04-14T23:34:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f6c5bb640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f4f640d3040 con 0x7f4f64162850 2024-04-14T23:34:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f6c5bb640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4f640b6d70 con 0x7f4f641623a0 2024-04-14T23:34:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f6a357640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4f6415e1c0 0x7f4f64161c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:39454/0 (socket says 172.21.15.47:39454) 2024-04-14T23:34:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f6a357640 1 -- 172.21.15.47:0/1813113067 learned_addr learned my addr 172.21.15.47:0/1813113067 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69355640 1 -- 172.21.15.47:0/1813113067 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1597823106 0 0) 0x7f4f6415e5a0 con 0x7f4f6415e1c0 2024-04-14T23:34:36.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69355640 1 -- 172.21.15.47:0/1813113067 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f50003520 con 0x7f4f6415e1c0 2024-04-14T23:34:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f6ab58640 1 --2- 172.21.15.47:0/1813113067 >> v2:172.21.15.191:3300/0 conn(0x7f4f64162850 0x7f4f640b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69b56640 1 --2- 172.21.15.47:0/1813113067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f641623a0 0x7f4f640d4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69355640 1 -- 172.21.15.47:0/1813113067 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1794134809 0 0) 0x7f4f50003520 con 0x7f4f6415e1c0 2024-04-14T23:34:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69355640 1 -- 172.21.15.47:0/1813113067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f641623a0 msgr2=0x7f4f640d4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69355640 1 --2- 172.21.15.47:0/1813113067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f641623a0 0x7f4f640d4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69355640 1 -- 172.21.15.47:0/1813113067 >> v2:172.21.15.191:3300/0 conn(0x7f4f64162850 msgr2=0x7f4f640b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69355640 1 --2- 172.21.15.47:0/1813113067 >> v2:172.21.15.191:3300/0 conn(0x7f4f64162850 0x7f4f640b74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69355640 1 -- 172.21.15.47:0/1813113067 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f640d27a0 con 0x7f4f6415e1c0 2024-04-14T23:34:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69355640 1 -- 172.21.15.47:0/1813113067 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f4f60001670 con 0x7f4f6415e1c0 2024-04-14T23:34:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69355640 1 -- 172.21.15.47:0/1813113067 >> v1:172.21.15.47:6789/0 conn(0x7f4f6415e1c0 legacy=0x7f4f64161c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69355640 1 --2- 172.21.15.47:0/1813113067 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f500039b0 0x7f4f50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69355640 1 --2- 172.21.15.47:0/1813113067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f50004800 0x7f4f50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69355640 1 --2- 172.21.15.47:0/1813113067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f641623a0 0x7f4f500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69355640 1 -- 172.21.15.47:0/1813113067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4f640d3040 con 0x7f4f50004800 2024-04-14T23:34:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69355640 1 -- 172.21.15.47:0/1813113067 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4f640b6d70 con 0x7f4f500039b0 2024-04-14T23:34:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69355640 1 -- 172.21.15.47:0/1813113067 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4f5000b9c0 con 0x7f4f641623a0 2024-04-14T23:34:36.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.811+0000 7f4f69b56640 1 --2- 172.21.15.47:0/1813113067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f50004800 0x7f4f50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.812+0000 7f4f6a357640 1 --2- 172.21.15.47:0/1813113067 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f500039b0 0x7f4f50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.812+0000 7f4f6ab58640 1 --2- 172.21.15.47:0/1813113067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f641623a0 0x7f4f500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.812+0000 7f4f69b56640 1 -- 172.21.15.47:0/1813113067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f641623a0 msgr2=0x7f4f500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.812+0000 7f4f69b56640 1 --2- 172.21.15.47:0/1813113067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f641623a0 0x7f4f500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.812+0000 7f4f69b56640 1 -- 172.21.15.47:0/1813113067 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f500039b0 msgr2=0x7f4f50003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.812+0000 7f4f69b56640 1 --2- 172.21.15.47:0/1813113067 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f500039b0 0x7f4f50003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.812+0000 7f4f69b56640 1 -- 172.21.15.47:0/1813113067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f50003520 con 0x7f4f50004800 2024-04-14T23:34:36.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.812+0000 7f4f69b56640 1 --2- 172.21.15.47:0/1813113067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f50004800 0x7f4f50004c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009ac0 tx=0x7f4f50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa563cb47e26aa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.813+0000 7f4f69355640 1 -- 172.21.15.47:0/1813113067 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54039070 con 0x7f4f50004800 2024-04-14T23:34:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.813+0000 7f4f69355640 1 -- 172.21.15.47:0/1813113067 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f5402c6b0 con 0x7f4f50004800 2024-04-14T23:34:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.813+0000 7f4f69355640 1 -- 172.21.15.47:0/1813113067 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54009690 con 0x7f4f50004800 2024-04-14T23:34:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.813+0000 7f4f6c5bb640 1 -- 172.21.15.47:0/1813113067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f50004800 msgr2=0x7f4f50004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.813+0000 7f4f6c5bb640 1 --2- 172.21.15.47:0/1813113067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f50004800 0x7f4f50004c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009ac0 tx=0x7f4f50005830 comp rx=0 tx=0).stop 2024-04-14T23:34:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.813+0000 7f4f6ab58640 1 -- 172.21.15.47:0/1813113067 reap_dead start 2024-04-14T23:34:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.813+0000 7f4f6c5bb640 1 -- 172.21.15.47:0/1813113067 shutdown_connections 2024-04-14T23:34:36.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.813+0000 7f4f6c5bb640 1 -- 172.21.15.47:0/1813113067 >> 172.21.15.47:0/1813113067 conn(0x7f4f6409d2b0 msgr2=0x7f4f640d3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.813+0000 7f4f6c5bb640 1 -- 172.21.15.47:0/1813113067 shutdown_connections 2024-04-14T23:34:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.813+0000 7f4f6c5bb640 1 -- 172.21.15.47:0/1813113067 wait complete. 2024-04-14T23:34:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.814+0000 7f4f6c5bb640 1 Processor -- start 2024-04-14T23:34:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.814+0000 7f4f6c5bb640 1 -- start start 2024-04-14T23:34:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.815+0000 7f4f6c5bb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f50004800 0x7f4f641542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.815+0000 7f4f6c5bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f64152440 0x7f4f641480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:36.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.815+0000 7f4f6c5bb640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f6406ce70 0x7f4f6406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:36.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.815+0000 7f4f6c5bb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4f640b6fc0 con 0x7f4f64152440 2024-04-14T23:34:36.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.815+0000 7f4f6c5bb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4f640d2d60 con 0x7f4f50004800 2024-04-14T23:34:36.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.815+0000 7f4f6c5bb640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4f640d2470 con 0x7f4f6406ce70 2024-04-14T23:34:36.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.815+0000 7f4f69b56640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f64152440 0x7f4f641480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:36.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.815+0000 7f4f69b56640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f64152440 0x7f4f641480d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42418/0 (socket says 172.21.15.47:42418) 2024-04-14T23:34:36.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.815+0000 7f4f69b56640 1 -- 172.21.15.47:0/2885553762 learned_addr learned my addr 172.21.15.47:0/2885553762 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:36.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.815+0000 7f4f6a357640 1 --2- 172.21.15.47:0/2885553762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f50004800 0x7f4f641542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:36.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.815+0000 7f4f6ab58640 1 --2- 172.21.15.47:0/2885553762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f6406ce70 0x7f4f6406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:36.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.816+0000 7f4f69b56640 1 -- 172.21.15.47:0/2885553762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f6406ce70 msgr2=0x7f4f6406d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:36.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.816+0000 7f4f69b56640 1 --2- 172.21.15.47:0/2885553762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f6406ce70 0x7f4f6406d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.816+0000 7f4f69b56640 1 -- 172.21.15.47:0/2885553762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f50004800 msgr2=0x7f4f641542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:36.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.816+0000 7f4f69b56640 1 --2- 172.21.15.47:0/2885553762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f50004800 0x7f4f641542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:36.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.816+0000 7f4f69b56640 1 -- 172.21.15.47:0/2885553762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f64154980 con 0x7f4f64152440 2024-04-14T23:34:36.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.816+0000 7f4f6a357640 1 --2- 172.21.15.47:0/2885553762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f50004800 0x7f4f641542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:36.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.816+0000 7f4f69b56640 1 --2- 172.21.15.47:0/2885553762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f64152440 0x7f4f641480d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009ac0 tx=0x7f4f54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:36.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.816+0000 7f4f5affd640 1 -- 172.21.15.47:0/2885553762 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54039050 con 0x7f4f64152440 2024-04-14T23:34:36.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.816+0000 7f4f5affd640 1 -- 172.21.15.47:0/2885553762 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f54045070 con 0x7f4f64152440 2024-04-14T23:34:36.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.816+0000 7f4f6c5bb640 1 -- 172.21.15.47:0/2885553762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f64154c60 con 0x7f4f64152440 2024-04-14T23:34:36.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.816+0000 7f4f5affd640 1 -- 172.21.15.47:0/2885553762 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54003a50 con 0x7f4f64152440 2024-04-14T23:34:36.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.816+0000 7f4f6c5bb640 1 -- 172.21.15.47:0/2885553762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f64155220 con 0x7f4f64152440 2024-04-14T23:34:36.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.817+0000 7f4f6c5bb640 1 -- 172.21.15.47:0/2885553762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f64073f50 con 0x7f4f64152440 2024-04-14T23:34:36.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.817+0000 7f4f5affd640 1 -- 172.21.15.47:0/2885553762 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4f54003bf0 con 0x7f4f64152440 2024-04-14T23:34:36.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.818+0000 7f4f5affd640 1 --2- 172.21.15.47:0/2885553762 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4f4806b990 0x7f4f4806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:36.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.818+0000 7f4f5affd640 1 -- 172.21.15.47:0/2885553762 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f4f540ac3a0 con 0x7f4f64152440 2024-04-14T23:34:36.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.818+0000 7f4f6a357640 1 --2- 172.21.15.47:0/2885553762 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4f4806b990 0x7f4f4806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:36.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.818+0000 7f4f6a357640 1 --2- 172.21.15.47:0/2885553762 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4f4806b990 0x7f4f4806de50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4f60007fd0 tx=0x7f4f60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:36.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:36.823+0000 7f4f5affd640 1 -- 172.21.15.47:0/2885553762 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4f5404e020 con 0x7f4f64152440 2024-04-14T23:34:37.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.003+0000 7f4f6c5bb640 1 -- 172.21.15.47:0/2885553762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f4f640c75d0 con 0x7f4f64152440 2024-04-14T23:34:37.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.688+0000 7f4f5affd640 1 -- 172.21.15.47:0/2885553762 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f4f5407b2d0 con 0x7f4f64152440 2024-04-14T23:34:37.690 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' created 2024-04-14T23:34:37.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.692+0000 7f4f6c5bb640 1 -- 172.21.15.47:0/2885553762 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4f4806b990 msgr2=0x7f4f4806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:37.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.692+0000 7f4f6c5bb640 1 --2- 172.21.15.47:0/2885553762 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4f4806b990 0x7f4f4806de50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4f60007fd0 tx=0x7f4f60009040 comp rx=0 tx=0).stop 2024-04-14T23:34:37.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.692+0000 7f4f6c5bb640 1 -- 172.21.15.47:0/2885553762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f64152440 msgr2=0x7f4f641480d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:37.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.692+0000 7f4f6c5bb640 1 --2- 172.21.15.47:0/2885553762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f64152440 0x7f4f641480d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009ac0 tx=0x7f4f54004730 comp rx=0 tx=0).stop 2024-04-14T23:34:37.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.693+0000 7f4f6c5bb640 1 -- 172.21.15.47:0/2885553762 shutdown_connections 2024-04-14T23:34:37.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.693+0000 7f4f6c5bb640 1 --2- 172.21.15.47:0/2885553762 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4f4806b990 0x7f4f4806de50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:37.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.693+0000 7f4f6c5bb640 1 --2- 172.21.15.47:0/2885553762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f6406ce70 0x7f4f6406d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:37.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.693+0000 7f4f6c5bb640 1 --2- 172.21.15.47:0/2885553762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f64152440 0x7f4f641480d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:37.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.693+0000 7f4f6c5bb640 1 --2- 172.21.15.47:0/2885553762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f50004800 0x7f4f641542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:37.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.693+0000 7f4f6c5bb640 1 -- 172.21.15.47:0/2885553762 >> 172.21.15.47:0/2885553762 conn(0x7f4f6409d2b0 msgr2=0x7f4f6415bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:37.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.697+0000 7f4f6c5bb640 1 -- 172.21.15.47:0/2885553762 shutdown_connections 2024-04-14T23:34:37.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.698+0000 7f4f6c5bb640 1 -- 172.21.15.47:0/2885553762 wait complete. 2024-04-14T23:34:37.722 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-14T23:34:37.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.829+0000 7f57f73cf640 1 Processor -- start 2024-04-14T23:34:37.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.829+0000 7f57f73cf640 1 -- start start 2024-04-14T23:34:37.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.830+0000 7f57f73cf640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f57f006b910 0x7f57f00cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:37.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.830+0000 7f57f73cf640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f006f530 con 0x7f57f0072cd0 2024-04-14T23:34:37.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.830+0000 7f57f73cf640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f00d0580 con 0x7f57f015e240 2024-04-14T23:34:37.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.830+0000 7f57f73cf640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f57f00d0860 con 0x7f57f006b910 2024-04-14T23:34:37.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.830+0000 7f57f596c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f57f006b910 0x7f57f00cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:37.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.830+0000 7f57f596c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f57f006b910 0x7f57f00cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42426/0 (socket says 172.21.15.47:42426) 2024-04-14T23:34:37.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.830+0000 7f57f596c640 1 -- 172.21.15.47:0/661193540 learned_addr learned my addr 172.21.15.47:0/661193540 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:37.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.830+0000 7f57f496a640 1 --1- 172.21.15.47:0/661193540 >> v1:172.21.15.47:6789/0 conn(0x7f57f0072cd0 0x7f57f006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:39464/0 (socket says 172.21.15.47:39464) 2024-04-14T23:34:37.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.831+0000 7f57f596c640 1 -- 172.21.15.47:0/661193540 >> v1:172.21.15.191:6789/0 conn(0x7f57f015e240 legacy=0x7f57f00ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:37.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.831+0000 7f57f596c640 1 -- 172.21.15.47:0/661193540 >> v1:172.21.15.47:6789/0 conn(0x7f57f0072cd0 legacy=0x7f57f006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:37.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.831+0000 7f57f596c640 1 -- 172.21.15.47:0/661193540 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f00727b0 con 0x7f57f006b910 2024-04-14T23:34:37.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.831+0000 7f57f596c640 1 --2- 172.21.15.47:0/661193540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57f006b910 0x7f57f00cb290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009e50 tx=0x7f57e002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d025a59b7033b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:37.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.832+0000 7f57effff640 1 -- 172.21.15.47:0/661193540 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e002cb20 con 0x7f57f006b910 2024-04-14T23:34:37.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.832+0000 7f57effff640 1 -- 172.21.15.47:0/661193540 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e002ccc0 con 0x7f57f006b910 2024-04-14T23:34:37.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.832+0000 7f57effff640 1 -- 172.21.15.47:0/661193540 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0034610 con 0x7f57f006b910 2024-04-14T23:34:37.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.832+0000 7f57f73cf640 1 -- 172.21.15.47:0/661193540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57f006b910 msgr2=0x7f57f00cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:37.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.832+0000 7f57f73cf640 1 --2- 172.21.15.47:0/661193540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57f006b910 0x7f57f00cb290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009e50 tx=0x7f57e002bf80 comp rx=0 tx=0).stop 2024-04-14T23:34:37.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.832+0000 7f57f73cf640 1 -- 172.21.15.47:0/661193540 shutdown_connections 2024-04-14T23:34:37.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.832+0000 7f57f73cf640 1 --2- 172.21.15.47:0/661193540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57f006b910 0x7f57f00cb290 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:37.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.832+0000 7f57f73cf640 1 -- 172.21.15.47:0/661193540 >> 172.21.15.47:0/661193540 conn(0x7f57f00d0c40 msgr2=0x7f57f00d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:37.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.832+0000 7f57f73cf640 1 -- 172.21.15.47:0/661193540 shutdown_connections 2024-04-14T23:34:37.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.832+0000 7f57f73cf640 1 -- 172.21.15.47:0/661193540 wait complete. 2024-04-14T23:34:37.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.833+0000 7f57f73cf640 1 Processor -- start 2024-04-14T23:34:37.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.833+0000 7f57f73cf640 1 -- start start 2024-04-14T23:34:37.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.834+0000 7f57f73cf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57f006b910 0x7f57f015fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:37.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.834+0000 7f57f73cf640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57f0072cd0 0x7f57f0160530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:37.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.834+0000 7f57f73cf640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57f015e240 0x7f57f0160a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:37.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.834+0000 7f57f73cf640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f57f006f310 con 0x7f57f006b910 2024-04-14T23:34:37.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.834+0000 7f57f73cf640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f57f006f190 con 0x7f57f0072cd0 2024-04-14T23:34:37.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.834+0000 7f57f73cf640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f57f00d01e0 con 0x7f57f015e240 2024-04-14T23:34:37.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.834+0000 7f57f516b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57f006b910 0x7f57f015fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:37.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.834+0000 7f57f516b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57f006b910 0x7f57f015fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42440/0 (socket says 172.21.15.47:42440) 2024-04-14T23:34:37.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.834+0000 7f57f516b640 1 -- 172.21.15.47:0/4100396561 learned_addr learned my addr 172.21.15.47:0/4100396561 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:37.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.834+0000 7f57f596c640 1 --2- 172.21.15.47:0/4100396561 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57f015e240 0x7f57f0160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:37.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.834+0000 7f57f496a640 1 --2- 172.21.15.47:0/4100396561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57f0072cd0 0x7f57f0160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:37.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.835+0000 7f57f516b640 1 -- 172.21.15.47:0/4100396561 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57f015e240 msgr2=0x7f57f0160a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:37.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.835+0000 7f57f516b640 1 --2- 172.21.15.47:0/4100396561 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57f015e240 0x7f57f0160a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:37.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.835+0000 7f57f516b640 1 -- 172.21.15.47:0/4100396561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57f0072cd0 msgr2=0x7f57f0160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:37.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.835+0000 7f57f516b640 1 --2- 172.21.15.47:0/4100396561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57f0072cd0 0x7f57f0160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:37.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.835+0000 7f57f516b640 1 -- 172.21.15.47:0/4100396561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f015c6b0 con 0x7f57f006b910 2024-04-14T23:34:37.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.835+0000 7f57f516b640 1 --2- 172.21.15.47:0/4100396561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57f006b910 0x7f57f015fff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f57e800c3f0 tx=0x7f57e800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:37.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.835+0000 7f57edffb640 1 -- 172.21.15.47:0/4100396561 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e80052d0 con 0x7f57f006b910 2024-04-14T23:34:37.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.835+0000 7f57edffb640 1 -- 172.21.15.47:0/4100396561 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e8005490 con 0x7f57f006b910 2024-04-14T23:34:37.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.835+0000 7f57f73cf640 1 -- 172.21.15.47:0/4100396561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f015f510 con 0x7f57f006b910 2024-04-14T23:34:37.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.835+0000 7f57edffb640 1 -- 172.21.15.47:0/4100396561 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e8007260 con 0x7f57f006b910 2024-04-14T23:34:37.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.835+0000 7f57f73cf640 1 -- 172.21.15.47:0/4100396561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f0155a70 con 0x7f57f006b910 2024-04-14T23:34:37.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.836+0000 7f57f73cf640 1 -- 172.21.15.47:0/4100396561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f00681f0 con 0x7f57f006b910 2024-04-14T23:34:37.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.836+0000 7f57edffb640 1 -- 172.21.15.47:0/4100396561 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f57e8007400 con 0x7f57f006b910 2024-04-14T23:34:37.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.837+0000 7f57edffb640 1 --2- 172.21.15.47:0/4100396561 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f57dc06b990 0x7f57dc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:37.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.837+0000 7f57edffb640 1 -- 172.21.15.47:0/4100396561 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f57e8089d60 con 0x7f57f006b910 2024-04-14T23:34:37.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.837+0000 7f57f496a640 1 --2- 172.21.15.47:0/4100396561 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f57dc06b990 0x7f57dc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:37.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.838+0000 7f57f496a640 1 --2- 172.21.15.47:0/4100396561 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f57dc06b990 0x7f57dc06de50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f57f01f7240 tx=0x7f57e4007c80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:37.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:37.841+0000 7f57edffb640 1 -- 172.21.15.47:0/4100396561 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f57e8058930 con 0x7f57f006b910 2024-04-14T23:34:38.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.058+0000 7f57f73cf640 1 -- 172.21.15.47:0/4100396561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f57f006ed60 con 0x7f57f006b910 2024-04-14T23:34:38.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.705+0000 7f57edffb640 1 -- 172.21.15.47:0/4100396561 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f57e8058230 con 0x7f57f006b910 2024-04-14T23:34:38.708 INFO:teuthology.orchestra.run.smithi047.stderr:new fs with metadata pool 2 and data pool 3 2024-04-14T23:34:38.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.720+0000 7f57f73cf640 1 -- 172.21.15.47:0/4100396561 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f57dc06b990 msgr2=0x7f57dc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:38.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.720+0000 7f57f73cf640 1 --2- 172.21.15.47:0/4100396561 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f57dc06b990 0x7f57dc06de50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f57f01f7240 tx=0x7f57e4007c80 comp rx=0 tx=0).stop 2024-04-14T23:34:38.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.720+0000 7f57f73cf640 1 -- 172.21.15.47:0/4100396561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57f006b910 msgr2=0x7f57f015fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:38.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.720+0000 7f57f73cf640 1 --2- 172.21.15.47:0/4100396561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57f006b910 0x7f57f015fff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f57e800c3f0 tx=0x7f57e800c8b0 comp rx=0 tx=0).stop 2024-04-14T23:34:38.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.721+0000 7f57f73cf640 1 -- 172.21.15.47:0/4100396561 shutdown_connections 2024-04-14T23:34:38.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.721+0000 7f57f73cf640 1 --2- 172.21.15.47:0/4100396561 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f57dc06b990 0x7f57dc06de50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:38.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.721+0000 7f57f73cf640 1 --2- 172.21.15.47:0/4100396561 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57f015e240 0x7f57f0160a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:38.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.721+0000 7f57f73cf640 1 --2- 172.21.15.47:0/4100396561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57f0072cd0 0x7f57f0160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:38.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.721+0000 7f57f73cf640 1 --2- 172.21.15.47:0/4100396561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57f006b910 0x7f57f015fff0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:38.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.721+0000 7f57f73cf640 1 -- 172.21.15.47:0/4100396561 >> 172.21.15.47:0/4100396561 conn(0x7f57f00d0c40 msgr2=0x7f57f00d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:38.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.721+0000 7f57f73cf640 1 -- 172.21.15.47:0/4100396561 shutdown_connections 2024-04-14T23:34:38.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.722+0000 7f57f73cf640 1 -- 172.21.15.47:0/4100396561 wait complete. 2024-04-14T23:34:38.737 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-14T23:34:38.737 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-14T23:34:38.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.846+0000 7fd1dcfcc640 1 Processor -- start 2024-04-14T23:34:38.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.846+0000 7fd1dcfcc640 1 -- start start 2024-04-14T23:34:38.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.847+0000 7fd1dcfcc640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd1d806b910 0x7fd1d80d1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:38.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.847+0000 7fd1dcfcc640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1d80b55e0 con 0x7fd1d80ad8a0 2024-04-14T23:34:38.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.847+0000 7fd1dcfcc640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1d80b58c0 con 0x7fd1d815e370 2024-04-14T23:34:38.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.847+0000 7fd1dcfcc640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fd1d80b3d40 con 0x7fd1d806b910 2024-04-14T23:34:38.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.847+0000 7fd1d6d9d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd1d80ad8a0 0x7fd1d806ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:39468/0 (socket says 172.21.15.47:39468) 2024-04-14T23:34:38.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.847+0000 7fd1d6d9d640 1 -- 172.21.15.47:0/2595702110 learned_addr learned my addr 172.21.15.47:0/2595702110 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:38.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.847+0000 7fd1d5d9b640 1 --2- 172.21.15.47:0/2595702110 >> v2:172.21.15.191:3300/0 conn(0x7fd1d806b910 0x7fd1d80d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:38.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.847+0000 7fd1d559a640 1 -- 172.21.15.47:0/2595702110 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1381666932 0 0) 0x7fd1d80b55e0 con 0x7fd1d80ad8a0 2024-04-14T23:34:38.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.847+0000 7fd1d559a640 1 -- 172.21.15.47:0/2595702110 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1c4003520 con 0x7fd1d80ad8a0 2024-04-14T23:34:38.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.847+0000 7fd1d559a640 1 -- 172.21.15.47:0/2595702110 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2336337305 0 0) 0x7fd1c4003520 con 0x7fd1d80ad8a0 2024-04-14T23:34:38.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.847+0000 7fd1d5d9b640 1 -- 172.21.15.47:0/2595702110 >> v1:172.21.15.191:6789/0 conn(0x7fd1d815e370 legacy=0x7fd1d806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:38.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.848+0000 7fd1d5d9b640 1 -- 172.21.15.47:0/2595702110 >> v1:172.21.15.47:6789/0 conn(0x7fd1d80ad8a0 legacy=0x7fd1d806ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:38.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.848+0000 7fd1d5d9b640 1 -- 172.21.15.47:0/2595702110 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d80b5ba0 con 0x7fd1d806b910 2024-04-14T23:34:38.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.848+0000 7fd1d5d9b640 1 --2- 172.21.15.47:0/2595702110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1d806b910 0x7fd1d80d1700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00097a0 tx=0x7fd1c002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86f4e5c1545e82c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:38.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.848+0000 7fd1d559a640 1 -- 172.21.15.47:0/2595702110 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0038070 con 0x7fd1d806b910 2024-04-14T23:34:38.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.848+0000 7fd1d559a640 1 -- 172.21.15.47:0/2595702110 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c0031500 con 0x7fd1d806b910 2024-04-14T23:34:38.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.848+0000 7fd1d559a640 1 -- 172.21.15.47:0/2595702110 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80019f0 con 0x7fd1d806b910 2024-04-14T23:34:38.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.849+0000 7fd1dcfcc640 1 -- 172.21.15.47:0/2595702110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1d806b910 msgr2=0x7fd1d80d1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:38.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.849+0000 7fd1dcfcc640 1 --2- 172.21.15.47:0/2595702110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1d806b910 0x7fd1d80d1700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00097a0 tx=0x7fd1c002b820 comp rx=0 tx=0).stop 2024-04-14T23:34:38.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.849+0000 7fd1dcfcc640 1 -- 172.21.15.47:0/2595702110 shutdown_connections 2024-04-14T23:34:38.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.849+0000 7fd1dcfcc640 1 --2- 172.21.15.47:0/2595702110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1d806b910 0x7fd1d80d1700 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:38.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.849+0000 7fd1dcfcc640 1 -- 172.21.15.47:0/2595702110 >> 172.21.15.47:0/2595702110 conn(0x7fd1d80d0be0 msgr2=0x7fd1d80d0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:38.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.849+0000 7fd1dcfcc640 1 -- 172.21.15.47:0/2595702110 shutdown_connections 2024-04-14T23:34:38.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.849+0000 7fd1dcfcc640 1 -- 172.21.15.47:0/2595702110 wait complete. 2024-04-14T23:34:38.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.850+0000 7fd1dcfcc640 1 Processor -- start 2024-04-14T23:34:38.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.850+0000 7fd1dcfcc640 1 -- start start 2024-04-14T23:34:38.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.851+0000 7fd1dcfcc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d806b910 0x7fd1d81f3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:38.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.851+0000 7fd1dcfcc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1d80ad8a0 0x7fd1d81f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:38.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.851+0000 7fd1dcfcc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1d815e370 0x7fd1d8145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.851+0000 7fd1dcfcc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d8070650 con 0x7fd1d806b910 2024-04-14T23:34:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.851+0000 7fd1dcfcc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d80704d0 con 0x7fd1d80ad8a0 2024-04-14T23:34:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.851+0000 7fd1dcfcc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d806e4c0 con 0x7fd1d815e370 2024-04-14T23:34:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.851+0000 7fd1d659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d806b910 0x7fd1d81f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.851+0000 7fd1d659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d806b910 0x7fd1d81f3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42446/0 (socket says 172.21.15.47:42446) 2024-04-14T23:34:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.851+0000 7fd1d659c640 1 -- 172.21.15.47:0/1369379321 learned_addr learned my addr 172.21.15.47:0/1369379321 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.851+0000 7fd1d5d9b640 1 --2- 172.21.15.47:0/1369379321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1d80ad8a0 0x7fd1d81f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.851+0000 7fd1d6d9d640 1 --2- 172.21.15.47:0/1369379321 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1d815e370 0x7fd1d8145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.852+0000 7fd1d659c640 1 -- 172.21.15.47:0/1369379321 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1d815e370 msgr2=0x7fd1d8145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.852+0000 7fd1d659c640 1 --2- 172.21.15.47:0/1369379321 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1d815e370 0x7fd1d8145ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.852+0000 7fd1d659c640 1 -- 172.21.15.47:0/1369379321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1d80ad8a0 msgr2=0x7fd1d81f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.852+0000 7fd1d659c640 1 --2- 172.21.15.47:0/1369379321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1d80ad8a0 0x7fd1d81f7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.852+0000 7fd1d659c640 1 -- 172.21.15.47:0/1369379321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d81453e0 con 0x7fd1d806b910 2024-04-14T23:34:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.852+0000 7fd1d6d9d640 1 --2- 172.21.15.47:0/1369379321 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1d815e370 0x7fd1d8145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.852+0000 7fd1d659c640 1 --2- 172.21.15.47:0/1369379321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d806b910 0x7fd1d81f3310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000c430 tx=0x7fd1d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:38.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.852+0000 7fd1ceffd640 1 -- 172.21.15.47:0/1369379321 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0017070 con 0x7fd1d806b910 2024-04-14T23:34:38.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.852+0000 7fd1ceffd640 1 -- 172.21.15.47:0/1369379321 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d00052d0 con 0x7fd1d806b910 2024-04-14T23:34:38.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.852+0000 7fd1ceffd640 1 -- 172.21.15.47:0/1369379321 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0003830 con 0x7fd1d806b910 2024-04-14T23:34:38.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.852+0000 7fd1dcfcc640 1 -- 172.21.15.47:0/1369379321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d80cf850 con 0x7fd1d806b910 2024-04-14T23:34:38.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.852+0000 7fd1dcfcc640 1 -- 172.21.15.47:0/1369379321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d8145680 con 0x7fd1d806b910 2024-04-14T23:34:38.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.853+0000 7fd1dcfcc640 1 -- 172.21.15.47:0/1369379321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1d80754a0 con 0x7fd1d806b910 2024-04-14T23:34:38.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.853+0000 7fd1ceffd640 1 -- 172.21.15.47:0/1369379321 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd1d001a070 con 0x7fd1d806b910 2024-04-14T23:34:38.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.854+0000 7fd1ceffd640 1 --2- 172.21.15.47:0/1369379321 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd1b806b990 0x7fd1b806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:38.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.854+0000 7fd1ceffd640 1 -- 172.21.15.47:0/1369379321 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fd1d0089a90 con 0x7fd1d806b910 2024-04-14T23:34:38.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.854+0000 7fd1d5d9b640 1 --2- 172.21.15.47:0/1369379321 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd1b806b990 0x7fd1b806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:38.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.854+0000 7fd1d5d9b640 1 --2- 172.21.15.47:0/1369379321 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd1b806b990 0x7fd1b806de50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0035000 tx=0x7fd1c0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:38.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:38.858+0000 7fd1ceffd640 1 -- 172.21.15.47:0/1369379321 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd1d00580e0 con 0x7fd1d806b910 2024-04-14T23:34:39.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.047+0000 7fd1dcfcc640 1 -- 172.21.15.47:0/1369379321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fd1d81458c0 con 0x7fd1d806b910 2024-04-14T23:34:39.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.691+0000 7fd1ceffd640 1 -- 172.21.15.47:0/1369379321 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7fd1d005c180 con 0x7fd1d806b910 2024-04-14T23:34:39.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.694+0000 7fd1dcfcc640 1 -- 172.21.15.47:0/1369379321 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd1b806b990 msgr2=0x7fd1b806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:39.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.694+0000 7fd1dcfcc640 1 --2- 172.21.15.47:0/1369379321 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd1b806b990 0x7fd1b806de50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0035000 tx=0x7fd1c0008030 comp rx=0 tx=0).stop 2024-04-14T23:34:39.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.694+0000 7fd1dcfcc640 1 -- 172.21.15.47:0/1369379321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d806b910 msgr2=0x7fd1d81f3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:39.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.694+0000 7fd1dcfcc640 1 --2- 172.21.15.47:0/1369379321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d806b910 0x7fd1d81f3310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000c430 tx=0x7fd1d000c8f0 comp rx=0 tx=0).stop 2024-04-14T23:34:39.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.694+0000 7fd1dcfcc640 1 -- 172.21.15.47:0/1369379321 shutdown_connections 2024-04-14T23:34:39.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.694+0000 7fd1dcfcc640 1 --2- 172.21.15.47:0/1369379321 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd1b806b990 0x7fd1b806de50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:39.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.694+0000 7fd1dcfcc640 1 --2- 172.21.15.47:0/1369379321 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1d815e370 0x7fd1d8145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:39.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.694+0000 7fd1dcfcc640 1 --2- 172.21.15.47:0/1369379321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1d80ad8a0 0x7fd1d81f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:39.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.694+0000 7fd1dcfcc640 1 --2- 172.21.15.47:0/1369379321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d806b910 0x7fd1d81f3310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:39.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.694+0000 7fd1dcfcc640 1 -- 172.21.15.47:0/1369379321 >> 172.21.15.47:0/1369379321 conn(0x7fd1d80d0be0 msgr2=0x7fd1d815b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:39.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.694+0000 7fd1dcfcc640 1 -- 172.21.15.47:0/1369379321 shutdown_connections 2024-04-14T23:34:39.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.694+0000 7fd1dcfcc640 1 -- 172.21.15.47:0/1369379321 wait complete. 2024-04-14T23:34:39.711 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-14T23:34:39.761 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T23:34:39.764 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T23:34:39.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.826+0000 7fe635d81640 1 Processor -- start 2024-04-14T23:34:39.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.826+0000 7fe635d81640 1 -- start start 2024-04-14T23:34:39.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.826+0000 7fe635d81640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6300d1070 0x7fe6300cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:39.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.826+0000 7fe635d81640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe6300d4680 0x7fe6300cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:39.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.826+0000 7fe635d81640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6300d26f0 con 0x7fe630161780 2024-04-14T23:34:39.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.826+0000 7fe635d81640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fe6300d2f90 con 0x7fe6300d4680 2024-04-14T23:34:39.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.826+0000 7fe635d81640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe6300b6dc0 con 0x7fe6300d1070 2024-04-14T23:34:39.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.827+0000 7fe62ffff640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe6300d4680 0x7fe6300cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:39.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.827+0000 7fe62effd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6300d1070 0x7fe6300cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:39.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.827+0000 7fe62ffff640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe6300d4680 0x7fe6300cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:36168/0 (socket says 172.21.15.47:36168) 2024-04-14T23:34:39.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.827+0000 7fe62ffff640 1 -- 172.21.15.47:0/1149380765 learned_addr learned my addr 172.21.15.47:0/1149380765 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:39.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.827+0000 7fe62f7fe640 1 --1- 172.21.15.47:0/1149380765 >> v1:172.21.15.191:6789/0 conn(0x7fe630161780 0x7fe6300d0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.47:45084/0 (socket says 172.21.15.47:45084) 2024-04-14T23:34:39.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.827+0000 7fe62ffff640 1 -- 172.21.15.47:0/1149380765 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6300d1070 msgr2=0x7fe6300cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:39.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.827+0000 7fe62ffff640 1 --2- 172.21.15.47:0/1149380765 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6300d1070 0x7fe6300cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:39.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.827+0000 7fe62ffff640 1 -- 172.21.15.47:0/1149380765 >> v1:172.21.15.191:6789/0 conn(0x7fe630161780 legacy=0x7fe6300d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:39.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.827+0000 7fe62ffff640 1 -- 172.21.15.47:0/1149380765 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6300d29d0 con 0x7fe6300d4680 2024-04-14T23:34:39.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.827+0000 7fe62e7fc640 1 -- 172.21.15.47:0/1149380765 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023889949 0 0) 0x7fe6300d26f0 con 0x7fe630161780 2024-04-14T23:34:39.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.827+0000 7fe62effd640 1 --2- 172.21.15.47:0/1149380765 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6300d1070 0x7fe6300cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.828+0000 7fe62ffff640 1 --2- 172.21.15.47:0/1149380765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6300d4680 0x7fe6300cefa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe628009e50 tx=0x7fe62802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=306a55efe8b75c56 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.828+0000 7fe62e7fc640 1 -- 172.21.15.47:0/1149380765 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62802cb00 con 0x7fe6300d4680 2024-04-14T23:34:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.828+0000 7fe62e7fc640 1 -- 172.21.15.47:0/1149380765 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe62802cca0 con 0x7fe6300d4680 2024-04-14T23:34:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.828+0000 7fe62e7fc640 1 -- 172.21.15.47:0/1149380765 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe628034610 con 0x7fe6300d4680 2024-04-14T23:34:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.829+0000 7fe635d81640 1 -- 172.21.15.47:0/1149380765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6300d4680 msgr2=0x7fe6300cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.829+0000 7fe635d81640 1 --2- 172.21.15.47:0/1149380765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6300d4680 0x7fe6300cefa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe628009e50 tx=0x7fe62802bf60 comp rx=0 tx=0).stop 2024-04-14T23:34:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.829+0000 7fe635d81640 1 -- 172.21.15.47:0/1149380765 shutdown_connections 2024-04-14T23:34:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.829+0000 7fe635d81640 1 --2- 172.21.15.47:0/1149380765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6300d4680 0x7fe6300cefa0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.829+0000 7fe635d81640 1 --2- 172.21.15.47:0/1149380765 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6300d1070 0x7fe6300cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.829+0000 7fe635d81640 1 -- 172.21.15.47:0/1149380765 >> 172.21.15.47:0/1149380765 conn(0x7fe63009d240 msgr2=0x7fe6300d3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.829+0000 7fe635d81640 1 -- 172.21.15.47:0/1149380765 shutdown_connections 2024-04-14T23:34:39.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.829+0000 7fe635d81640 1 -- 172.21.15.47:0/1149380765 wait complete. 2024-04-14T23:34:39.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.830+0000 7fe635d81640 1 Processor -- start 2024-04-14T23:34:39.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.830+0000 7fe635d81640 1 -- start start 2024-04-14T23:34:39.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe635d81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6300d1070 0x7fe63014b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:39.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe635d81640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6300d4680 0x7fe6300ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:39.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe635d81640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe630161780 0x7fe6300cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:39.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe635d81640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6300b4fb0 con 0x7fe6300d1070 2024-04-14T23:34:39.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe635d81640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe6300b4e30 con 0x7fe6300d4680 2024-04-14T23:34:39.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe635d81640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe630161b60 con 0x7fe630161780 2024-04-14T23:34:39.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe62f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6300d1070 0x7fe63014b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:39.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe62f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6300d1070 0x7fe63014b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42462/0 (socket says 172.21.15.47:42462) 2024-04-14T23:34:39.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe62f7fe640 1 -- 172.21.15.47:0/3712928020 learned_addr learned my addr 172.21.15.47:0/3712928020 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:39.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe62effd640 1 --2- 172.21.15.47:0/3712928020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6300d4680 0x7fe6300ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:39.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe62ffff640 1 --2- 172.21.15.47:0/3712928020 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe630161780 0x7fe6300cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:39.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe62f7fe640 1 -- 172.21.15.47:0/3712928020 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe630161780 msgr2=0x7fe6300cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:39.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe62f7fe640 1 --2- 172.21.15.47:0/3712928020 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe630161780 0x7fe6300cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:39.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe62f7fe640 1 -- 172.21.15.47:0/3712928020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6300d4680 msgr2=0x7fe6300ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:39.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe62f7fe640 1 --2- 172.21.15.47:0/3712928020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6300d4680 0x7fe6300ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:39.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe62f7fe640 1 -- 172.21.15.47:0/3712928020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6300cc4d0 con 0x7fe6300d1070 2024-04-14T23:34:39.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe62f7fe640 1 --2- 172.21.15.47:0/3712928020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6300d1070 0x7fe63014b230 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe62000c430 tx=0x7fe62000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:39.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe617fff640 1 -- 172.21.15.47:0/3712928020 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6200074e0 con 0x7fe6300d1070 2024-04-14T23:34:39.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe617fff640 1 -- 172.21.15.47:0/3712928020 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6200047e0 con 0x7fe6300d1070 2024-04-14T23:34:39.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe635d81640 1 -- 172.21.15.47:0/3712928020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6300cc7b0 con 0x7fe6300d1070 2024-04-14T23:34:39.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe617fff640 1 -- 172.21.15.47:0/3712928020 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe620004bd0 con 0x7fe6300d1070 2024-04-14T23:34:39.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.831+0000 7fe635d81640 1 -- 172.21.15.47:0/3712928020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6300ccd70 con 0x7fe6300d1070 2024-04-14T23:34:39.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.832+0000 7fe635d81640 1 -- 172.21.15.47:0/3712928020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe630073f50 con 0x7fe6300d1070 2024-04-14T23:34:39.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.833+0000 7fe617fff640 1 -- 172.21.15.47:0/3712928020 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe620011070 con 0x7fe6300d1070 2024-04-14T23:34:39.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.833+0000 7fe617fff640 1 --2- 172.21.15.47:0/3712928020 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe61c06b990 0x7fe61c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:39.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.834+0000 7fe617fff640 1 -- 172.21.15.47:0/3712928020 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7fe62008a400 con 0x7fe6300d1070 2024-04-14T23:34:39.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.834+0000 7fe62effd640 1 --2- 172.21.15.47:0/3712928020 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe61c06b990 0x7fe61c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:39.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.834+0000 7fe62effd640 1 --2- 172.21.15.47:0/3712928020 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe61c06b990 0x7fe61c06de50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe624009560 tx=0x7fe624009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:39.838+0000 7fe617fff640 1 -- 172.21.15.47:0/3712928020 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe620058920 con 0x7fe6300d1070 2024-04-14T23:34:40.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:40.019+0000 7fe635d81640 1 -- 172.21.15.47:0/3712928020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe6300ce660 con 0x7fe6300d1070 2024-04-14T23:34:41.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.706+0000 7fe617fff640 1 -- 172.21.15.47:0/3712928020 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7fe62005c9c0 con 0x7fe6300d1070 2024-04-14T23:34:41.710 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data_ec' created 2024-04-14T23:34:41.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.710+0000 7fe635d81640 1 -- 172.21.15.47:0/3712928020 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe61c06b990 msgr2=0x7fe61c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:41.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.710+0000 7fe635d81640 1 --2- 172.21.15.47:0/3712928020 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe61c06b990 0x7fe61c06de50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe624009560 tx=0x7fe624009190 comp rx=0 tx=0).stop 2024-04-14T23:34:41.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.710+0000 7fe635d81640 1 -- 172.21.15.47:0/3712928020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6300d1070 msgr2=0x7fe63014b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:41.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.710+0000 7fe635d81640 1 --2- 172.21.15.47:0/3712928020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6300d1070 0x7fe63014b230 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe62000c430 tx=0x7fe62000c8f0 comp rx=0 tx=0).stop 2024-04-14T23:34:41.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.710+0000 7fe635d81640 1 -- 172.21.15.47:0/3712928020 shutdown_connections 2024-04-14T23:34:41.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.711+0000 7fe635d81640 1 --2- 172.21.15.47:0/3712928020 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe61c06b990 0x7fe61c06de50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:41.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.711+0000 7fe635d81640 1 --2- 172.21.15.47:0/3712928020 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe630161780 0x7fe6300cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:41.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.711+0000 7fe635d81640 1 --2- 172.21.15.47:0/3712928020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6300d4680 0x7fe6300ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:41.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.711+0000 7fe635d81640 1 --2- 172.21.15.47:0/3712928020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6300d1070 0x7fe63014b230 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:41.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.711+0000 7fe635d81640 1 -- 172.21.15.47:0/3712928020 >> 172.21.15.47:0/3712928020 conn(0x7fe63009d240 msgr2=0x7fe630160470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:41.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.711+0000 7fe635d81640 1 -- 172.21.15.47:0/3712928020 shutdown_connections 2024-04-14T23:34:41.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.711+0000 7fe635d81640 1 -- 172.21.15.47:0/3712928020 wait complete. 2024-04-14T23:34:41.733 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-14T23:34:41.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.882+0000 7f4affd11640 1 Processor -- start 2024-04-14T23:34:41.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.882+0000 7f4affd11640 1 -- start start 2024-04-14T23:34:41.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.883+0000 7f4affd11640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4af80d0c40 0x7f4af80cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.883+0000 7f4affd11640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4af815dcc0 0x7f4af815e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.883+0000 7f4affd11640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af80cfb00 con 0x7f4af80d1020 2024-04-14T23:34:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.883+0000 7f4affd11640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4af80d00c0 con 0x7f4af815dcc0 2024-04-14T23:34:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.883+0000 7f4affd11640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f4af80cfde0 con 0x7f4af80d0c40 2024-04-14T23:34:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.883+0000 7f4afe2ae640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4af815dcc0 0x7f4af815e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.883+0000 7f4afe2ae640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4af815dcc0 0x7f4af815e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42464/0 (socket says 172.21.15.47:42464) 2024-04-14T23:34:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.883+0000 7f4afe2ae640 1 -- 172.21.15.47:0/4029281633 learned_addr learned my addr 172.21.15.47:0/4029281633 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.883+0000 7f4afdaad640 1 --2- 172.21.15.47:0/4029281633 >> v2:172.21.15.191:3300/0 conn(0x7f4af80d0c40 0x7f4af80cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.883+0000 7f4afe2ae640 1 -- 172.21.15.47:0/4029281633 >> v2:172.21.15.191:3300/0 conn(0x7f4af80d0c40 msgr2=0x7f4af80cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.883+0000 7f4afe2ae640 1 --2- 172.21.15.47:0/4029281633 >> v2:172.21.15.191:3300/0 conn(0x7f4af80d0c40 0x7f4af80cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.883+0000 7f4afe2ae640 1 -- 172.21.15.47:0/4029281633 >> v1:172.21.15.191:6789/0 conn(0x7f4af80d1020 legacy=0x7f4af80cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.883+0000 7f4afe2ae640 1 -- 172.21.15.47:0/4029281633 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af80b39d0 con 0x7f4af815dcc0 2024-04-14T23:34:41.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.883+0000 7f4afdaad640 1 --2- 172.21.15.47:0/4029281633 >> v2:172.21.15.191:3300/0 conn(0x7f4af80d0c40 0x7f4af80cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:41.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.884+0000 7f4afe2ae640 1 --2- 172.21.15.47:0/4029281633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af815dcc0 0x7f4af815e150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4af808e280 tx=0x7f4af002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33a426b1ed7bf8e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:41.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.884+0000 7f4afcaab640 1 -- 172.21.15.47:0/4029281633 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af002ca80 con 0x7f4af815dcc0 2024-04-14T23:34:41.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.884+0000 7f4afcaab640 1 -- 172.21.15.47:0/4029281633 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af002cc20 con 0x7f4af815dcc0 2024-04-14T23:34:41.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.884+0000 7f4afcaab640 1 -- 172.21.15.47:0/4029281633 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af00343f0 con 0x7f4af815dcc0 2024-04-14T23:34:41.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.885+0000 7f4affd11640 1 -- 172.21.15.47:0/4029281633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af815dcc0 msgr2=0x7f4af815e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:41.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.885+0000 7f4affd11640 1 --2- 172.21.15.47:0/4029281633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af815dcc0 0x7f4af815e150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4af808e280 tx=0x7f4af002bee0 comp rx=0 tx=0).stop 2024-04-14T23:34:41.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.885+0000 7f4affd11640 1 -- 172.21.15.47:0/4029281633 shutdown_connections 2024-04-14T23:34:41.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.885+0000 7f4affd11640 1 --2- 172.21.15.47:0/4029281633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af815dcc0 0x7f4af815e150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:41.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.885+0000 7f4affd11640 1 --2- 172.21.15.47:0/4029281633 >> v2:172.21.15.191:3300/0 conn(0x7f4af80d0c40 0x7f4af80cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:41.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.885+0000 7f4affd11640 1 -- 172.21.15.47:0/4029281633 >> 172.21.15.47:0/4029281633 conn(0x7f4af809d340 msgr2=0x7f4af80d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:41.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.885+0000 7f4affd11640 1 -- 172.21.15.47:0/4029281633 shutdown_connections 2024-04-14T23:34:41.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.885+0000 7f4affd11640 1 -- 172.21.15.47:0/4029281633 wait complete. 2024-04-14T23:34:41.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.886+0000 7f4affd11640 1 Processor -- start 2024-04-14T23:34:41.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.886+0000 7f4affd11640 1 -- start start 2024-04-14T23:34:41.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4affd11640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4af80d0c40 0x7f4af80c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:41.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4affd11640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af80d1020 0x7f4af80d4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:41.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4affd11640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4af815dcc0 0x7f4af80d45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:41.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4affd11640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4af80b41b0 con 0x7f4af80d1020 2024-04-14T23:34:41.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4affd11640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4af815e690 con 0x7f4af80d0c40 2024-04-14T23:34:41.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4affd11640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4af80b4330 con 0x7f4af815dcc0 2024-04-14T23:34:41.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4afd2ac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af80d1020 0x7f4af80d4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:41.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4afd2ac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af80d1020 0x7f4af80d4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42468/0 (socket says 172.21.15.47:42468) 2024-04-14T23:34:41.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4afd2ac640 1 -- 172.21.15.47:0/2637662629 learned_addr learned my addr 172.21.15.47:0/2637662629 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:41.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4afdaad640 1 --2- 172.21.15.47:0/2637662629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4af80d0c40 0x7f4af80c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:41.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4afe2ae640 1 --2- 172.21.15.47:0/2637662629 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4af815dcc0 0x7f4af80d45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:41.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4afd2ac640 1 -- 172.21.15.47:0/2637662629 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4af815dcc0 msgr2=0x7f4af80d45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:41.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4afd2ac640 1 --2- 172.21.15.47:0/2637662629 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4af815dcc0 0x7f4af80d45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:41.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4afd2ac640 1 -- 172.21.15.47:0/2637662629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4af80d0c40 msgr2=0x7f4af80c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:41.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4afd2ac640 1 --2- 172.21.15.47:0/2637662629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4af80d0c40 0x7f4af80c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:41.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4afd2ac640 1 -- 172.21.15.47:0/2637662629 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af815ebf0 con 0x7f4af80d1020 2024-04-14T23:34:41.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.887+0000 7f4afd2ac640 1 --2- 172.21.15.47:0/2637662629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af80d1020 0x7f4af80d4070 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800c430 tx=0x7f4ae800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:41.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.888+0000 7f4aee7fc640 1 -- 172.21.15.47:0/2637662629 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8011790 con 0x7f4af80d1020 2024-04-14T23:34:41.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.888+0000 7f4aee7fc640 1 -- 172.21.15.47:0/2637662629 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae8017070 con 0x7f4af80d1020 2024-04-14T23:34:41.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.888+0000 7f4affd11640 1 -- 172.21.15.47:0/2637662629 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af815eed0 con 0x7f4af80d1020 2024-04-14T23:34:41.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.888+0000 7f4aee7fc640 1 -- 172.21.15.47:0/2637662629 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8011bb0 con 0x7f4af80d1020 2024-04-14T23:34:41.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.888+0000 7f4affd11640 1 -- 172.21.15.47:0/2637662629 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af815f490 con 0x7f4af80d1020 2024-04-14T23:34:41.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.888+0000 7f4affd11640 1 -- 172.21.15.47:0/2637662629 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af80754a0 con 0x7f4af80d1020 2024-04-14T23:34:41.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.889+0000 7f4aee7fc640 1 -- 172.21.15.47:0/2637662629 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4ae801c460 con 0x7f4af80d1020 2024-04-14T23:34:41.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.890+0000 7f4aee7fc640 1 --2- 172.21.15.47:0/2637662629 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4adc06b990 0x7f4adc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:41.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.890+0000 7f4aee7fc640 1 -- 172.21.15.47:0/2637662629 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f4ae808a8f0 con 0x7f4af80d1020 2024-04-14T23:34:41.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.890+0000 7f4afdaad640 1 --2- 172.21.15.47:0/2637662629 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4adc06b990 0x7f4adc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:41.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.890+0000 7f4afdaad640 1 --2- 172.21.15.47:0/2637662629 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4adc06b990 0x7f4adc06de50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4af80a1f80 tx=0x7f4af4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:41.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:41.894+0000 7f4aee7fc640 1 -- 172.21.15.47:0/2637662629 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4ae8058b90 con 0x7f4af80d1020 2024-04-14T23:34:42.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.079+0000 7f4affd11640 1 -- 172.21.15.47:0/2637662629 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f4af8146930 con 0x7f4af80d1020 2024-04-14T23:34:42.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.712+0000 7f4aee7fc640 1 -- 172.21.15.47:0/2637662629 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f4ae805cc30 con 0x7f4af80d1020 2024-04-14T23:34:42.715 INFO:teuthology.orchestra.run.smithi047.stderr:set pool 4 allow_ec_overwrites to true 2024-04-14T23:34:42.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.717+0000 7f4affd11640 1 -- 172.21.15.47:0/2637662629 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4adc06b990 msgr2=0x7f4adc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:42.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.717+0000 7f4affd11640 1 --2- 172.21.15.47:0/2637662629 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4adc06b990 0x7f4adc06de50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4af80a1f80 tx=0x7f4af4008040 comp rx=0 tx=0).stop 2024-04-14T23:34:42.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.717+0000 7f4affd11640 1 -- 172.21.15.47:0/2637662629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af80d1020 msgr2=0x7f4af80d4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:42.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.717+0000 7f4affd11640 1 --2- 172.21.15.47:0/2637662629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af80d1020 0x7f4af80d4070 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800c430 tx=0x7f4ae800c8f0 comp rx=0 tx=0).stop 2024-04-14T23:34:42.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.720+0000 7f4affd11640 1 -- 172.21.15.47:0/2637662629 shutdown_connections 2024-04-14T23:34:42.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.720+0000 7f4affd11640 1 --2- 172.21.15.47:0/2637662629 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4adc06b990 0x7f4adc06de50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:42.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.720+0000 7f4affd11640 1 --2- 172.21.15.47:0/2637662629 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4af815dcc0 0x7f4af80d45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:42.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.720+0000 7f4affd11640 1 --2- 172.21.15.47:0/2637662629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af80d1020 0x7f4af80d4070 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:42.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.720+0000 7f4affd11640 1 --2- 172.21.15.47:0/2637662629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4af80d0c40 0x7f4af80c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:42.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.720+0000 7f4affd11640 1 -- 172.21.15.47:0/2637662629 >> 172.21.15.47:0/2637662629 conn(0x7f4af809d340 msgr2=0x7f4af80b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:42.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.729+0000 7f4affd11640 1 -- 172.21.15.47:0/2637662629 shutdown_connections 2024-04-14T23:34:42.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.730+0000 7f4affd11640 1 -- 172.21.15.47:0/2637662629 wait complete. 2024-04-14T23:34:42.752 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-14T23:34:42.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.853+0000 7fc0e9d1e640 1 Processor -- start 2024-04-14T23:34:42.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.853+0000 7fc0e9d1e640 1 -- start start 2024-04-14T23:34:42.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.853+0000 7fc0e9d1e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e40d03b0 0x7fc0e40d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:42.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.853+0000 7fc0e9d1e640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc0e40cebc0 0x7fc0e406eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:42.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.853+0000 7fc0e9d1e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc0e406f080 0x7fc0e406d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:42.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.853+0000 7fc0e9d1e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc0e4072400 con 0x7fc0e406f080 2024-04-14T23:34:42.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.854+0000 7fc0e9d1e640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fc0e41568f0 con 0x7fc0e40cebc0 2024-04-14T23:34:42.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.854+0000 7fc0e9d1e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e40d0cd0 con 0x7fc0e40d03b0 2024-04-14T23:34:42.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.854+0000 7fc0e3fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc0e406f080 0x7fc0e406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:42.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.854+0000 7fc0e3fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc0e406f080 0x7fc0e406d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42474/0 (socket says 172.21.15.47:42474) 2024-04-14T23:34:42.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.854+0000 7fc0e3fff640 1 -- 172.21.15.47:0/944014060 learned_addr learned my addr 172.21.15.47:0/944014060 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:42.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.854+0000 7fc0e2ffd640 1 --2- 172.21.15.47:0/944014060 >> v2:172.21.15.191:3300/0 conn(0x7fc0e40cebc0 0x7fc0e406eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:42.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.854+0000 7fc0e37fe640 1 --2- 172.21.15.47:0/944014060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e40d03b0 0x7fc0e40d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.854+0000 7fc0e3fff640 1 -- 172.21.15.47:0/944014060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e40d03b0 msgr2=0x7fc0e40d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.854+0000 7fc0e3fff640 1 --2- 172.21.15.47:0/944014060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e40d03b0 0x7fc0e40d0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.854+0000 7fc0e3fff640 1 -- 172.21.15.47:0/944014060 >> v2:172.21.15.191:3300/0 conn(0x7fc0e40cebc0 msgr2=0x7fc0e406eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.854+0000 7fc0e3fff640 1 --2- 172.21.15.47:0/944014060 >> v2:172.21.15.191:3300/0 conn(0x7fc0e40cebc0 0x7fc0e406eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.854+0000 7fc0e3fff640 1 -- 172.21.15.47:0/944014060 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e415c550 con 0x7fc0e406f080 2024-04-14T23:34:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.854+0000 7fc0e2ffd640 1 --2- 172.21.15.47:0/944014060 >> v2:172.21.15.191:3300/0 conn(0x7fc0e40cebc0 0x7fc0e406eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.855+0000 7fc0e3fff640 1 --2- 172.21.15.47:0/944014060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e406f080 0x7fc0e406d600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4068760 tx=0x7fc0dc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50bedc89023b011 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.855+0000 7fc0e27fc640 1 -- 172.21.15.47:0/944014060 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc02ca70 con 0x7fc0e406f080 2024-04-14T23:34:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.855+0000 7fc0e27fc640 1 -- 172.21.15.47:0/944014060 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0dc02cc10 con 0x7fc0e406f080 2024-04-14T23:34:42.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.855+0000 7fc0e27fc640 1 -- 172.21.15.47:0/944014060 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc0343f0 con 0x7fc0e406f080 2024-04-14T23:34:42.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.855+0000 7fc0e9d1e640 1 -- 172.21.15.47:0/944014060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e406f080 msgr2=0x7fc0e406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:42.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.855+0000 7fc0e9d1e640 1 --2- 172.21.15.47:0/944014060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e406f080 0x7fc0e406d600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4068760 tx=0x7fc0dc02bed0 comp rx=0 tx=0).stop 2024-04-14T23:34:42.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.855+0000 7fc0e9d1e640 1 -- 172.21.15.47:0/944014060 shutdown_connections 2024-04-14T23:34:42.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.855+0000 7fc0e9d1e640 1 --2- 172.21.15.47:0/944014060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e406f080 0x7fc0e406d600 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:42.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.855+0000 7fc0e9d1e640 1 --2- 172.21.15.47:0/944014060 >> v2:172.21.15.191:3300/0 conn(0x7fc0e40cebc0 0x7fc0e406eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:42.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.855+0000 7fc0e9d1e640 1 --2- 172.21.15.47:0/944014060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e40d03b0 0x7fc0e40d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:42.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.855+0000 7fc0e9d1e640 1 -- 172.21.15.47:0/944014060 >> 172.21.15.47:0/944014060 conn(0x7fc0e406b200 msgr2=0x7fc0e406b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:42.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.855+0000 7fc0e9d1e640 1 -- 172.21.15.47:0/944014060 shutdown_connections 2024-04-14T23:34:42.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.855+0000 7fc0e9d1e640 1 -- 172.21.15.47:0/944014060 wait complete. 2024-04-14T23:34:42.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.857+0000 7fc0e9d1e640 1 Processor -- start 2024-04-14T23:34:42.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.857+0000 7fc0e9d1e640 1 -- start start 2024-04-14T23:34:42.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.857+0000 7fc0e9d1e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e406f080 0x7fc0e4158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:42.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.857+0000 7fc0e9d1e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0e40cebc0 0x7fc0e4141d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:42.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.857+0000 7fc0e9d1e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e40d03b0 0x7fc0e4142280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:42.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.857+0000 7fc0e9d1e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e415cdf0 con 0x7fc0e406f080 2024-04-14T23:34:42.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.857+0000 7fc0e9d1e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e415cb10 con 0x7fc0e40cebc0 2024-04-14T23:34:42.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.857+0000 7fc0e9d1e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e406db40 con 0x7fc0e40d03b0 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.857+0000 7fc0e37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e406f080 0x7fc0e4158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.858+0000 7fc0e37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e406f080 0x7fc0e4158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42484/0 (socket says 172.21.15.47:42484) 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.858+0000 7fc0e37fe640 1 -- 172.21.15.47:0/3546103001 learned_addr learned my addr 172.21.15.47:0/3546103001 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.858+0000 7fc0e2ffd640 1 --2- 172.21.15.47:0/3546103001 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0e40cebc0 0x7fc0e4141d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.858+0000 7fc0e3fff640 1 --2- 172.21.15.47:0/3546103001 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e40d03b0 0x7fc0e4142280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.858+0000 7fc0e37fe640 1 -- 172.21.15.47:0/3546103001 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e40d03b0 msgr2=0x7fc0e4142280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.858+0000 7fc0e37fe640 1 --2- 172.21.15.47:0/3546103001 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e40d03b0 0x7fc0e4142280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.858+0000 7fc0e37fe640 1 -- 172.21.15.47:0/3546103001 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0e40cebc0 msgr2=0x7fc0e4141d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.858+0000 7fc0e37fe640 1 --2- 172.21.15.47:0/3546103001 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0e40cebc0 0x7fc0e4141d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.858+0000 7fc0e37fe640 1 -- 172.21.15.47:0/3546103001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e41e6350 con 0x7fc0e406f080 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.858+0000 7fc0e3fff640 1 --2- 172.21.15.47:0/3546103001 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e40d03b0 0x7fc0e4142280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.858+0000 7fc0e37fe640 1 --2- 172.21.15.47:0/3546103001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e406f080 0x7fc0e4158b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400d5f0 tx=0x7fc0d400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.858+0000 7fc0cbfff640 1 -- 172.21.15.47:0/3546103001 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40125f0 con 0x7fc0e406f080 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.858+0000 7fc0cbfff640 1 -- 172.21.15.47:0/3546103001 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d4019070 con 0x7fc0e406f080 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.858+0000 7fc0e9d1e640 1 -- 172.21.15.47:0/3546103001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e41e6630 con 0x7fc0e406f080 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.858+0000 7fc0cbfff640 1 -- 172.21.15.47:0/3546103001 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40129d0 con 0x7fc0e406f080 2024-04-14T23:34:42.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.858+0000 7fc0e9d1e640 1 -- 172.21.15.47:0/3546103001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e41e6bf0 con 0x7fc0e406f080 2024-04-14T23:34:42.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.859+0000 7fc0e9d1e640 1 -- 172.21.15.47:0/3546103001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e4073f50 con 0x7fc0e406f080 2024-04-14T23:34:42.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.860+0000 7fc0cbfff640 1 -- 172.21.15.47:0/3546103001 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc0d4012b70 con 0x7fc0e406f080 2024-04-14T23:34:42.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.860+0000 7fc0cbfff640 1 --2- 172.21.15.47:0/3546103001 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc0d006b990 0x7fc0d006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:42.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.860+0000 7fc0cbfff640 1 -- 172.21.15.47:0/3546103001 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fc0d408af00 con 0x7fc0e406f080 2024-04-14T23:34:42.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.860+0000 7fc0e2ffd640 1 --2- 172.21.15.47:0/3546103001 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc0d006b990 0x7fc0d006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:42.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.861+0000 7fc0e2ffd640 1 --2- 172.21.15.47:0/3546103001 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc0d006b990 0x7fc0d006de50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8006fd0 tx=0x7fc0d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:42.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:42.864+0000 7fc0cbfff640 1 -- 172.21.15.47:0/3546103001 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc0d4059880 con 0x7fc0e406f080 2024-04-14T23:34:42.896 INFO:tasks.ceph.mds.c.smithi047.stderr:2024-04-14T23:34:42.894+0000 7f65f17f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-14T23:34:43.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.086+0000 7fc0e9d1e640 1 -- 172.21.15.47:0/3546103001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fc0e4156b00 con 0x7fc0e406f080 2024-04-14T23:34:43.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.713+0000 7fc0cbfff640 1 -- 172.21.15.47:0/3546103001 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7fc0d4059180 con 0x7fc0e406f080 2024-04-14T23:34:43.717 INFO:teuthology.orchestra.run.smithi047.stderr:added data pool 4 to fsmap 2024-04-14T23:34:43.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.717+0000 7fc0e9d1e640 1 -- 172.21.15.47:0/3546103001 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc0d006b990 msgr2=0x7fc0d006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:43.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.717+0000 7fc0e9d1e640 1 --2- 172.21.15.47:0/3546103001 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc0d006b990 0x7fc0d006de50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8006fd0 tx=0x7fc0d8008040 comp rx=0 tx=0).stop 2024-04-14T23:34:43.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.717+0000 7fc0e9d1e640 1 -- 172.21.15.47:0/3546103001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e406f080 msgr2=0x7fc0e4158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:43.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.717+0000 7fc0e9d1e640 1 --2- 172.21.15.47:0/3546103001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e406f080 0x7fc0e4158b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400d5f0 tx=0x7fc0d400dab0 comp rx=0 tx=0).stop 2024-04-14T23:34:43.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.717+0000 7fc0e9d1e640 1 -- 172.21.15.47:0/3546103001 shutdown_connections 2024-04-14T23:34:43.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.717+0000 7fc0e9d1e640 1 --2- 172.21.15.47:0/3546103001 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc0d006b990 0x7fc0d006de50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:43.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.717+0000 7fc0e9d1e640 1 --2- 172.21.15.47:0/3546103001 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e40d03b0 0x7fc0e4142280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:43.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.717+0000 7fc0e9d1e640 1 --2- 172.21.15.47:0/3546103001 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0e40cebc0 0x7fc0e4141d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:43.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.717+0000 7fc0e9d1e640 1 --2- 172.21.15.47:0/3546103001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0e406f080 0x7fc0e4158b10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:43.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.717+0000 7fc0e9d1e640 1 -- 172.21.15.47:0/3546103001 >> 172.21.15.47:0/3546103001 conn(0x7fc0e406b200 msgr2=0x7fc0e4154e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:43.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.718+0000 7fc0e9d1e640 1 -- 172.21.15.47:0/3546103001 shutdown_connections 2024-04-14T23:34:43.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.718+0000 7fc0e9d1e640 1 -- 172.21.15.47:0/3546103001 wait complete. 2024-04-14T23:34:43.734 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T23:34:43.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.838+0000 7f48e13f0640 1 Processor -- start 2024-04-14T23:34:43.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.838+0000 7f48e13f0640 1 -- start start 2024-04-14T23:34:43.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.839+0000 7f48e13f0640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f48dc15e270 0x7f48dc0d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:43.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.839+0000 7f48e13f0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f48dc0d1e00 0x7f48dc0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:43.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.839+0000 7f48e13f0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48dc0d1450 0x7f48dc0d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:43.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.839+0000 7f48e13f0640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f48dc0b4300 con 0x7f48dc0d1e00 2024-04-14T23:34:43.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.839+0000 7f48e13f0640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f48dc0b39d0 con 0x7f48dc15e270 2024-04-14T23:34:43.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.839+0000 7f48e13f0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f48dc0b3cb0 con 0x7f48dc0d1450 2024-04-14T23:34:43.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.839+0000 7f48da7fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f48dc0d1e00 0x7f48dc0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:43.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.839+0000 7f48da7fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f48dc0d1e00 0x7f48dc0d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58820/0 (socket says 172.21.15.47:58820) 2024-04-14T23:34:43.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.839+0000 7f48da7fc640 1 -- 172.21.15.47:0/672292237 learned_addr learned my addr 172.21.15.47:0/672292237 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:43.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.839+0000 7f48db7fe640 1 --2- 172.21.15.47:0/672292237 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48dc0d1450 0x7f48dc0d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:43.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.839+0000 7f48daffd640 1 --2- 172.21.15.47:0/672292237 >> v2:172.21.15.191:3300/0 conn(0x7f48dc15e270 0x7f48dc0d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:43.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.839+0000 7f48da7fc640 1 -- 172.21.15.47:0/672292237 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48dc0d1450 msgr2=0x7f48dc0d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:43.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.839+0000 7f48da7fc640 1 --2- 172.21.15.47:0/672292237 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48dc0d1450 0x7f48dc0d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:43.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.839+0000 7f48da7fc640 1 -- 172.21.15.47:0/672292237 >> v2:172.21.15.191:3300/0 conn(0x7f48dc15e270 msgr2=0x7f48dc0d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:43.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.839+0000 7f48da7fc640 1 --2- 172.21.15.47:0/672292237 >> v2:172.21.15.191:3300/0 conn(0x7f48dc15e270 0x7f48dc0d0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:43.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.839+0000 7f48da7fc640 1 -- 172.21.15.47:0/672292237 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc0b3f90 con 0x7f48dc0d1e00 2024-04-14T23:34:43.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.840+0000 7f48da7fc640 1 --2- 172.21.15.47:0/672292237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1e00 0x7f48dc0d2200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f48dc0b6a50 tx=0x7f48c402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4208670963c51c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:43.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.840+0000 7f48d9ffb640 1 -- 172.21.15.47:0/672292237 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4034070 con 0x7f48dc0d1e00 2024-04-14T23:34:43.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.840+0000 7f48d9ffb640 1 -- 172.21.15.47:0/672292237 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c4030860 con 0x7f48dc0d1e00 2024-04-14T23:34:43.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.840+0000 7f48d9ffb640 1 -- 172.21.15.47:0/672292237 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4030c30 con 0x7f48dc0d1e00 2024-04-14T23:34:43.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.840+0000 7f48e13f0640 1 -- 172.21.15.47:0/672292237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1e00 msgr2=0x7f48dc0d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:43.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.840+0000 7f48e13f0640 1 --2- 172.21.15.47:0/672292237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1e00 0x7f48dc0d2200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f48dc0b6a50 tx=0x7f48c402b9a0 comp rx=0 tx=0).stop 2024-04-14T23:34:43.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.841+0000 7f48e13f0640 1 -- 172.21.15.47:0/672292237 shutdown_connections 2024-04-14T23:34:43.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.841+0000 7f48e13f0640 1 --2- 172.21.15.47:0/672292237 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48dc0d1450 0x7f48dc0d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:43.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.841+0000 7f48e13f0640 1 --2- 172.21.15.47:0/672292237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1e00 0x7f48dc0d2200 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:43.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.841+0000 7f48e13f0640 1 --2- 172.21.15.47:0/672292237 >> v2:172.21.15.191:3300/0 conn(0x7f48dc15e270 0x7f48dc0d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:43.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.841+0000 7f48e13f0640 1 -- 172.21.15.47:0/672292237 >> 172.21.15.47:0/672292237 conn(0x7f48dc0d3ed0 msgr2=0x7f48dc0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:43.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.841+0000 7f48e13f0640 1 -- 172.21.15.47:0/672292237 shutdown_connections 2024-04-14T23:34:43.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.841+0000 7f48e13f0640 1 -- 172.21.15.47:0/672292237 wait complete. 2024-04-14T23:34:43.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.842+0000 7f48e13f0640 1 Processor -- start 2024-04-14T23:34:43.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.842+0000 7f48e13f0640 1 -- start start 2024-04-14T23:34:43.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48e13f0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1450 0x7f48dc153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:43.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48e13f0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48dc0d1e00 0x7f48dc0cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:43.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48e13f0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48dc15e270 0x7f48dc0cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:43.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48e13f0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc15e7d0 con 0x7f48dc0d1450 2024-04-14T23:34:43.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48e13f0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc15e650 con 0x7f48dc15e270 2024-04-14T23:34:43.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48e13f0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f48dc0ce9e0 con 0x7f48dc0d1e00 2024-04-14T23:34:43.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48daffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1450 0x7f48dc153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:43.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48daffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1450 0x7f48dc153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58826/0 (socket says 172.21.15.47:58826) 2024-04-14T23:34:43.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48daffd640 1 -- 172.21.15.47:0/3418792510 learned_addr learned my addr 172.21.15.47:0/3418792510 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48da7fc640 1 --2- 172.21.15.47:0/3418792510 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48dc0d1e00 0x7f48dc0cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48db7fe640 1 --2- 172.21.15.47:0/3418792510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48dc15e270 0x7f48dc0cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48daffd640 1 -- 172.21.15.47:0/3418792510 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48dc0d1e00 msgr2=0x7f48dc0cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48daffd640 1 --2- 172.21.15.47:0/3418792510 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48dc0d1e00 0x7f48dc0cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48daffd640 1 -- 172.21.15.47:0/3418792510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48dc15e270 msgr2=0x7f48dc0cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48daffd640 1 --2- 172.21.15.47:0/3418792510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48dc15e270 0x7f48dc0cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48daffd640 1 -- 172.21.15.47:0/3418792510 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc0cd3c0 con 0x7f48dc0d1450 2024-04-14T23:34:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48daffd640 1 --2- 172.21.15.47:0/3418792510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1450 0x7f48dc153f20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f48d400d5f0 tx=0x7f48d400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48d37fe640 1 -- 172.21.15.47:0/3418792510 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d40125f0 con 0x7f48dc0d1450 2024-04-14T23:34:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48d37fe640 1 -- 172.21.15.47:0/3418792510 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d4019070 con 0x7f48dc0d1450 2024-04-14T23:34:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48e13f0640 1 -- 172.21.15.47:0/3418792510 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48dc0cd6a0 con 0x7f48dc0d1450 2024-04-14T23:34:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.843+0000 7f48d37fe640 1 -- 172.21.15.47:0/3418792510 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d40129d0 con 0x7f48dc0d1450 2024-04-14T23:34:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.844+0000 7f48e13f0640 1 -- 172.21.15.47:0/3418792510 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48dc154460 con 0x7f48dc0d1450 2024-04-14T23:34:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.844+0000 7f48e13f0640 1 -- 172.21.15.47:0/3418792510 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48dc075430 con 0x7f48dc0d1450 2024-04-14T23:34:43.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.845+0000 7f48d37fe640 1 -- 172.21.15.47:0/3418792510 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f48d4012b70 con 0x7f48dc0d1450 2024-04-14T23:34:43.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.845+0000 7f48d37fe640 1 --2- 172.21.15.47:0/3418792510 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f48bc06b9c0 0x7f48bc06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:43.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.845+0000 7f48d37fe640 1 -- 172.21.15.47:0/3418792510 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f48d408af50 con 0x7f48dc0d1450 2024-04-14T23:34:43.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.845+0000 7f48da7fc640 1 --2- 172.21.15.47:0/3418792510 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f48bc06b9c0 0x7f48bc06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:43.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.846+0000 7f48da7fc640 1 --2- 172.21.15.47:0/3418792510 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f48bc06b9c0 0x7f48bc06de80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f48c4036000 tx=0x7f48c403b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:43.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:43.850+0000 7f48d37fe640 1 -- 172.21.15.47:0/3418792510 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f48d4059830 con 0x7f48dc0d1450 2024-04-14T23:34:44.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.069+0000 7f48e13f0640 1 -- 172.21.15.47:0/3418792510 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48dc0cf160 con 0x7f48dc0d1450 2024-04-14T23:34:44.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.070+0000 7f48d37fe640 1 -- 172.21.15.47:0/3418792510 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5180 (secure 0 0 0) 0x7f48d4059130 con 0x7f48dc0d1450 2024-04-14T23:34:44.073 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:44.073 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/416388535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":416388535},{"type":"v1","addr":"172.21.15.191:6837","nonce":416388535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/2830978927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2830978927},{"type":"v1","addr":"172.21.15.47:6833","nonce":2830978927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/4025654680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":4025654680},{"type":"v1","addr":"172.21.15.191:6836","nonce":4025654680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T23:34:38.059644+0000","modified":"2024-04-14T23:34:43.087707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/1169029730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1169029730},{"type":"v1","addr":"172.21.15.47:6835","nonce":1169029730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-14T23:34:44.073 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 6 2024-04-14T23:34:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.072+0000 7f48e13f0640 1 -- 172.21.15.47:0/3418792510 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f48bc06b9c0 msgr2=0x7f48bc06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.072+0000 7f48e13f0640 1 --2- 172.21.15.47:0/3418792510 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f48bc06b9c0 0x7f48bc06de80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f48c4036000 tx=0x7f48c403b040 comp rx=0 tx=0).stop 2024-04-14T23:34:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.072+0000 7f48e13f0640 1 -- 172.21.15.47:0/3418792510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1450 msgr2=0x7f48dc153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.072+0000 7f48e13f0640 1 --2- 172.21.15.47:0/3418792510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1450 0x7f48dc153f20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f48d400d5f0 tx=0x7f48d400dab0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.072+0000 7f48e13f0640 1 -- 172.21.15.47:0/3418792510 shutdown_connections 2024-04-14T23:34:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.072+0000 7f48e13f0640 1 --2- 172.21.15.47:0/3418792510 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f48bc06b9c0 0x7f48bc06de80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.072+0000 7f48e13f0640 1 --2- 172.21.15.47:0/3418792510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48dc15e270 0x7f48dc0cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.072+0000 7f48e13f0640 1 --2- 172.21.15.47:0/3418792510 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48dc0d1e00 0x7f48dc0cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.072+0000 7f48e13f0640 1 --2- 172.21.15.47:0/3418792510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48dc0d1450 0x7f48dc153f20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.072+0000 7f48e13f0640 1 -- 172.21.15.47:0/3418792510 >> 172.21.15.47:0/3418792510 conn(0x7f48dc0d3ed0 msgr2=0x7f48dc0b4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.072+0000 7f48e13f0640 1 -- 172.21.15.47:0/3418792510 shutdown_connections 2024-04-14T23:34:44.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.072+0000 7f48e13f0640 1 -- 172.21.15.47:0/3418792510 wait complete. 2024-04-14T23:34:44.085 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:34:44.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.184+0000 7f77b6d1e640 1 Processor -- start 2024-04-14T23:34:44.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.184+0000 7f77b6d1e640 1 -- start start 2024-04-14T23:34:44.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.185+0000 7f77b6d1e640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f77b015e2b0 0x7f77b00d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.185+0000 7f77b6d1e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77b00cf4c0 0x7f77b00c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.185+0000 7f77b6d1e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b015e690 con 0x7f77b00d2be0 2024-04-14T23:34:44.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.185+0000 7f77b6d1e640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f77b00cfb20 con 0x7f77b015e2b0 2024-04-14T23:34:44.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.185+0000 7f77b6d1e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f77b00cfe00 con 0x7f77b00cf4c0 2024-04-14T23:34:44.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.185+0000 7f77b52bb640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77b00cf4c0 0x7f77b00c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.185+0000 7f77b4aba640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f77b015e2b0 0x7f77b00d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.185+0000 7f77a7fff640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f77b00d2be0 0x7f77b00cedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.47:47004/0 (socket says 172.21.15.47:47004) 2024-04-14T23:34:44.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.185+0000 7f77b4aba640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f77b015e2b0 0x7f77b00d26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:59796/0 (socket says 172.21.15.47:59796) 2024-04-14T23:34:44.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.185+0000 7f77b52bb640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77b00cf4c0 0x7f77b00c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:51406/0 (socket says 172.21.15.47:51406) 2024-04-14T23:34:44.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.185+0000 7f77a7fff640 1 -- 172.21.15.47:0/3371125366 learned_addr learned my addr 172.21.15.47:0/3371125366 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:44.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.185+0000 7f77b52bb640 1 -- 172.21.15.47:0/3371125366 >> v2:172.21.15.191:3300/0 conn(0x7f77b015e2b0 msgr2=0x7f77b00d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:44.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.185+0000 7f77b52bb640 1 --2- 172.21.15.47:0/3371125366 >> v2:172.21.15.191:3300/0 conn(0x7f77b015e2b0 0x7f77b00d26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.185+0000 7f77b52bb640 1 -- 172.21.15.47:0/3371125366 >> v1:172.21.15.191:6789/0 conn(0x7f77b00d2be0 legacy=0x7f77b00cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.185+0000 7f77b52bb640 1 -- 172.21.15.47:0/3371125366 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b00d00e0 con 0x7f77b00cf4c0 2024-04-14T23:34:44.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.185+0000 7f77b4aba640 1 --2- 172.21.15.47:0/3371125366 >> v2:172.21.15.191:3300/0 conn(0x7f77b015e2b0 0x7f77b00d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:44.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.186+0000 7f77b52bb640 1 --2- 172.21.15.47:0/3371125366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77b00cf4c0 0x7f77b00c7f60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009d90 tx=0x7f77a802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78b0bdcc543846a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:44.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.186+0000 7f77a77fe640 1 -- 172.21.15.47:0/3371125366 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a8039070 con 0x7f77b00cf4c0 2024-04-14T23:34:44.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.186+0000 7f77a77fe640 1 -- 172.21.15.47:0/3371125366 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a802cc50 con 0x7f77b00cf4c0 2024-04-14T23:34:44.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.186+0000 7f77a77fe640 1 -- 172.21.15.47:0/3371125366 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a8034440 con 0x7f77b00cf4c0 2024-04-14T23:34:44.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.187+0000 7f77b6d1e640 1 -- 172.21.15.47:0/3371125366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77b00cf4c0 msgr2=0x7f77b00c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.187+0000 7f77b6d1e640 1 --2- 172.21.15.47:0/3371125366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77b00cf4c0 0x7f77b00c7f60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009d90 tx=0x7f77a802bea0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.187+0000 7f77b6d1e640 1 -- 172.21.15.47:0/3371125366 shutdown_connections 2024-04-14T23:34:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.187+0000 7f77b6d1e640 1 --2- 172.21.15.47:0/3371125366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77b00cf4c0 0x7f77b00c7f60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.187+0000 7f77b6d1e640 1 --2- 172.21.15.47:0/3371125366 >> v2:172.21.15.191:3300/0 conn(0x7f77b015e2b0 0x7f77b00d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.187+0000 7f77b6d1e640 1 -- 172.21.15.47:0/3371125366 >> 172.21.15.47:0/3371125366 conn(0x7f77b0067940 msgr2=0x7f77b009d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.187+0000 7f77b6d1e640 1 -- 172.21.15.47:0/3371125366 shutdown_connections 2024-04-14T23:34:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.187+0000 7f77b6d1e640 1 -- 172.21.15.47:0/3371125366 wait complete. 2024-04-14T23:34:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.188+0000 7f77b6d1e640 1 Processor -- start 2024-04-14T23:34:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.188+0000 7f77b6d1e640 1 -- start start 2024-04-14T23:34:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b6d1e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b00cf4c0 0x7f77b00cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b6d1e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77b00d2be0 0x7f77b0153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b6d1e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77b015e2b0 0x7f77b0161320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b6d1e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77b00c84a0 con 0x7f77b00cf4c0 2024-04-14T23:34:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b6d1e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f77b00d06a0 con 0x7f77b015e2b0 2024-04-14T23:34:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b6d1e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f77b00c8620 con 0x7f77b00d2be0 2024-04-14T23:34:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b4aba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b00cf4c0 0x7f77b00cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b4aba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b00cf4c0 0x7f77b00cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58836/0 (socket says 172.21.15.47:58836) 2024-04-14T23:34:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b4aba640 1 -- 172.21.15.47:0/2677040567 learned_addr learned my addr 172.21.15.47:0/2677040567 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77a7fff640 1 --2- 172.21.15.47:0/2677040567 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77b00d2be0 0x7f77b0153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b52bb640 1 --2- 172.21.15.47:0/2677040567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77b015e2b0 0x7f77b0161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b4aba640 1 -- 172.21.15.47:0/2677040567 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77b00d2be0 msgr2=0x7f77b0153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b4aba640 1 --2- 172.21.15.47:0/2677040567 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77b00d2be0 0x7f77b0153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b4aba640 1 -- 172.21.15.47:0/2677040567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77b015e2b0 msgr2=0x7f77b0161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b4aba640 1 --2- 172.21.15.47:0/2677040567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77b015e2b0 0x7f77b0161320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b4aba640 1 -- 172.21.15.47:0/2677040567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b00cb680 con 0x7f77b00cf4c0 2024-04-14T23:34:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77a7fff640 1 --2- 172.21.15.47:0/2677040567 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77b00d2be0 0x7f77b0153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b52bb640 1 --2- 172.21.15.47:0/2677040567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77b015e2b0 0x7f77b0161320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.189+0000 7f77b4aba640 1 --2- 172.21.15.47:0/2677040567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b00cf4c0 0x7f77b00cdde0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00e960 tx=0x7f77ac00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.190+0000 7f77a57fa640 1 -- 172.21.15.47:0/2677040567 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac017070 con 0x7f77b00cf4c0 2024-04-14T23:34:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.190+0000 7f77a57fa640 1 -- 172.21.15.47:0/2677040567 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ac00ca00 con 0x7f77b00cf4c0 2024-04-14T23:34:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.190+0000 7f77b6d1e640 1 -- 172.21.15.47:0/2677040567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77b00cb920 con 0x7f77b00cf4c0 2024-04-14T23:34:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.190+0000 7f77a57fa640 1 -- 172.21.15.47:0/2677040567 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac00cdd0 con 0x7f77b00cf4c0 2024-04-14T23:34:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.190+0000 7f77b6d1e640 1 -- 172.21.15.47:0/2677040567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77b00cbee0 con 0x7f77b00cf4c0 2024-04-14T23:34:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.191+0000 7f77b6d1e640 1 -- 172.21.15.47:0/2677040567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b0075430 con 0x7f77b00cf4c0 2024-04-14T23:34:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.191+0000 7f77a57fa640 1 -- 172.21.15.47:0/2677040567 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f77ac01a070 con 0x7f77b00cf4c0 2024-04-14T23:34:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.191+0000 7f77a57fa640 1 --2- 172.21.15.47:0/2677040567 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f779c06b990 0x7f779c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.192+0000 7f77a57fa640 1 -- 172.21.15.47:0/2677040567 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f77ac08add0 con 0x7f77b00cf4c0 2024-04-14T23:34:44.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.192+0000 7f77a7fff640 1 --2- 172.21.15.47:0/2677040567 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f779c06b990 0x7f779c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.192+0000 7f77a7fff640 1 --2- 172.21.15.47:0/2677040567 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f779c06b990 0x7f779c06de50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f77b01f74e0 tx=0x7f77a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:44.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.196+0000 7f77a57fa640 1 -- 172.21.15.47:0/2677040567 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f77ac0596a0 con 0x7f77b00cf4c0 2024-04-14T23:34:44.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.379+0000 7f77b6d1e640 1 -- 172.21.15.47:0/2677040567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77b00b9fc0 con 0x7f77b00cf4c0 2024-04-14T23:34:44.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.380+0000 7f77a57fa640 1 -- 172.21.15.47:0/2677040567 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18515 (secure 0 0 0) 0x7f77ac058fa0 con 0x7f77b00cf4c0 2024-04-14T23:34:44.383 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:44.384 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:43.087507+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:34:44.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.382+0000 7f77b6d1e640 1 -- 172.21.15.47:0/2677040567 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f779c06b990 msgr2=0x7f779c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.382+0000 7f77b6d1e640 1 --2- 172.21.15.47:0/2677040567 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f779c06b990 0x7f779c06de50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f77b01f74e0 tx=0x7f77a0009040 comp rx=0 tx=0).stop 2024-04-14T23:34:44.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.382+0000 7f77b6d1e640 1 -- 172.21.15.47:0/2677040567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b00cf4c0 msgr2=0x7f77b00cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.382+0000 7f77b6d1e640 1 --2- 172.21.15.47:0/2677040567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b00cf4c0 0x7f77b00cdde0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00e960 tx=0x7f77ac00ee20 comp rx=0 tx=0).stop 2024-04-14T23:34:44.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.382+0000 7f77b6d1e640 1 -- 172.21.15.47:0/2677040567 shutdown_connections 2024-04-14T23:34:44.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.382+0000 7f77b6d1e640 1 --2- 172.21.15.47:0/2677040567 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f779c06b990 0x7f779c06de50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.382+0000 7f77b6d1e640 1 --2- 172.21.15.47:0/2677040567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77b015e2b0 0x7f77b0161320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.382+0000 7f77b6d1e640 1 --2- 172.21.15.47:0/2677040567 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77b00d2be0 0x7f77b0153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.382+0000 7f77b6d1e640 1 --2- 172.21.15.47:0/2677040567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b00cf4c0 0x7f77b00cdde0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.382+0000 7f77b6d1e640 1 -- 172.21.15.47:0/2677040567 >> 172.21.15.47:0/2677040567 conn(0x7f77b0067940 msgr2=0x7f77b015d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:44.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.382+0000 7f77b6d1e640 1 -- 172.21.15.47:0/2677040567 shutdown_connections 2024-04-14T23:34:44.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.382+0000 7f77b6d1e640 1 -- 172.21.15.47:0/2677040567 wait complete. 2024-04-14T23:34:44.396 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:34:44.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.494+0000 7f9c8d111640 1 Processor -- start 2024-04-14T23:34:44.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.494+0000 7f9c8d111640 1 -- start start 2024-04-14T23:34:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.495+0000 7f9c8d111640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9c880d2910 0x7f9c88168f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.495+0000 7f9c8d111640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c880b57a0 con 0x7f9c8815e270 2024-04-14T23:34:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.495+0000 7f9c8d111640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c880d1620 con 0x7f9c880d1e00 2024-04-14T23:34:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.495+0000 7f9c8d111640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f9c880b4300 con 0x7f9c880d2910 2024-04-14T23:34:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.495+0000 7f9c8759e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9c880d2910 0x7f9c88168f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.495+0000 7f9c8759e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9c880d2910 0x7f9c88168f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58852/0 (socket says 172.21.15.47:58852) 2024-04-14T23:34:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.495+0000 7f9c8759e640 1 -- 172.21.15.47:0/91847837 learned_addr learned my addr 172.21.15.47:0/91847837 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.495+0000 7f9c86d9d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9c8815e270 0x7f9c880d0f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41832/0 (socket says 172.21.15.47:41832) 2024-04-14T23:34:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.495+0000 7f9c8759e640 1 -- 172.21.15.47:0/91847837 >> v1:172.21.15.191:6789/0 conn(0x7f9c880d1e00 legacy=0x7f9c880d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.495+0000 7f9c8759e640 1 -- 172.21.15.47:0/91847837 >> v1:172.21.15.47:6789/0 conn(0x7f9c8815e270 legacy=0x7f9c880d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.495+0000 7f9c8759e640 1 -- 172.21.15.47:0/91847837 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c880b39d0 con 0x7f9c880d2910 2024-04-14T23:34:44.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.496+0000 7f9c8759e640 1 --2- 172.21.15.47:0/91847837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c880d2910 0x7f9c88168f40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9c78009e50 tx=0x7f9c7802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161a65f3e5cdacdb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:44.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.496+0000 7f9c85d9b640 1 -- 172.21.15.47:0/91847837 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7802cbb0 con 0x7f9c880d2910 2024-04-14T23:34:44.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.496+0000 7f9c85d9b640 1 -- 172.21.15.47:0/91847837 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c7802cd50 con 0x7f9c880d2910 2024-04-14T23:34:44.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.496+0000 7f9c85d9b640 1 -- 172.21.15.47:0/91847837 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c78034610 con 0x7f9c880d2910 2024-04-14T23:34:44.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.497+0000 7f9c8d111640 1 -- 172.21.15.47:0/91847837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c880d2910 msgr2=0x7f9c88168f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.497+0000 7f9c8d111640 1 --2- 172.21.15.47:0/91847837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c880d2910 0x7f9c88168f40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9c78009e50 tx=0x7f9c7802c010 comp rx=0 tx=0).stop 2024-04-14T23:34:44.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.497+0000 7f9c8d111640 1 -- 172.21.15.47:0/91847837 shutdown_connections 2024-04-14T23:34:44.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.497+0000 7f9c8d111640 1 --2- 172.21.15.47:0/91847837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c880d2910 0x7f9c88168f40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.497+0000 7f9c8d111640 1 -- 172.21.15.47:0/91847837 >> 172.21.15.47:0/91847837 conn(0x7f9c880d3ed0 msgr2=0x7f9c880d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:44.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.497+0000 7f9c8d111640 1 -- 172.21.15.47:0/91847837 shutdown_connections 2024-04-14T23:34:44.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.497+0000 7f9c8d111640 1 -- 172.21.15.47:0/91847837 wait complete. 2024-04-14T23:34:44.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.498+0000 7f9c8d111640 1 Processor -- start 2024-04-14T23:34:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.498+0000 7f9c8d111640 1 -- start start 2024-04-14T23:34:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.499+0000 7f9c8d111640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c880d1e00 0x7f9c88161240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.499+0000 7f9c8d111640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c880d2910 0x7f9c880c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.499+0000 7f9c8d111640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c8815e270 0x7f9c880cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.499+0000 7f9c8d111640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9c880b0c60 con 0x7f9c8815e270 2024-04-14T23:34:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.499+0000 7f9c8d111640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9c880b3f90 con 0x7f9c880d1e00 2024-04-14T23:34:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.499+0000 7f9c8d111640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f9c8815e650 con 0x7f9c880d2910 2024-04-14T23:34:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.499+0000 7f9c8759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c8815e270 0x7f9c880cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.499+0000 7f9c8759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c8815e270 0x7f9c880cb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58858/0 (socket says 172.21.15.47:58858) 2024-04-14T23:34:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.499+0000 7f9c8759e640 1 -- 172.21.15.47:0/2057485293 learned_addr learned my addr 172.21.15.47:0/2057485293 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.499+0000 7f9c86d9d640 1 --2- 172.21.15.47:0/2057485293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c880d1e00 0x7f9c88161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.499+0000 7f9c8659c640 1 --2- 172.21.15.47:0/2057485293 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c880d2910 0x7f9c880c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.500+0000 7f9c8759e640 1 -- 172.21.15.47:0/2057485293 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c880d2910 msgr2=0x7f9c880c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.500+0000 7f9c8759e640 1 --2- 172.21.15.47:0/2057485293 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c880d2910 0x7f9c880c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.500+0000 7f9c8759e640 1 -- 172.21.15.47:0/2057485293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c880d1e00 msgr2=0x7f9c88161240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.500+0000 7f9c8759e640 1 --2- 172.21.15.47:0/2057485293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c880d1e00 0x7f9c88161240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.500+0000 7f9c8759e640 1 -- 172.21.15.47:0/2057485293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c880b7220 con 0x7f9c8815e270 2024-04-14T23:34:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.500+0000 7f9c8659c640 1 --2- 172.21.15.47:0/2057485293 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c880d2910 0x7f9c880c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.500+0000 7f9c86d9d640 1 --2- 172.21.15.47:0/2057485293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c880d1e00 0x7f9c88161240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.500+0000 7f9c8759e640 1 --2- 172.21.15.47:0/2057485293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c8815e270 0x7f9c880cb2c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9c78036040 tx=0x7f9c78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.500+0000 7f9c7f7fe640 1 -- 172.21.15.47:0/2057485293 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c78043020 con 0x7f9c8815e270 2024-04-14T23:34:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.500+0000 7f9c7f7fe640 1 -- 172.21.15.47:0/2057485293 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c7803e450 con 0x7f9c8815e270 2024-04-14T23:34:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.500+0000 7f9c8d111640 1 -- 172.21.15.47:0/2057485293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c880b7500 con 0x7f9c8815e270 2024-04-14T23:34:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.500+0000 7f9c7f7fe640 1 -- 172.21.15.47:0/2057485293 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7803e860 con 0x7f9c8815e270 2024-04-14T23:34:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.500+0000 7f9c8d111640 1 -- 172.21.15.47:0/2057485293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c880b7ac0 con 0x7f9c8815e270 2024-04-14T23:34:44.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.501+0000 7f9c8d111640 1 -- 172.21.15.47:0/2057485293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c88075430 con 0x7f9c8815e270 2024-04-14T23:34:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.501+0000 7f9c7f7fe640 1 -- 172.21.15.47:0/2057485293 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9c78046020 con 0x7f9c8815e270 2024-04-14T23:34:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.502+0000 7f9c7f7fe640 1 --2- 172.21.15.47:0/2057485293 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9c6806b990 0x7f9c6806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.502+0000 7f9c7f7fe640 1 -- 172.21.15.47:0/2057485293 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9c780ad4c0 con 0x7f9c8815e270 2024-04-14T23:34:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.502+0000 7f9c86d9d640 1 --2- 172.21.15.47:0/2057485293 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9c6806b990 0x7f9c6806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.502+0000 7f9c86d9d640 1 --2- 172.21.15.47:0/2057485293 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9c6806b990 0x7f9c6806de50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c80007fd0 tx=0x7f9c80007d60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:44.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.506+0000 7f9c7f7fe640 1 -- 172.21.15.47:0/2057485293 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9c7804d030 con 0x7f9c8815e270 2024-04-14T23:34:44.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.687+0000 7f9c8d111640 1 -- 172.21.15.47:0/2057485293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c88074860 con 0x7f9c8815e270 2024-04-14T23:34:44.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.688+0000 7f9c7f7fe640 1 -- 172.21.15.47:0/2057485293 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18515 (secure 0 0 0) 0x7f9c7807bd90 con 0x7f9c8815e270 2024-04-14T23:34:44.692 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:44.692 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:43.087507+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:34:44.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.691+0000 7f9c8d111640 1 -- 172.21.15.47:0/2057485293 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9c6806b990 msgr2=0x7f9c6806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.691+0000 7f9c8d111640 1 --2- 172.21.15.47:0/2057485293 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9c6806b990 0x7f9c6806de50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c80007fd0 tx=0x7f9c80007d60 comp rx=0 tx=0).stop 2024-04-14T23:34:44.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.691+0000 7f9c8d111640 1 -- 172.21.15.47:0/2057485293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c8815e270 msgr2=0x7f9c880cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.691+0000 7f9c8d111640 1 --2- 172.21.15.47:0/2057485293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c8815e270 0x7f9c880cb2c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9c78036040 tx=0x7f9c78004a40 comp rx=0 tx=0).stop 2024-04-14T23:34:44.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.691+0000 7f9c8d111640 1 -- 172.21.15.47:0/2057485293 shutdown_connections 2024-04-14T23:34:44.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.691+0000 7f9c8d111640 1 --2- 172.21.15.47:0/2057485293 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9c6806b990 0x7f9c6806de50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.691+0000 7f9c8d111640 1 --2- 172.21.15.47:0/2057485293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c8815e270 0x7f9c880cb2c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.691+0000 7f9c8d111640 1 --2- 172.21.15.47:0/2057485293 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c880d2910 0x7f9c880c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.691+0000 7f9c8d111640 1 --2- 172.21.15.47:0/2057485293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c880d1e00 0x7f9c88161240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.691+0000 7f9c8d111640 1 -- 172.21.15.47:0/2057485293 >> 172.21.15.47:0/2057485293 conn(0x7f9c880d3ed0 msgr2=0x7f9c880cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:44.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.691+0000 7f9c8d111640 1 -- 172.21.15.47:0/2057485293 shutdown_connections 2024-04-14T23:34:44.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.691+0000 7f9c8d111640 1 -- 172.21.15.47:0/2057485293 wait complete. 2024-04-14T23:34:44.721 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T23:34:44.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.819+0000 7f0b601cc640 1 Processor -- start 2024-04-14T23:34:44.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.819+0000 7f0b601cc640 1 -- start start 2024-04-14T23:34:44.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.820+0000 7f0b601cc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5815e220 0x7f0b580d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.820+0000 7f0b601cc640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0b580c5a80 0x7f0b5806f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.820+0000 7f0b601cc640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b5806fca0 con 0x7f0b5806b200 2024-04-14T23:34:44.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.820+0000 7f0b601cc640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f0b580c73a0 con 0x7f0b580c5a80 2024-04-14T23:34:44.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.820+0000 7f0b601cc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0b580c75d0 con 0x7f0b5815e220 2024-04-14T23:34:44.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.820+0000 7f0b5df68640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5815e220 0x7f0b580d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.820+0000 7f0b5d767640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0b580c5a80 0x7f0b5806f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.820+0000 7f0b5df68640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5815e220 0x7f0b580d1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:51424/0 (socket says 172.21.15.47:51424) 2024-04-14T23:34:44.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.820+0000 7f0b5df68640 1 -- 172.21.15.47:0/3595062496 learned_addr learned my addr 172.21.15.47:0/3595062496 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:44.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.820+0000 7f0b5d767640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0b580c5a80 0x7f0b5806f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:59822/0 (socket says 172.21.15.47:59822) 2024-04-14T23:34:44.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.821+0000 7f0b5df68640 1 -- 172.21.15.47:0/3595062496 >> v2:172.21.15.191:3300/0 conn(0x7f0b580c5a80 msgr2=0x7f0b5806f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:44.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.821+0000 7f0b5df68640 1 --2- 172.21.15.47:0/3595062496 >> v2:172.21.15.191:3300/0 conn(0x7f0b580c5a80 0x7f0b5806f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.821+0000 7f0b5df68640 1 -- 172.21.15.47:0/3595062496 >> v1:172.21.15.191:6789/0 conn(0x7f0b5806b200 legacy=0x7f0b580ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.821+0000 7f0b5df68640 1 -- 172.21.15.47:0/3595062496 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b580c78b0 con 0x7f0b5815e220 2024-04-14T23:34:44.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.821+0000 7f0b5cf66640 1 -- 172.21.15.47:0/3595062496 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3346958515 0 0) 0x7f0b48001490 con 0x7f0b5806b200 2024-04-14T23:34:44.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.821+0000 7f0b5d767640 1 --2- 172.21.15.47:0/3595062496 >> v2:172.21.15.191:3300/0 conn(0x7f0b580c5a80 0x7f0b5806f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:44.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.822+0000 7f0b5df68640 1 --2- 172.21.15.47:0/3595062496 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5815e220 0x7f0b580d1720 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009870 tx=0x7f0b5002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72dc40126875bae9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:44.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.822+0000 7f0b5cf66640 1 -- 172.21.15.47:0/3595062496 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50034070 con 0x7f0b5815e220 2024-04-14T23:34:44.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.822+0000 7f0b5cf66640 1 -- 172.21.15.47:0/3595062496 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b50030840 con 0x7f0b5815e220 2024-04-14T23:34:44.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.822+0000 7f0b5cf66640 1 -- 172.21.15.47:0/3595062496 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50030c10 con 0x7f0b5815e220 2024-04-14T23:34:44.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.822+0000 7f0b601cc640 1 -- 172.21.15.47:0/3595062496 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5815e220 msgr2=0x7f0b580d1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.822+0000 7f0b601cc640 1 --2- 172.21.15.47:0/3595062496 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5815e220 0x7f0b580d1720 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009870 tx=0x7f0b5002b980 comp rx=0 tx=0).stop 2024-04-14T23:34:44.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.822+0000 7f0b601cc640 1 -- 172.21.15.47:0/3595062496 shutdown_connections 2024-04-14T23:34:44.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.822+0000 7f0b601cc640 1 --2- 172.21.15.47:0/3595062496 >> v2:172.21.15.191:3300/0 conn(0x7f0b580c5a80 0x7f0b5806f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.822+0000 7f0b601cc640 1 --2- 172.21.15.47:0/3595062496 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5815e220 0x7f0b580d1720 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.822+0000 7f0b601cc640 1 -- 172.21.15.47:0/3595062496 >> 172.21.15.47:0/3595062496 conn(0x7f0b580d0c00 msgr2=0x7f0b580d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:44.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.822+0000 7f0b601cc640 1 -- 172.21.15.47:0/3595062496 shutdown_connections 2024-04-14T23:34:44.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.822+0000 7f0b601cc640 1 -- 172.21.15.47:0/3595062496 wait complete. 2024-04-14T23:34:44.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.823+0000 7f0b601cc640 1 Processor -- start 2024-04-14T23:34:44.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.824+0000 7f0b601cc640 1 -- start start 2024-04-14T23:34:44.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.824+0000 7f0b601cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5806b200 0x7f0b580b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.824+0000 7f0b601cc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b580c5a80 0x7f0b58157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.824+0000 7f0b601cc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5815bf40 0x7f0b5814af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.824+0000 7f0b601cc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0b580c5ee0 con 0x7f0b5806b200 2024-04-14T23:34:44.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.824+0000 7f0b601cc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5806ec90 con 0x7f0b580c5a80 2024-04-14T23:34:44.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.824+0000 7f0b601cc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0b5806b650 con 0x7f0b5815bf40 2024-04-14T23:34:44.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.824+0000 7f0b5df68640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5806b200 0x7f0b580b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.824+0000 7f0b5df68640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5806b200 0x7f0b580b64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58874/0 (socket says 172.21.15.47:58874) 2024-04-14T23:34:44.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.824+0000 7f0b5df68640 1 -- 172.21.15.47:0/1146963484 learned_addr learned my addr 172.21.15.47:0/1146963484 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:44.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.825+0000 7f0b5d767640 1 --2- 172.21.15.47:0/1146963484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b580c5a80 0x7f0b58157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.825+0000 7f0b5e769640 1 --2- 172.21.15.47:0/1146963484 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5815bf40 0x7f0b5814af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.825+0000 7f0b5df68640 1 -- 172.21.15.47:0/1146963484 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5815bf40 msgr2=0x7f0b5814af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.825+0000 7f0b5df68640 1 --2- 172.21.15.47:0/1146963484 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5815bf40 0x7f0b5814af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.825+0000 7f0b5df68640 1 -- 172.21.15.47:0/1146963484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b580c5a80 msgr2=0x7f0b58157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:44.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.825+0000 7f0b5df68640 1 --2- 172.21.15.47:0/1146963484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b580c5a80 0x7f0b58157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:44.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.825+0000 7f0b5df68640 1 -- 172.21.15.47:0/1146963484 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5815c720 con 0x7f0b5806b200 2024-04-14T23:34:44.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.825+0000 7f0b5e769640 1 --2- 172.21.15.47:0/1146963484 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5815bf40 0x7f0b5814af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:44.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.825+0000 7f0b5df68640 1 --2- 172.21.15.47:0/1146963484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5806b200 0x7f0b580b64c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0b500090b0 tx=0x7f0b500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:44.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.825+0000 7f0b567fc640 1 -- 172.21.15.47:0/1146963484 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50034040 con 0x7f0b5806b200 2024-04-14T23:34:44.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.825+0000 7f0b567fc640 1 -- 172.21.15.47:0/1146963484 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b5003ab90 con 0x7f0b5806b200 2024-04-14T23:34:44.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.825+0000 7f0b567fc640 1 -- 172.21.15.47:0/1146963484 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50004030 con 0x7f0b5806b200 2024-04-14T23:34:44.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.825+0000 7f0b601cc640 1 -- 172.21.15.47:0/1146963484 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5815ca00 con 0x7f0b5806b200 2024-04-14T23:34:44.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.825+0000 7f0b601cc640 1 -- 172.21.15.47:0/1146963484 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b5815cfc0 con 0x7f0b5806b200 2024-04-14T23:34:44.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.826+0000 7f0b601cc640 1 -- 172.21.15.47:0/1146963484 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b58075430 con 0x7f0b5806b200 2024-04-14T23:34:44.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.826+0000 7f0b567fc640 1 -- 172.21.15.47:0/1146963484 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0b5004b060 con 0x7f0b5806b200 2024-04-14T23:34:44.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.827+0000 7f0b567fc640 1 --2- 172.21.15.47:0/1146963484 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0b4406b9c0 0x7f0b4406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:44.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.827+0000 7f0b567fc640 1 -- 172.21.15.47:0/1146963484 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0b500ac880 con 0x7f0b5806b200 2024-04-14T23:34:44.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.827+0000 7f0b5d767640 1 --2- 172.21.15.47:0/1146963484 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0b4406b9c0 0x7f0b4406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:44.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.828+0000 7f0b5d767640 1 --2- 172.21.15.47:0/1146963484 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0b4406b9c0 0x7f0b4406de80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009560 tx=0x7f0b4c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:44.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:44.831+0000 7f0b567fc640 1 -- 172.21.15.47:0/1146963484 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0b5003f070 con 0x7f0b5806b200 2024-04-14T23:34:45.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.049+0000 7f0b601cc640 1 -- 172.21.15.47:0/1146963484 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b580b0b00 con 0x7f0b5806b200 2024-04-14T23:34:45.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.049+0000 7f0b567fc640 1 -- 172.21.15.47:0/1146963484 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5180 (secure 0 0 0) 0x7f0b5007b270 con 0x7f0b5806b200 2024-04-14T23:34:45.053 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:45.053 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/416388535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":416388535},{"type":"v1","addr":"172.21.15.191:6837","nonce":416388535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/2830978927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2830978927},{"type":"v1","addr":"172.21.15.47:6833","nonce":2830978927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/4025654680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":4025654680},{"type":"v1","addr":"172.21.15.191:6836","nonce":4025654680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T23:34:38.059644+0000","modified":"2024-04-14T23:34:43.087707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/1169029730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1169029730},{"type":"v1","addr":"172.21.15.47:6835","nonce":1169029730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-14T23:34:45.053 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 6 2024-04-14T23:34:45.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.051+0000 7f0b601cc640 1 -- 172.21.15.47:0/1146963484 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0b4406b9c0 msgr2=0x7f0b4406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.051+0000 7f0b601cc640 1 --2- 172.21.15.47:0/1146963484 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0b4406b9c0 0x7f0b4406de80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009560 tx=0x7f0b4c009190 comp rx=0 tx=0).stop 2024-04-14T23:34:45.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.051+0000 7f0b601cc640 1 -- 172.21.15.47:0/1146963484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5806b200 msgr2=0x7f0b580b64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.051+0000 7f0b601cc640 1 --2- 172.21.15.47:0/1146963484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5806b200 0x7f0b580b64c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0b500090b0 tx=0x7f0b500046c0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.051+0000 7f0b601cc640 1 -- 172.21.15.47:0/1146963484 shutdown_connections 2024-04-14T23:34:45.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.051+0000 7f0b601cc640 1 --2- 172.21.15.47:0/1146963484 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0b4406b9c0 0x7f0b4406de80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.051+0000 7f0b601cc640 1 --2- 172.21.15.47:0/1146963484 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5815bf40 0x7f0b5814af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.051+0000 7f0b601cc640 1 --2- 172.21.15.47:0/1146963484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b580c5a80 0x7f0b58157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.051+0000 7f0b601cc640 1 --2- 172.21.15.47:0/1146963484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5806b200 0x7f0b580b64c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.051+0000 7f0b601cc640 1 -- 172.21.15.47:0/1146963484 >> 172.21.15.47:0/1146963484 conn(0x7f0b580d0c00 msgr2=0x7f0b580b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:45.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.051+0000 7f0b601cc640 1 -- 172.21.15.47:0/1146963484 shutdown_connections 2024-04-14T23:34:45.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.051+0000 7f0b601cc640 1 -- 172.21.15.47:0/1146963484 wait complete. 2024-04-14T23:34:45.065 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:34:45.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.170+0000 7fde85bcc640 1 Processor -- start 2024-04-14T23:34:45.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.170+0000 7fde85bcc640 1 -- start start 2024-04-14T23:34:45.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.171+0000 7fde85bcc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde8015e420 0x7fde800d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.171+0000 7fde85bcc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fde800cf020 0x7fde800cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.171+0000 7fde85bcc640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde800d1040 con 0x7fde800ce4b0 2024-04-14T23:34:45.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.171+0000 7fde85bcc640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fde800cc280 con 0x7fde800cf020 2024-04-14T23:34:45.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.171+0000 7fde85bcc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fde8006d750 con 0x7fde8015e420 2024-04-14T23:34:45.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.171+0000 7fde7ffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fde800cf020 0x7fde800cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.171+0000 7fde7ffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fde800cf020 0x7fde800cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58890/0 (socket says 172.21.15.47:58890) 2024-04-14T23:34:45.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.171+0000 7fde7effd640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fde800ce4b0 0x7fde800ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41834/0 (socket says 172.21.15.47:41834) 2024-04-14T23:34:45.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.171+0000 7fde7ffff640 1 -- 172.21.15.47:0/1317249355 learned_addr learned my addr 172.21.15.47:0/1317249355 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:45.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.172+0000 7fde7ffff640 1 -- 172.21.15.47:0/1317249355 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde8015e420 msgr2=0x7fde800d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:45.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.172+0000 7fde7f7fe640 1 --2- 172.21.15.47:0/1317249355 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde8015e420 0x7fde800d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.172+0000 7fde7ffff640 1 --2- 172.21.15.47:0/1317249355 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde8015e420 0x7fde800d0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.172+0000 7fde7ffff640 1 -- 172.21.15.47:0/1317249355 >> v1:172.21.15.47:6789/0 conn(0x7fde800ce4b0 legacy=0x7fde800ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.172+0000 7fde7e7fc640 1 -- 172.21.15.47:0/1317249355 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3631559728 0 0) 0x7fde800d1040 con 0x7fde800ce4b0 2024-04-14T23:34:45.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.172+0000 7fde7ffff640 1 -- 172.21.15.47:0/1317249355 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde800d1320 con 0x7fde800cf020 2024-04-14T23:34:45.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.172+0000 7fde7ffff640 1 --2- 172.21.15.47:0/1317249355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde800cf020 0x7fde800cccd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fde78009e50 tx=0x7fde7802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562183bd8c1b6c39 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:45.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.172+0000 7fde7e7fc640 1 -- 172.21.15.47:0/1317249355 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7802cb90 con 0x7fde800cf020 2024-04-14T23:34:45.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.172+0000 7fde7e7fc640 1 -- 172.21.15.47:0/1317249355 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde7802cd30 con 0x7fde800cf020 2024-04-14T23:34:45.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.172+0000 7fde7e7fc640 1 -- 172.21.15.47:0/1317249355 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78034610 con 0x7fde800cf020 2024-04-14T23:34:45.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.173+0000 7fde85bcc640 1 -- 172.21.15.47:0/1317249355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde800cf020 msgr2=0x7fde800cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.173+0000 7fde85bcc640 1 --2- 172.21.15.47:0/1317249355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde800cf020 0x7fde800cccd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fde78009e50 tx=0x7fde7802bff0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.173+0000 7fde85bcc640 1 -- 172.21.15.47:0/1317249355 shutdown_connections 2024-04-14T23:34:45.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.173+0000 7fde85bcc640 1 --2- 172.21.15.47:0/1317249355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde800cf020 0x7fde800cccd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.173+0000 7fde85bcc640 1 --2- 172.21.15.47:0/1317249355 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde8015e420 0x7fde800d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.173+0000 7fde85bcc640 1 -- 172.21.15.47:0/1317249355 >> 172.21.15.47:0/1317249355 conn(0x7fde800d1c30 msgr2=0x7fde800d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:45.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.173+0000 7fde85bcc640 1 -- 172.21.15.47:0/1317249355 shutdown_connections 2024-04-14T23:34:45.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.173+0000 7fde85bcc640 1 -- 172.21.15.47:0/1317249355 wait complete. 2024-04-14T23:34:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.174+0000 7fde85bcc640 1 Processor -- start 2024-04-14T23:34:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.174+0000 7fde85bcc640 1 -- start start 2024-04-14T23:34:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde85bcc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde800ce4b0 0x7fde8014db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde85bcc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde800cf020 0x7fde8015e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde85bcc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde8015e420 0x7fde800afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde85bcc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fde8015e800 con 0x7fde800cf020 2024-04-14T23:34:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde85bcc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fde800cc7b0 con 0x7fde800ce4b0 2024-04-14T23:34:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde85bcc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fde800cd210 con 0x7fde8015e420 2024-04-14T23:34:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde7effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde800cf020 0x7fde8015e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde7effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde800cf020 0x7fde8015e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58900/0 (socket says 172.21.15.47:58900) 2024-04-14T23:34:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde7effd640 1 -- 172.21.15.47:0/1685267992 learned_addr learned my addr 172.21.15.47:0/1685267992 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde7f7fe640 1 --2- 172.21.15.47:0/1685267992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde800ce4b0 0x7fde8014db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde7ffff640 1 --2- 172.21.15.47:0/1685267992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde8015e420 0x7fde800afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde7effd640 1 -- 172.21.15.47:0/1685267992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde8015e420 msgr2=0x7fde800afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde7effd640 1 --2- 172.21.15.47:0/1685267992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde8015e420 0x7fde800afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde7effd640 1 -- 172.21.15.47:0/1685267992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde800ce4b0 msgr2=0x7fde8014db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde7effd640 1 --2- 172.21.15.47:0/1685267992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde800ce4b0 0x7fde8014db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde7effd640 1 -- 172.21.15.47:0/1685267992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8014e0a0 con 0x7fde800cf020 2024-04-14T23:34:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde7f7fe640 1 --2- 172.21.15.47:0/1685267992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde800ce4b0 0x7fde8014db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.175+0000 7fde7ffff640 1 --2- 172.21.15.47:0/1685267992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde8015e420 0x7fde800afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.176+0000 7fde7effd640 1 --2- 172.21.15.47:0/1685267992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde800cf020 0x7fde8015e980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fde7400c4d0 tx=0x7fde7400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.176+0000 7fde67fff640 1 -- 172.21.15.47:0/1685267992 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde74018070 con 0x7fde800cf020 2024-04-14T23:34:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.176+0000 7fde67fff640 1 -- 172.21.15.47:0/1685267992 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde74007500 con 0x7fde800cf020 2024-04-14T23:34:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.176+0000 7fde85bcc640 1 -- 172.21.15.47:0/1685267992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde800c9f60 con 0x7fde800cf020 2024-04-14T23:34:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.176+0000 7fde67fff640 1 -- 172.21.15.47:0/1685267992 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde74004a20 con 0x7fde800cf020 2024-04-14T23:34:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.176+0000 7fde85bcc640 1 -- 172.21.15.47:0/1685267992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde800ca520 con 0x7fde800cf020 2024-04-14T23:34:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.177+0000 7fde85bcc640 1 -- 172.21.15.47:0/1685267992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde80075430 con 0x7fde800cf020 2024-04-14T23:34:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.177+0000 7fde67fff640 1 -- 172.21.15.47:0/1685267992 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fde7401b070 con 0x7fde800cf020 2024-04-14T23:34:45.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.178+0000 7fde67fff640 1 --2- 172.21.15.47:0/1685267992 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fde6c06b990 0x7fde6c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.178+0000 7fde67fff640 1 -- 172.21.15.47:0/1685267992 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fde74089df0 con 0x7fde800cf020 2024-04-14T23:34:45.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.178+0000 7fde7f7fe640 1 --2- 172.21.15.47:0/1685267992 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fde6c06b990 0x7fde6c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.178+0000 7fde7f7fe640 1 --2- 172.21.15.47:0/1685267992 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fde6c06b990 0x7fde6c06de50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde7000b820 tx=0x7fde70008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:45.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.182+0000 7fde67fff640 1 -- 172.21.15.47:0/1685267992 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fde74058750 con 0x7fde800cf020 2024-04-14T23:34:45.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.363+0000 7fde85bcc640 1 -- 172.21.15.47:0/1685267992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde8006d8d0 con 0x7fde800cf020 2024-04-14T23:34:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.364+0000 7fde67fff640 1 -- 172.21.15.47:0/1685267992 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7fde74058050 con 0x7fde800cf020 2024-04-14T23:34:45.367 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:45.367 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:44.714882+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:34:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.366+0000 7fde85bcc640 1 -- 172.21.15.47:0/1685267992 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fde6c06b990 msgr2=0x7fde6c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.366+0000 7fde85bcc640 1 --2- 172.21.15.47:0/1685267992 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fde6c06b990 0x7fde6c06de50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde7000b820 tx=0x7fde70008040 comp rx=0 tx=0).stop 2024-04-14T23:34:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.366+0000 7fde85bcc640 1 -- 172.21.15.47:0/1685267992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde800cf020 msgr2=0x7fde8015e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.366+0000 7fde85bcc640 1 --2- 172.21.15.47:0/1685267992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde800cf020 0x7fde8015e980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fde7400c4d0 tx=0x7fde7400c990 comp rx=0 tx=0).stop 2024-04-14T23:34:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.366+0000 7fde85bcc640 1 -- 172.21.15.47:0/1685267992 shutdown_connections 2024-04-14T23:34:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.366+0000 7fde85bcc640 1 --2- 172.21.15.47:0/1685267992 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fde6c06b990 0x7fde6c06de50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.366+0000 7fde85bcc640 1 --2- 172.21.15.47:0/1685267992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde8015e420 0x7fde800afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.366+0000 7fde85bcc640 1 --2- 172.21.15.47:0/1685267992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde800cf020 0x7fde8015e980 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.366+0000 7fde85bcc640 1 --2- 172.21.15.47:0/1685267992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde800ce4b0 0x7fde8014db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.366+0000 7fde85bcc640 1 -- 172.21.15.47:0/1685267992 >> 172.21.15.47:0/1685267992 conn(0x7fde800d1c30 msgr2=0x7fde8015b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.366+0000 7fde85bcc640 1 -- 172.21.15.47:0/1685267992 shutdown_connections 2024-04-14T23:34:45.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.366+0000 7fde85bcc640 1 -- 172.21.15.47:0/1685267992 wait complete. 2024-04-14T23:34:45.782 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-14T23:34:38.059644+0000', 'modified': '2024-04-14T23:34:43.087707+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.47:6835/1169029730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6834', 'nonce': 1169029730}, {'type': 'v1', 'addr': '172.21.15.47:6835', 'nonce': 1169029730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4287, 'qdb_cluster': [4287]} 2024-04-14T23:34:45.783 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-14T23:34:45.783 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-14T23:34:45.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.886+0000 7f3a96ade640 1 Processor -- start 2024-04-14T23:34:45.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.886+0000 7f3a96ade640 1 -- start start 2024-04-14T23:34:45.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.887+0000 7f3a96ade640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a9015e4a0 0x7f3a900d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.887+0000 7f3a96ade640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f3a900d1c40 0x7f3a900d2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.887+0000 7f3a96ade640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3a900c9460 0x7f3a900c9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.887+0000 7f3a96ade640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3a9015e880 con 0x7f3a900c9460 2024-04-14T23:34:45.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.887+0000 7f3a96ade640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f3a900c83c0 con 0x7f3a900d1c40 2024-04-14T23:34:45.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.887+0000 7f3a96ade640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f3a900c86a0 con 0x7f3a9015e4a0 2024-04-14T23:34:45.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.887+0000 7f3a9507b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3a900c9460 0x7f3a900c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.887+0000 7f3a9507b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3a900c9460 0x7f3a900c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58912/0 (socket says 172.21.15.47:58912) 2024-04-14T23:34:45.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.887+0000 7f3a9507b640 1 -- 172.21.15.47:0/1339415544 learned_addr learned my addr 172.21.15.47:0/1339415544 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:45.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.887+0000 7f3a9507b640 1 -- 172.21.15.47:0/1339415544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a9015e4a0 msgr2=0x7f3a900d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:45.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.887+0000 7f3a9507b640 1 --2- 172.21.15.47:0/1339415544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a9015e4a0 0x7f3a900d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.887+0000 7f3a9507b640 1 -- 172.21.15.47:0/1339415544 >> v2:172.21.15.191:3300/0 conn(0x7f3a900d1c40 msgr2=0x7f3a900d2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:45.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.887+0000 7f3a9507b640 1 --2- 172.21.15.47:0/1339415544 >> v2:172.21.15.191:3300/0 conn(0x7f3a900d1c40 0x7f3a900d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.887+0000 7f3a9507b640 1 -- 172.21.15.47:0/1339415544 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a900c8980 con 0x7f3a900c9460 2024-04-14T23:34:45.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.888+0000 7f3a9507b640 1 --2- 172.21.15.47:0/1339415544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a900c9460 0x7f3a900c9910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3a9008cb70 tx=0x7f3a7802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f855f4cb4520b631 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:45.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.888+0000 7f3a8f7fe640 1 -- 172.21.15.47:0/1339415544 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a78035020 con 0x7f3a900c9460 2024-04-14T23:34:45.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.888+0000 7f3a8f7fe640 1 -- 172.21.15.47:0/1339415544 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a78031870 con 0x7f3a900c9460 2024-04-14T23:34:45.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.888+0000 7f3a8f7fe640 1 -- 172.21.15.47:0/1339415544 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a78031c40 con 0x7f3a900c9460 2024-04-14T23:34:45.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.889+0000 7f3a96ade640 1 -- 172.21.15.47:0/1339415544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a900c9460 msgr2=0x7f3a900c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.889+0000 7f3a96ade640 1 --2- 172.21.15.47:0/1339415544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a900c9460 0x7f3a900c9910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3a9008cb70 tx=0x7f3a7802b910 comp rx=0 tx=0).stop 2024-04-14T23:34:45.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.889+0000 7f3a96ade640 1 -- 172.21.15.47:0/1339415544 shutdown_connections 2024-04-14T23:34:45.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.889+0000 7f3a96ade640 1 --2- 172.21.15.47:0/1339415544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a900c9460 0x7f3a900c9910 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.889+0000 7f3a96ade640 1 --2- 172.21.15.47:0/1339415544 >> v2:172.21.15.191:3300/0 conn(0x7f3a900d1c40 0x7f3a900d2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.889+0000 7f3a96ade640 1 --2- 172.21.15.47:0/1339415544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a9015e4a0 0x7f3a900d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.889+0000 7f3a96ade640 1 -- 172.21.15.47:0/1339415544 >> 172.21.15.47:0/1339415544 conn(0x7f3a900d3ef0 msgr2=0x7f3a900d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:45.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.889+0000 7f3a96ade640 1 -- 172.21.15.47:0/1339415544 shutdown_connections 2024-04-14T23:34:45.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.889+0000 7f3a96ade640 1 -- 172.21.15.47:0/1339415544 wait complete. 2024-04-14T23:34:45.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.890+0000 7f3a96ade640 1 Processor -- start 2024-04-14T23:34:45.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.890+0000 7f3a96ade640 1 -- start start 2024-04-14T23:34:45.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.891+0000 7f3a96ade640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a900c9460 0x7f3a900cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.891+0000 7f3a96ade640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a900d1c40 0x7f3a90157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.891+0000 7f3a96ade640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a9015e4a0 0x7f3a9015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.891+0000 7f3a96ade640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3a90067bb0 con 0x7f3a900c9460 2024-04-14T23:34:45.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.891+0000 7f3a96ade640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3a900c8f40 con 0x7f3a9015e4a0 2024-04-14T23:34:45.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.891+0000 7f3a96ade640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f3a90067d30 con 0x7f3a900d1c40 2024-04-14T23:34:45.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.891+0000 7f3a9487a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a900c9460 0x7f3a900cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.891+0000 7f3a9487a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a900c9460 0x7f3a900cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58916/0 (socket says 172.21.15.47:58916) 2024-04-14T23:34:45.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.891+0000 7f3a9487a640 1 -- 172.21.15.47:0/1911013160 learned_addr learned my addr 172.21.15.47:0/1911013160 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:45.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.891+0000 7f3a9487a640 1 -- 172.21.15.47:0/1911013160 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a900d1c40 msgr2=0x7f3a90157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.891+0000 7f3a9487a640 1 --2- 172.21.15.47:0/1911013160 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a900d1c40 0x7f3a90157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.891+0000 7f3a9487a640 1 -- 172.21.15.47:0/1911013160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a9015e4a0 msgr2=0x7f3a9015aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.891+0000 7f3a9507b640 1 --2- 172.21.15.47:0/1911013160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a9015e4a0 0x7f3a9015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.891+0000 7f3a9487a640 1 --2- 172.21.15.47:0/1911013160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a9015e4a0 0x7f3a9015aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.891+0000 7f3a9487a640 1 -- 172.21.15.47:0/1911013160 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a900cde80 con 0x7f3a900c9460 2024-04-14T23:34:45.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.891+0000 7f3a9487a640 1 --2- 172.21.15.47:0/1911013160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a900c9460 0x7f3a900cd940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800ba80 tx=0x7f3a8800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:45.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.892+0000 7f3a8d7fa640 1 -- 172.21.15.47:0/1911013160 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88019070 con 0x7f3a900c9460 2024-04-14T23:34:45.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.892+0000 7f3a8d7fa640 1 -- 172.21.15.47:0/1911013160 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a8800cc20 con 0x7f3a900c9460 2024-04-14T23:34:45.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.892+0000 7f3a8d7fa640 1 -- 172.21.15.47:0/1911013160 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88014440 con 0x7f3a900c9460 2024-04-14T23:34:45.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.892+0000 7f3a96ade640 1 -- 172.21.15.47:0/1911013160 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a900cc8a0 con 0x7f3a900c9460 2024-04-14T23:34:45.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.892+0000 7f3a96ade640 1 -- 172.21.15.47:0/1911013160 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a900cce60 con 0x7f3a900c9460 2024-04-14T23:34:45.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.893+0000 7f3a8d7fa640 1 -- 172.21.15.47:0/1911013160 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f3a8801c070 con 0x7f3a900c9460 2024-04-14T23:34:45.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.894+0000 7f3a8d7fa640 1 --2- 172.21.15.47:0/1911013160 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3a7006b990 0x7f3a7006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.894+0000 7f3a8d7fa640 1 -- 172.21.15.47:0/1911013160 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3a8808a8b0 con 0x7f3a900c9460 2024-04-14T23:34:45.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.894+0000 7f3a8ffff640 1 --2- 172.21.15.47:0/1911013160 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3a7006b990 0x7f3a7006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.894+0000 7f3a8ffff640 1 --2- 172.21.15.47:0/1911013160 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3a7006b990 0x7f3a7006de50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a900b9cb0 tx=0x7f3a80006bf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:45.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.894+0000 7f3a999b2740 1 Processor -- start 2024-04-14T23:34:45.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.894+0000 7f3a999b2740 1 -- start start 2024-04-14T23:34:45.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.895+0000 7f3a999b2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e86f0 0x55fed14bb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.895+0000 7f3a999b2740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e8ad0 0x55fed14eb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.895+0000 7f3a999b2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed14bbbd0 0x55fed14eb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.895+0000 7f3a999b2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fed1424f80 con 0x55fed14e86f0 2024-04-14T23:34:45.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.895+0000 7f3a999b2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fed13cd9a0 con 0x55fed14bbbd0 2024-04-14T23:34:45.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.895+0000 7f3a999b2740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55fed1420f30 con 0x55fed14e8ad0 2024-04-14T23:34:45.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.895+0000 7f3a9487a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e86f0 0x55fed14bb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.895+0000 7f3a9487a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e86f0 0x55fed14bb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58932/0 (socket says 172.21.15.47:58932) 2024-04-14T23:34:45.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.895+0000 7f3a9487a640 1 -- 172.21.15.47:0/2261992040 learned_addr learned my addr 172.21.15.47:0/2261992040 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:45.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.895+0000 7f3a8ffff640 1 --2- 172.21.15.47:0/2261992040 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e8ad0 0x55fed14eb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.895+0000 7f3a9507b640 1 --2- 172.21.15.47:0/2261992040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed14bbbd0 0x55fed14eb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.895+0000 7f3a9487a640 1 -- 172.21.15.47:0/2261992040 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e8ad0 msgr2=0x55fed14eb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:45.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.895+0000 7f3a9487a640 1 --2- 172.21.15.47:0/2261992040 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e8ad0 0x55fed14eb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a9487a640 1 -- 172.21.15.47:0/2261992040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed14bbbd0 msgr2=0x55fed14eb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:45.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a9487a640 1 --2- 172.21.15.47:0/2261992040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed14bbbd0 0x55fed14eb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a9487a640 1 -- 172.21.15.47:0/2261992040 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed13ee480 con 0x55fed14e86f0 2024-04-14T23:34:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a8ffff640 1 --2- 172.21.15.47:0/2261992040 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e8ad0 0x55fed14eb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a9487a640 1 --2- 172.21.15.47:0/2261992040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e86f0 0x55fed14bb690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3a88060e30 tx=0x7f3a88004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405bf5822937c631 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a867fc640 1 -- 172.21.15.47:0/2261992040 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88088e60 con 0x55fed14e86f0 2024-04-14T23:34:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a867fc640 1 -- 172.21.15.47:0/2261992040 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a8805f070 con 0x55fed14e86f0 2024-04-14T23:34:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a867fc640 1 -- 172.21.15.47:0/2261992040 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88060ed0 con 0x55fed14e86f0 2024-04-14T23:34:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a999b2740 1 -- 172.21.15.47:0/2261992040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e86f0 msgr2=0x55fed14bb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a999b2740 1 --2- 172.21.15.47:0/2261992040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e86f0 0x55fed14bb690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3a88060e30 tx=0x7f3a88004b50 comp rx=0 tx=0).stop 2024-04-14T23:34:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a999b2740 1 -- 172.21.15.47:0/2261992040 shutdown_connections 2024-04-14T23:34:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a999b2740 1 --2- 172.21.15.47:0/2261992040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed14bbbd0 0x55fed14eb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a999b2740 1 --2- 172.21.15.47:0/2261992040 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e8ad0 0x55fed14eb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a999b2740 1 --2- 172.21.15.47:0/2261992040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e86f0 0x55fed14bb690 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a999b2740 1 -- 172.21.15.47:0/2261992040 >> 172.21.15.47:0/2261992040 conn(0x55fed14bd900 msgr2=0x55fed1506480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a999b2740 1 -- 172.21.15.47:0/2261992040 shutdown_connections 2024-04-14T23:34:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.896+0000 7f3a999b2740 1 -- 172.21.15.47:0/2261992040 wait complete. 2024-04-14T23:34:45.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.897+0000 7f3a999b2740 1 -- start start 2024-04-14T23:34:45.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.897+0000 7f3a999b2740 1 Processor -- start 2024-04-14T23:34:45.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a999b2740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e86f0 0x55fed14eb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a999b2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e8ad0 0x55fed14ed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a999b2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed1516570 0x55fed14ed610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a999b2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fed14bfea0 con 0x55fed14e8ad0 2024-04-14T23:34:45.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a999b2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fed13e0f40 con 0x55fed1516570 2024-04-14T23:34:45.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a999b2740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55fed14bf290 con 0x55fed14e86f0 2024-04-14T23:34:45.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a999b2740 10 client.0 _ll_register_callbacks cb 0x55fed13db9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T23:34:45.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a8ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e8ad0 0x55fed14ed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a8ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e8ad0 0x55fed14ed0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58938/0 (socket says 172.21.15.47:58938) 2024-04-14T23:34:45.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a8ffff640 1 -- 172.21.15.47:0/1871413043 learned_addr learned my addr 172.21.15.47:0/1871413043 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:45.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a9487a640 1 --2- 172.21.15.47:0/1871413043 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e86f0 0x55fed14eb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a9507b640 1 --2- 172.21.15.47:0/1871413043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed1516570 0x55fed14ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a8ffff640 1 -- 172.21.15.47:0/1871413043 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e86f0 msgr2=0x55fed14eb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:45.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a8ffff640 1 --2- 172.21.15.47:0/1871413043 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e86f0 0x55fed14eb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a8ffff640 1 -- 172.21.15.47:0/1871413043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed1516570 msgr2=0x55fed14ed610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:45.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a8ffff640 1 --2- 172.21.15.47:0/1871413043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed1516570 0x55fed14ed610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a8ffff640 1 -- 172.21.15.47:0/1871413043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fed11392d0 con 0x55fed14e8ad0 2024-04-14T23:34:45.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a9487a640 1 --2- 172.21.15.47:0/1871413043 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e86f0 0x55fed14eb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:45.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a9507b640 1 --2- 172.21.15.47:0/1871413043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed1516570 0x55fed14ed610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:45.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a8ffff640 1 --2- 172.21.15.47:0/1871413043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e8ad0 0x55fed14ed0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3a80013f40 tx=0x7f3a800047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c644b0ad76473684 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:45.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-14T23:34:45.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.898+0000 7f3a6f7fe640 1 -- 172.21.15.47:0/1871413043 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80012e60 con 0x55fed14e8ad0 2024-04-14T23:34:45.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.899+0000 7f3a6f7fe640 1 -- 172.21.15.47:0/1871413043 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3a80010770 con 0x55fed14e8ad0 2024-04-14T23:34:45.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.899+0000 7f3a999b2740 1 -- 172.21.15.47:0/1871413043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fed14324c0 con 0x55fed14e8ad0 2024-04-14T23:34:45.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.899+0000 7f3a6f7fe640 1 -- 172.21.15.47:0/1871413043 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f3a8002c050 con 0x55fed14e8ad0 2024-04-14T23:34:45.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.899+0000 7f3a999b2740 10 client.4434 fetch_fsmap learned FSMap version 6 2024-04-14T23:34:45.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.899+0000 7f3a999b2740 1 -- 172.21.15.47:0/1871413043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55fed12036b0 con 0x55fed14e8ad0 2024-04-14T23:34:45.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.899+0000 7f3a6f7fe640 1 -- 172.21.15.47:0/1871413043 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fed14324c0 con 0x55fed14e8ad0 2024-04-14T23:34:45.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.899+0000 7f3a6f7fe640 1 -- 172.21.15.47:0/1871413043 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f3a8002f020 con 0x55fed14e8ad0 2024-04-14T23:34:45.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.899+0000 7f3a999b2740 10 client.4434 fetch_fsmap finished waiting for FSMap version 6 2024-04-14T23:34:45.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.899+0000 7f3a999b2740 10 client.4434 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-14T23:34:45.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.899+0000 7f3a999b2740 20 client.4434 populate_metadata read hostname 'smithi047' 2024-04-14T23:34:45.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.899+0000 7f3a999b2740 1 --2- 172.21.15.47:0/1871413043 >> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] conn(0x55fed151a650 0x55fed151aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.899+0000 7f3a999b2740 4 client.4434 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T23:34:45.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.899+0000 7f3a999b2740 1 -- 172.21.15.47:0/1871413043 --> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fed142c810 con 0x55fed151a650 2024-04-14T23:34:45.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.899+0000 7f3a9487a640 1 --2- 172.21.15.47:0/1871413043 >> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] conn(0x55fed151a650 0x55fed151aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.899+0000 7f3a6f7fe640 10 client.4434 ms_handle_connect on v2:172.21.15.47:6834/1169029730 2024-04-14T23:34:45.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.899+0000 7f3a9487a640 1 --2- 172.21.15.47:0/1871413043 >> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] conn(0x55fed151a650 0x55fed151aa30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8e51f62d14dd887 server_cookie=9a5e96390639015d in_seq=0 out_seq=0 2024-04-14T23:34:45.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.900+0000 7f3a6f7fe640 1 -- 172.21.15.47:0/1871413043 <== mds.0 v2:172.21.15.47:6834/1169029730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fed142c810 con 0x55fed151a650 2024-04-14T23:34:45.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.900+0000 7f3a6f7fe640 10 client.4434 handle_command_reply: tid=0 2024-04-14T23:34:45.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.900+0000 7f3a999b2740 1 client.4434 shutdown 2024-04-14T23:34:45.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.900+0000 7f3a999b2740 1 -- 172.21.15.47:0/1871413043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e8ad0 msgr2=0x55fed14ed0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.900+0000 7f3a999b2740 1 --2- 172.21.15.47:0/1871413043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e8ad0 0x55fed14ed0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3a80013f40 tx=0x7f3a800047a0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.900+0000 7f3a999b2740 1 -- 172.21.15.47:0/1871413043 shutdown_connections 2024-04-14T23:34:45.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.900+0000 7f3a999b2740 1 --2- 172.21.15.47:0/1871413043 >> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] conn(0x55fed151a650 0x55fed151aa30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.900+0000 7f3a999b2740 1 --2- 172.21.15.47:0/1871413043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed1516570 0x55fed14ed610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.900+0000 7f3a999b2740 1 --2- 172.21.15.47:0/1871413043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e8ad0 0x55fed14ed0d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.900+0000 7f3a999b2740 1 --2- 172.21.15.47:0/1871413043 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e86f0 0x55fed14eb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.900+0000 7f3a999b2740 1 -- 172.21.15.47:0/1871413043 >> 172.21.15.47:0/1871413043 conn(0x55fed14bbbd0 msgr2=0x55fed1509990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:45.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.900+0000 7f3a6f7fe640 0 client.4434 ms_handle_reset on v2:172.21.15.47:6834/1169029730 2024-04-14T23:34:45.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.900+0000 7f3a999b2740 1 -- 172.21.15.47:0/1871413043 shutdown_connections 2024-04-14T23:34:45.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.900+0000 7f3a999b2740 1 -- 172.21.15.47:0/1871413043 wait complete. 2024-04-14T23:34:45.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.900+0000 7f3a999b2740 20 client.4434 trim_cache size 0 max 16384 2024-04-14T23:34:45.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.918+0000 7f3a999b2740 1 Processor -- start 2024-04-14T23:34:45.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.919+0000 7f3a999b2740 1 -- start start 2024-04-14T23:34:45.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.919+0000 7f3a999b2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed14e86f0 0x55fed1529e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.919+0000 7f3a999b2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e8ad0 0x55fed14ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.919+0000 7f3a999b2740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed1516570 0x55fed14ed420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.919+0000 7f3a999b2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3a90200e10 con 0x55fed14e8ad0 2024-04-14T23:34:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.919+0000 7f3a999b2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3a901f8570 con 0x55fed14e86f0 2024-04-14T23:34:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.919+0000 7f3a999b2740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f3a902008a0 con 0x55fed1516570 2024-04-14T23:34:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.919+0000 7f3a8ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e8ad0 0x55fed14ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.919+0000 7f3a8ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e8ad0 0x55fed14ecee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58952/0 (socket says 172.21.15.47:58952) 2024-04-14T23:34:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.919+0000 7f3a8ffff640 1 -- 172.21.15.47:0/2156812384 learned_addr learned my addr 172.21.15.47:0/2156812384 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.919+0000 7f3a9507b640 1 --2- 172.21.15.47:0/2156812384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed1516570 0x55fed14ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.919+0000 7f3a9487a640 1 --2- 172.21.15.47:0/2156812384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed14e86f0 0x55fed1529e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a8ffff640 1 -- 172.21.15.47:0/2156812384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed1516570 msgr2=0x55fed14ed420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a8ffff640 1 --2- 172.21.15.47:0/2156812384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed1516570 0x55fed14ed420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a8ffff640 1 -- 172.21.15.47:0/2156812384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed14e86f0 msgr2=0x55fed1529e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a8ffff640 1 --2- 172.21.15.47:0/2156812384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed14e86f0 0x55fed1529e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a8ffff640 1 -- 172.21.15.47:0/2156812384 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed151ada0 con 0x55fed14e8ad0 2024-04-14T23:34:45.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a8ffff640 1 --2- 172.21.15.47:0/2156812384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e8ad0 0x55fed14ecee0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3a80012c70 tx=0x7f3a80017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9bab12eb8a616e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a85ffb640 1 -- 172.21.15.47:0/2156812384 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80035020 con 0x55fed14e8ad0 2024-04-14T23:34:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a85ffb640 1 -- 172.21.15.47:0/2156812384 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a80024070 con 0x55fed14e8ad0 2024-04-14T23:34:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a85ffb640 1 -- 172.21.15.47:0/2156812384 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80010770 con 0x55fed14e8ad0 2024-04-14T23:34:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a999b2740 1 -- 172.21.15.47:0/2156812384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e8ad0 msgr2=0x55fed14ecee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a999b2740 1 --2- 172.21.15.47:0/2156812384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e8ad0 0x55fed14ecee0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3a80012c70 tx=0x7f3a80017070 comp rx=0 tx=0).stop 2024-04-14T23:34:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a999b2740 1 -- 172.21.15.47:0/2156812384 shutdown_connections 2024-04-14T23:34:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a999b2740 1 --2- 172.21.15.47:0/2156812384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed1516570 0x55fed14ed420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a999b2740 1 --2- 172.21.15.47:0/2156812384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed14e8ad0 0x55fed14ecee0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a999b2740 1 --2- 172.21.15.47:0/2156812384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed14e86f0 0x55fed1529e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a999b2740 1 -- 172.21.15.47:0/2156812384 >> 172.21.15.47:0/2156812384 conn(0x55fed14bbbd0 msgr2=0x55fed14bf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a999b2740 1 -- 172.21.15.47:0/2156812384 shutdown_connections 2024-04-14T23:34:45.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.920+0000 7f3a999b2740 1 -- 172.21.15.47:0/2156812384 wait complete. 2024-04-14T23:34:45.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.921+0000 7f3a999b2740 1 -- start start 2024-04-14T23:34:45.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.921+0000 7f3a999b2740 1 Processor -- start 2024-04-14T23:34:45.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a999b2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed14e86f0 0x55fed15803f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a999b2740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e8ad0 0x55fed1509990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a999b2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed1516570 0x55fed14e0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a999b2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fed14edc10 con 0x55fed1516570 2024-04-14T23:34:45.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a999b2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fed14ead00 con 0x55fed14e86f0 2024-04-14T23:34:45.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a999b2740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55fed14e41a0 con 0x55fed14e8ad0 2024-04-14T23:34:45.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a999b2740 10 client.0 _ll_register_callbacks cb 0x7f3a80013430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T23:34:45.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a9507b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed1516570 0x55fed14e0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a9507b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed1516570 0x55fed14e0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58954/0 (socket says 172.21.15.47:58954) 2024-04-14T23:34:45.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a9507b640 1 -- 172.21.15.47:0/3802129476 learned_addr learned my addr 172.21.15.47:0/3802129476 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:45.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a9487a640 1 --2- 172.21.15.47:0/3802129476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed14e86f0 0x55fed15803f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a8ffff640 1 --2- 172.21.15.47:0/3802129476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e8ad0 0x55fed1509990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a9507b640 1 -- 172.21.15.47:0/3802129476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e8ad0 msgr2=0x55fed1509990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:45.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a9507b640 1 --2- 172.21.15.47:0/3802129476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e8ad0 0x55fed1509990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a9507b640 1 -- 172.21.15.47:0/3802129476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed14e86f0 msgr2=0x55fed15803f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:45.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a9507b640 1 --2- 172.21.15.47:0/3802129476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed14e86f0 0x55fed15803f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a9507b640 1 -- 172.21.15.47:0/3802129476 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fed14ee150 con 0x55fed1516570 2024-04-14T23:34:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a9507b640 1 --2- 172.21.15.47:0/3802129476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed1516570 0x55fed14e0970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3a780090b0 tx=0x7f3a78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e7574dcc8f3f5d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.922+0000 7f3a6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-14T23:34:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a6f7fe640 1 -- 172.21.15.47:0/3802129476 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7803a830 con 0x55fed1516570 2024-04-14T23:34:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a6f7fe640 1 -- 172.21.15.47:0/3802129476 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3a7803a9d0 con 0x55fed1516570 2024-04-14T23:34:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a999b2740 1 -- 172.21.15.47:0/3802129476 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a80024070 con 0x55fed1516570 2024-04-14T23:34:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a6f7fe640 1 -- 172.21.15.47:0/3802129476 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f3a78054050 con 0x55fed1516570 2024-04-14T23:34:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a999b2740 10 client.4440 fetch_fsmap learned FSMap version 6 2024-04-14T23:34:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a999b2740 1 -- 172.21.15.47:0/3802129476 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55fed1509ed0 con 0x55fed1516570 2024-04-14T23:34:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a6f7fe640 1 -- 172.21.15.47:0/3802129476 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a80024070 con 0x55fed1516570 2024-04-14T23:34:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a6f7fe640 1 -- 172.21.15.47:0/3802129476 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f3a78057020 con 0x55fed1516570 2024-04-14T23:34:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a999b2740 10 client.4440 fetch_fsmap finished waiting for FSMap version 6 2024-04-14T23:34:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a999b2740 10 client.4440 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-14T23:34:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a999b2740 20 client.4440 populate_metadata read hostname 'smithi047' 2024-04-14T23:34:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a999b2740 1 --2- 172.21.15.47:0/3802129476 >> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] conn(0x55fed14c06c0 0x55fed14c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a999b2740 4 client.4440 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-14T23:34:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a999b2740 1 -- 172.21.15.47:0/3802129476 --> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] -- command(tid 0: {"prefix": "status"}) -- 0x55fed13aa9d0 con 0x55fed14c06c0 2024-04-14T23:34:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a9487a640 1 --2- 172.21.15.47:0/3802129476 >> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] conn(0x55fed14c06c0 0x55fed14c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a6f7fe640 10 client.4440 ms_handle_connect on v2:172.21.15.47:6834/1169029730 2024-04-14T23:34:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.923+0000 7f3a9487a640 1 --2- 172.21.15.47:0/3802129476 >> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] conn(0x55fed14c06c0 0x55fed14c0aa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c666b6dde947d22c server_cookie=d895f50757bf1952 in_seq=0 out_seq=0 2024-04-14T23:34:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a6f7fe640 1 -- 172.21.15.47:0/3802129476 <== mds.0 v2:172.21.15.47:6834/1169029730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55fed13aa9d0 con 0x55fed14c06c0 2024-04-14T23:34:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a6f7fe640 10 client.4440 handle_command_reply: tid=0 2024-04-14T23:34:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a999b2740 1 client.4440 shutdown 2024-04-14T23:34:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a999b2740 1 -- 172.21.15.47:0/3802129476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed1516570 msgr2=0x55fed14e0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a999b2740 1 --2- 172.21.15.47:0/3802129476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed1516570 0x55fed14e0970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3a780090b0 tx=0x7f3a78004730 comp rx=0 tx=0).stop 2024-04-14T23:34:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a999b2740 1 -- 172.21.15.47:0/3802129476 shutdown_connections 2024-04-14T23:34:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a999b2740 1 --2- 172.21.15.47:0/3802129476 >> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] conn(0x55fed14c06c0 0x55fed14c0aa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a999b2740 1 --2- 172.21.15.47:0/3802129476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed1516570 0x55fed14e0970 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a999b2740 1 --2- 172.21.15.47:0/3802129476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fed14e8ad0 0x55fed1509990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a999b2740 1 --2- 172.21.15.47:0/3802129476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fed14e86f0 0x55fed15803f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a6f7fe640 0 client.4440 ms_handle_reset on v2:172.21.15.47:6834/1169029730 2024-04-14T23:34:45.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a999b2740 1 -- 172.21.15.47:0/3802129476 >> 172.21.15.47:0/3802129476 conn(0x55fed14bbbd0 msgr2=0x55fed14bf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:45.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a999b2740 1 -- 172.21.15.47:0/3802129476 shutdown_connections 2024-04-14T23:34:45.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a999b2740 1 -- 172.21.15.47:0/3802129476 wait complete. 2024-04-14T23:34:45.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a999b2740 20 client.4440 trim_cache size 0 max 16384 2024-04-14T23:34:45.934 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-14T23:34:45.934 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "4f54965e-64cf-4502-8b02-6c5af72b63aa", 2024-04-14T23:34:45.934 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-04-14T23:34:45.934 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4287, 2024-04-14T23:34:45.935 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-04-14T23:34:45.935 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-04-14T23:34:45.935 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-04-14T23:34:45.935 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 7.2234646690000002, 2024-04-14T23:34:45.935 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 6, 2024-04-14T23:34:45.935 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 25, 2024-04-14T23:34:45.935 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 23, 2024-04-14T23:34:45.935 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 14.045529048000001 2024-04-14T23:34:45.935 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-14T23:34:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a96ade640 1 -- 172.21.15.47:0/1911013160 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3a7006b990 msgr2=0x7f3a7006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a96ade640 1 --2- 172.21.15.47:0/1911013160 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3a7006b990 0x7f3a7006de50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a900b9cb0 tx=0x7f3a80006bf0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a96ade640 1 -- 172.21.15.47:0/1911013160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a900c9460 msgr2=0x7f3a900cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a96ade640 1 --2- 172.21.15.47:0/1911013160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a900c9460 0x7f3a900cd940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800ba80 tx=0x7f3a8800bf40 comp rx=0 tx=0).stop 2024-04-14T23:34:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a96ade640 1 -- 172.21.15.47:0/1911013160 shutdown_connections 2024-04-14T23:34:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a96ade640 1 --2- 172.21.15.47:0/1911013160 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3a7006b990 0x7f3a7006de50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a96ade640 1 --2- 172.21.15.47:0/1911013160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a9015e4a0 0x7f3a9015aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a96ade640 1 --2- 172.21.15.47:0/1911013160 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a900d1c40 0x7f3a90157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a96ade640 1 --2- 172.21.15.47:0/1911013160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a900c9460 0x7f3a900cd940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.924+0000 7f3a96ade640 1 -- 172.21.15.47:0/1911013160 >> 172.21.15.47:0/1911013160 conn(0x7f3a900d3ef0 msgr2=0x7f3a9015ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.925+0000 7f3a96ade640 1 -- 172.21.15.47:0/1911013160 shutdown_connections 2024-04-14T23:34:45.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:45.925+0000 7f3a96ade640 1 -- 172.21.15.47:0/1911013160 wait complete. 2024-04-14T23:34:45.938 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-14T23:34:45.938 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-14T23:34:45.938 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-14T23:34:46.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.038+0000 7fd6a6805640 1 Processor -- start 2024-04-14T23:34:46.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.038+0000 7fd6a6805640 1 -- start start 2024-04-14T23:34:46.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.039+0000 7fd6a6805640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6a015e270 0x7fd6a00d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:46.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.039+0000 7fd6a6805640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd6a00d1450 0x7fd6a00b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:46.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.039+0000 7fd6a6805640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a00b39d0 con 0x7fd6a00d1e00 2024-04-14T23:34:46.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.039+0000 7fd6a6805640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fd6a00b4300 con 0x7fd6a00d1450 2024-04-14T23:34:46.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.039+0000 7fd6a6805640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a00b3cb0 con 0x7fd6a015e270 2024-04-14T23:34:46.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.039+0000 7fd6a4da2640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd6a00d1450 0x7fd6a00b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:46.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.040+0000 7fd6a4da2640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd6a00d1450 0x7fd6a00b4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:59896/0 (socket says 172.21.15.47:59896) 2024-04-14T23:34:46.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.040+0000 7fd6a4da2640 1 -- 172.21.15.47:0/3021877157 learned_addr learned my addr 172.21.15.47:0/3021877157 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:46.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.040+0000 7fd69ffff640 1 --2- 172.21.15.47:0/3021877157 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6a015e270 0x7fd6a00d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:46.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.040+0000 7fd6a4da2640 1 -- 172.21.15.47:0/3021877157 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6a015e270 msgr2=0x7fd6a00d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:46.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.040+0000 7fd6a4da2640 1 --2- 172.21.15.47:0/3021877157 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6a015e270 0x7fd6a00d0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:46.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.040+0000 7fd6a4da2640 1 -- 172.21.15.47:0/3021877157 >> v1:172.21.15.191:6789/0 conn(0x7fd6a00d1e00 legacy=0x7fd6a00d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:46.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.040+0000 7fd69effd640 1 -- 172.21.15.47:0/3021877157 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122732051 0 0) 0x7fd6a00b39d0 con 0x7fd6a00d1e00 2024-04-14T23:34:46.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.040+0000 7fd6a4da2640 1 -- 172.21.15.47:0/3021877157 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a00b3f90 con 0x7fd6a00d1450 2024-04-14T23:34:46.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.040+0000 7fd69ffff640 1 --2- 172.21.15.47:0/3021877157 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6a015e270 0x7fd6a00d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:46.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.041+0000 7fd6a4da2640 1 --2- 172.21.15.47:0/3021877157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6a00d1450 0x7fd6a00b4790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd698009e50 tx=0x7fd69802bff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b0db7aed6f70995 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:46.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.041+0000 7fd69effd640 1 -- 172.21.15.47:0/3021877157 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69802cb90 con 0x7fd6a00d1450 2024-04-14T23:34:46.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.041+0000 7fd69effd640 1 -- 172.21.15.47:0/3021877157 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69802cd30 con 0x7fd6a00d1450 2024-04-14T23:34:46.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.041+0000 7fd69effd640 1 -- 172.21.15.47:0/3021877157 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698034610 con 0x7fd6a00d1450 2024-04-14T23:34:46.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.041+0000 7fd6a6805640 1 -- 172.21.15.47:0/3021877157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6a00d1450 msgr2=0x7fd6a00b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:46.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.041+0000 7fd6a6805640 1 --2- 172.21.15.47:0/3021877157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6a00d1450 0x7fd6a00b4790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd698009e50 tx=0x7fd69802bff0 comp rx=0 tx=0).stop 2024-04-14T23:34:46.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.041+0000 7fd6a6805640 1 -- 172.21.15.47:0/3021877157 shutdown_connections 2024-04-14T23:34:46.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.041+0000 7fd6a6805640 1 --2- 172.21.15.47:0/3021877157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6a00d1450 0x7fd6a00b4790 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:46.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.041+0000 7fd6a6805640 1 --2- 172.21.15.47:0/3021877157 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6a015e270 0x7fd6a00d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:46.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.041+0000 7fd6a6805640 1 -- 172.21.15.47:0/3021877157 >> 172.21.15.47:0/3021877157 conn(0x7fd6a00d3ed0 msgr2=0x7fd6a00d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:46.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.041+0000 7fd6a6805640 1 -- 172.21.15.47:0/3021877157 shutdown_connections 2024-04-14T23:34:46.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.041+0000 7fd6a6805640 1 -- 172.21.15.47:0/3021877157 wait complete. 2024-04-14T23:34:46.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.042+0000 7fd6a6805640 1 Processor -- start 2024-04-14T23:34:46.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.043+0000 7fd6a6805640 1 -- start start 2024-04-14T23:34:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.043+0000 7fd6a6805640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a00d1450 0x7fd6a00cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.043+0000 7fd6a6805640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6a00d1e00 0x7fd6a00b9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.043+0000 7fd6a6805640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6a015e270 0x7fd6a00cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.043+0000 7fd6a6805640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a015e7d0 con 0x7fd6a00d1450 2024-04-14T23:34:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.043+0000 7fd6a6805640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a015e650 con 0x7fd6a015e270 2024-04-14T23:34:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.043+0000 7fd6a6805640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a00d2910 con 0x7fd6a00d1e00 2024-04-14T23:34:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.043+0000 7fd69ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a00d1450 0x7fd6a00cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.043+0000 7fd69ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a00d1450 0x7fd6a00cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58968/0 (socket says 172.21.15.47:58968) 2024-04-14T23:34:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.044+0000 7fd69ffff640 1 -- 172.21.15.47:0/1153493923 learned_addr learned my addr 172.21.15.47:0/1153493923 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.044+0000 7fd69f7fe640 1 --2- 172.21.15.47:0/1153493923 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6a00d1e00 0x7fd6a00b9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.044+0000 7fd6a4da2640 1 --2- 172.21.15.47:0/1153493923 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6a015e270 0x7fd6a00cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.044+0000 7fd69ffff640 1 -- 172.21.15.47:0/1153493923 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6a00d1e00 msgr2=0x7fd6a00b9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.044+0000 7fd69ffff640 1 --2- 172.21.15.47:0/1153493923 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6a00d1e00 0x7fd6a00b9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.044+0000 7fd69ffff640 1 -- 172.21.15.47:0/1153493923 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6a015e270 msgr2=0x7fd6a00cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.044+0000 7fd69ffff640 1 --2- 172.21.15.47:0/1153493923 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6a015e270 0x7fd6a00cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.044+0000 7fd69ffff640 1 -- 172.21.15.47:0/1153493923 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a015f8d0 con 0x7fd6a00d1450 2024-04-14T23:34:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.044+0000 7fd69ffff640 1 --2- 172.21.15.47:0/1153493923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a00d1450 0x7fd6a00cbe70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd69000e960 tx=0x7fd69000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.044+0000 7fd69cff9640 1 -- 172.21.15.47:0/1153493923 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690017070 con 0x7fd6a00d1450 2024-04-14T23:34:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.044+0000 7fd69cff9640 1 -- 172.21.15.47:0/1153493923 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69000ca00 con 0x7fd6a00d1450 2024-04-14T23:34:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.044+0000 7fd6a6805640 1 -- 172.21.15.47:0/1153493923 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a015fbb0 con 0x7fd6a00d1450 2024-04-14T23:34:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.044+0000 7fd69cff9640 1 -- 172.21.15.47:0/1153493923 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69000cdd0 con 0x7fd6a00d1450 2024-04-14T23:34:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.044+0000 7fd6a6805640 1 -- 172.21.15.47:0/1153493923 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a00b7380 con 0x7fd6a00d1450 2024-04-14T23:34:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.045+0000 7fd6a6805640 1 -- 172.21.15.47:0/1153493923 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a0075430 con 0x7fd6a00d1450 2024-04-14T23:34:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.045+0000 7fd69cff9640 1 -- 172.21.15.47:0/1153493923 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd69001a070 con 0x7fd6a00d1450 2024-04-14T23:34:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.046+0000 7fd69cff9640 1 --2- 172.21.15.47:0/1153493923 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd68c06b990 0x7fd68c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.046+0000 7fd69cff9640 1 -- 172.21.15.47:0/1153493923 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd69008ae00 con 0x7fd6a00d1450 2024-04-14T23:34:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.046+0000 7fd69f7fe640 1 --2- 172.21.15.47:0/1153493923 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd68c06b990 0x7fd68c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:46.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.047+0000 7fd69f7fe640 1 --2- 172.21.15.47:0/1153493923 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd68c06b990 0x7fd68c06de50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00b32c0 tx=0x7fd694009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:46.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.050+0000 7fd69cff9640 1 -- 172.21.15.47:0/1153493923 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd6900596d0 con 0x7fd6a00d1450 2024-04-14T23:34:46.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.268+0000 7fd6a6805640 1 -- 172.21.15.47:0/1153493923 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd6a00008d0 con 0x7fd6a00d1450 2024-04-14T23:34:46.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.268+0000 7fd69cff9640 1 -- 172.21.15.47:0/1153493923 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7fd690058fd0 con 0x7fd6a00d1450 2024-04-14T23:34:46.272 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-14T23:34:46.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.270+0000 7fd6a6805640 1 -- 172.21.15.47:0/1153493923 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd68c06b990 msgr2=0x7fd68c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:46.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.270+0000 7fd6a6805640 1 --2- 172.21.15.47:0/1153493923 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd68c06b990 0x7fd68c06de50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00b32c0 tx=0x7fd694009040 comp rx=0 tx=0).stop 2024-04-14T23:34:46.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.270+0000 7fd6a6805640 1 -- 172.21.15.47:0/1153493923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a00d1450 msgr2=0x7fd6a00cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:46.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.271+0000 7fd6a6805640 1 --2- 172.21.15.47:0/1153493923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a00d1450 0x7fd6a00cbe70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd69000e960 tx=0x7fd69000ee20 comp rx=0 tx=0).stop 2024-04-14T23:34:46.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.271+0000 7fd6a6805640 1 -- 172.21.15.47:0/1153493923 shutdown_connections 2024-04-14T23:34:46.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.271+0000 7fd6a6805640 1 --2- 172.21.15.47:0/1153493923 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd68c06b990 0x7fd68c06de50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:46.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.271+0000 7fd6a6805640 1 --2- 172.21.15.47:0/1153493923 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6a015e270 0x7fd6a00cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:46.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.271+0000 7fd6a6805640 1 --2- 172.21.15.47:0/1153493923 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6a00d1e00 0x7fd6a00b9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:46.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.271+0000 7fd6a6805640 1 --2- 172.21.15.47:0/1153493923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6a00d1450 0x7fd6a00cbe70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:46.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.271+0000 7fd6a6805640 1 -- 172.21.15.47:0/1153493923 >> 172.21.15.47:0/1153493923 conn(0x7fd6a00d3ed0 msgr2=0x7fd6a00cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:46.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.271+0000 7fd6a6805640 1 -- 172.21.15.47:0/1153493923 shutdown_connections 2024-04-14T23:34:46.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46.271+0000 7fd6a6805640 1 -- 172.21.15.47:0/1153493923 wait complete. 2024-04-14T23:34:46.285 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-14T23:34:46.285 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-14T23:34:46.285 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-04-14T23:34:46.285 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-14T23:34:46.285 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-14T23:34:46.285 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-14T23:34:46.285 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-14T23:34:46.285 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-14T23:34:46.285 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-14T23:34:46.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:34:46.286 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-04-14T23:34:46.302 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T23:34:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T23:34:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T23:34:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:34:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-04-14T23:34:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:34:46.303 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:34:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:34:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-04-14T23:34:46.303 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:34:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:34:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-04-14T23:34:46.303 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-14T23:34:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-04-14T23:34:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-04-14T23:34:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-14T23:34:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42724sec preferred_lft 42724sec 2024-04-14T23:34:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-04-14T23:34:46.304 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:34:46.304 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:34:46.304 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-04-14T23:34:46.304 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-04-14T23:34:46.304 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-14T23:34:46.304 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:34:46.304 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-14T23:34:46.305 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-04-14T23:34:46.305 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-04-14T23:34:46.305 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-04-14T23:34:46.305 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-14T23:34:46.305 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-14T23:34:46.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:34:46.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:34:46.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:34:46.509 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-14T23:34:46.539 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-04-14T23:34:46.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:34:46.540 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-04-14T23:34:46.630 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-04-14T23:34:46.630 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-14T23:34:46.630 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-14T23:34:46.630 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-14T23:34:46.630 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-14T23:34:46.630 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:34:46.631 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-14T23:34:46.631 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-14T23:34:46.631 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-14T23:34:46.631 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-14T23:34:46.631 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-14T23:34:46.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:34:46.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:34:46.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:34:46.903 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-14T23:34:46.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:34:46.919 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-04-14T23:34:46.974 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:34:46.975 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-14T23:34:46.975 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-14T23:34:46.975 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-14T23:34:46.975 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-14T23:34:47.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:34:47.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:34:47.098 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-14T23:34:47.099 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:34:47.099 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-14T23:34:47.099 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-14T23:34:47.099 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-14T23:34:47.099 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-14T23:34:47.099 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-14T23:34:47.099 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-14T23:34:47.099 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-14T23:34:47.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:34:47.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:34:47.249 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:34:47.249 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-14T23:34:47.249 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-04-14T23:34:47.249 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-04-14T23:34:47.249 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-14T23:34:47.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:34:47.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:34:47.332 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-14T23:34:47.333 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T23:34:47.333 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-14T23:34:47.352 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-14T23:34:47.352 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T23:34:47.352 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-14T23:34:47.406 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-14T23:34:47.473 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-14T23:34:47.528 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-14T23:34:47.529 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-14T23:34:47.529 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-14T23:34:47.529 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-14T23:34:47.529 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-14T23:34:47.529 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-14T23:34:47.529 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-14T23:34:47.529 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-14T23:34:47.529 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-14T23:34:47.529 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-14T23:34:47.529 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-14T23:34:47.529 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-04-14T23:34:47.529 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-14T23:34:47.529 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-14T23:34:47.529 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-14T23:34:47.529 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-14T23:34:47.530 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-14T23:34:47.530 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-14T23:34:47.530 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-14T23:34:47.530 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-04-14T23:34:47.530 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-14T23:34:47.530 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-14T23:34:47.530 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-04-14T23:34:47.530 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-14T23:34:47.530 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-14T23:34:47.530 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-14T23:34:47.530 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-14T23:34:47.530 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-14T23:34:47.530 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-14T23:34:47.531 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-14T23:34:47.531 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-14T23:34:47.531 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-14T23:34:47.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:34:47.531 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-14T23:34:47.583 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-14T23:34:47.583 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-14T23:34:47.625 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-14T23:34:47.652 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-14T23:34:47.707 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-14T23:34:47.707 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-14T23:34:47.707 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-14T23:34:47.707 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-14T23:34:47.707 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-14T23:34:47.707 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-14T23:34:47.708 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-14T23:34:47.708 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-14T23:34:47.708 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-14T23:34:47.708 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-14T23:34:47.708 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-14T23:34:47.708 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-04-14T23:34:47.708 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-14T23:34:47.708 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-14T23:34:47.708 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-14T23:34:47.708 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-14T23:34:47.708 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-14T23:34:47.708 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-14T23:34:47.708 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-14T23:34:47.708 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-04-14T23:34:47.709 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-14T23:34:47.709 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-14T23:34:47.709 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-04-14T23:34:47.709 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-14T23:34:47.709 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-14T23:34:47.709 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-14T23:34:47.709 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-14T23:34:47.709 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-14T23:34:47.709 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-14T23:34:47.709 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-14T23:34:47.709 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-14T23:34:47.709 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-14T23:34:47.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:34:47.710 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-14T23:34:47.713 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi047.stderr:2024-04-14T23:34:47.710+0000 7f3078e3f480 -1 init, newargv = 0x55d45a7104e0 newargc=15 2024-04-14T23:34:47.713 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi047.stderr:ceph-fuse[44609]: starting ceph client 2024-04-14T23:34:47.719 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi047.stderr:ceph-fuse[44609]: starting fuse 2024-04-14T23:34:47.729 INFO:teuthology.orchestra.run.smithi047.stdout:41 2024-04-14T23:34:47.730 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-04-14T23:34:47.730 DEBUG:teuthology.orchestra.run.smithi047:> sudo stdin-killer -- python3 -c ' 2024-04-14T23:34:47.730 DEBUG:teuthology.orchestra.run.smithi047:> import glob 2024-04-14T23:34:47.730 DEBUG:teuthology.orchestra.run.smithi047:> import re 2024-04-14T23:34:47.730 DEBUG:teuthology.orchestra.run.smithi047:> import os 2024-04-14T23:34:47.730 DEBUG:teuthology.orchestra.run.smithi047:> import subprocess 2024-04-14T23:34:47.730 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-14T23:34:47.730 DEBUG:teuthology.orchestra.run.smithi047:> def _find_admin_socket(client_name): 2024-04-14T23:34:47.730 DEBUG:teuthology.orchestra.run.smithi047:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-14T23:34:47.730 DEBUG:teuthology.orchestra.run.smithi047:> files = glob.glob(asok_path) 2024-04-14T23:34:47.730 DEBUG:teuthology.orchestra.run.smithi047:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-14T23:34:47.731 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-14T23:34:47.731 DEBUG:teuthology.orchestra.run.smithi047:> # Given a non-glob path, it better be there 2024-04-14T23:34:47.731 DEBUG:teuthology.orchestra.run.smithi047:> if "*" not in asok_path: 2024-04-14T23:34:47.731 DEBUG:teuthology.orchestra.run.smithi047:> assert(len(files) == 1) 2024-04-14T23:34:47.731 DEBUG:teuthology.orchestra.run.smithi047:> return files[0] 2024-04-14T23:34:47.731 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-14T23:34:47.731 DEBUG:teuthology.orchestra.run.smithi047:> for f in files: 2024-04-14T23:34:47.731 DEBUG:teuthology.orchestra.run.smithi047:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-14T23:34:47.731 DEBUG:teuthology.orchestra.run.smithi047:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-14T23:34:47.731 DEBUG:teuthology.orchestra.run.smithi047:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-14T23:34:47.731 DEBUG:teuthology.orchestra.run.smithi047:> contents = proc_f.read() 2024-04-14T23:34:47.731 DEBUG:teuthology.orchestra.run.smithi047:> if mountpoint in contents: 2024-04-14T23:34:47.731 DEBUG:teuthology.orchestra.run.smithi047:> return f 2024-04-14T23:34:47.731 DEBUG:teuthology.orchestra.run.smithi047:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-14T23:34:47.731 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-14T23:34:47.731 DEBUG:teuthology.orchestra.run.smithi047:> print(_find_admin_socket("client.admin")) 2024-04-14T23:34:47.732 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-04-14T23:34:47.850 INFO:teuthology.orchestra.run.smithi047.stdout:/var/run/ceph/ceph-client.admin.44609.asok 2024-04-14T23:34:47.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:34:47.861 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44609.asok 2024-04-14T23:34:47.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:34:47.861 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44609.asok status 2024-04-14T23:34:47.999 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-14T23:34:47.999 INFO:teuthology.orchestra.run.smithi047.stdout: "metadata": { 2024-04-14T23:34:47.999 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_sha1": "a9a752df26c63acad72e1b3569fd79a515ca0765", 2024-04-14T23:34:48.000 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.0.0-2114-ga9a752df (a9a752df26c63acad72e1b3569fd79a515ca0765) squid (dev)", 2024-04-14T23:34:48.000 INFO:teuthology.orchestra.run.smithi047.stdout: "entity_id": "admin", 2024-04-14T23:34:48.000 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": "smithi047", 2024-04-14T23:34:48.000 INFO:teuthology.orchestra.run.smithi047.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-14T23:34:48.000 INFO:teuthology.orchestra.run.smithi047.stdout: "pid": "44609", 2024-04-14T23:34:48.000 INFO:teuthology.orchestra.run.smithi047.stdout: "root": "/" 2024-04-14T23:34:48.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:34:48.000 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_count": 0, 2024-04-14T23:34:48.000 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_pinned_count": 0, 2024-04-14T23:34:48.000 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4449, 2024-04-14T23:34:48.000 INFO:teuthology.orchestra.run.smithi047.stdout: "inst": { 2024-04-14T23:34:48.000 INFO:teuthology.orchestra.run.smithi047.stdout: "name": { 2024-04-14T23:34:48.000 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "client", 2024-04-14T23:34:48.001 INFO:teuthology.orchestra.run.smithi047.stdout: "num": 4449 2024-04-14T23:34:48.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:34:48.001 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-04-14T23:34:48.001 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-04-14T23:34:48.001 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-04-14T23:34:48.001 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 1999000994 2024-04-14T23:34:48.001 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:34:48.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:34:48.001 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-04-14T23:34:48.001 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-04-14T23:34:48.001 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-04-14T23:34:48.001 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 1999000994 2024-04-14T23:34:48.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:34:48.001 INFO:teuthology.orchestra.run.smithi047.stdout: "inst_str": "client.4449 192.168.0.1:0/1999000994", 2024-04-14T23:34:48.002 INFO:teuthology.orchestra.run.smithi047.stdout: "addr_str": "192.168.0.1:0/1999000994", 2024-04-14T23:34:48.002 INFO:teuthology.orchestra.run.smithi047.stdout: "inode_count": 1, 2024-04-14T23:34:48.002 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_epoch": 6, 2024-04-14T23:34:48.002 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch": 25, 2024-04-14T23:34:48.002 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch_barrier": 0, 2024-04-14T23:34:48.002 INFO:teuthology.orchestra.run.smithi047.stdout: "blocklisted": false, 2024-04-14T23:34:48.002 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs" 2024-04-14T23:34:48.002 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-14T23:34:48.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:34:48.008 DEBUG:teuthology.orchestra.run.smithi047:> stat --file-system '--printf=%T 2024-04-14T23:34:48.008 DEBUG:teuthology.orchestra.run.smithi047:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-14T23:34:48.022 INFO:teuthology.orchestra.run.smithi047.stdout:fuseblk 2024-04-14T23:34:48.023 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-14T23:34:48.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:34:48.023 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-14T23:34:48.090 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-14T23:34:48.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T23:34:48.192 INFO:teuthology.orchestra.run.smithi047.stdout:# file: . 2024-04-14T23:34:48.192 INFO:teuthology.orchestra.run.smithi047.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-14T23:34:48.192 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:48.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:34:48.198 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:34:48.198 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:34:48.213 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:34:48.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.353+0000 7f4f98e60640 1 Processor -- start 2024-04-14T23:34:48.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.353+0000 7f4f98e60640 1 -- start start 2024-04-14T23:34:48.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.354+0000 7f4f98e60640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4f9406ea80 0x7f4f940b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.354+0000 7f4f98e60640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f940ce410 0x7f4f940ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.354+0000 7f4f98e60640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f9406d970 con 0x7f4f94144a80 2024-04-14T23:34:48.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.354+0000 7f4f98e60640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4f9406d720 con 0x7f4f9406ea80 2024-04-14T23:34:48.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.354+0000 7f4f98e60640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4f9406eed0 con 0x7f4f940ce410 2024-04-14T23:34:48.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.354+0000 7f4f8bfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4f9406ea80 0x7f4f940b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:48.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.354+0000 7f4f9259c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4f94144a80 0x7f4f940b2a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41842/0 (socket says 172.21.15.47:41842) 2024-04-14T23:34:48.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.354+0000 7f4f9259c640 1 -- 172.21.15.47:0/1269729350 learned_addr learned my addr 172.21.15.47:0/1269729350 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:48.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.354+0000 7f4f8bfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4f9406ea80 0x7f4f940b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58972/0 (socket says 172.21.15.47:58972) 2024-04-14T23:34:48.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.354+0000 7f4f92d9d640 1 --2- 172.21.15.47:0/1269729350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f940ce410 0x7f4f940ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:48.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.354+0000 7f4f8bfff640 1 -- 172.21.15.47:0/1269729350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f940ce410 msgr2=0x7f4f940ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:48.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.354+0000 7f4f8bfff640 1 --2- 172.21.15.47:0/1269729350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f940ce410 0x7f4f940ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.354+0000 7f4f8bfff640 1 -- 172.21.15.47:0/1269729350 >> v1:172.21.15.47:6789/0 conn(0x7f4f94144a80 legacy=0x7f4f940b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:48.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.354+0000 7f4f8bfff640 1 -- 172.21.15.47:0/1269729350 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9406dc50 con 0x7f4f9406ea80 2024-04-14T23:34:48.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.354+0000 7f4f91d9b640 1 -- 172.21.15.47:0/1269729350 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2366751231 0 0) 0x7f4f9406d970 con 0x7f4f94144a80 2024-04-14T23:34:48.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.355+0000 7f4f8bfff640 1 --2- 172.21.15.47:0/1269729350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f9406ea80 0x7f4f940b3180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0097a0 tx=0x7f4f7c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0da7649e9b1d895 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:48.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.355+0000 7f4f91d9b640 1 -- 172.21.15.47:0/1269729350 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c035020 con 0x7f4f9406ea80 2024-04-14T23:34:48.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.355+0000 7f4f91d9b640 1 -- 172.21.15.47:0/1269729350 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f7c031830 con 0x7f4f9406ea80 2024-04-14T23:34:48.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.355+0000 7f4f91d9b640 1 -- 172.21.15.47:0/1269729350 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c031c00 con 0x7f4f9406ea80 2024-04-14T23:34:48.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.356+0000 7f4f98e60640 1 -- 172.21.15.47:0/1269729350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f9406ea80 msgr2=0x7f4f940b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:48.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.356+0000 7f4f98e60640 1 --2- 172.21.15.47:0/1269729350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f9406ea80 0x7f4f940b3180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0097a0 tx=0x7f4f7c02b8d0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.356+0000 7f4f98e60640 1 -- 172.21.15.47:0/1269729350 shutdown_connections 2024-04-14T23:34:48.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.356+0000 7f4f98e60640 1 --2- 172.21.15.47:0/1269729350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f940ce410 0x7f4f940ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.356+0000 7f4f98e60640 1 --2- 172.21.15.47:0/1269729350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f9406ea80 0x7f4f940b3180 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.356+0000 7f4f98e60640 1 -- 172.21.15.47:0/1269729350 >> 172.21.15.47:0/1269729350 conn(0x7f4f9406b200 msgr2=0x7f4f9406b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:48.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.356+0000 7f4f98e60640 1 -- 172.21.15.47:0/1269729350 shutdown_connections 2024-04-14T23:34:48.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.356+0000 7f4f98e60640 1 -- 172.21.15.47:0/1269729350 wait complete. 2024-04-14T23:34:48.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.357+0000 7f4f98e60640 1 Processor -- start 2024-04-14T23:34:48.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.357+0000 7f4f98e60640 1 -- start start 2024-04-14T23:34:48.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f98e60640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f9406ea80 0x7f4f940727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f98e60640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f940ce410 0x7f4f9415a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f98e60640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f94144a80 0x7f4f9415e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f98e60640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4f94144e60 con 0x7f4f9406ea80 2024-04-14T23:34:48.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f98e60640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9406e210 con 0x7f4f940ce410 2024-04-14T23:34:48.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f98e60640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4f940b36c0 con 0x7f4f94144a80 2024-04-14T23:34:48.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f9259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f9406ea80 0x7f4f940727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:48.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f9259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f9406ea80 0x7f4f940727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58988/0 (socket says 172.21.15.47:58988) 2024-04-14T23:34:48.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f9259c640 1 -- 172.21.15.47:0/2305556019 learned_addr learned my addr 172.21.15.47:0/2305556019 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:48.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f9259c640 1 -- 172.21.15.47:0/2305556019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f94144a80 msgr2=0x7f4f9415e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:48.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f9259c640 1 --2- 172.21.15.47:0/2305556019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f94144a80 0x7f4f9415e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f9259c640 1 -- 172.21.15.47:0/2305556019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f940ce410 msgr2=0x7f4f9415a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:48.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f9259c640 1 --2- 172.21.15.47:0/2305556019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f940ce410 0x7f4f9415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f9259c640 1 -- 172.21.15.47:0/2305556019 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9415a9a0 con 0x7f4f9406ea80 2024-04-14T23:34:48.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f9259c640 1 --2- 172.21.15.47:0/2305556019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f9406ea80 0x7f4f940727b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400c430 tx=0x7f4f8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:48.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f8affd640 1 -- 172.21.15.47:0/2305556019 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f840074e0 con 0x7f4f9406ea80 2024-04-14T23:34:48.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f8affd640 1 -- 172.21.15.47:0/2305556019 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f840047e0 con 0x7f4f9406ea80 2024-04-14T23:34:48.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f8affd640 1 -- 172.21.15.47:0/2305556019 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f84004bd0 con 0x7f4f9406ea80 2024-04-14T23:34:48.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f98e60640 1 -- 172.21.15.47:0/2305556019 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9415d710 con 0x7f4f9406ea80 2024-04-14T23:34:48.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.358+0000 7f4f98e60640 1 -- 172.21.15.47:0/2305556019 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f9415dcd0 con 0x7f4f9406ea80 2024-04-14T23:34:48.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.359+0000 7f4f98e60640 1 -- 172.21.15.47:0/2305556019 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f94075430 con 0x7f4f9406ea80 2024-04-14T23:34:48.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.360+0000 7f4f8affd640 1 -- 172.21.15.47:0/2305556019 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4f84011070 con 0x7f4f9406ea80 2024-04-14T23:34:48.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.360+0000 7f4f8affd640 1 --2- 172.21.15.47:0/2305556019 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4f7406b990 0x7f4f7406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.360+0000 7f4f8affd640 1 -- 172.21.15.47:0/2305556019 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4f8408a7f0 con 0x7f4f9406ea80 2024-04-14T23:34:48.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.360+0000 7f4f8bfff640 1 --2- 172.21.15.47:0/2305556019 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4f7406b990 0x7f4f7406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:48.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.361+0000 7f4f8bfff640 1 --2- 172.21.15.47:0/2305556019 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4f7406b990 0x7f4f7406de50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c036000 tx=0x7f4f7c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:48.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.365+0000 7f4f8affd640 1 -- 172.21.15.47:0/2305556019 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4f9415a9a0 con 0x7f4f9406ea80 2024-04-14T23:34:48.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.545+0000 7f4f98e60640 1 -- 172.21.15.47:0/2305556019 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f940b46d0 con 0x7f4f9406ea80 2024-04-14T23:34:48.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.546+0000 7f4f8affd640 1 -- 172.21.15.47:0/2305556019 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7f4f8400e280 con 0x7f4f9406ea80 2024-04-14T23:34:48.550 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:48.550 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:44.714882+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:34:48.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.548+0000 7f4f98e60640 1 -- 172.21.15.47:0/2305556019 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4f7406b990 msgr2=0x7f4f7406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:48.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.548+0000 7f4f98e60640 1 --2- 172.21.15.47:0/2305556019 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4f7406b990 0x7f4f7406de50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c036000 tx=0x7f4f7c030000 comp rx=0 tx=0).stop 2024-04-14T23:34:48.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.548+0000 7f4f98e60640 1 -- 172.21.15.47:0/2305556019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f9406ea80 msgr2=0x7f4f940727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:48.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.548+0000 7f4f98e60640 1 --2- 172.21.15.47:0/2305556019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f9406ea80 0x7f4f940727b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400c430 tx=0x7f4f8400c8f0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.548+0000 7f4f98e60640 1 -- 172.21.15.47:0/2305556019 shutdown_connections 2024-04-14T23:34:48.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.548+0000 7f4f98e60640 1 --2- 172.21.15.47:0/2305556019 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4f7406b990 0x7f4f7406de50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.548+0000 7f4f98e60640 1 --2- 172.21.15.47:0/2305556019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f94144a80 0x7f4f9415e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.548+0000 7f4f98e60640 1 --2- 172.21.15.47:0/2305556019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f940ce410 0x7f4f9415a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.548+0000 7f4f98e60640 1 --2- 172.21.15.47:0/2305556019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f9406ea80 0x7f4f940727b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.548+0000 7f4f98e60640 1 -- 172.21.15.47:0/2305556019 >> 172.21.15.47:0/2305556019 conn(0x7f4f9406b200 msgr2=0x7f4f940cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:48.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.548+0000 7f4f98e60640 1 -- 172.21.15.47:0/2305556019 shutdown_connections 2024-04-14T23:34:48.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.548+0000 7f4f98e60640 1 -- 172.21.15.47:0/2305556019 wait complete. 2024-04-14T23:34:48.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T23:34:36.382034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T23:34:37.023103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T23:34:40.726418+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T23:34:48.563 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:34:48.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.663+0000 7fc30c715640 1 Processor -- start 2024-04-14T23:34:48.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.663+0000 7fc30c715640 1 -- start start 2024-04-14T23:34:48.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.664+0000 7fc30c715640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc3040b4e30 0x7fc3040cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.664+0000 7fc30c715640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc3040cf760 0x7fc3040c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.664+0000 7fc30c715640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3040b5590 con 0x7fc304161870 2024-04-14T23:34:48.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.664+0000 7fc30c715640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc3040cff40 con 0x7fc3040b4e30 2024-04-14T23:34:48.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.664+0000 7fc30c715640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fc3040b52b0 con 0x7fc3040cf760 2024-04-14T23:34:48.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.664+0000 7fc309cb0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc3040b4e30 0x7fc3040cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:48.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.664+0000 7fc30a4b1640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc304161870 0x7fc3040ceb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41844/0 (socket says 172.21.15.47:41844) 2024-04-14T23:34:48.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.664+0000 7fc309cb0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc3040b4e30 0x7fc3040cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58998/0 (socket says 172.21.15.47:58998) 2024-04-14T23:34:48.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.664+0000 7fc30a4b1640 1 -- 172.21.15.47:0/3986514700 learned_addr learned my addr 172.21.15.47:0/3986514700 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:48.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.665+0000 7fc30acb2640 1 --2- 172.21.15.47:0/3986514700 >> v2:172.21.15.191:3300/0 conn(0x7fc3040cf760 0x7fc3040c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:48.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.665+0000 7fc309cb0640 1 -- 172.21.15.47:0/3986514700 >> v2:172.21.15.191:3300/0 conn(0x7fc3040cf760 msgr2=0x7fc3040c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:48.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.665+0000 7fc309cb0640 1 --2- 172.21.15.47:0/3986514700 >> v2:172.21.15.191:3300/0 conn(0x7fc3040cf760 0x7fc3040c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.665+0000 7fc309cb0640 1 -- 172.21.15.47:0/3986514700 >> v1:172.21.15.47:6789/0 conn(0x7fc304161870 legacy=0x7fc3040ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:48.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.665+0000 7fc309cb0640 1 -- 172.21.15.47:0/3986514700 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3040d2680 con 0x7fc3040b4e30 2024-04-14T23:34:48.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.665+0000 7fc309cb0640 1 --2- 172.21.15.47:0/3986514700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3040b4e30 0x7fc3040cf220 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc3040b5860 tx=0x7fc2f802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a18ceb6dd2550f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:48.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.665+0000 7fc3094af640 1 -- 172.21.15.47:0/3986514700 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f80315a0 con 0x7fc3040b4e30 2024-04-14T23:34:48.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.666+0000 7fc3094af640 1 -- 172.21.15.47:0/3986514700 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f8037070 con 0x7fc3040b4e30 2024-04-14T23:34:48.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.666+0000 7fc3094af640 1 -- 172.21.15.47:0/3986514700 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8031960 con 0x7fc3040b4e30 2024-04-14T23:34:48.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.666+0000 7fc30c715640 1 -- 172.21.15.47:0/3986514700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3040b4e30 msgr2=0x7fc3040cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:48.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.666+0000 7fc30c715640 1 --2- 172.21.15.47:0/3986514700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3040b4e30 0x7fc3040cf220 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc3040b5860 tx=0x7fc2f802b840 comp rx=0 tx=0).stop 2024-04-14T23:34:48.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.666+0000 7fc30c715640 1 -- 172.21.15.47:0/3986514700 shutdown_connections 2024-04-14T23:34:48.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.666+0000 7fc30c715640 1 --2- 172.21.15.47:0/3986514700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3040b4e30 0x7fc3040cf220 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.666+0000 7fc30c715640 1 --2- 172.21.15.47:0/3986514700 >> v2:172.21.15.191:3300/0 conn(0x7fc3040cf760 0x7fc3040c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.666+0000 7fc30c715640 1 -- 172.21.15.47:0/3986514700 >> 172.21.15.47:0/3986514700 conn(0x7fc3040d3f70 msgr2=0x7fc3040d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:48.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.666+0000 7fc30c715640 1 -- 172.21.15.47:0/3986514700 shutdown_connections 2024-04-14T23:34:48.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.666+0000 7fc30c715640 1 -- 172.21.15.47:0/3986514700 wait complete. 2024-04-14T23:34:48.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.667+0000 7fc30c715640 1 Processor -- start 2024-04-14T23:34:48.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.667+0000 7fc30c715640 1 -- start start 2024-04-14T23:34:48.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc30c715640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3040b4e30 0x7fc3041542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc30c715640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3040cf760 0x7fc3040cd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc30c715640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc304161870 0x7fc3040c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc30c715640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc3040d18e0 con 0x7fc3040b4e30 2024-04-14T23:34:48.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc30c715640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc3040d2c40 con 0x7fc3040cf760 2024-04-14T23:34:48.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc30c715640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc304161c50 con 0x7fc304161870 2024-04-14T23:34:48.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc30a4b1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3040b4e30 0x7fc3041542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:48.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc30a4b1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3040b4e30 0x7fc3041542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59000/0 (socket says 172.21.15.47:59000) 2024-04-14T23:34:48.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc30a4b1640 1 -- 172.21.15.47:0/36674059 learned_addr learned my addr 172.21.15.47:0/36674059 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:48.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc30a4b1640 1 -- 172.21.15.47:0/36674059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc304161870 msgr2=0x7fc3040c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:48.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc309cb0640 1 --2- 172.21.15.47:0/36674059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3040cf760 0x7fc3040cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:48.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc30acb2640 1 --2- 172.21.15.47:0/36674059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc304161870 0x7fc3040c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:48.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc30a4b1640 1 --2- 172.21.15.47:0/36674059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc304161870 0x7fc3040c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc30a4b1640 1 -- 172.21.15.47:0/36674059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3040cf760 msgr2=0x7fc3040cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:48.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc30a4b1640 1 --2- 172.21.15.47:0/36674059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3040cf760 0x7fc3040cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc30a4b1640 1 -- 172.21.15.47:0/36674059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3040cdaf0 con 0x7fc3040b4e30 2024-04-14T23:34:48.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc309cb0640 1 --2- 172.21.15.47:0/36674059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3040cf760 0x7fc3040cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:48.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.668+0000 7fc30acb2640 1 --2- 172.21.15.47:0/36674059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc304161870 0x7fc3040c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:48.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.669+0000 7fc30a4b1640 1 --2- 172.21.15.47:0/36674059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3040b4e30 0x7fc3041542e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400cb40 tx=0x7fc2f400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:48.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.669+0000 7fc302ffd640 1 -- 172.21.15.47:0/36674059 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4017070 con 0x7fc3040b4e30 2024-04-14T23:34:48.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.669+0000 7fc302ffd640 1 -- 172.21.15.47:0/36674059 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f400aca0 con 0x7fc3040b4e30 2024-04-14T23:34:48.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.669+0000 7fc30c715640 1 -- 172.21.15.47:0/36674059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3040cb0e0 con 0x7fc3040b4e30 2024-04-14T23:34:48.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.669+0000 7fc302ffd640 1 -- 172.21.15.47:0/36674059 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4012620 con 0x7fc3040b4e30 2024-04-14T23:34:48.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.669+0000 7fc30c715640 1 -- 172.21.15.47:0/36674059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3040cb6a0 con 0x7fc3040b4e30 2024-04-14T23:34:48.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.670+0000 7fc30c715640 1 -- 172.21.15.47:0/36674059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc304073f50 con 0x7fc3040b4e30 2024-04-14T23:34:48.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.670+0000 7fc302ffd640 1 -- 172.21.15.47:0/36674059 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc2f401a070 con 0x7fc3040b4e30 2024-04-14T23:34:48.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.670+0000 7fc302ffd640 1 --2- 172.21.15.47:0/36674059 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc2f006b990 0x7fc2f006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.671+0000 7fc302ffd640 1 -- 172.21.15.47:0/36674059 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc2f408a960 con 0x7fc3040b4e30 2024-04-14T23:34:48.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.671+0000 7fc309cb0640 1 --2- 172.21.15.47:0/36674059 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc2f006b990 0x7fc2f006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:48.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.671+0000 7fc309cb0640 1 --2- 172.21.15.47:0/36674059 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc2f006b990 0x7fc2f006de50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8036000 tx=0x7fc2f8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:48.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.675+0000 7fc302ffd640 1 -- 172.21.15.47:0/36674059 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc2f4059230 con 0x7fc3040b4e30 2024-04-14T23:34:48.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.856+0000 7fc30c715640 1 -- 172.21.15.47:0/36674059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc30415fe60 con 0x7fc3040b4e30 2024-04-14T23:34:48.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.856+0000 7fc302ffd640 1 -- 172.21.15.47:0/36674059 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fc2f4058b30 con 0x7fc3040b4e30 2024-04-14T23:34:48.859 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:34:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.858+0000 7fc30c715640 1 -- 172.21.15.47:0/36674059 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc2f006b990 msgr2=0x7fc2f006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.858+0000 7fc30c715640 1 --2- 172.21.15.47:0/36674059 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc2f006b990 0x7fc2f006de50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8036000 tx=0x7fc2f8008030 comp rx=0 tx=0).stop 2024-04-14T23:34:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.858+0000 7fc30c715640 1 -- 172.21.15.47:0/36674059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3040b4e30 msgr2=0x7fc3041542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.858+0000 7fc30c715640 1 --2- 172.21.15.47:0/36674059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3040b4e30 0x7fc3041542e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400cb40 tx=0x7fc2f400a060 comp rx=0 tx=0).stop 2024-04-14T23:34:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.858+0000 7fc30c715640 1 -- 172.21.15.47:0/36674059 shutdown_connections 2024-04-14T23:34:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.858+0000 7fc30c715640 1 --2- 172.21.15.47:0/36674059 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc2f006b990 0x7fc2f006de50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.858+0000 7fc30c715640 1 --2- 172.21.15.47:0/36674059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc304161870 0x7fc3040c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.858+0000 7fc30c715640 1 --2- 172.21.15.47:0/36674059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3040cf760 0x7fc3040cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.858+0000 7fc30c715640 1 --2- 172.21.15.47:0/36674059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3040b4e30 0x7fc3041542e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.858+0000 7fc30c715640 1 -- 172.21.15.47:0/36674059 >> 172.21.15.47:0/36674059 conn(0x7fc3040d3f70 msgr2=0x7fc30406cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:48.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.858+0000 7fc30c715640 1 -- 172.21.15.47:0/36674059 shutdown_connections 2024-04-14T23:34:48.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.858+0000 7fc30c715640 1 -- 172.21.15.47:0/36674059 wait complete. 2024-04-14T23:34:48.871 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T23:34:48.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.972+0000 7fb2cbe36640 1 Processor -- start 2024-04-14T23:34:48.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.972+0000 7fb2cbe36640 1 -- start start 2024-04-14T23:34:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.973+0000 7fb2cbe36640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb2c40b53c0 0x7fb2c40cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.973+0000 7fb2cbe36640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2c40cfb30 0x7fb2c40d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.973+0000 7fb2cbe36640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c40d2fa0 con 0x7fb2c40d2b10 2024-04-14T23:34:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.973+0000 7fb2cbe36640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb2c40b6e40 con 0x7fb2c40b53c0 2024-04-14T23:34:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.973+0000 7fb2cbe36640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb2c40b7090 con 0x7fb2c40cfb30 2024-04-14T23:34:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.973+0000 7fb2c9bd2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb2c40b53c0 0x7fb2c40cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.973+0000 7fb2c9bd2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb2c40b53c0 0x7fb2c40cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59016/0 (socket says 172.21.15.47:59016) 2024-04-14T23:34:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.973+0000 7fb2c9bd2640 1 -- 172.21.15.47:0/2765111646 learned_addr learned my addr 172.21.15.47:0/2765111646 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.973+0000 7fb2c93d1640 1 --2- 172.21.15.47:0/2765111646 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2c40cfb30 0x7fb2c40d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.974+0000 7fb2c9bd2640 1 -- 172.21.15.47:0/2765111646 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2c40cfb30 msgr2=0x7fb2c40d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.974+0000 7fb2c9bd2640 1 --2- 172.21.15.47:0/2765111646 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2c40cfb30 0x7fb2c40d25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.974+0000 7fb2c9bd2640 1 -- 172.21.15.47:0/2765111646 >> v1:172.21.15.191:6789/0 conn(0x7fb2c40d2b10 legacy=0x7fb2c40d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:48.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.974+0000 7fb2c9bd2640 1 -- 172.21.15.47:0/2765111646 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c40b7370 con 0x7fb2c40b53c0 2024-04-14T23:34:48.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.974+0000 7fb2c9bd2640 1 --2- 172.21.15.47:0/2765111646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c40b53c0 0x7fb2c40cf5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009870 tx=0x7fb2bc02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a0697f545c2f46 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:48.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.974+0000 7fb2c8bd0640 1 -- 172.21.15.47:0/2765111646 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc02f840 con 0x7fb2c40b53c0 2024-04-14T23:34:48.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.975+0000 7fb2c8bd0640 1 -- 172.21.15.47:0/2765111646 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2bc02f9e0 con 0x7fb2c40b53c0 2024-04-14T23:34:48.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.975+0000 7fb2c8bd0640 1 -- 172.21.15.47:0/2765111646 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc02fdb0 con 0x7fb2c40b53c0 2024-04-14T23:34:48.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.975+0000 7fb2cbe36640 1 -- 172.21.15.47:0/2765111646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c40b53c0 msgr2=0x7fb2c40cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:48.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.975+0000 7fb2cbe36640 1 --2- 172.21.15.47:0/2765111646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c40b53c0 0x7fb2c40cf5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009870 tx=0x7fb2bc02ba20 comp rx=0 tx=0).stop 2024-04-14T23:34:48.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.975+0000 7fb2cbe36640 1 -- 172.21.15.47:0/2765111646 shutdown_connections 2024-04-14T23:34:48.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.975+0000 7fb2cbe36640 1 --2- 172.21.15.47:0/2765111646 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2c40cfb30 0x7fb2c40d25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.975+0000 7fb2cbe36640 1 --2- 172.21.15.47:0/2765111646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c40b53c0 0x7fb2c40cf5f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.975+0000 7fb2cbe36640 1 -- 172.21.15.47:0/2765111646 >> 172.21.15.47:0/2765111646 conn(0x7fb2c409d2c0 msgr2=0x7fb2c40d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:48.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.975+0000 7fb2cbe36640 1 -- 172.21.15.47:0/2765111646 shutdown_connections 2024-04-14T23:34:48.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.975+0000 7fb2cbe36640 1 -- 172.21.15.47:0/2765111646 wait complete. 2024-04-14T23:34:48.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.976+0000 7fb2cbe36640 1 Processor -- start 2024-04-14T23:34:48.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.976+0000 7fb2cbe36640 1 -- start start 2024-04-14T23:34:48.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2cbe36640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c40b53c0 0x7fb2c415bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2cbe36640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2c40cfb30 0x7fb2c40b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2cbe36640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2c40d2b10 0x7fb2c40d3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2cbe36640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c40b57a0 con 0x7fb2c40b53c0 2024-04-14T23:34:48.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2cbe36640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c40b7930 con 0x7fb2c40d2b10 2024-04-14T23:34:48.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2cbe36640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb2c40b5920 con 0x7fb2c40cfb30 2024-04-14T23:34:48.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2c9bd2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c40b53c0 0x7fb2c415bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:48.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2c9bd2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c40b53c0 0x7fb2c415bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59028/0 (socket says 172.21.15.47:59028) 2024-04-14T23:34:48.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2c9bd2640 1 -- 172.21.15.47:0/3966378305 learned_addr learned my addr 172.21.15.47:0/3966378305 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:48.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2c93d1640 1 --2- 172.21.15.47:0/3966378305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2c40cfb30 0x7fb2c40b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:48.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2ca3d3640 1 --2- 172.21.15.47:0/3966378305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2c40d2b10 0x7fb2c40d3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:48.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2c9bd2640 1 -- 172.21.15.47:0/3966378305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2c40cfb30 msgr2=0x7fb2c40b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:48.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2c9bd2640 1 --2- 172.21.15.47:0/3966378305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2c40cfb30 0x7fb2c40b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2c9bd2640 1 -- 172.21.15.47:0/3966378305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2c40d2b10 msgr2=0x7fb2c40d3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:48.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2c9bd2640 1 --2- 172.21.15.47:0/3966378305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2c40d2b10 0x7fb2c40d3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:48.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2c9bd2640 1 -- 172.21.15.47:0/3966378305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c415c570 con 0x7fb2c40b53c0 2024-04-14T23:34:48.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2c93d1640 1 --2- 172.21.15.47:0/3966378305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2c40cfb30 0x7fb2c40b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:48.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.977+0000 7fb2ca3d3640 1 --2- 172.21.15.47:0/3966378305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2c40d2b10 0x7fb2c40d3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:48.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.978+0000 7fb2c9bd2640 1 --2- 172.21.15.47:0/3966378305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c40b53c0 0x7fb2c415bcb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc000c00 tx=0x7fb2bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:48.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.978+0000 7fb2c27fc640 1 -- 172.21.15.47:0/3966378305 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc037c90 con 0x7fb2c40b53c0 2024-04-14T23:34:48.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.978+0000 7fb2c27fc640 1 -- 172.21.15.47:0/3966378305 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2bc046070 con 0x7fb2c40b53c0 2024-04-14T23:34:48.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.978+0000 7fb2c27fc640 1 -- 172.21.15.47:0/3966378305 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc041640 con 0x7fb2c40b53c0 2024-04-14T23:34:48.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.978+0000 7fb2cbe36640 1 -- 172.21.15.47:0/3966378305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c415c850 con 0x7fb2c40b53c0 2024-04-14T23:34:48.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.978+0000 7fb2cbe36640 1 -- 172.21.15.47:0/3966378305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c415c1f0 con 0x7fb2c40b53c0 2024-04-14T23:34:48.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.979+0000 7fb2cbe36640 1 -- 172.21.15.47:0/3966378305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c4073f50 con 0x7fb2c40b53c0 2024-04-14T23:34:48.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.979+0000 7fb2c27fc640 1 -- 172.21.15.47:0/3966378305 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb2bc040070 con 0x7fb2c40b53c0 2024-04-14T23:34:48.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.979+0000 7fb2c27fc640 1 --2- 172.21.15.47:0/3966378305 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb2b006b990 0x7fb2b006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:48.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.980+0000 7fb2c27fc640 1 -- 172.21.15.47:0/3966378305 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb2bc0ad250 con 0x7fb2c40b53c0 2024-04-14T23:34:48.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.980+0000 7fb2c93d1640 1 --2- 172.21.15.47:0/3966378305 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb2b006b990 0x7fb2b006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:48.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.980+0000 7fb2c93d1640 1 --2- 172.21.15.47:0/3966378305 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb2b006b990 0x7fb2b006de50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb2c40ca9b0 tx=0x7fb2b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:48.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:48.984+0000 7fb2c27fc640 1 -- 172.21.15.47:0/3966378305 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb2bc033030 con 0x7fb2c40b53c0 2024-04-14T23:34:49.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.164+0000 7fb2cbe36640 1 -- 172.21.15.47:0/3966378305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb2c40c7aa0 con 0x7fb2c40b53c0 2024-04-14T23:34:49.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.164+0000 7fb2c27fc640 1 -- 172.21.15.47:0/3966378305 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fb2bc07bbb0 con 0x7fb2c40b53c0 2024-04-14T23:34:49.167 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:34:49.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.166+0000 7fb2cbe36640 1 -- 172.21.15.47:0/3966378305 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb2b006b990 msgr2=0x7fb2b006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.166+0000 7fb2cbe36640 1 --2- 172.21.15.47:0/3966378305 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb2b006b990 0x7fb2b006de50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb2c40ca9b0 tx=0x7fb2b8008040 comp rx=0 tx=0).stop 2024-04-14T23:34:49.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.166+0000 7fb2cbe36640 1 -- 172.21.15.47:0/3966378305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c40b53c0 msgr2=0x7fb2c415bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.166+0000 7fb2cbe36640 1 --2- 172.21.15.47:0/3966378305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c40b53c0 0x7fb2c415bcb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc000c00 tx=0x7fb2bc004730 comp rx=0 tx=0).stop 2024-04-14T23:34:49.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.166+0000 7fb2cbe36640 1 -- 172.21.15.47:0/3966378305 shutdown_connections 2024-04-14T23:34:49.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.166+0000 7fb2cbe36640 1 --2- 172.21.15.47:0/3966378305 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb2b006b990 0x7fb2b006de50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.166+0000 7fb2cbe36640 1 --2- 172.21.15.47:0/3966378305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2c40d2b10 0x7fb2c40d3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.166+0000 7fb2cbe36640 1 --2- 172.21.15.47:0/3966378305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2c40cfb30 0x7fb2c40b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.166+0000 7fb2cbe36640 1 --2- 172.21.15.47:0/3966378305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2c40b53c0 0x7fb2c415bcb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.166+0000 7fb2cbe36640 1 -- 172.21.15.47:0/3966378305 >> 172.21.15.47:0/3966378305 conn(0x7fb2c409d2c0 msgr2=0x7fb2c40cd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:49.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.166+0000 7fb2cbe36640 1 -- 172.21.15.47:0/3966378305 shutdown_connections 2024-04-14T23:34:49.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.166+0000 7fb2cbe36640 1 -- 172.21.15.47:0/3966378305 wait complete. 2024-04-14T23:34:49.180 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T23:34:49.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.281+0000 7f356dc6d640 1 Processor -- start 2024-04-14T23:34:49.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.281+0000 7f356dc6d640 1 -- start start 2024-04-14T23:34:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.282+0000 7f356dc6d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f35680d2b80 0x7f35680d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.282+0000 7f356dc6d640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35680b6e10 con 0x7f35680b4f70 2024-04-14T23:34:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.282+0000 7f356dc6d640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35680cf790 con 0x7f3568161a70 2024-04-14T23:34:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.282+0000 7f356dc6d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f35680cf540 con 0x7f35680d2b80 2024-04-14T23:34:49.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.282+0000 7f3566ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f35680d2b80 0x7f35680d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.282+0000 7f3567fff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f35680b4f70 0x7f35680b75a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41860/0 (socket says 172.21.15.47:41860) 2024-04-14T23:34:49.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.282+0000 7f3567fff640 1 -- 172.21.15.47:0/3142683782 learned_addr learned my addr 172.21.15.47:0/3142683782 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:49.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.282+0000 7f3566ffd640 1 -- 172.21.15.47:0/3142683782 >> v1:172.21.15.191:6789/0 conn(0x7f3568161a70 legacy=0x7f35680d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:49.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.282+0000 7f3566ffd640 1 -- 172.21.15.47:0/3142683782 >> v1:172.21.15.47:6789/0 conn(0x7f35680b4f70 legacy=0x7f35680b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.282+0000 7f3566ffd640 1 -- 172.21.15.47:0/3142683782 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35680cfa70 con 0x7f35680d2b80 2024-04-14T23:34:49.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.282+0000 7f35667fc640 1 -- 172.21.15.47:0/3142683782 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1366282947 0 0) 0x7f35680b6e10 con 0x7f35680b4f70 2024-04-14T23:34:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.283+0000 7f3566ffd640 1 --2- 172.21.15.47:0/3142683782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35680d2b80 0x7f35680d1c70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f355c0097a0 tx=0x7f355c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f972e31ae57048d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.283+0000 7f35667fc640 1 -- 172.21.15.47:0/3142683782 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c0315a0 con 0x7f35680d2b80 2024-04-14T23:34:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.283+0000 7f35667fc640 1 -- 172.21.15.47:0/3142683782 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f355c037070 con 0x7f35680d2b80 2024-04-14T23:34:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.283+0000 7f35667fc640 1 -- 172.21.15.47:0/3142683782 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c031960 con 0x7f35680d2b80 2024-04-14T23:34:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.284+0000 7f356dc6d640 1 -- 172.21.15.47:0/3142683782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35680d2b80 msgr2=0x7f35680d1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.284+0000 7f356dc6d640 1 --2- 172.21.15.47:0/3142683782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35680d2b80 0x7f35680d1c70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f355c0097a0 tx=0x7f355c02b840 comp rx=0 tx=0).stop 2024-04-14T23:34:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.284+0000 7f356dc6d640 1 -- 172.21.15.47:0/3142683782 shutdown_connections 2024-04-14T23:34:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.284+0000 7f356dc6d640 1 --2- 172.21.15.47:0/3142683782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35680d2b80 0x7f35680d1c70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.284+0000 7f356dc6d640 1 -- 172.21.15.47:0/3142683782 >> 172.21.15.47:0/3142683782 conn(0x7f35680d3f20 msgr2=0x7f35680d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.284+0000 7f356dc6d640 1 -- 172.21.15.47:0/3142683782 shutdown_connections 2024-04-14T23:34:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.284+0000 7f356dc6d640 1 -- 172.21.15.47:0/3142683782 wait complete. 2024-04-14T23:34:49.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.285+0000 7f356dc6d640 1 Processor -- start 2024-04-14T23:34:49.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.285+0000 7f356dc6d640 1 -- start start 2024-04-14T23:34:49.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f356dc6d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35680b4f70 0x7f356806d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f356dc6d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35680d2b80 0x7f35681f7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f356dc6d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3568161a70 0x7f356814fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f356dc6d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3568161e50 con 0x7f3568161a70 2024-04-14T23:34:49.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f356dc6d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f35680b7110 con 0x7f35680d2b80 2024-04-14T23:34:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f356dc6d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f35680b7cb0 con 0x7f35680b4f70 2024-04-14T23:34:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f3567fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3568161a70 0x7f356814fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f3567fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3568161a70 0x7f356814fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59054/0 (socket says 172.21.15.47:59054) 2024-04-14T23:34:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f3567fff640 1 -- 172.21.15.47:0/3458249658 learned_addr learned my addr 172.21.15.47:0/3458249658 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f3566ffd640 1 --2- 172.21.15.47:0/3458249658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35680d2b80 0x7f35681f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f35677fe640 1 --2- 172.21.15.47:0/3458249658 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35680b4f70 0x7f356806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f3567fff640 1 -- 172.21.15.47:0/3458249658 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35680b4f70 msgr2=0x7f356806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f3567fff640 1 --2- 172.21.15.47:0/3458249658 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35680b4f70 0x7f356806d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f3567fff640 1 -- 172.21.15.47:0/3458249658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35680d2b80 msgr2=0x7f35681f7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f3567fff640 1 --2- 172.21.15.47:0/3458249658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35680d2b80 0x7f35681f7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f3567fff640 1 -- 172.21.15.47:0/3458249658 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35681f7e90 con 0x7f3568161a70 2024-04-14T23:34:49.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f3566ffd640 1 --2- 172.21.15.47:0/3458249658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35680d2b80 0x7f35681f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f3567fff640 1 --2- 172.21.15.47:0/3458249658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3568161a70 0x7f356814fde0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f356000c7d0 tx=0x7f356000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f354ffff640 1 -- 172.21.15.47:0/3458249658 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560018070 con 0x7f3568161a70 2024-04-14T23:34:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f354ffff640 1 -- 172.21.15.47:0/3458249658 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356000a640 con 0x7f3568161a70 2024-04-14T23:34:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f354ffff640 1 -- 172.21.15.47:0/3458249658 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356000aa70 con 0x7f3568161a70 2024-04-14T23:34:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.286+0000 7f356dc6d640 1 -- 172.21.15.47:0/3458249658 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35681f8170 con 0x7f3568161a70 2024-04-14T23:34:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.287+0000 7f356dc6d640 1 -- 172.21.15.47:0/3458249658 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35681511a0 con 0x7f3568161a70 2024-04-14T23:34:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.287+0000 7f356dc6d640 1 -- 172.21.15.47:0/3458249658 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3568073f50 con 0x7f3568161a70 2024-04-14T23:34:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.288+0000 7f354ffff640 1 -- 172.21.15.47:0/3458249658 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f356001b070 con 0x7f3568161a70 2024-04-14T23:34:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.288+0000 7f354ffff640 1 --2- 172.21.15.47:0/3458249658 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f355406b990 0x7f355406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.288+0000 7f354ffff640 1 -- 172.21.15.47:0/3458249658 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f356008a1b0 con 0x7f3568161a70 2024-04-14T23:34:49.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.289+0000 7f35677fe640 1 --2- 172.21.15.47:0/3458249658 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f355406b990 0x7f355406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.289+0000 7f35677fe640 1 --2- 172.21.15.47:0/3458249658 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f355406b990 0x7f355406de50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f355800a750 tx=0x7f3558008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.293+0000 7f354ffff640 1 -- 172.21.15.47:0/3458249658 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3560058a80 con 0x7f3568161a70 2024-04-14T23:34:49.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.473+0000 7f356dc6d640 1 -- 172.21.15.47:0/3458249658 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f35680d2250 con 0x7f3568161a70 2024-04-14T23:34:49.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.473+0000 7f354ffff640 1 -- 172.21.15.47:0/3458249658 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f3560058380 con 0x7f3568161a70 2024-04-14T23:34:49.476 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-14T23:34:49.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.475+0000 7f356dc6d640 1 -- 172.21.15.47:0/3458249658 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f355406b990 msgr2=0x7f355406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.475+0000 7f356dc6d640 1 --2- 172.21.15.47:0/3458249658 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f355406b990 0x7f355406de50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f355800a750 tx=0x7f3558008040 comp rx=0 tx=0).stop 2024-04-14T23:34:49.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.475+0000 7f356dc6d640 1 -- 172.21.15.47:0/3458249658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3568161a70 msgr2=0x7f356814fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.475+0000 7f356dc6d640 1 --2- 172.21.15.47:0/3458249658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3568161a70 0x7f356814fde0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f356000c7d0 tx=0x7f356000cc90 comp rx=0 tx=0).stop 2024-04-14T23:34:49.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.475+0000 7f356dc6d640 1 -- 172.21.15.47:0/3458249658 shutdown_connections 2024-04-14T23:34:49.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.475+0000 7f356dc6d640 1 --2- 172.21.15.47:0/3458249658 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f355406b990 0x7f355406de50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.475+0000 7f356dc6d640 1 --2- 172.21.15.47:0/3458249658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3568161a70 0x7f356814fde0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.475+0000 7f356dc6d640 1 --2- 172.21.15.47:0/3458249658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35680d2b80 0x7f35681f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.475+0000 7f356dc6d640 1 --2- 172.21.15.47:0/3458249658 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35680b4f70 0x7f356806d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.475+0000 7f356dc6d640 1 -- 172.21.15.47:0/3458249658 >> 172.21.15.47:0/3458249658 conn(0x7f35680d3f20 msgr2=0x7f356806bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.475+0000 7f356dc6d640 1 -- 172.21.15.47:0/3458249658 shutdown_connections 2024-04-14T23:34:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.475+0000 7f356dc6d640 1 -- 172.21.15.47:0/3458249658 wait complete. 2024-04-14T23:34:49.489 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T23:34:49.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.589+0000 7fe5fed1e640 1 Processor -- start 2024-04-14T23:34:49.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.590+0000 7fe5fed1e640 1 -- start start 2024-04-14T23:34:49.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.590+0000 7fe5fed1e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5f80d25d0 0x7fe5f80d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.590+0000 7fe5fed1e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe5f80b7e50 0x7fe5f80b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.590+0000 7fe5fed1e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5f80b7090 con 0x7fe5f80b53c0 2024-04-14T23:34:49.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.590+0000 7fe5fed1e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe5f80b6e40 con 0x7fe5f80b7e50 2024-04-14T23:34:49.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.590+0000 7fe5fed1e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe5f80b7370 con 0x7fe5f80d25d0 2024-04-14T23:34:49.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.590+0000 7fe5fd2bb640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe5f80b7e50 0x7fe5f80b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.590+0000 7fe5fd2bb640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe5f80b7e50 0x7fe5f80b82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59058/0 (socket says 172.21.15.47:59058) 2024-04-14T23:34:49.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.590+0000 7fe5fd2bb640 1 -- 172.21.15.47:0/1656992937 learned_addr learned my addr 172.21.15.47:0/1656992937 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:49.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.591+0000 7fe5f7fff640 1 --2- 172.21.15.47:0/1656992937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5f80d25d0 0x7fe5f80d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.591+0000 7fe5fd2bb640 1 -- 172.21.15.47:0/1656992937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5f80d25d0 msgr2=0x7fe5f80d2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:49.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.591+0000 7fe5fd2bb640 1 --2- 172.21.15.47:0/1656992937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5f80d25d0 0x7fe5f80d2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.591+0000 7fe5fd2bb640 1 -- 172.21.15.47:0/1656992937 >> v1:172.21.15.191:6789/0 conn(0x7fe5f80b53c0 legacy=0x7fe5f80cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.591+0000 7fe5fd2bb640 1 -- 172.21.15.47:0/1656992937 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f80b7650 con 0x7fe5f80b7e50 2024-04-14T23:34:49.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.591+0000 7fe5fd2bb640 1 --2- 172.21.15.47:0/1656992937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f80b7e50 0x7fe5f80b82a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009e50 tx=0x7fe5f002bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70c6ffba6e90b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:49.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.592+0000 7fe5f77fe640 1 -- 172.21.15.47:0/1656992937 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f002cb90 con 0x7fe5f80b7e50 2024-04-14T23:34:49.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.592+0000 7fe5f77fe640 1 -- 172.21.15.47:0/1656992937 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f002cd30 con 0x7fe5f80b7e50 2024-04-14T23:34:49.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.592+0000 7fe5f77fe640 1 -- 172.21.15.47:0/1656992937 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0034610 con 0x7fe5f80b7e50 2024-04-14T23:34:49.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.592+0000 7fe5fed1e640 1 -- 172.21.15.47:0/1656992937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f80b7e50 msgr2=0x7fe5f80b82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.592+0000 7fe5fed1e640 1 --2- 172.21.15.47:0/1656992937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f80b7e50 0x7fe5f80b82a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009e50 tx=0x7fe5f002bff0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.592+0000 7fe5fed1e640 1 -- 172.21.15.47:0/1656992937 shutdown_connections 2024-04-14T23:34:49.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.592+0000 7fe5fed1e640 1 --2- 172.21.15.47:0/1656992937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f80b7e50 0x7fe5f80b82a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.592+0000 7fe5fed1e640 1 --2- 172.21.15.47:0/1656992937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5f80d25d0 0x7fe5f80d2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.592+0000 7fe5fed1e640 1 -- 172.21.15.47:0/1656992937 >> 172.21.15.47:0/1656992937 conn(0x7fe5f809d2c0 msgr2=0x7fe5f80d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:49.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.592+0000 7fe5fed1e640 1 -- 172.21.15.47:0/1656992937 shutdown_connections 2024-04-14T23:34:49.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.592+0000 7fe5fed1e640 1 -- 172.21.15.47:0/1656992937 wait complete. 2024-04-14T23:34:49.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.593+0000 7fe5fed1e640 1 Processor -- start 2024-04-14T23:34:49.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.593+0000 7fe5fed1e640 1 -- start start 2024-04-14T23:34:49.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.594+0000 7fe5fed1e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5f80b53c0 0x7fe5f806c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.594+0000 7fe5fed1e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f80b7e50 0x7fe5f806c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.594+0000 7fe5fed1e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5f80d25d0 0x7fe5f81f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.594+0000 7fe5fed1e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f80cfd00 con 0x7fe5f80b7e50 2024-04-14T23:34:49.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.594+0000 7fe5fed1e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f80d2f50 con 0x7fe5f80b53c0 2024-04-14T23:34:49.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.594+0000 7fe5fed1e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe5f80b57a0 con 0x7fe5f80d25d0 2024-04-14T23:34:49.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.594+0000 7fe5f7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f80b7e50 0x7fe5f806c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.594+0000 7fe5f7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f80b7e50 0x7fe5f806c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59060/0 (socket says 172.21.15.47:59060) 2024-04-14T23:34:49.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.594+0000 7fe5f7fff640 1 -- 172.21.15.47:0/1080500946 learned_addr learned my addr 172.21.15.47:0/1080500946 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:49.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.594+0000 7fe5fd2bb640 1 --2- 172.21.15.47:0/1080500946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5f80d25d0 0x7fe5f81f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.594+0000 7fe5fcaba640 1 --2- 172.21.15.47:0/1080500946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5f80b53c0 0x7fe5f806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.594+0000 7fe5f7fff640 1 -- 172.21.15.47:0/1080500946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5f80d25d0 msgr2=0x7fe5f81f2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.594+0000 7fe5f7fff640 1 --2- 172.21.15.47:0/1080500946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5f80d25d0 0x7fe5f81f2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.594+0000 7fe5f7fff640 1 -- 172.21.15.47:0/1080500946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5f80b53c0 msgr2=0x7fe5f806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.594+0000 7fe5f7fff640 1 --2- 172.21.15.47:0/1080500946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5f80b53c0 0x7fe5f806c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.594+0000 7fe5f7fff640 1 -- 172.21.15.47:0/1080500946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f8152530 con 0x7fe5f80b7e50 2024-04-14T23:34:49.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.595+0000 7fe5f7fff640 1 --2- 172.21.15.47:0/1080500946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f80b7e50 0x7fe5f806c7d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400e9b0 tx=0x7fe5e400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:49.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.595+0000 7fe5f57fa640 1 -- 172.21.15.47:0/1080500946 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4017070 con 0x7fe5f80b7e50 2024-04-14T23:34:49.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.595+0000 7fe5f57fa640 1 -- 172.21.15.47:0/1080500946 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e400c9a0 con 0x7fe5f80b7e50 2024-04-14T23:34:49.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.595+0000 7fe5fed1e640 1 -- 172.21.15.47:0/1080500946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f81f7b10 con 0x7fe5f80b7e50 2024-04-14T23:34:49.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.595+0000 7fe5f57fa640 1 -- 172.21.15.47:0/1080500946 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e400cd90 con 0x7fe5f80b7e50 2024-04-14T23:34:49.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.595+0000 7fe5fed1e640 1 -- 172.21.15.47:0/1080500946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f8152ab0 con 0x7fe5f80b7e50 2024-04-14T23:34:49.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.596+0000 7fe5fed1e640 1 -- 172.21.15.47:0/1080500946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f8073f50 con 0x7fe5f80b7e50 2024-04-14T23:34:49.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.596+0000 7fe5f57fa640 1 -- 172.21.15.47:0/1080500946 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe5e401a070 con 0x7fe5f80b7e50 2024-04-14T23:34:49.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.597+0000 7fe5f57fa640 1 --2- 172.21.15.47:0/1080500946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe5dc06b990 0x7fe5dc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.597+0000 7fe5f57fa640 1 -- 172.21.15.47:0/1080500946 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe5e408ab90 con 0x7fe5f80b7e50 2024-04-14T23:34:49.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.597+0000 7fe5fcaba640 1 --2- 172.21.15.47:0/1080500946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe5dc06b990 0x7fe5dc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.597+0000 7fe5fcaba640 1 --2- 172.21.15.47:0/1080500946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe5dc06b990 0x7fe5dc06de50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec007fd0 tx=0x7fe5ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:49.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.601+0000 7fe5f57fa640 1 -- 172.21.15.47:0/1080500946 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe5e40594f0 con 0x7fe5f80b7e50 2024-04-14T23:34:49.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.780+0000 7fe5fed1e640 1 -- 172.21.15.47:0/1080500946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe5f80749b0 con 0x7fe5f80b7e50 2024-04-14T23:34:49.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.780+0000 7fe5f57fa640 1 -- 172.21.15.47:0/1080500946 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fe5e4058df0 con 0x7fe5f80b7e50 2024-04-14T23:34:49.784 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:34:49.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.782+0000 7fe5fed1e640 1 -- 172.21.15.47:0/1080500946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe5dc06b990 msgr2=0x7fe5dc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.782+0000 7fe5fed1e640 1 --2- 172.21.15.47:0/1080500946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe5dc06b990 0x7fe5dc06de50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec007fd0 tx=0x7fe5ec009040 comp rx=0 tx=0).stop 2024-04-14T23:34:49.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.782+0000 7fe5fed1e640 1 -- 172.21.15.47:0/1080500946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f80b7e50 msgr2=0x7fe5f806c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.782+0000 7fe5fed1e640 1 --2- 172.21.15.47:0/1080500946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f80b7e50 0x7fe5f806c7d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400e9b0 tx=0x7fe5e400ee70 comp rx=0 tx=0).stop 2024-04-14T23:34:49.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.782+0000 7fe5fed1e640 1 -- 172.21.15.47:0/1080500946 shutdown_connections 2024-04-14T23:34:49.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.782+0000 7fe5fed1e640 1 --2- 172.21.15.47:0/1080500946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe5dc06b990 0x7fe5dc06de50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.782+0000 7fe5fed1e640 1 --2- 172.21.15.47:0/1080500946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5f80d25d0 0x7fe5f81f2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.782+0000 7fe5fed1e640 1 --2- 172.21.15.47:0/1080500946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f80b7e50 0x7fe5f806c7d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.782+0000 7fe5fed1e640 1 --2- 172.21.15.47:0/1080500946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5f80b53c0 0x7fe5f806c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.782+0000 7fe5fed1e640 1 -- 172.21.15.47:0/1080500946 >> 172.21.15.47:0/1080500946 conn(0x7fe5f809d2c0 msgr2=0x7fe5f806d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:49.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.782+0000 7fe5fed1e640 1 -- 172.21.15.47:0/1080500946 shutdown_connections 2024-04-14T23:34:49.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.782+0000 7fe5fed1e640 1 -- 172.21.15.47:0/1080500946 wait complete. 2024-04-14T23:34:49.796 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T23:34:49.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.896+0000 7fbec1895640 1 Processor -- start 2024-04-14T23:34:49.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.896+0000 7fbec1895640 1 -- start start 2024-04-14T23:34:49.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.897+0000 7fbec1895640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbebc15e4a0 0x7fbebc0d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.897+0000 7fbec1895640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbebc0d1c40 0x7fbebc0d2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.897+0000 7fbec1895640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbebc0c83c0 con 0x7fbebc0c9460 2024-04-14T23:34:49.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.897+0000 7fbec1895640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbebc15e880 con 0x7fbebc15e4a0 2024-04-14T23:34:49.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.897+0000 7fbec1895640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbebc0c86a0 con 0x7fbebc0d1c40 2024-04-14T23:34:49.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.897+0000 7fbebaffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbebc15e4a0 0x7fbebc0d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.897+0000 7fbebb7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbebc0c9460 0x7fbebc0c9910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41866/0 (socket says 172.21.15.47:41866) 2024-04-14T23:34:49.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.897+0000 7fbebb7fe640 1 -- 172.21.15.47:0/1651451468 learned_addr learned my addr 172.21.15.47:0/1651451468 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:49.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.897+0000 7fbeb3fff640 1 --2- 172.21.15.47:0/1651451468 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbebc0d1c40 0x7fbebc0d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.897+0000 7fbebaffd640 1 -- 172.21.15.47:0/1651451468 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbebc0d1c40 msgr2=0x7fbebc0d2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:49.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.897+0000 7fbebaffd640 1 --2- 172.21.15.47:0/1651451468 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbebc0d1c40 0x7fbebc0d2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.897+0000 7fbebaffd640 1 -- 172.21.15.47:0/1651451468 >> v1:172.21.15.47:6789/0 conn(0x7fbebc0c9460 legacy=0x7fbebc0c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.897+0000 7fbeba7fc640 1 -- 172.21.15.47:0/1651451468 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1627414448 0 0) 0x7fbebc0c83c0 con 0x7fbebc0c9460 2024-04-14T23:34:49.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.897+0000 7fbebaffd640 1 -- 172.21.15.47:0/1651451468 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbebc0c8980 con 0x7fbebc15e4a0 2024-04-14T23:34:49.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.898+0000 7fbebaffd640 1 --2- 172.21.15.47:0/1651451468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbebc15e4a0 0x7fbebc0d2420 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0097a0 tx=0x7fbeac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e27d6ed7ad28d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:49.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.898+0000 7fbeba7fc640 1 -- 172.21.15.47:0/1651451468 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac035020 con 0x7fbebc15e4a0 2024-04-14T23:34:49.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.898+0000 7fbeba7fc640 1 -- 172.21.15.47:0/1651451468 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeac031830 con 0x7fbebc15e4a0 2024-04-14T23:34:49.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.898+0000 7fbeba7fc640 1 -- 172.21.15.47:0/1651451468 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac031c00 con 0x7fbebc15e4a0 2024-04-14T23:34:49.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.899+0000 7fbec1895640 1 -- 172.21.15.47:0/1651451468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbebc15e4a0 msgr2=0x7fbebc0d2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.899+0000 7fbec1895640 1 --2- 172.21.15.47:0/1651451468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbebc15e4a0 0x7fbebc0d2420 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0097a0 tx=0x7fbeac02b8d0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.899+0000 7fbec1895640 1 -- 172.21.15.47:0/1651451468 shutdown_connections 2024-04-14T23:34:49.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.899+0000 7fbec1895640 1 --2- 172.21.15.47:0/1651451468 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbebc0d1c40 0x7fbebc0d2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.899+0000 7fbec1895640 1 --2- 172.21.15.47:0/1651451468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbebc15e4a0 0x7fbebc0d2420 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.899+0000 7fbec1895640 1 -- 172.21.15.47:0/1651451468 >> 172.21.15.47:0/1651451468 conn(0x7fbebc0d3ef0 msgr2=0x7fbebc0d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:49.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.899+0000 7fbec1895640 1 -- 172.21.15.47:0/1651451468 shutdown_connections 2024-04-14T23:34:49.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.899+0000 7fbec1895640 1 -- 172.21.15.47:0/1651451468 wait complete. 2024-04-14T23:34:49.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.900+0000 7fbec1895640 1 Processor -- start 2024-04-14T23:34:49.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.900+0000 7fbec1895640 1 -- start start 2024-04-14T23:34:49.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbec1895640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbebc0c9460 0x7fbebc15a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbec1895640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbebc0d1c40 0x7fbebc14c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbec1895640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbebc15e4a0 0x7fbebc15fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbec1895640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc067bb0 con 0x7fbebc15e4a0 2024-04-14T23:34:49.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbec1895640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc0c8f40 con 0x7fbebc0c9460 2024-04-14T23:34:49.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbec1895640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbebc067d30 con 0x7fbebc0d1c40 2024-04-14T23:34:49.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbebb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbebc15e4a0 0x7fbebc15fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbebb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbebc15e4a0 0x7fbebc15fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59076/0 (socket says 172.21.15.47:59076) 2024-04-14T23:34:49.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbebb7fe640 1 -- 172.21.15.47:0/2268580173 learned_addr learned my addr 172.21.15.47:0/2268580173 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:49.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbeb3fff640 1 --2- 172.21.15.47:0/2268580173 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbebc0d1c40 0x7fbebc14c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbebaffd640 1 --2- 172.21.15.47:0/2268580173 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbebc0c9460 0x7fbebc15a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbebb7fe640 1 -- 172.21.15.47:0/2268580173 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbebc0d1c40 msgr2=0x7fbebc14c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbebb7fe640 1 --2- 172.21.15.47:0/2268580173 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbebc0d1c40 0x7fbebc14c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbebb7fe640 1 -- 172.21.15.47:0/2268580173 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbebc0c9460 msgr2=0x7fbebc15a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:49.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbebb7fe640 1 --2- 172.21.15.47:0/2268580173 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbebc0c9460 0x7fbebc15a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:49.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbebb7fe640 1 -- 172.21.15.47:0/2268580173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbebc15a080 con 0x7fbebc15e4a0 2024-04-14T23:34:49.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbebb7fe640 1 --2- 172.21.15.47:0/2268580173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbebc15e4a0 0x7fbebc15fbc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400c730 tx=0x7fbeb400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:49.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbeb8ff9640 1 -- 172.21.15.47:0/2268580173 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4018070 con 0x7fbebc15e4a0 2024-04-14T23:34:49.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbeb8ff9640 1 -- 172.21.15.47:0/2268580173 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb400ce40 con 0x7fbebc15e4a0 2024-04-14T23:34:49.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbec1895640 1 -- 172.21.15.47:0/2268580173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbebc14cb50 con 0x7fbebc15e4a0 2024-04-14T23:34:49.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbeb8ff9640 1 -- 172.21.15.47:0/2268580173 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb400a880 con 0x7fbebc15e4a0 2024-04-14T23:34:49.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.901+0000 7fbec1895640 1 -- 172.21.15.47:0/2268580173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbebc0b7280 con 0x7fbebc15e4a0 2024-04-14T23:34:49.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.902+0000 7fbec1895640 1 -- 172.21.15.47:0/2268580173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbebc075430 con 0x7fbebc15e4a0 2024-04-14T23:34:49.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.903+0000 7fbeb8ff9640 1 -- 172.21.15.47:0/2268580173 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fbeb401b070 con 0x7fbebc15e4a0 2024-04-14T23:34:49.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.903+0000 7fbeb8ff9640 1 --2- 172.21.15.47:0/2268580173 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbe9c06b990 0x7fbe9c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:49.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.903+0000 7fbeb8ff9640 1 -- 172.21.15.47:0/2268580173 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbeb408a030 con 0x7fbebc15e4a0 2024-04-14T23:34:49.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.903+0000 7fbebaffd640 1 --2- 172.21.15.47:0/2268580173 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbe9c06b990 0x7fbe9c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:49.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.904+0000 7fbebaffd640 1 --2- 172.21.15.47:0/2268580173 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbe9c06b990 0x7fbe9c06de50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbeac036000 tx=0x7fbeac008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:49.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:49.907+0000 7fbeb8ff9640 1 -- 172.21.15.47:0/2268580173 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbeb4058990 con 0x7fbebc15e4a0 2024-04-14T23:34:50.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.099+0000 7fbec1895640 1 -- 172.21.15.47:0/2268580173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbebc0d21e0 con 0x7fbebc15e4a0 2024-04-14T23:34:50.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.100+0000 7fbeb8ff9640 1 -- 172.21.15.47:0/2268580173 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fbeb4058290 con 0x7fbebc15e4a0 2024-04-14T23:34:50.103 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-14T23:34:50.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.102+0000 7fbec1895640 1 -- 172.21.15.47:0/2268580173 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbe9c06b990 msgr2=0x7fbe9c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.102+0000 7fbec1895640 1 --2- 172.21.15.47:0/2268580173 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbe9c06b990 0x7fbe9c06de50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbeac036000 tx=0x7fbeac008030 comp rx=0 tx=0).stop 2024-04-14T23:34:50.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.102+0000 7fbec1895640 1 -- 172.21.15.47:0/2268580173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbebc15e4a0 msgr2=0x7fbebc15fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.102+0000 7fbec1895640 1 --2- 172.21.15.47:0/2268580173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbebc15e4a0 0x7fbebc15fbc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400c730 tx=0x7fbeb400cbf0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.102+0000 7fbec1895640 1 -- 172.21.15.47:0/2268580173 shutdown_connections 2024-04-14T23:34:50.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.102+0000 7fbec1895640 1 --2- 172.21.15.47:0/2268580173 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbe9c06b990 0x7fbe9c06de50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.102+0000 7fbec1895640 1 --2- 172.21.15.47:0/2268580173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbebc15e4a0 0x7fbebc15fbc0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.102+0000 7fbec1895640 1 --2- 172.21.15.47:0/2268580173 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbebc0d1c40 0x7fbebc14c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.102+0000 7fbec1895640 1 --2- 172.21.15.47:0/2268580173 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbebc0c9460 0x7fbebc15a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.102+0000 7fbec1895640 1 -- 172.21.15.47:0/2268580173 >> 172.21.15.47:0/2268580173 conn(0x7fbebc0d3ef0 msgr2=0x7fbebc0c98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:50.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.102+0000 7fbec1895640 1 -- 172.21.15.47:0/2268580173 shutdown_connections 2024-04-14T23:34:50.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.102+0000 7fbec1895640 1 -- 172.21.15.47:0/2268580173 wait complete. 2024-04-14T23:34:50.118 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:34:50.118 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:34:50.133 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:34:50.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.271+0000 7f2da6c08640 1 Processor -- start 2024-04-14T23:34:50.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.271+0000 7f2da6c08640 1 -- start start 2024-04-14T23:34:50.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.272+0000 7f2da6c08640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2da0151600 0x7f2da006d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.272+0000 7f2da6c08640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2da00cf5f0 0x7f2da00b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.272+0000 7f2da6c08640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2da0071930 con 0x7f2da00b2fb0 2024-04-14T23:34:50.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.272+0000 7f2da6c08640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2da006dfb0 con 0x7f2da0151600 2024-04-14T23:34:50.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.272+0000 7f2da6c08640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f2da00716e0 con 0x7f2da00cf5f0 2024-04-14T23:34:50.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.272+0000 7f2da49a4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2da0151600 0x7f2da006d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:50.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.272+0000 7f2da51a5640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f2da00b2fb0 0x7f2da00726f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41868/0 (socket says 172.21.15.47:41868) 2024-04-14T23:34:50.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.272+0000 7f2da51a5640 1 -- 172.21.15.47:0/703835720 learned_addr learned my addr 172.21.15.47:0/703835720 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:50.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.272+0000 7f2da49a4640 1 -- 172.21.15.47:0/703835720 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2da00cf5f0 msgr2=0x7f2da00b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:50.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.272+0000 7f2da49a4640 1 --2- 172.21.15.47:0/703835720 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2da00cf5f0 0x7f2da00b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.272+0000 7f2da49a4640 1 -- 172.21.15.47:0/703835720 >> v1:172.21.15.47:6789/0 conn(0x7f2da00b2fb0 legacy=0x7f2da00726f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.272+0000 7f2da49a4640 1 -- 172.21.15.47:0/703835720 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da0071c10 con 0x7f2da0151600 2024-04-14T23:34:50.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.272+0000 7f2d9f7fe640 1 -- 172.21.15.47:0/703835720 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 308137098 0 0) 0x7f2da0071930 con 0x7f2da00b2fb0 2024-04-14T23:34:50.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.273+0000 7f2da49a4640 1 --2- 172.21.15.47:0/703835720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da0151600 0x7f2da006d720 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2d940097a0 tx=0x7f2d9402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd21991add11e1ff server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:50.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.273+0000 7f2d9f7fe640 1 -- 172.21.15.47:0/703835720 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d94035020 con 0x7f2da0151600 2024-04-14T23:34:50.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.273+0000 7f2d9f7fe640 1 -- 172.21.15.47:0/703835720 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d94031830 con 0x7f2da0151600 2024-04-14T23:34:50.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.273+0000 7f2d9f7fe640 1 -- 172.21.15.47:0/703835720 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d94031c00 con 0x7f2da0151600 2024-04-14T23:34:50.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.273+0000 7f2da6c08640 1 -- 172.21.15.47:0/703835720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da0151600 msgr2=0x7f2da006d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.273+0000 7f2da6c08640 1 --2- 172.21.15.47:0/703835720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da0151600 0x7f2da006d720 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2d940097a0 tx=0x7f2d9402b8d0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.273+0000 7f2da6c08640 1 -- 172.21.15.47:0/703835720 shutdown_connections 2024-04-14T23:34:50.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.273+0000 7f2da6c08640 1 --2- 172.21.15.47:0/703835720 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2da00cf5f0 0x7f2da00b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.273+0000 7f2da6c08640 1 --2- 172.21.15.47:0/703835720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da0151600 0x7f2da006d720 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.274+0000 7f2da6c08640 1 -- 172.21.15.47:0/703835720 >> 172.21.15.47:0/703835720 conn(0x7f2da006b200 msgr2=0x7f2da006b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:50.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.274+0000 7f2da6c08640 1 -- 172.21.15.47:0/703835720 shutdown_connections 2024-04-14T23:34:50.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.274+0000 7f2da6c08640 1 -- 172.21.15.47:0/703835720 wait complete. 2024-04-14T23:34:50.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.275+0000 7f2da6c08640 1 Processor -- start 2024-04-14T23:34:50.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.275+0000 7f2da6c08640 1 -- start start 2024-04-14T23:34:50.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.275+0000 7f2da6c08640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2da00b2fb0 0x7f2da0148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.275+0000 7f2da6c08640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2da00cf5f0 0x7f2da01f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2da6c08640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da0151600 0x7f2da00ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2da6c08640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2da006dc60 con 0x7f2da0151600 2024-04-14T23:34:50.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2da6c08640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2da0072260 con 0x7f2da00b2fb0 2024-04-14T23:34:50.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2da6c08640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f2da0072e00 con 0x7f2da00cf5f0 2024-04-14T23:34:50.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2da51a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da0151600 0x7f2da00ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:50.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2da51a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da0151600 0x7f2da00ce0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59102/0 (socket says 172.21.15.47:59102) 2024-04-14T23:34:50.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2da51a5640 1 -- 172.21.15.47:0/1014833930 learned_addr learned my addr 172.21.15.47:0/1014833930 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:50.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2d9ffff640 1 --2- 172.21.15.47:0/1014833930 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2da00cf5f0 0x7f2da01f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:50.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2da49a4640 1 --2- 172.21.15.47:0/1014833930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2da00b2fb0 0x7f2da0148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:50.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2da51a5640 1 -- 172.21.15.47:0/1014833930 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2da00cf5f0 msgr2=0x7f2da01f5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2da51a5640 1 --2- 172.21.15.47:0/1014833930 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2da00cf5f0 0x7f2da01f5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2da51a5640 1 -- 172.21.15.47:0/1014833930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2da00b2fb0 msgr2=0x7f2da0148700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2da51a5640 1 --2- 172.21.15.47:0/1014833930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2da00b2fb0 0x7f2da0148700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2da51a5640 1 -- 172.21.15.47:0/1014833930 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da00cd630 con 0x7f2da0151600 2024-04-14T23:34:50.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2da51a5640 1 --2- 172.21.15.47:0/1014833930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da0151600 0x7f2da00ce0d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800c730 tx=0x7f2d9800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2d9d7fa640 1 -- 172.21.15.47:0/1014833930 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d98018070 con 0x7f2da0151600 2024-04-14T23:34:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2d9d7fa640 1 -- 172.21.15.47:0/1014833930 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d9800ce40 con 0x7f2da0151600 2024-04-14T23:34:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2d9d7fa640 1 -- 172.21.15.47:0/1014833930 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9800a860 con 0x7f2da0151600 2024-04-14T23:34:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2da6c08640 1 -- 172.21.15.47:0/1014833930 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2da00ad9d0 con 0x7f2da0151600 2024-04-14T23:34:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.276+0000 7f2da6c08640 1 -- 172.21.15.47:0/1014833930 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da01f5670 con 0x7f2da0151600 2024-04-14T23:34:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.277+0000 7f2da6c08640 1 -- 172.21.15.47:0/1014833930 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2da0075430 con 0x7f2da0151600 2024-04-14T23:34:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.278+0000 7f2d9d7fa640 1 -- 172.21.15.47:0/1014833930 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f2d9801b070 con 0x7f2da0151600 2024-04-14T23:34:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.278+0000 7f2d9d7fa640 1 --2- 172.21.15.47:0/1014833930 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d8406b990 0x7f2d8406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.278+0000 7f2d9d7fa640 1 -- 172.21.15.47:0/1014833930 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2d9808a060 con 0x7f2da0151600 2024-04-14T23:34:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.278+0000 7f2da49a4640 1 --2- 172.21.15.47:0/1014833930 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d8406b990 0x7f2d8406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.279+0000 7f2da49a4640 1 --2- 172.21.15.47:0/1014833930 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d8406b990 0x7f2d8406de50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2d94036000 tx=0x7f2d9403c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:50.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.282+0000 7f2d9d7fa640 1 -- 172.21.15.47:0/1014833930 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2d980589c0 con 0x7f2da0151600 2024-04-14T23:34:50.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.465+0000 7f2da6c08640 1 -- 172.21.15.47:0/1014833930 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2da0072a90 con 0x7f2da0151600 2024-04-14T23:34:50.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.466+0000 7f2d9d7fa640 1 -- 172.21.15.47:0/1014833930 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7f2d980582c0 con 0x7f2da0151600 2024-04-14T23:34:50.469 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:50.469 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:44.714882+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:34:50.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.468+0000 7f2da6c08640 1 -- 172.21.15.47:0/1014833930 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d8406b990 msgr2=0x7f2d8406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.468+0000 7f2da6c08640 1 --2- 172.21.15.47:0/1014833930 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d8406b990 0x7f2d8406de50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2d94036000 tx=0x7f2d9403c040 comp rx=0 tx=0).stop 2024-04-14T23:34:50.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.468+0000 7f2da6c08640 1 -- 172.21.15.47:0/1014833930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da0151600 msgr2=0x7f2da00ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.468+0000 7f2da6c08640 1 --2- 172.21.15.47:0/1014833930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da0151600 0x7f2da00ce0d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800c730 tx=0x7f2d9800cbf0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.468+0000 7f2da6c08640 1 -- 172.21.15.47:0/1014833930 shutdown_connections 2024-04-14T23:34:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.468+0000 7f2da6c08640 1 --2- 172.21.15.47:0/1014833930 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d8406b990 0x7f2d8406de50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.468+0000 7f2da6c08640 1 --2- 172.21.15.47:0/1014833930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2da0151600 0x7f2da00ce0d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.468+0000 7f2da6c08640 1 --2- 172.21.15.47:0/1014833930 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2da00cf5f0 0x7f2da01f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.468+0000 7f2da6c08640 1 --2- 172.21.15.47:0/1014833930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2da00b2fb0 0x7f2da0148700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.468+0000 7f2da6c08640 1 -- 172.21.15.47:0/1014833930 >> 172.21.15.47:0/1014833930 conn(0x7f2da006b200 msgr2=0x7f2da00b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.468+0000 7f2da6c08640 1 -- 172.21.15.47:0/1014833930 shutdown_connections 2024-04-14T23:34:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.468+0000 7f2da6c08640 1 -- 172.21.15.47:0/1014833930 wait complete. 2024-04-14T23:34:50.482 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T23:34:36.382034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T23:34:37.023103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T23:34:40.726418+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T23:34:50.482 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:34:50.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.583+0000 7f68070a2640 1 Processor -- start 2024-04-14T23:34:50.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.583+0000 7f68070a2640 1 -- start start 2024-04-14T23:34:50.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.584+0000 7f68070a2640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6800071da0 0x7f68000cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.584+0000 7f68070a2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f680015f4e0 0x7f6800072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.584+0000 7f68070a2640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68000cba10 con 0x7f68000cc470 2024-04-14T23:34:50.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.584+0000 7f68070a2640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f68000cbcb0 con 0x7f680015f4e0 2024-04-14T23:34:50.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.584+0000 7f68070a2640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f68000726c0 con 0x7f6800071da0 2024-04-14T23:34:50.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.584+0000 7f67fffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f680015f4e0 0x7f6800072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:50.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.584+0000 7f67fffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f680015f4e0 0x7f6800072180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59106/0 (socket says 172.21.15.47:59106) 2024-04-14T23:34:50.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.584+0000 7f67fffff640 1 -- 172.21.15.47:0/181823972 learned_addr learned my addr 172.21.15.47:0/181823972 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:50.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.584+0000 7f6804e3e640 1 --2- 172.21.15.47:0/181823972 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6800071da0 0x7f68000cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:50.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.585+0000 7f67fffff640 1 -- 172.21.15.47:0/181823972 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6800071da0 msgr2=0x7f68000cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:50.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.585+0000 7f67fffff640 1 --2- 172.21.15.47:0/181823972 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6800071da0 0x7f68000cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.585+0000 7f67fffff640 1 -- 172.21.15.47:0/181823972 >> v1:172.21.15.191:6789/0 conn(0x7f68000cc470 legacy=0x7f68000cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.585+0000 7f67fffff640 1 -- 172.21.15.47:0/181823972 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68000cfea0 con 0x7f680015f4e0 2024-04-14T23:34:50.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.585+0000 7f6804e3e640 1 --2- 172.21.15.47:0/181823972 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6800071da0 0x7f68000cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:50.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.585+0000 7f67fffff640 1 --2- 172.21.15.47:0/181823972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f680015f4e0 0x7f6800072180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009870 tx=0x7f67f002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981c6cf703fc4bf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:50.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.585+0000 7f67ff7fe640 1 -- 172.21.15.47:0/181823972 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0034070 con 0x7f680015f4e0 2024-04-14T23:34:50.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.586+0000 7f67ff7fe640 1 -- 172.21.15.47:0/181823972 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f0030840 con 0x7f680015f4e0 2024-04-14T23:34:50.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.586+0000 7f67ff7fe640 1 -- 172.21.15.47:0/181823972 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0030c10 con 0x7f680015f4e0 2024-04-14T23:34:50.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.586+0000 7f68070a2640 1 -- 172.21.15.47:0/181823972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f680015f4e0 msgr2=0x7f6800072180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.586+0000 7f68070a2640 1 --2- 172.21.15.47:0/181823972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f680015f4e0 0x7f6800072180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009870 tx=0x7f67f002b980 comp rx=0 tx=0).stop 2024-04-14T23:34:50.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.586+0000 7f68070a2640 1 -- 172.21.15.47:0/181823972 shutdown_connections 2024-04-14T23:34:50.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.586+0000 7f68070a2640 1 --2- 172.21.15.47:0/181823972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f680015f4e0 0x7f6800072180 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.586+0000 7f68070a2640 1 --2- 172.21.15.47:0/181823972 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6800071da0 0x7f68000cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.586+0000 7f68070a2640 1 -- 172.21.15.47:0/181823972 >> 172.21.15.47:0/181823972 conn(0x7f68000d0c20 msgr2=0x7f68000d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:50.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.586+0000 7f68070a2640 1 -- 172.21.15.47:0/181823972 shutdown_connections 2024-04-14T23:34:50.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.586+0000 7f68070a2640 1 -- 172.21.15.47:0/181823972 wait complete. 2024-04-14T23:34:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.587+0000 7f68070a2640 1 Processor -- start 2024-04-14T23:34:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.587+0000 7f68070a2640 1 -- start start 2024-04-14T23:34:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.588+0000 7f68070a2640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6800071da0 0x7f68000c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.588+0000 7f68070a2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68000cc470 0x7f6800159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.588+0000 7f68070a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f680015f4e0 0x7f68000c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.588+0000 7f68070a2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68000cbf50 con 0x7f680015f4e0 2024-04-14T23:34:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.588+0000 7f68070a2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f68000cfbc0 con 0x7f68000cc470 2024-04-14T23:34:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.588+0000 7f68070a2640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f680015f940 con 0x7f6800071da0 2024-04-14T23:34:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.588+0000 7f680563f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f680015f4e0 0x7f68000c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.588+0000 7f680563f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f680015f4e0 0x7f68000c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59120/0 (socket says 172.21.15.47:59120) 2024-04-14T23:34:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.588+0000 7f680563f640 1 -- 172.21.15.47:0/2411562972 learned_addr learned my addr 172.21.15.47:0/2411562972 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:50.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.588+0000 7f6804e3e640 1 --2- 172.21.15.47:0/2411562972 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6800071da0 0x7f68000c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.588+0000 7f67fffff640 1 --2- 172.21.15.47:0/2411562972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68000cc470 0x7f6800159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.589+0000 7f680563f640 1 -- 172.21.15.47:0/2411562972 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6800071da0 msgr2=0x7f68000c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.589+0000 7f680563f640 1 --2- 172.21.15.47:0/2411562972 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6800071da0 0x7f68000c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.589+0000 7f680563f640 1 -- 172.21.15.47:0/2411562972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68000cc470 msgr2=0x7f6800159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.589+0000 7f680563f640 1 --2- 172.21.15.47:0/2411562972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68000cc470 0x7f6800159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.589+0000 7f680563f640 1 -- 172.21.15.47:0/2411562972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68000c5250 con 0x7f680015f4e0 2024-04-14T23:34:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.589+0000 7f680563f640 1 --2- 172.21.15.47:0/2411562972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f680015f4e0 0x7f68000c4750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f67e8001eb0 tx=0x7f67e800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.589+0000 7f67fd7fa640 1 -- 172.21.15.47:0/2411562972 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e8017070 con 0x7f680015f4e0 2024-04-14T23:34:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.589+0000 7f67fd7fa640 1 -- 172.21.15.47:0/2411562972 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e80052d0 con 0x7f680015f4e0 2024-04-14T23:34:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.589+0000 7f68070a2640 1 -- 172.21.15.47:0/2411562972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68000c5530 con 0x7f680015f4e0 2024-04-14T23:34:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.589+0000 7f67fd7fa640 1 -- 172.21.15.47:0/2411562972 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e8003810 con 0x7f680015f4e0 2024-04-14T23:34:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.589+0000 7f68070a2640 1 -- 172.21.15.47:0/2411562972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68000c6470 con 0x7f680015f4e0 2024-04-14T23:34:50.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.590+0000 7f68070a2640 1 -- 172.21.15.47:0/2411562972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68000681f0 con 0x7f680015f4e0 2024-04-14T23:34:50.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.590+0000 7f67fd7fa640 1 -- 172.21.15.47:0/2411562972 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f67e801a070 con 0x7f680015f4e0 2024-04-14T23:34:50.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.591+0000 7f67fd7fa640 1 --2- 172.21.15.47:0/2411562972 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67e006b9c0 0x7f67e006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.591+0000 7f67fd7fa640 1 -- 172.21.15.47:0/2411562972 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f67e8089e40 con 0x7f680015f4e0 2024-04-14T23:34:50.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.591+0000 7f6804e3e640 1 --2- 172.21.15.47:0/2411562972 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67e006b9c0 0x7f67e006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:50.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.591+0000 7f6804e3e640 1 --2- 172.21.15.47:0/2411562972 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67e006b9c0 0x7f67e006de80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009fd0 tx=0x7f67f8009870 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:50.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.595+0000 7f67fd7fa640 1 -- 172.21.15.47:0/2411562972 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f67e80580c0 con 0x7f680015f4e0 2024-04-14T23:34:50.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.778+0000 7f68070a2640 1 -- 172.21.15.47:0/2411562972 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f68000c4530 con 0x7f680015f4e0 2024-04-14T23:34:50.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.778+0000 7f67fd7fa640 1 -- 172.21.15.47:0/2411562972 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f67e805c160 con 0x7f680015f4e0 2024-04-14T23:34:50.781 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:34:50.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.780+0000 7f68070a2640 1 -- 172.21.15.47:0/2411562972 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67e006b9c0 msgr2=0x7f67e006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.780+0000 7f68070a2640 1 --2- 172.21.15.47:0/2411562972 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67e006b9c0 0x7f67e006de80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009fd0 tx=0x7f67f8009870 comp rx=0 tx=0).stop 2024-04-14T23:34:50.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.780+0000 7f68070a2640 1 -- 172.21.15.47:0/2411562972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f680015f4e0 msgr2=0x7f68000c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.780+0000 7f68070a2640 1 --2- 172.21.15.47:0/2411562972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f680015f4e0 0x7f68000c4750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f67e8001eb0 tx=0x7f67e800c890 comp rx=0 tx=0).stop 2024-04-14T23:34:50.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.780+0000 7f68070a2640 1 -- 172.21.15.47:0/2411562972 shutdown_connections 2024-04-14T23:34:50.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.780+0000 7f68070a2640 1 --2- 172.21.15.47:0/2411562972 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67e006b9c0 0x7f67e006de80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.780+0000 7f68070a2640 1 --2- 172.21.15.47:0/2411562972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f680015f4e0 0x7f68000c4750 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.780+0000 7f68070a2640 1 --2- 172.21.15.47:0/2411562972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68000cc470 0x7f6800159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.780+0000 7f68070a2640 1 --2- 172.21.15.47:0/2411562972 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6800071da0 0x7f68000c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.780+0000 7f68070a2640 1 -- 172.21.15.47:0/2411562972 >> 172.21.15.47:0/2411562972 conn(0x7f68000d0c20 msgr2=0x7f68000b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:50.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.780+0000 7f68070a2640 1 -- 172.21.15.47:0/2411562972 shutdown_connections 2024-04-14T23:34:50.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.780+0000 7f68070a2640 1 -- 172.21.15.47:0/2411562972 wait complete. 2024-04-14T23:34:50.794 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T23:34:50.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.895+0000 7fb996f84640 1 Processor -- start 2024-04-14T23:34:50.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.895+0000 7fb996f84640 1 -- start start 2024-04-14T23:34:50.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.896+0000 7fb996f84640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb9900d2810 0x7fb99006ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.896+0000 7fb996f84640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9900b0e20 0x7fb99006d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.896+0000 7fb996f84640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9900d12e0 con 0x7fb9900ce700 2024-04-14T23:34:50.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.896+0000 7fb996f84640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb99006c3b0 con 0x7fb9900b0e20 2024-04-14T23:34:50.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.896+0000 7fb996f84640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb99006f2c0 con 0x7fb9900d2810 2024-04-14T23:34:50.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.896+0000 7fb995521640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9900b0e20 0x7fb99006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:50.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.896+0000 7fb995521640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9900b0e20 0x7fb99006d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59126/0 (socket says 172.21.15.47:59126) 2024-04-14T23:34:50.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.896+0000 7fb995521640 1 -- 172.21.15.47:0/3560214370 learned_addr learned my addr 172.21.15.47:0/3560214370 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:50.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.896+0000 7fb995521640 1 -- 172.21.15.47:0/3560214370 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb9900d2810 msgr2=0x7fb99006ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:50.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.896+0000 7fb995521640 1 --2- 172.21.15.47:0/3560214370 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb9900d2810 0x7fb99006ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.896+0000 7fb995521640 1 -- 172.21.15.47:0/3560214370 >> v1:172.21.15.191:6789/0 conn(0x7fb9900ce700 legacy=0x7fb9900ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:50.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.896+0000 7fb995521640 1 -- 172.21.15.47:0/3560214370 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99006c650 con 0x7fb9900b0e20 2024-04-14T23:34:50.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.897+0000 7fb995521640 1 --2- 172.21.15.47:0/3560214370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9900b0e20 0x7fb99006d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb978009870 tx=0x7fb97802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a094127fb0474942 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.897+0000 7fb98f7fe640 1 -- 172.21.15.47:0/3560214370 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978035020 con 0x7fb9900b0e20 2024-04-14T23:34:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.897+0000 7fb98f7fe640 1 -- 172.21.15.47:0/3560214370 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb978031640 con 0x7fb9900b0e20 2024-04-14T23:34:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.897+0000 7fb98f7fe640 1 -- 172.21.15.47:0/3560214370 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97802d040 con 0x7fb9900b0e20 2024-04-14T23:34:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.898+0000 7fb996f84640 1 -- 172.21.15.47:0/3560214370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9900b0e20 msgr2=0x7fb99006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.898+0000 7fb996f84640 1 --2- 172.21.15.47:0/3560214370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9900b0e20 0x7fb99006d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb978009870 tx=0x7fb97802b8f0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.898+0000 7fb996f84640 1 -- 172.21.15.47:0/3560214370 shutdown_connections 2024-04-14T23:34:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.898+0000 7fb996f84640 1 --2- 172.21.15.47:0/3560214370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9900b0e20 0x7fb99006d390 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.898+0000 7fb996f84640 1 --2- 172.21.15.47:0/3560214370 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb9900d2810 0x7fb99006ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.898+0000 7fb996f84640 1 -- 172.21.15.47:0/3560214370 >> 172.21.15.47:0/3560214370 conn(0x7fb9900d1cf0 msgr2=0x7fb9900d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.898+0000 7fb996f84640 1 -- 172.21.15.47:0/3560214370 shutdown_connections 2024-04-14T23:34:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.898+0000 7fb996f84640 1 -- 172.21.15.47:0/3560214370 wait complete. 2024-04-14T23:34:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.899+0000 7fb996f84640 1 Processor -- start 2024-04-14T23:34:50.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.899+0000 7fb996f84640 1 -- start start 2024-04-14T23:34:50.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb996f84640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb9900b0e20 0x7fb9901f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb996f84640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9900ce700 0x7fb9901492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb996f84640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9900d2810 0x7fb990159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb996f84640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb99015e600 con 0x7fb9900ce700 2024-04-14T23:34:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb996f84640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb99006f5a0 con 0x7fb9900d2810 2024-04-14T23:34:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb996f84640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb99015e780 con 0x7fb9900b0e20 2024-04-14T23:34:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb98ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9900ce700 0x7fb9901492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb98ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9900ce700 0x7fb9901492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59136/0 (socket says 172.21.15.47:59136) 2024-04-14T23:34:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb98ffff640 1 -- 172.21.15.47:0/1703292572 learned_addr learned my addr 172.21.15.47:0/1703292572 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb98ffff640 1 -- 172.21.15.47:0/1703292572 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb9900b0e20 msgr2=0x7fb9901f3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb98ffff640 1 --2- 172.21.15.47:0/1703292572 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb9900b0e20 0x7fb9901f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb98ffff640 1 -- 172.21.15.47:0/1703292572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9900d2810 msgr2=0x7fb990159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb995521640 1 --2- 172.21.15.47:0/1703292572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9900d2810 0x7fb990159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb98ffff640 1 --2- 172.21.15.47:0/1703292572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9900d2810 0x7fb990159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:50.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb98ffff640 1 -- 172.21.15.47:0/1703292572 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb990149d90 con 0x7fb9900ce700 2024-04-14T23:34:50.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb98ffff640 1 --2- 172.21.15.47:0/1703292572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9900ce700 0x7fb9901492d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb98000ba50 tx=0x7fb98000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:50.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb98d7fa640 1 -- 172.21.15.47:0/1703292572 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980019070 con 0x7fb9900ce700 2024-04-14T23:34:50.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb98d7fa640 1 -- 172.21.15.47:0/1703292572 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98000cc00 con 0x7fb9900ce700 2024-04-14T23:34:50.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.900+0000 7fb98d7fa640 1 -- 172.21.15.47:0/1703292572 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980014440 con 0x7fb9900ce700 2024-04-14T23:34:50.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.901+0000 7fb996f84640 1 -- 172.21.15.47:0/1703292572 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99014a070 con 0x7fb9900ce700 2024-04-14T23:34:50.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.901+0000 7fb996f84640 1 -- 172.21.15.47:0/1703292572 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb990153500 con 0x7fb9900ce700 2024-04-14T23:34:50.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.901+0000 7fb996f84640 1 -- 172.21.15.47:0/1703292572 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb990147240 con 0x7fb9900ce700 2024-04-14T23:34:50.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.902+0000 7fb98d7fa640 1 -- 172.21.15.47:0/1703292572 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb98001c070 con 0x7fb9900ce700 2024-04-14T23:34:50.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.902+0000 7fb98d7fa640 1 --2- 172.21.15.47:0/1703292572 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb97006b9c0 0x7fb97006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:50.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.902+0000 7fb98d7fa640 1 -- 172.21.15.47:0/1703292572 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb98008a8c0 con 0x7fb9900ce700 2024-04-14T23:34:50.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.903+0000 7fb994d20640 1 --2- 172.21.15.47:0/1703292572 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb97006b9c0 0x7fb97006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:50.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.903+0000 7fb994d20640 1 --2- 172.21.15.47:0/1703292572 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb97006b9c0 0x7fb97006de80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb988009650 tx=0x7fb988006ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:50.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:50.906+0000 7fb98d7fa640 1 -- 172.21.15.47:0/1703292572 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb980059190 con 0x7fb9900ce700 2024-04-14T23:34:51.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.086+0000 7fb996f84640 1 -- 172.21.15.47:0/1703292572 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb990074860 con 0x7fb9900ce700 2024-04-14T23:34:51.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.086+0000 7fb98d7fa640 1 -- 172.21.15.47:0/1703292572 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fb980058a90 con 0x7fb9900ce700 2024-04-14T23:34:51.090 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:34:51.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.088+0000 7fb996f84640 1 -- 172.21.15.47:0/1703292572 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb97006b9c0 msgr2=0x7fb97006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.088+0000 7fb996f84640 1 --2- 172.21.15.47:0/1703292572 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb97006b9c0 0x7fb97006de80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb988009650 tx=0x7fb988006ba0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.088+0000 7fb996f84640 1 -- 172.21.15.47:0/1703292572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9900ce700 msgr2=0x7fb9901492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.088+0000 7fb996f84640 1 --2- 172.21.15.47:0/1703292572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9900ce700 0x7fb9901492d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb98000ba50 tx=0x7fb98000bf10 comp rx=0 tx=0).stop 2024-04-14T23:34:51.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.088+0000 7fb996f84640 1 -- 172.21.15.47:0/1703292572 shutdown_connections 2024-04-14T23:34:51.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.088+0000 7fb996f84640 1 --2- 172.21.15.47:0/1703292572 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb97006b9c0 0x7fb97006de80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.088+0000 7fb996f84640 1 --2- 172.21.15.47:0/1703292572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb9900d2810 0x7fb990159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.088+0000 7fb996f84640 1 --2- 172.21.15.47:0/1703292572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9900ce700 0x7fb9901492d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.088+0000 7fb996f84640 1 --2- 172.21.15.47:0/1703292572 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb9900b0e20 0x7fb9901f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.088+0000 7fb996f84640 1 -- 172.21.15.47:0/1703292572 >> 172.21.15.47:0/1703292572 conn(0x7fb9900d1cf0 msgr2=0x7fb9900d20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:51.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.088+0000 7fb996f84640 1 -- 172.21.15.47:0/1703292572 shutdown_connections 2024-04-14T23:34:51.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.088+0000 7fb996f84640 1 -- 172.21.15.47:0/1703292572 wait complete. 2024-04-14T23:34:51.102 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T23:34:51.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.204+0000 7fdb9b955640 1 Processor -- start 2024-04-14T23:34:51.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.204+0000 7fdb9b955640 1 -- start start 2024-04-14T23:34:51.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.205+0000 7fdb9b955640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdb94155310 0x7fdb9406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.205+0000 7fdb9b955640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb940cc150 con 0x7fdb9406b740 2024-04-14T23:34:51.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.205+0000 7fdb9b955640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb94161d70 con 0x7fdb940d0070 2024-04-14T23:34:51.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.205+0000 7fdb9b955640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fdb9406bbb0 con 0x7fdb94155310 2024-04-14T23:34:51.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.205+0000 7fdb996f1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdb94155310 0x7fdb9406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.205+0000 7fdb996f1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdb94155310 0x7fdb9406b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59140/0 (socket says 172.21.15.47:59140) 2024-04-14T23:34:51.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.205+0000 7fdb98ef0640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fdb9406b740 0x7fdb940cf960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41876/0 (socket says 172.21.15.47:41876) 2024-04-14T23:34:51.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.205+0000 7fdb996f1640 1 -- 172.21.15.47:0/3880592327 learned_addr learned my addr 172.21.15.47:0/3880592327 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:51.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.205+0000 7fdb996f1640 1 -- 172.21.15.47:0/3880592327 >> v1:172.21.15.191:6789/0 conn(0x7fdb940d0070 legacy=0x7fdb9415e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.205+0000 7fdb996f1640 1 -- 172.21.15.47:0/3880592327 >> v1:172.21.15.47:6789/0 conn(0x7fdb9406b740 legacy=0x7fdb940cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.205+0000 7fdb996f1640 1 -- 172.21.15.47:0/3880592327 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb94162050 con 0x7fdb94155310 2024-04-14T23:34:51.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.206+0000 7fdb996f1640 1 --2- 172.21.15.47:0/3880592327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94155310 0x7fdb9406b200 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009870 tx=0x7fdb8c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abb02466c3a1f8b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:51.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.206+0000 7fdb8bfff640 1 -- 172.21.15.47:0/3880592327 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c02f840 con 0x7fdb94155310 2024-04-14T23:34:51.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.206+0000 7fdb8bfff640 1 -- 172.21.15.47:0/3880592327 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb8c02f9e0 con 0x7fdb94155310 2024-04-14T23:34:51.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.206+0000 7fdb8bfff640 1 -- 172.21.15.47:0/3880592327 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c02fdb0 con 0x7fdb94155310 2024-04-14T23:34:51.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.207+0000 7fdb9b955640 1 -- 172.21.15.47:0/3880592327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94155310 msgr2=0x7fdb9406b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.207+0000 7fdb9b955640 1 --2- 172.21.15.47:0/3880592327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94155310 0x7fdb9406b200 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009870 tx=0x7fdb8c02ba20 comp rx=0 tx=0).stop 2024-04-14T23:34:51.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.207+0000 7fdb9b955640 1 -- 172.21.15.47:0/3880592327 shutdown_connections 2024-04-14T23:34:51.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.207+0000 7fdb9b955640 1 --2- 172.21.15.47:0/3880592327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb94155310 0x7fdb9406b200 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.207+0000 7fdb9b955640 1 -- 172.21.15.47:0/3880592327 >> 172.21.15.47:0/3880592327 conn(0x7fdb940cd670 msgr2=0x7fdb940cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:51.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.207+0000 7fdb9b955640 1 -- 172.21.15.47:0/3880592327 shutdown_connections 2024-04-14T23:34:51.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.207+0000 7fdb9b955640 1 -- 172.21.15.47:0/3880592327 wait complete. 2024-04-14T23:34:51.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.208+0000 7fdb9b955640 1 Processor -- start 2024-04-14T23:34:51.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.208+0000 7fdb9b955640 1 -- start start 2024-04-14T23:34:51.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb9b955640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb9406b740 0x7fdb941465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb9b955640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb940d0070 0x7fdb94157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb9b955640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb94155310 0x7fdb941583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb9b955640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdb940d0540 con 0x7fdb940d0070 2024-04-14T23:34:51.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb9b955640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdb940ce500 con 0x7fdb94155310 2024-04-14T23:34:51.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb9b955640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fdb941626a0 con 0x7fdb9406b740 2024-04-14T23:34:51.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb98ef0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb940d0070 0x7fdb94157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb98ef0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb940d0070 0x7fdb94157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59142/0 (socket says 172.21.15.47:59142) 2024-04-14T23:34:51.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb98ef0640 1 -- 172.21.15.47:0/1542347684 learned_addr learned my addr 172.21.15.47:0/1542347684 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:51.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb996f1640 1 --2- 172.21.15.47:0/1542347684 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb9406b740 0x7fdb941465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb99ef2640 1 --2- 172.21.15.47:0/1542347684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb94155310 0x7fdb941583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb98ef0640 1 -- 172.21.15.47:0/1542347684 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb9406b740 msgr2=0x7fdb941465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb98ef0640 1 --2- 172.21.15.47:0/1542347684 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb9406b740 0x7fdb941465e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb98ef0640 1 -- 172.21.15.47:0/1542347684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb94155310 msgr2=0x7fdb941583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb98ef0640 1 --2- 172.21.15.47:0/1542347684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb94155310 0x7fdb941583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb98ef0640 1 -- 172.21.15.47:0/1542347684 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb94158a20 con 0x7fdb940d0070 2024-04-14T23:34:51.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb99ef2640 1 --2- 172.21.15.47:0/1542347684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb94155310 0x7fdb941583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:51.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb98ef0640 1 --2- 172.21.15.47:0/1542347684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb940d0070 0x7fdb94157eb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400c3e0 tx=0x7fdb8400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:51.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.209+0000 7fdb89ffb640 1 -- 172.21.15.47:0/1542347684 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb840074e0 con 0x7fdb940d0070 2024-04-14T23:34:51.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.210+0000 7fdb89ffb640 1 -- 172.21.15.47:0/1542347684 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb84007680 con 0x7fdb940d0070 2024-04-14T23:34:51.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.210+0000 7fdb9b955640 1 -- 172.21.15.47:0/1542347684 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb94156a20 con 0x7fdb940d0070 2024-04-14T23:34:51.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.210+0000 7fdb89ffb640 1 -- 172.21.15.47:0/1542347684 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb840049e0 con 0x7fdb940d0070 2024-04-14T23:34:51.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.210+0000 7fdb9b955640 1 -- 172.21.15.47:0/1542347684 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb94156fe0 con 0x7fdb940d0070 2024-04-14T23:34:51.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.211+0000 7fdb9b955640 1 -- 172.21.15.47:0/1542347684 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb94073f50 con 0x7fdb940d0070 2024-04-14T23:34:51.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.211+0000 7fdb89ffb640 1 -- 172.21.15.47:0/1542347684 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fdb8401a020 con 0x7fdb940d0070 2024-04-14T23:34:51.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.211+0000 7fdb89ffb640 1 --2- 172.21.15.47:0/1542347684 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdb7806b990 0x7fdb7806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.211+0000 7fdb89ffb640 1 -- 172.21.15.47:0/1542347684 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdb8408a2e0 con 0x7fdb940d0070 2024-04-14T23:34:51.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.211+0000 7fdb996f1640 1 --2- 172.21.15.47:0/1542347684 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdb7806b990 0x7fdb7806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.212+0000 7fdb996f1640 1 --2- 172.21.15.47:0/1542347684 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdb7806b990 0x7fdb7806de50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c036000 tx=0x7fdb8c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:51.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.215+0000 7fdb89ffb640 1 -- 172.21.15.47:0/1542347684 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdb940cc150 con 0x7fdb940d0070 2024-04-14T23:34:51.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.395+0000 7fdb9b955640 1 -- 172.21.15.47:0/1542347684 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdb941567d0 con 0x7fdb940d0070 2024-04-14T23:34:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.396+0000 7fdb89ffb640 1 -- 172.21.15.47:0/1542347684 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fdb84058bb0 con 0x7fdb940d0070 2024-04-14T23:34:51.399 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-14T23:34:51.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.398+0000 7fdb9b955640 1 -- 172.21.15.47:0/1542347684 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdb7806b990 msgr2=0x7fdb7806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.398+0000 7fdb9b955640 1 --2- 172.21.15.47:0/1542347684 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdb7806b990 0x7fdb7806de50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c036000 tx=0x7fdb8c008030 comp rx=0 tx=0).stop 2024-04-14T23:34:51.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.398+0000 7fdb9b955640 1 -- 172.21.15.47:0/1542347684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb940d0070 msgr2=0x7fdb94157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.398+0000 7fdb9b955640 1 --2- 172.21.15.47:0/1542347684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb940d0070 0x7fdb94157eb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400c3e0 tx=0x7fdb8400c8a0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.398+0000 7fdb9b955640 1 -- 172.21.15.47:0/1542347684 shutdown_connections 2024-04-14T23:34:51.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.398+0000 7fdb9b955640 1 --2- 172.21.15.47:0/1542347684 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdb7806b990 0x7fdb7806de50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.398+0000 7fdb9b955640 1 --2- 172.21.15.47:0/1542347684 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb94155310 0x7fdb941583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.398+0000 7fdb9b955640 1 --2- 172.21.15.47:0/1542347684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb940d0070 0x7fdb94157eb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.398+0000 7fdb9b955640 1 --2- 172.21.15.47:0/1542347684 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb9406b740 0x7fdb941465e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.398+0000 7fdb9b955640 1 -- 172.21.15.47:0/1542347684 >> 172.21.15.47:0/1542347684 conn(0x7fdb940cd670 msgr2=0x7fdb940b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:51.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.398+0000 7fdb9b955640 1 -- 172.21.15.47:0/1542347684 shutdown_connections 2024-04-14T23:34:51.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.398+0000 7fdb9b955640 1 -- 172.21.15.47:0/1542347684 wait complete. 2024-04-14T23:34:51.411 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T23:34:51.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.512+0000 7ff2a0308640 1 Processor -- start 2024-04-14T23:34:51.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.512+0000 7ff2a0308640 1 -- start start 2024-04-14T23:34:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.513+0000 7ff2a0308640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff29815e060 0x7ff2980b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.513+0000 7ff2a0308640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff2980b0eb0 0x7ff2980d2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.513+0000 7ff2a0308640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2980b1420 con 0x7ff29815e440 2024-04-14T23:34:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.513+0000 7ff2a0308640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7ff2980b1700 con 0x7ff2980b0eb0 2024-04-14T23:34:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.513+0000 7ff2a0308640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff2980b19e0 con 0x7ff29815e060 2024-04-14T23:34:51.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.514+0000 7ff29d8a3640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff2980b0eb0 0x7ff2980d2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.514+0000 7ff29e0a4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff29815e060 0x7ff2980b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.514+0000 7ff29e8a5640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7ff29815e440 0x7ff2980d4060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.47:47086/0 (socket says 172.21.15.47:47086) 2024-04-14T23:34:51.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.514+0000 7ff29d8a3640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff2980b0eb0 0x7ff2980d2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:60054/0 (socket says 172.21.15.47:60054) 2024-04-14T23:34:51.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.514+0000 7ff29e0a4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff29815e060 0x7ff2980b4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:51716/0 (socket says 172.21.15.47:51716) 2024-04-14T23:34:51.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.514+0000 7ff29e8a5640 1 -- 172.21.15.47:0/3259305598 learned_addr learned my addr 172.21.15.47:0/3259305598 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:51.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.514+0000 7ff29e0a4640 1 -- 172.21.15.47:0/3259305598 >> v2:172.21.15.191:3300/0 conn(0x7ff2980b0eb0 msgr2=0x7ff2980d2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:51.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.514+0000 7ff29e0a4640 1 --2- 172.21.15.47:0/3259305598 >> v2:172.21.15.191:3300/0 conn(0x7ff2980b0eb0 0x7ff2980d2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.514+0000 7ff29e0a4640 1 -- 172.21.15.47:0/3259305598 >> v1:172.21.15.191:6789/0 conn(0x7ff29815e440 legacy=0x7ff2980d4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.514+0000 7ff29e0a4640 1 -- 172.21.15.47:0/3259305598 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2980b1cc0 con 0x7ff29815e060 2024-04-14T23:34:51.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.515+0000 7ff29e0a4640 1 --2- 172.21.15.47:0/3259305598 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff29815e060 0x7ff2980b4f00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff2940097a0 tx=0x7ff29402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8c3fd14d32c03d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:51.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.515+0000 7ff29d0a2640 1 -- 172.21.15.47:0/3259305598 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff294035020 con 0x7ff29815e060 2024-04-14T23:34:51.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.515+0000 7ff29d0a2640 1 -- 172.21.15.47:0/3259305598 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff294031830 con 0x7ff29815e060 2024-04-14T23:34:51.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.515+0000 7ff29d0a2640 1 -- 172.21.15.47:0/3259305598 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff294031c00 con 0x7ff29815e060 2024-04-14T23:34:51.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.516+0000 7ff2a0308640 1 -- 172.21.15.47:0/3259305598 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff29815e060 msgr2=0x7ff2980b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.516+0000 7ff2a0308640 1 --2- 172.21.15.47:0/3259305598 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff29815e060 0x7ff2980b4f00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff2940097a0 tx=0x7ff29402b8d0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.516+0000 7ff2a0308640 1 -- 172.21.15.47:0/3259305598 shutdown_connections 2024-04-14T23:34:51.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.516+0000 7ff2a0308640 1 --2- 172.21.15.47:0/3259305598 >> v2:172.21.15.191:3300/0 conn(0x7ff2980b0eb0 0x7ff2980d2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.516+0000 7ff2a0308640 1 --2- 172.21.15.47:0/3259305598 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff29815e060 0x7ff2980b4f00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.516+0000 7ff2a0308640 1 -- 172.21.15.47:0/3259305598 >> 172.21.15.47:0/3259305598 conn(0x7ff298067940 msgr2=0x7ff29809d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:51.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.516+0000 7ff2a0308640 1 -- 172.21.15.47:0/3259305598 shutdown_connections 2024-04-14T23:34:51.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.516+0000 7ff2a0308640 1 -- 172.21.15.47:0/3259305598 wait complete. 2024-04-14T23:34:51.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.517+0000 7ff2a0308640 1 Processor -- start 2024-04-14T23:34:51.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.517+0000 7ff2a0308640 1 -- start start 2024-04-14T23:34:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff2a0308640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2980b0eb0 0x7ff2981f72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff2a0308640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff29815e060 0x7ff2981578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff2a0308640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff29815e440 0x7ff2980cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff2a0308640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2980b5440 con 0x7ff29815e440 2024-04-14T23:34:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff2a0308640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff2980ceaf0 con 0x7ff2980b0eb0 2024-04-14T23:34:51.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff2a0308640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff2980b34d0 con 0x7ff29815e060 2024-04-14T23:34:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff29e8a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff29815e440 0x7ff2980cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff29e8a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff29815e440 0x7ff2980cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59144/0 (socket says 172.21.15.47:59144) 2024-04-14T23:34:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff29e8a5640 1 -- 172.21.15.47:0/4241781677 learned_addr learned my addr 172.21.15.47:0/4241781677 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff29d8a3640 1 --2- 172.21.15.47:0/4241781677 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff29815e060 0x7ff2981578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff29e0a4640 1 --2- 172.21.15.47:0/4241781677 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2980b0eb0 0x7ff2981f72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff29e8a5640 1 -- 172.21.15.47:0/4241781677 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff29815e060 msgr2=0x7ff2981578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff29e8a5640 1 --2- 172.21.15.47:0/4241781677 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff29815e060 0x7ff2981578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff29e8a5640 1 -- 172.21.15.47:0/4241781677 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2980b0eb0 msgr2=0x7ff2981f72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff29e8a5640 1 --2- 172.21.15.47:0/4241781677 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2980b0eb0 0x7ff2981f72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff29e8a5640 1 -- 172.21.15.47:0/4241781677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2981f79d0 con 0x7ff29815e440 2024-04-14T23:34:51.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff29e8a5640 1 --2- 172.21.15.47:0/4241781677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff29815e440 0x7ff2980cfcc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff29000ca80 tx=0x7ff29000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:51.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff28effd640 1 -- 172.21.15.47:0/4241781677 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff290017070 con 0x7ff29815e440 2024-04-14T23:34:51.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff28effd640 1 -- 172.21.15.47:0/4241781677 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff29000ac30 con 0x7ff29815e440 2024-04-14T23:34:51.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff2a0308640 1 -- 172.21.15.47:0/4241781677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2981f7cb0 con 0x7ff29815e440 2024-04-14T23:34:51.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.518+0000 7ff28effd640 1 -- 172.21.15.47:0/4241781677 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff290012600 con 0x7ff29815e440 2024-04-14T23:34:51.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.519+0000 7ff2a0308640 1 -- 172.21.15.47:0/4241781677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff298160170 con 0x7ff29815e440 2024-04-14T23:34:51.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.520+0000 7ff2a0308640 1 -- 172.21.15.47:0/4241781677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2981f81d0 con 0x7ff29815e440 2024-04-14T23:34:51.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.520+0000 7ff28effd640 1 -- 172.21.15.47:0/4241781677 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ff29001a070 con 0x7ff29815e440 2024-04-14T23:34:51.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.520+0000 7ff28effd640 1 --2- 172.21.15.47:0/4241781677 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff27c06b990 0x7ff27c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.520+0000 7ff28effd640 1 -- 172.21.15.47:0/4241781677 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff29008a7c0 con 0x7ff29815e440 2024-04-14T23:34:51.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.520+0000 7ff29e0a4640 1 --2- 172.21.15.47:0/4241781677 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff27c06b990 0x7ff27c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.521+0000 7ff29e0a4640 1 --2- 172.21.15.47:0/4241781677 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff27c06b990 0x7ff27c06de50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff294036000 tx=0x7ff294008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:51.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.524+0000 7ff28effd640 1 -- 172.21.15.47:0/4241781677 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff2981f81d0 con 0x7ff29815e440 2024-04-14T23:34:51.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.705+0000 7ff2a0308640 1 -- 172.21.15.47:0/4241781677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff298073460 con 0x7ff29815e440 2024-04-14T23:34:51.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.705+0000 7ff28effd640 1 -- 172.21.15.47:0/4241781677 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7ff298073460 con 0x7ff29815e440 2024-04-14T23:34:51.708 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:34:51.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.707+0000 7ff2a0308640 1 -- 172.21.15.47:0/4241781677 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff27c06b990 msgr2=0x7ff27c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.707+0000 7ff2a0308640 1 --2- 172.21.15.47:0/4241781677 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff27c06b990 0x7ff27c06de50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff294036000 tx=0x7ff294008030 comp rx=0 tx=0).stop 2024-04-14T23:34:51.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.707+0000 7ff2a0308640 1 -- 172.21.15.47:0/4241781677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff29815e440 msgr2=0x7ff2980cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.707+0000 7ff2a0308640 1 --2- 172.21.15.47:0/4241781677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff29815e440 0x7ff2980cfcc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff29000ca80 tx=0x7ff29000cf40 comp rx=0 tx=0).stop 2024-04-14T23:34:51.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.707+0000 7ff2a0308640 1 -- 172.21.15.47:0/4241781677 shutdown_connections 2024-04-14T23:34:51.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.707+0000 7ff2a0308640 1 --2- 172.21.15.47:0/4241781677 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff27c06b990 0x7ff27c06de50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.707+0000 7ff2a0308640 1 --2- 172.21.15.47:0/4241781677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff29815e440 0x7ff2980cfcc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.707+0000 7ff2a0308640 1 --2- 172.21.15.47:0/4241781677 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff29815e060 0x7ff2981578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.707+0000 7ff2a0308640 1 --2- 172.21.15.47:0/4241781677 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2980b0eb0 0x7ff2981f72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.707+0000 7ff2a0308640 1 -- 172.21.15.47:0/4241781677 >> 172.21.15.47:0/4241781677 conn(0x7ff298067940 msgr2=0x7ff29815b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:51.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.707+0000 7ff2a0308640 1 -- 172.21.15.47:0/4241781677 shutdown_connections 2024-04-14T23:34:51.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.707+0000 7ff2a0308640 1 -- 172.21.15.47:0/4241781677 wait complete. 2024-04-14T23:34:51.721 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T23:34:51.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.820+0000 7fcc63c36640 1 Processor -- start 2024-04-14T23:34:51.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.821+0000 7fcc63c36640 1 -- start start 2024-04-14T23:34:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.821+0000 7fcc63c36640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fcc5c15e270 0x7fcc5c0d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.821+0000 7fcc63c36640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc5c0d1450 0x7fcc5c0b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.821+0000 7fcc63c36640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc5c0b39d0 con 0x7fcc5c0d1e00 2024-04-14T23:34:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.821+0000 7fcc63c36640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fcc5c0b4300 con 0x7fcc5c15e270 2024-04-14T23:34:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.821+0000 7fcc63c36640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fcc5c0b3cb0 con 0x7fcc5c0d1450 2024-04-14T23:34:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.822+0000 7fcc619d2640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fcc5c15e270 0x7fcc5c0d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.822+0000 7fcc621d3640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc5c0d1450 0x7fcc5c0b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.822+0000 7fcc619d2640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fcc5c15e270 0x7fcc5c0d0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:60068/0 (socket says 172.21.15.47:60068) 2024-04-14T23:34:51.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.822+0000 7fcc619d2640 1 -- 172.21.15.47:0/3381671472 learned_addr learned my addr 172.21.15.47:0/3381671472 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:51.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.822+0000 7fcc619d2640 1 -- 172.21.15.47:0/3381671472 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc5c0d1450 msgr2=0x7fcc5c0b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:51.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.822+0000 7fcc619d2640 1 --2- 172.21.15.47:0/3381671472 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc5c0d1450 0x7fcc5c0b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.822+0000 7fcc619d2640 1 -- 172.21.15.47:0/3381671472 >> v1:172.21.15.191:6789/0 conn(0x7fcc5c0d1e00 legacy=0x7fcc5c0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.822+0000 7fcc619d2640 1 -- 172.21.15.47:0/3381671472 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5c0b3f90 con 0x7fcc5c15e270 2024-04-14T23:34:51.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.822+0000 7fcc621d3640 1 --2- 172.21.15.47:0/3381671472 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc5c0d1450 0x7fcc5c0b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:51.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.823+0000 7fcc619d2640 1 --2- 172.21.15.47:0/3381671472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc5c15e270 0x7fcc5c0d0f10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009870 tx=0x7fcc5402ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b23347564056a67c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.823+0000 7fcc609d0640 1 -- 172.21.15.47:0/3381671472 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5402f830 con 0x7fcc5c15e270 2024-04-14T23:34:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.823+0000 7fcc609d0640 1 -- 172.21.15.47:0/3381671472 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc5402f9d0 con 0x7fcc5c15e270 2024-04-14T23:34:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.823+0000 7fcc609d0640 1 -- 172.21.15.47:0/3381671472 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5402fda0 con 0x7fcc5c15e270 2024-04-14T23:34:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.823+0000 7fcc63c36640 1 -- 172.21.15.47:0/3381671472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc5c15e270 msgr2=0x7fcc5c0d0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.823+0000 7fcc63c36640 1 --2- 172.21.15.47:0/3381671472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc5c15e270 0x7fcc5c0d0f10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009870 tx=0x7fcc5402ba10 comp rx=0 tx=0).stop 2024-04-14T23:34:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.824+0000 7fcc63c36640 1 -- 172.21.15.47:0/3381671472 shutdown_connections 2024-04-14T23:34:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.824+0000 7fcc63c36640 1 --2- 172.21.15.47:0/3381671472 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc5c0d1450 0x7fcc5c0b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.824+0000 7fcc63c36640 1 --2- 172.21.15.47:0/3381671472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc5c15e270 0x7fcc5c0d0f10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.824+0000 7fcc63c36640 1 -- 172.21.15.47:0/3381671472 >> 172.21.15.47:0/3381671472 conn(0x7fcc5c0d3ed0 msgr2=0x7fcc5c0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.824+0000 7fcc63c36640 1 -- 172.21.15.47:0/3381671472 shutdown_connections 2024-04-14T23:34:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.824+0000 7fcc63c36640 1 -- 172.21.15.47:0/3381671472 wait complete. 2024-04-14T23:34:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.825+0000 7fcc63c36640 1 Processor -- start 2024-04-14T23:34:51.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.825+0000 7fcc63c36640 1 -- start start 2024-04-14T23:34:51.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.825+0000 7fcc63c36640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc5c0d1450 0x7fcc5c0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.825+0000 7fcc63c36640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc5c0d1e00 0x7fcc5c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.825+0000 7fcc63c36640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc5c15e270 0x7fcc5c1f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.825+0000 7fcc63c36640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c15e7d0 con 0x7fcc5c0d1450 2024-04-14T23:34:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.825+0000 7fcc63c36640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c15e650 con 0x7fcc5c15e270 2024-04-14T23:34:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.825+0000 7fcc63c36640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fcc5c0d2910 con 0x7fcc5c0d1e00 2024-04-14T23:34:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.826+0000 7fcc619d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc5c0d1450 0x7fcc5c0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.826+0000 7fcc619d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc5c0d1450 0x7fcc5c0c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59156/0 (socket says 172.21.15.47:59156) 2024-04-14T23:34:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.826+0000 7fcc619d2640 1 -- 172.21.15.47:0/3965658712 learned_addr learned my addr 172.21.15.47:0/3965658712 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.826+0000 7fcc621d3640 1 --2- 172.21.15.47:0/3965658712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc5c15e270 0x7fcc5c1f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.826+0000 7fcc611d1640 1 --2- 172.21.15.47:0/3965658712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc5c0d1e00 0x7fcc5c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.826+0000 7fcc619d2640 1 -- 172.21.15.47:0/3965658712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc5c0d1e00 msgr2=0x7fcc5c0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.826+0000 7fcc619d2640 1 --2- 172.21.15.47:0/3965658712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc5c0d1e00 0x7fcc5c0cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.826+0000 7fcc619d2640 1 -- 172.21.15.47:0/3965658712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc5c15e270 msgr2=0x7fcc5c1f7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:51.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.826+0000 7fcc619d2640 1 --2- 172.21.15.47:0/3965658712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc5c15e270 0x7fcc5c1f7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:51.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.826+0000 7fcc619d2640 1 -- 172.21.15.47:0/3965658712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5c0cd1c0 con 0x7fcc5c0d1450 2024-04-14T23:34:51.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.826+0000 7fcc619d2640 1 --2- 172.21.15.47:0/3965658712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc5c0d1450 0x7fcc5c0c9f10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcc54000c00 tx=0x7fcc54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:51.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.826+0000 7fcc5a7fc640 1 -- 172.21.15.47:0/3965658712 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54037c40 con 0x7fcc5c0d1450 2024-04-14T23:34:51.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.826+0000 7fcc5a7fc640 1 -- 172.21.15.47:0/3965658712 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc54046070 con 0x7fcc5c0d1450 2024-04-14T23:34:51.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.826+0000 7fcc5a7fc640 1 -- 172.21.15.47:0/3965658712 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54041400 con 0x7fcc5c0d1450 2024-04-14T23:34:51.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.826+0000 7fcc63c36640 1 -- 172.21.15.47:0/3965658712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc5c0cd4a0 con 0x7fcc5c0d1450 2024-04-14T23:34:51.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.826+0000 7fcc63c36640 1 -- 172.21.15.47:0/3965658712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc5c0cda60 con 0x7fcc5c0d1450 2024-04-14T23:34:51.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.827+0000 7fcc63c36640 1 -- 172.21.15.47:0/3965658712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc5c075430 con 0x7fcc5c0d1450 2024-04-14T23:34:51.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.828+0000 7fcc5a7fc640 1 -- 172.21.15.47:0/3965658712 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fcc54040070 con 0x7fcc5c0d1450 2024-04-14T23:34:51.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.828+0000 7fcc5a7fc640 1 --2- 172.21.15.47:0/3965658712 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fcc4806b990 0x7fcc4806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:51.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.828+0000 7fcc5a7fc640 1 -- 172.21.15.47:0/3965658712 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcc540ad140 con 0x7fcc5c0d1450 2024-04-14T23:34:51.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.828+0000 7fcc611d1640 1 --2- 172.21.15.47:0/3965658712 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fcc4806b990 0x7fcc4806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:51.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.829+0000 7fcc611d1640 1 --2- 172.21.15.47:0/3965658712 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fcc4806b990 0x7fcc4806de50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c1f71e0 tx=0x7fcc50009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:51.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:51.832+0000 7fcc5a7fc640 1 -- 172.21.15.47:0/3965658712 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fcc54033030 con 0x7fcc5c0d1450 2024-04-14T23:34:52.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.024+0000 7fcc63c36640 1 -- 172.21.15.47:0/3965658712 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcc5c0d2e80 con 0x7fcc5c0d1450 2024-04-14T23:34:52.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.024+0000 7fcc5a7fc640 1 -- 172.21.15.47:0/3965658712 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fcc5407ba10 con 0x7fcc5c0d1450 2024-04-14T23:34:52.027 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-14T23:34:52.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.026+0000 7fcc63c36640 1 -- 172.21.15.47:0/3965658712 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fcc4806b990 msgr2=0x7fcc4806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.026+0000 7fcc63c36640 1 --2- 172.21.15.47:0/3965658712 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fcc4806b990 0x7fcc4806de50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c1f71e0 tx=0x7fcc50009040 comp rx=0 tx=0).stop 2024-04-14T23:34:52.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.026+0000 7fcc63c36640 1 -- 172.21.15.47:0/3965658712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc5c0d1450 msgr2=0x7fcc5c0c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.026+0000 7fcc63c36640 1 --2- 172.21.15.47:0/3965658712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc5c0d1450 0x7fcc5c0c9f10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcc54000c00 tx=0x7fcc54004730 comp rx=0 tx=0).stop 2024-04-14T23:34:52.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.026+0000 7fcc63c36640 1 -- 172.21.15.47:0/3965658712 shutdown_connections 2024-04-14T23:34:52.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.026+0000 7fcc63c36640 1 --2- 172.21.15.47:0/3965658712 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fcc4806b990 0x7fcc4806de50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.026+0000 7fcc63c36640 1 --2- 172.21.15.47:0/3965658712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc5c15e270 0x7fcc5c1f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.026+0000 7fcc63c36640 1 --2- 172.21.15.47:0/3965658712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc5c0d1e00 0x7fcc5c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.026+0000 7fcc63c36640 1 --2- 172.21.15.47:0/3965658712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc5c0d1450 0x7fcc5c0c9f10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.026+0000 7fcc63c36640 1 -- 172.21.15.47:0/3965658712 >> 172.21.15.47:0/3965658712 conn(0x7fcc5c0d3ed0 msgr2=0x7fcc5c0b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:52.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.026+0000 7fcc63c36640 1 -- 172.21.15.47:0/3965658712 shutdown_connections 2024-04-14T23:34:52.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.026+0000 7fcc63c36640 1 -- 172.21.15.47:0/3965658712 wait complete. 2024-04-14T23:34:52.039 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi047.front.sepia.ceph.com... 2024-04-14T23:34:52.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:34:52.040 DEBUG:teuthology.orchestra.run.smithi047:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-14T23:34:52.064 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi047.stderr:ceph-fuse[44609]: fuse finished with error 0 and tester_r 0 2024-04-14T23:34:52.066 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:34:52.104 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-04-14T23:34:52.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:34:52.105 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-14T23:34:52.183 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:34:52.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.321+0000 7fd51c069640 1 Processor -- start 2024-04-14T23:34:52.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.322+0000 7fd51c069640 1 -- start start 2024-04-14T23:34:52.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.322+0000 7fd51c069640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd51415e270 0x7fd5140d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.322+0000 7fd51c069640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5140d1450 0x7fd5140b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.322+0000 7fd51c069640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5140b39d0 con 0x7fd5140d1e00 2024-04-14T23:34:52.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.322+0000 7fd51c069640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fd5140b4300 con 0x7fd51415e270 2024-04-14T23:34:52.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.322+0000 7fd51c069640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd5140b3cb0 con 0x7fd5140d1450 2024-04-14T23:34:52.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.323+0000 7fd519e05640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd51415e270 0x7fd5140d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:52.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.323+0000 7fd51a606640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5140d1450 0x7fd5140b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:52.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.323+0000 7fd519e05640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd51415e270 0x7fd5140d0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:60092/0 (socket says 172.21.15.47:60092) 2024-04-14T23:34:52.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.323+0000 7fd51a606640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5140d1450 0x7fd5140b4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:51754/0 (socket says 172.21.15.47:51754) 2024-04-14T23:34:52.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.323+0000 7fd519e05640 1 -- 172.21.15.47:0/4090807967 learned_addr learned my addr 172.21.15.47:0/4090807967 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:52.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.323+0000 7fd519e05640 1 -- 172.21.15.47:0/4090807967 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5140d1450 msgr2=0x7fd5140b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:52.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.323+0000 7fd519e05640 1 --2- 172.21.15.47:0/4090807967 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5140d1450 0x7fd5140b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.323+0000 7fd519e05640 1 -- 172.21.15.47:0/4090807967 >> v1:172.21.15.191:6789/0 conn(0x7fd5140d1e00 legacy=0x7fd5140d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.323+0000 7fd518e03640 1 -- 172.21.15.47:0/4090807967 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911090358 0 0) 0x7fd5140b39d0 con 0x7fd5140d1e00 2024-04-14T23:34:52.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.323+0000 7fd519e05640 1 -- 172.21.15.47:0/4090807967 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5140b3f90 con 0x7fd51415e270 2024-04-14T23:34:52.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.323+0000 7fd51a606640 1 --2- 172.21.15.47:0/4090807967 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5140d1450 0x7fd5140b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:52.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.324+0000 7fd519e05640 1 --2- 172.21.15.47:0/4090807967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd51415e270 0x7fd5140d0f10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd510009870 tx=0x7fd51002ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6f1335b4f0373cb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:52.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.324+0000 7fd518e03640 1 -- 172.21.15.47:0/4090807967 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51002f840 con 0x7fd51415e270 2024-04-14T23:34:52.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.324+0000 7fd518e03640 1 -- 172.21.15.47:0/4090807967 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd51002f9e0 con 0x7fd51415e270 2024-04-14T23:34:52.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.324+0000 7fd518e03640 1 -- 172.21.15.47:0/4090807967 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51002fdb0 con 0x7fd51415e270 2024-04-14T23:34:52.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.325+0000 7fd51c069640 1 -- 172.21.15.47:0/4090807967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd51415e270 msgr2=0x7fd5140d0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.325+0000 7fd51c069640 1 --2- 172.21.15.47:0/4090807967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd51415e270 0x7fd5140d0f10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd510009870 tx=0x7fd51002ba20 comp rx=0 tx=0).stop 2024-04-14T23:34:52.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.325+0000 7fd51c069640 1 -- 172.21.15.47:0/4090807967 shutdown_connections 2024-04-14T23:34:52.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.325+0000 7fd51c069640 1 --2- 172.21.15.47:0/4090807967 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5140d1450 0x7fd5140b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.325+0000 7fd51c069640 1 --2- 172.21.15.47:0/4090807967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd51415e270 0x7fd5140d0f10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.325+0000 7fd51c069640 1 -- 172.21.15.47:0/4090807967 >> 172.21.15.47:0/4090807967 conn(0x7fd5140d3ed0 msgr2=0x7fd5140d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:52.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.325+0000 7fd51c069640 1 -- 172.21.15.47:0/4090807967 shutdown_connections 2024-04-14T23:34:52.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.325+0000 7fd51c069640 1 -- 172.21.15.47:0/4090807967 wait complete. 2024-04-14T23:34:52.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.326+0000 7fd51c069640 1 Processor -- start 2024-04-14T23:34:52.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.326+0000 7fd51c069640 1 -- start start 2024-04-14T23:34:52.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.326+0000 7fd51c069640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5140d1450 0x7fd51414e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd51c069640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5140d1e00 0x7fd5140cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd51c069640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd51415e270 0x7fd5140cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd51c069640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd51415e7d0 con 0x7fd5140d1e00 2024-04-14T23:34:52.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd51c069640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd51415e650 con 0x7fd5140d1450 2024-04-14T23:34:52.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd51c069640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd5140d2910 con 0x7fd51415e270 2024-04-14T23:34:52.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd519604640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5140d1e00 0x7fd5140cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:52.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd519604640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5140d1e00 0x7fd5140cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59160/0 (socket says 172.21.15.47:59160) 2024-04-14T23:34:52.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd519604640 1 -- 172.21.15.47:0/1355889636 learned_addr learned my addr 172.21.15.47:0/1355889636 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:52.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd51a606640 1 --2- 172.21.15.47:0/1355889636 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd51415e270 0x7fd5140cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:52.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd519e05640 1 --2- 172.21.15.47:0/1355889636 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5140d1450 0x7fd51414e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:52.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd519604640 1 -- 172.21.15.47:0/1355889636 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd51415e270 msgr2=0x7fd5140cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd519604640 1 --2- 172.21.15.47:0/1355889636 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd51415e270 0x7fd5140cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd519604640 1 -- 172.21.15.47:0/1355889636 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5140d1450 msgr2=0x7fd51414e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd519604640 1 --2- 172.21.15.47:0/1355889636 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5140d1450 0x7fd51414e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd519604640 1 -- 172.21.15.47:0/1355889636 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51414eb80 con 0x7fd5140d1e00 2024-04-14T23:34:52.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd519604640 1 --2- 172.21.15.47:0/1355889636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5140d1e00 0x7fd5140cafa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd50400c550 tx=0x7fd50400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:52.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd50a7fc640 1 -- 172.21.15.47:0/1355889636 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504017070 con 0x7fd5140d1e00 2024-04-14T23:34:52.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd50a7fc640 1 -- 172.21.15.47:0/1355889636 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5040035f0 con 0x7fd5140d1e00 2024-04-14T23:34:52.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd51c069640 1 -- 172.21.15.47:0/1355889636 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5140b7830 con 0x7fd5140d1e00 2024-04-14T23:34:52.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd50a7fc640 1 -- 172.21.15.47:0/1355889636 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5040039e0 con 0x7fd5140d1e00 2024-04-14T23:34:52.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.327+0000 7fd51c069640 1 -- 172.21.15.47:0/1355889636 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5140b7df0 con 0x7fd5140d1e00 2024-04-14T23:34:52.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.328+0000 7fd51c069640 1 -- 172.21.15.47:0/1355889636 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd514075430 con 0x7fd5140d1e00 2024-04-14T23:34:52.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.329+0000 7fd50a7fc640 1 -- 172.21.15.47:0/1355889636 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd50401a070 con 0x7fd5140d1e00 2024-04-14T23:34:52.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.329+0000 7fd50a7fc640 1 --2- 172.21.15.47:0/1355889636 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd4f806b9c0 0x7fd4f806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.329+0000 7fd50a7fc640 1 -- 172.21.15.47:0/1355889636 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd504089ea0 con 0x7fd5140d1e00 2024-04-14T23:34:52.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.329+0000 7fd519e05640 1 --2- 172.21.15.47:0/1355889636 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd4f806b9c0 0x7fd4f806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:52.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.330+0000 7fd519e05640 1 --2- 172.21.15.47:0/1355889636 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd4f806b9c0 0x7fd4f806de80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd510036000 tx=0x7fd510008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:52.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.334+0000 7fd50a7fc640 1 -- 172.21.15.47:0/1355889636 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd5040581b0 con 0x7fd5140d1e00 2024-04-14T23:34:52.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.514+0000 7fd51c069640 1 -- 172.21.15.47:0/1355889636 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd51406d860 con 0x7fd5140d1e00 2024-04-14T23:34:52.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.515+0000 7fd50a7fc640 1 -- 172.21.15.47:0/1355889636 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7fd50405c250 con 0x7fd5140d1e00 2024-04-14T23:34:52.518 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:52.518 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:44.714882+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:34:52.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.517+0000 7fd51c069640 1 -- 172.21.15.47:0/1355889636 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd4f806b9c0 msgr2=0x7fd4f806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.517+0000 7fd51c069640 1 --2- 172.21.15.47:0/1355889636 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd4f806b9c0 0x7fd4f806de80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd510036000 tx=0x7fd510008030 comp rx=0 tx=0).stop 2024-04-14T23:34:52.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.517+0000 7fd51c069640 1 -- 172.21.15.47:0/1355889636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5140d1e00 msgr2=0x7fd5140cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.517+0000 7fd51c069640 1 --2- 172.21.15.47:0/1355889636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5140d1e00 0x7fd5140cafa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd50400c550 tx=0x7fd50400ca10 comp rx=0 tx=0).stop 2024-04-14T23:34:52.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.517+0000 7fd51c069640 1 -- 172.21.15.47:0/1355889636 shutdown_connections 2024-04-14T23:34:52.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.517+0000 7fd51c069640 1 --2- 172.21.15.47:0/1355889636 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd4f806b9c0 0x7fd4f806de80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.517+0000 7fd51c069640 1 --2- 172.21.15.47:0/1355889636 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd51415e270 0x7fd5140cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.517+0000 7fd51c069640 1 --2- 172.21.15.47:0/1355889636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5140d1e00 0x7fd5140cafa0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.517+0000 7fd51c069640 1 --2- 172.21.15.47:0/1355889636 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5140d1450 0x7fd51414e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.517+0000 7fd51c069640 1 -- 172.21.15.47:0/1355889636 >> 172.21.15.47:0/1355889636 conn(0x7fd5140d3ed0 msgr2=0x7fd5140d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:52.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.517+0000 7fd51c069640 1 -- 172.21.15.47:0/1355889636 shutdown_connections 2024-04-14T23:34:52.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.517+0000 7fd51c069640 1 -- 172.21.15.47:0/1355889636 wait complete. 2024-04-14T23:34:52.531 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:34:52.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.629+0000 7f3a3082d640 1 Processor -- start 2024-04-14T23:34:52.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.629+0000 7f3a3082d640 1 -- start start 2024-04-14T23:34:52.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.630+0000 7f3a3082d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3a2c0cca50 0x7f3a2c0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.630+0000 7f3a3082d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a2c0d16d0 0x7f3a2c162480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.630+0000 7f3a3082d640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a2c15e9a0 con 0x7f3a2c0ceab0 2024-04-14T23:34:52.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.630+0000 7f3a3082d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3a2c15f5b0 con 0x7f3a2c0cca50 2024-04-14T23:34:52.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.630+0000 7f3a3082d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2c15ec80 con 0x7f3a2c0d16d0 2024-04-14T23:34:52.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.630+0000 7f3a2a59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3a2c0cca50 0x7f3a2c0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:52.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.630+0000 7f3a2a59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3a2c0cca50 0x7f3a2c0cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59168/0 (socket says 172.21.15.47:59168) 2024-04-14T23:34:52.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.630+0000 7f3a2a59c640 1 -- 172.21.15.47:0/3488504751 learned_addr learned my addr 172.21.15.47:0/3488504751 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:52.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.630+0000 7f3a2ad9d640 1 --2- 172.21.15.47:0/3488504751 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a2c0d16d0 0x7f3a2c162480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:52.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.630+0000 7f3a2a59c640 1 -- 172.21.15.47:0/3488504751 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a2c0d16d0 msgr2=0x7f3a2c162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:52.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.630+0000 7f3a2a59c640 1 --2- 172.21.15.47:0/3488504751 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a2c0d16d0 0x7f3a2c162480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.630+0000 7f3a2a59c640 1 -- 172.21.15.47:0/3488504751 >> v1:172.21.15.191:6789/0 conn(0x7f3a2c0ceab0 legacy=0x7f3a2c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.630+0000 7f3a2a59c640 1 -- 172.21.15.47:0/3488504751 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2c15ef60 con 0x7f3a2c0cca50 2024-04-14T23:34:52.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.631+0000 7f3a2a59c640 1 --2- 172.21.15.47:0/3488504751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2c0cca50 0x7f3a2c0cce30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009870 tx=0x7f3a1c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb186675b17f1f47 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:52.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.631+0000 7f3a29d9b640 1 -- 172.21.15.47:0/3488504751 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0317c0 con 0x7f3a2c0cca50 2024-04-14T23:34:52.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.631+0000 7f3a29d9b640 1 -- 172.21.15.47:0/3488504751 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1c037070 con 0x7f3a2c0cca50 2024-04-14T23:34:52.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.631+0000 7f3a29d9b640 1 -- 172.21.15.47:0/3488504751 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c031b80 con 0x7f3a2c0cca50 2024-04-14T23:34:52.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.632+0000 7f3a3082d640 1 -- 172.21.15.47:0/3488504751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2c0cca50 msgr2=0x7f3a2c0cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.632+0000 7f3a3082d640 1 --2- 172.21.15.47:0/3488504751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2c0cca50 0x7f3a2c0cce30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009870 tx=0x7f3a1c02b860 comp rx=0 tx=0).stop 2024-04-14T23:34:52.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.632+0000 7f3a3082d640 1 -- 172.21.15.47:0/3488504751 shutdown_connections 2024-04-14T23:34:52.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.632+0000 7f3a3082d640 1 --2- 172.21.15.47:0/3488504751 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a2c0d16d0 0x7f3a2c162480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.632+0000 7f3a3082d640 1 --2- 172.21.15.47:0/3488504751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2c0cca50 0x7f3a2c0cce30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.632+0000 7f3a3082d640 1 -- 172.21.15.47:0/3488504751 >> 172.21.15.47:0/3488504751 conn(0x7f3a2c0d0bb0 msgr2=0x7f3a2c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:52.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.632+0000 7f3a3082d640 1 -- 172.21.15.47:0/3488504751 shutdown_connections 2024-04-14T23:34:52.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.632+0000 7f3a3082d640 1 -- 172.21.15.47:0/3488504751 wait complete. 2024-04-14T23:34:52.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.633+0000 7f3a3082d640 1 Processor -- start 2024-04-14T23:34:52.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.633+0000 7f3a3082d640 1 -- start start 2024-04-14T23:34:52.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a3082d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a2c0cca50 0x7f3a2c0c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a3082d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2c0ceab0 0x7f3a2c1565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a3082d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a2c0d16d0 0x7f3a2c0c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a3082d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c15e660 con 0x7f3a2c0ceab0 2024-04-14T23:34:52.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a3082d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c0cd370 con 0x7f3a2c0d16d0 2024-04-14T23:34:52.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a3082d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2c0cb3c0 con 0x7f3a2c0cca50 2024-04-14T23:34:52.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a23fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2c0ceab0 0x7f3a2c1565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:52.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a23fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2c0ceab0 0x7f3a2c1565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59184/0 (socket says 172.21.15.47:59184) 2024-04-14T23:34:52.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a23fff640 1 -- 172.21.15.47:0/721206350 learned_addr learned my addr 172.21.15.47:0/721206350 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:52.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a2a59c640 1 --2- 172.21.15.47:0/721206350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a2c0cca50 0x7f3a2c0c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:52.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a2ad9d640 1 --2- 172.21.15.47:0/721206350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a2c0d16d0 0x7f3a2c0c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:52.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a23fff640 1 -- 172.21.15.47:0/721206350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a2c0cca50 msgr2=0x7f3a2c0c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a23fff640 1 --2- 172.21.15.47:0/721206350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a2c0cca50 0x7f3a2c0c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a23fff640 1 -- 172.21.15.47:0/721206350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a2c0d16d0 msgr2=0x7f3a2c0c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a23fff640 1 --2- 172.21.15.47:0/721206350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a2c0d16d0 0x7f3a2c0c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a23fff640 1 -- 172.21.15.47:0/721206350 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2c0c77a0 con 0x7f3a2c0ceab0 2024-04-14T23:34:52.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a23fff640 1 --2- 172.21.15.47:0/721206350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2c0ceab0 0x7f3a2c1565e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400c470 tx=0x7f3a14001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:52.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a22ffd640 1 -- 172.21.15.47:0/721206350 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a140052d0 con 0x7f3a2c0ceab0 2024-04-14T23:34:52.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.634+0000 7f3a22ffd640 1 -- 172.21.15.47:0/721206350 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a14005470 con 0x7f3a2c0ceab0 2024-04-14T23:34:52.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.635+0000 7f3a3082d640 1 -- 172.21.15.47:0/721206350 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a2c0b5a80 con 0x7f3a2c0ceab0 2024-04-14T23:34:52.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.635+0000 7f3a22ffd640 1 -- 172.21.15.47:0/721206350 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14007260 con 0x7f3a2c0ceab0 2024-04-14T23:34:52.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.635+0000 7f3a3082d640 1 -- 172.21.15.47:0/721206350 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a2c0b6040 con 0x7f3a2c0ceab0 2024-04-14T23:34:52.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.635+0000 7f3a3082d640 1 -- 172.21.15.47:0/721206350 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2c075430 con 0x7f3a2c0ceab0 2024-04-14T23:34:52.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.636+0000 7f3a22ffd640 1 -- 172.21.15.47:0/721206350 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f3a14007400 con 0x7f3a2c0ceab0 2024-04-14T23:34:52.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.636+0000 7f3a22ffd640 1 --2- 172.21.15.47:0/721206350 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3a0c06b990 0x7f3a0c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.636+0000 7f3a22ffd640 1 -- 172.21.15.47:0/721206350 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3a1408a000 con 0x7f3a2c0ceab0 2024-04-14T23:34:52.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.637+0000 7f3a2a59c640 1 --2- 172.21.15.47:0/721206350 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3a0c06b990 0x7f3a0c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:52.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.637+0000 7f3a2a59c640 1 --2- 172.21.15.47:0/721206350 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3a0c06b990 0x7f3a0c06de50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c036000 tx=0x7f3a1c03d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:52.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.641+0000 7f3a22ffd640 1 -- 172.21.15.47:0/721206350 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3a14058280 con 0x7f3a2c0ceab0 2024-04-14T23:34:52.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.824+0000 7f3a3082d640 1 -- 172.21.15.47:0/721206350 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a2c0c4260 con 0x7f3a2c0ceab0 2024-04-14T23:34:52.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.825+0000 7f3a22ffd640 1 -- 172.21.15.47:0/721206350 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7f3a1405c320 con 0x7f3a2c0ceab0 2024-04-14T23:34:52.829 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:52.829 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:44.714882+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:34:52.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.827+0000 7f3a3082d640 1 -- 172.21.15.47:0/721206350 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3a0c06b990 msgr2=0x7f3a0c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.827+0000 7f3a3082d640 1 --2- 172.21.15.47:0/721206350 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3a0c06b990 0x7f3a0c06de50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c036000 tx=0x7f3a1c03d040 comp rx=0 tx=0).stop 2024-04-14T23:34:52.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.827+0000 7f3a3082d640 1 -- 172.21.15.47:0/721206350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2c0ceab0 msgr2=0x7f3a2c1565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.827+0000 7f3a3082d640 1 --2- 172.21.15.47:0/721206350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2c0ceab0 0x7f3a2c1565e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400c470 tx=0x7f3a14001e70 comp rx=0 tx=0).stop 2024-04-14T23:34:52.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.827+0000 7f3a3082d640 1 -- 172.21.15.47:0/721206350 shutdown_connections 2024-04-14T23:34:52.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.827+0000 7f3a3082d640 1 --2- 172.21.15.47:0/721206350 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3a0c06b990 0x7f3a0c06de50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.827+0000 7f3a3082d640 1 --2- 172.21.15.47:0/721206350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a2c0d16d0 0x7f3a2c0c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.827+0000 7f3a3082d640 1 --2- 172.21.15.47:0/721206350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a2c0ceab0 0x7f3a2c1565e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.827+0000 7f3a3082d640 1 --2- 172.21.15.47:0/721206350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a2c0cca50 0x7f3a2c0c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.827+0000 7f3a3082d640 1 -- 172.21.15.47:0/721206350 >> 172.21.15.47:0/721206350 conn(0x7f3a2c0d0bb0 msgr2=0x7f3a2c0a0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:52.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.828+0000 7f3a3082d640 1 -- 172.21.15.47:0/721206350 shutdown_connections 2024-04-14T23:34:52.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.828+0000 7f3a3082d640 1 -- 172.21.15.47:0/721206350 wait complete. 2024-04-14T23:34:52.842 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-14T23:34:52.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.943+0000 7fc73f564640 1 Processor -- start 2024-04-14T23:34:52.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.943+0000 7fc73f564640 1 -- start start 2024-04-14T23:34:52.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.944+0000 7fc73f564640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc7380b1c20 0x7fc7380d2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.944+0000 7fc73f564640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7380d4cc0 con 0x7fc7380b2c70 2024-04-14T23:34:52.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.944+0000 7fc73f564640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7380d0d80 con 0x7fc7381619b0 2024-04-14T23:34:52.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.944+0000 7fc73f564640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc7380d2c00 con 0x7fc7380b1c20 2024-04-14T23:34:52.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.944+0000 7fc73caff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc7380b1c20 0x7fc7380d2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:52.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.944+0000 7fc73db01640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc7380b2c70 0x7fc7380ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41888/0 (socket says 172.21.15.47:41888) 2024-04-14T23:34:52.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.944+0000 7fc73db01640 1 -- 172.21.15.47:0/2792378397 learned_addr learned my addr 172.21.15.47:0/2792378397 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:52.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.944+0000 7fc73caff640 1 -- 172.21.15.47:0/2792378397 >> v1:172.21.15.191:6789/0 conn(0x7fc7381619b0 legacy=0x7fc7380d1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:52.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.944+0000 7fc73caff640 1 -- 172.21.15.47:0/2792378397 >> v1:172.21.15.47:6789/0 conn(0x7fc7380b2c70 legacy=0x7fc7380ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.944+0000 7fc73caff640 1 -- 172.21.15.47:0/2792378397 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7380d2ee0 con 0x7fc7380b1c20 2024-04-14T23:34:52.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.945+0000 7fc73caff640 1 --2- 172.21.15.47:0/2792378397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7380b1c20 0x7fc7380d2590 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc7380ba030 tx=0x7fc72c02b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ea7c8e758541bf server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:52.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.945+0000 7fc737fff640 1 -- 172.21.15.47:0/2792378397 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c039070 con 0x7fc7380b1c20 2024-04-14T23:34:52.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.945+0000 7fc737fff640 1 -- 172.21.15.47:0/2792378397 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc72c030070 con 0x7fc7380b1c20 2024-04-14T23:34:52.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.945+0000 7fc737fff640 1 -- 172.21.15.47:0/2792378397 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c0318f0 con 0x7fc7380b1c20 2024-04-14T23:34:52.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.946+0000 7fc73f564640 1 -- 172.21.15.47:0/2792378397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7380b1c20 msgr2=0x7fc7380d2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.946+0000 7fc73f564640 1 --2- 172.21.15.47:0/2792378397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7380b1c20 0x7fc7380d2590 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc7380ba030 tx=0x7fc72c02b770 comp rx=0 tx=0).stop 2024-04-14T23:34:52.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.946+0000 7fc73f564640 1 -- 172.21.15.47:0/2792378397 shutdown_connections 2024-04-14T23:34:52.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.946+0000 7fc73f564640 1 --2- 172.21.15.47:0/2792378397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7380b1c20 0x7fc7380d2590 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.946+0000 7fc73f564640 1 -- 172.21.15.47:0/2792378397 >> 172.21.15.47:0/2792378397 conn(0x7fc7380d3f80 msgr2=0x7fc7380d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:52.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.946+0000 7fc73f564640 1 -- 172.21.15.47:0/2792378397 shutdown_connections 2024-04-14T23:34:52.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.946+0000 7fc73f564640 1 -- 172.21.15.47:0/2792378397 wait complete. 2024-04-14T23:34:52.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.947+0000 7fc73f564640 1 Processor -- start 2024-04-14T23:34:52.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.947+0000 7fc73f564640 1 -- start start 2024-04-14T23:34:52.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73f564640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7380b1c20 0x7fc7380b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73f564640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7380b2c70 0x7fc73806cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73f564640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7381619b0 0x7fc73806d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73f564640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc7380cf2a0 con 0x7fc7381619b0 2024-04-14T23:34:52.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73f564640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc7380d1320 con 0x7fc7380b1c20 2024-04-14T23:34:52.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73f564640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc7380cf420 con 0x7fc7380b2c70 2024-04-14T23:34:52.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73db01640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7381619b0 0x7fc73806d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:52.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73db01640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7381619b0 0x7fc73806d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59188/0 (socket says 172.21.15.47:59188) 2024-04-14T23:34:52.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73db01640 1 -- 172.21.15.47:0/94439590 learned_addr learned my addr 172.21.15.47:0/94439590 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:52.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73db01640 1 -- 172.21.15.47:0/94439590 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7380b2c70 msgr2=0x7fc73806cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73db01640 1 --2- 172.21.15.47:0/94439590 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7380b2c70 0x7fc73806cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73db01640 1 -- 172.21.15.47:0/94439590 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7380b1c20 msgr2=0x7fc7380b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:52.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73d300640 1 --2- 172.21.15.47:0/94439590 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7380b1c20 0x7fc7380b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:52.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73db01640 1 --2- 172.21.15.47:0/94439590 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7380b1c20 0x7fc7380b8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:52.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73db01640 1 -- 172.21.15.47:0/94439590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7381f4d00 con 0x7fc7381619b0 2024-04-14T23:34:52.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73d300640 1 --2- 172.21.15.47:0/94439590 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7380b1c20 0x7fc7380b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:52.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73db01640 1 --2- 172.21.15.47:0/94439590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7381619b0 0x7fc73806d4a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc72800cad0 tx=0x7fc72800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:52.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc735ffb640 1 -- 172.21.15.47:0/94439590 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc728017070 con 0x7fc7381619b0 2024-04-14T23:34:52.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc735ffb640 1 -- 172.21.15.47:0/94439590 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc72800ac30 con 0x7fc7381619b0 2024-04-14T23:34:52.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc73f564640 1 -- 172.21.15.47:0/94439590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7380b8030 con 0x7fc7381619b0 2024-04-14T23:34:52.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.948+0000 7fc735ffb640 1 -- 172.21.15.47:0/94439590 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc728012620 con 0x7fc7381619b0 2024-04-14T23:34:52.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.949+0000 7fc73f564640 1 -- 172.21.15.47:0/94439590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7380b85f0 con 0x7fc7381619b0 2024-04-14T23:34:52.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.950+0000 7fc73f564640 1 -- 172.21.15.47:0/94439590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc738073f50 con 0x7fc7381619b0 2024-04-14T23:34:52.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.950+0000 7fc735ffb640 1 -- 172.21.15.47:0/94439590 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc72801a070 con 0x7fc7381619b0 2024-04-14T23:34:52.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.950+0000 7fc735ffb640 1 --2- 172.21.15.47:0/94439590 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc72406b990 0x7fc72406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:52.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.951+0000 7fc735ffb640 1 -- 172.21.15.47:0/94439590 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc72808a8f0 con 0x7fc7381619b0 2024-04-14T23:34:52.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.951+0000 7fc73d300640 1 --2- 172.21.15.47:0/94439590 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc72406b990 0x7fc72406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:52.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.951+0000 7fc73d300640 1 --2- 172.21.15.47:0/94439590 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc72406b990 0x7fc72406de50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc73000a830 tx=0x7fc730008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:52.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:52.955+0000 7fc735ffb640 1 -- 172.21.15.47:0/94439590 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc72800ae20 con 0x7fc7381619b0 2024-04-14T23:34:53.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.174+0000 7fc73f564640 1 -- 172.21.15.47:0/94439590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc7380686e0 con 0x7fc7381619b0 2024-04-14T23:34:53.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.748+0000 7fc735ffb640 1 -- 172.21.15.47:0/94439590 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fc7280591c0 con 0x7fc7381619b0 2024-04-14T23:34:53.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.751+0000 7fc73f564640 1 -- 172.21.15.47:0/94439590 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc72406b990 msgr2=0x7fc72406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:53.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.751+0000 7fc73f564640 1 --2- 172.21.15.47:0/94439590 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc72406b990 0x7fc72406de50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc73000a830 tx=0x7fc730008040 comp rx=0 tx=0).stop 2024-04-14T23:34:53.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.751+0000 7fc73f564640 1 -- 172.21.15.47:0/94439590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7381619b0 msgr2=0x7fc73806d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:53.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.751+0000 7fc73f564640 1 --2- 172.21.15.47:0/94439590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7381619b0 0x7fc73806d4a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc72800cad0 tx=0x7fc72800cf90 comp rx=0 tx=0).stop 2024-04-14T23:34:53.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.751+0000 7fc73f564640 1 -- 172.21.15.47:0/94439590 shutdown_connections 2024-04-14T23:34:53.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.751+0000 7fc73f564640 1 --2- 172.21.15.47:0/94439590 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc72406b990 0x7fc72406de50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:53.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.751+0000 7fc73f564640 1 --2- 172.21.15.47:0/94439590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7381619b0 0x7fc73806d4a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:53.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.751+0000 7fc73f564640 1 --2- 172.21.15.47:0/94439590 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7380b2c70 0x7fc73806cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:53.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.751+0000 7fc73f564640 1 --2- 172.21.15.47:0/94439590 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7380b1c20 0x7fc7380b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:53.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.751+0000 7fc73f564640 1 -- 172.21.15.47:0/94439590 >> 172.21.15.47:0/94439590 conn(0x7fc7380d3f80 msgr2=0x7fc73815e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:53.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.751+0000 7fc73f564640 1 -- 172.21.15.47:0/94439590 shutdown_connections 2024-04-14T23:34:53.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.751+0000 7fc73f564640 1 -- 172.21.15.47:0/94439590 wait complete. 2024-04-14T23:34:53.767 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-14T23:34:53.767 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-14T23:34:53.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.873+0000 7f2d1dc76640 1 Processor -- start 2024-04-14T23:34:53.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.873+0000 7f2d1dc76640 1 -- start start 2024-04-14T23:34:53.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.873+0000 7f2d1dc76640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2d1815f5d0 0x7f2d180d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:53.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.873+0000 7f2d1dc76640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2d180cd4d0 0x7f2d180cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:53.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.873+0000 7f2d1dc76640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d1815f9b0 con 0x7f2d1815fc20 2024-04-14T23:34:53.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.873+0000 7f2d1dc76640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2d180cfa20 con 0x7f2d180cd4d0 2024-04-14T23:34:53.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.873+0000 7f2d1dc76640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f2d180cfd00 con 0x7f2d1815f5d0 2024-04-14T23:34:53.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.873+0000 7f2d16ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2d180cd4d0 0x7f2d180cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:53.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.873+0000 7f2d16ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2d180cd4d0 0x7f2d180cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35814/0 (socket says 172.21.15.47:35814) 2024-04-14T23:34:53.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.873+0000 7f2d16ffd640 1 -- 172.21.15.47:0/1082035737 learned_addr learned my addr 172.21.15.47:0/1082035737 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:53.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.874+0000 7f2d177fe640 1 --2- 172.21.15.47:0/1082035737 >> v2:172.21.15.191:3300/0 conn(0x7f2d1815f5d0 0x7f2d180d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:53.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.874+0000 7f2d16ffd640 1 -- 172.21.15.47:0/1082035737 >> v2:172.21.15.191:3300/0 conn(0x7f2d1815f5d0 msgr2=0x7f2d180d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:53.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.874+0000 7f2d16ffd640 1 --2- 172.21.15.47:0/1082035737 >> v2:172.21.15.191:3300/0 conn(0x7f2d1815f5d0 0x7f2d180d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:53.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.874+0000 7f2d16ffd640 1 -- 172.21.15.47:0/1082035737 >> v1:172.21.15.191:6789/0 conn(0x7f2d1815fc20 legacy=0x7f2d180ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:53.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.874+0000 7f2d16ffd640 1 -- 172.21.15.47:0/1082035737 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d180cffe0 con 0x7f2d180cd4d0 2024-04-14T23:34:53.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.875+0000 7f2d16ffd640 1 --2- 172.21.15.47:0/1082035737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d180cd4d0 0x7f2d180cd940 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2d18071f60 tx=0x7f2d0c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761ef980fea2e3b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:53.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.875+0000 7f2d167fc640 1 -- 172.21.15.47:0/1082035737 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c02e070 con 0x7f2d180cd4d0 2024-04-14T23:34:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.875+0000 7f2d167fc640 1 -- 172.21.15.47:0/1082035737 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0c037070 con 0x7f2d180cd4d0 2024-04-14T23:34:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.875+0000 7f2d167fc640 1 -- 172.21.15.47:0/1082035737 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c031a00 con 0x7f2d180cd4d0 2024-04-14T23:34:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.875+0000 7f2d1dc76640 1 -- 172.21.15.47:0/1082035737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d180cd4d0 msgr2=0x7f2d180cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.875+0000 7f2d1dc76640 1 --2- 172.21.15.47:0/1082035737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d180cd4d0 0x7f2d180cd940 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2d18071f60 tx=0x7f2d0c02b880 comp rx=0 tx=0).stop 2024-04-14T23:34:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.875+0000 7f2d1dc76640 1 -- 172.21.15.47:0/1082035737 shutdown_connections 2024-04-14T23:34:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.875+0000 7f2d1dc76640 1 --2- 172.21.15.47:0/1082035737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d180cd4d0 0x7f2d180cd940 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.875+0000 7f2d1dc76640 1 --2- 172.21.15.47:0/1082035737 >> v2:172.21.15.191:3300/0 conn(0x7f2d1815f5d0 0x7f2d180d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.875+0000 7f2d1dc76640 1 -- 172.21.15.47:0/1082035737 >> 172.21.15.47:0/1082035737 conn(0x7f2d180d1db0 msgr2=0x7f2d180d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.875+0000 7f2d1dc76640 1 -- 172.21.15.47:0/1082035737 shutdown_connections 2024-04-14T23:34:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.875+0000 7f2d1dc76640 1 -- 172.21.15.47:0/1082035737 wait complete. 2024-04-14T23:34:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.876+0000 7f2d1dc76640 1 Processor -- start 2024-04-14T23:34:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.877+0000 7f2d1dc76640 1 -- start start 2024-04-14T23:34:53.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.877+0000 7f2d1dc76640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d180cd4d0 0x7f2d180c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:53.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.877+0000 7f2d1dc76640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d1815f5d0 0x7f2d181568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:53.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.877+0000 7f2d1dc76640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1815fc20 0x7f2d1815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:53.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.877+0000 7f2d1dc76640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2d180d2bd0 con 0x7f2d1815fc20 2024-04-14T23:34:53.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.877+0000 7f2d1dc76640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2d180d05a0 con 0x7f2d1815f5d0 2024-04-14T23:34:53.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.877+0000 7f2d1dc76640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f2d18160070 con 0x7f2d180cd4d0 2024-04-14T23:34:53.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.877+0000 7f2d17fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1815fc20 0x7f2d1815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:53.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.877+0000 7f2d17fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1815fc20 0x7f2d1815bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35818/0 (socket says 172.21.15.47:35818) 2024-04-14T23:34:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.877+0000 7f2d17fff640 1 -- 172.21.15.47:0/319531194 learned_addr learned my addr 172.21.15.47:0/319531194 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.878+0000 7f2d177fe640 1 --2- 172.21.15.47:0/319531194 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d180cd4d0 0x7f2d180c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.878+0000 7f2d16ffd640 1 --2- 172.21.15.47:0/319531194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d1815f5d0 0x7f2d181568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.878+0000 7f2d17fff640 1 -- 172.21.15.47:0/319531194 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d180cd4d0 msgr2=0x7f2d180c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.878+0000 7f2d17fff640 1 --2- 172.21.15.47:0/319531194 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d180cd4d0 0x7f2d180c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.878+0000 7f2d17fff640 1 -- 172.21.15.47:0/319531194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d1815f5d0 msgr2=0x7f2d181568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.878+0000 7f2d17fff640 1 --2- 172.21.15.47:0/319531194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d1815f5d0 0x7f2d181568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.878+0000 7f2d17fff640 1 -- 172.21.15.47:0/319531194 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d180ca000 con 0x7f2d1815fc20 2024-04-14T23:34:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.878+0000 7f2d17fff640 1 --2- 172.21.15.47:0/319531194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1815fc20 0x7f2d1815bdf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2d1000b970 tx=0x7f2d1000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.878+0000 7f2cfffff640 1 -- 172.21.15.47:0/319531194 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d10019070 con 0x7f2d1815fc20 2024-04-14T23:34:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.878+0000 7f2cfffff640 1 -- 172.21.15.47:0/319531194 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d1000cb40 con 0x7f2d1815fc20 2024-04-14T23:34:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.878+0000 7f2d1dc76640 1 -- 172.21.15.47:0/319531194 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d180ca2e0 con 0x7f2d1815fc20 2024-04-14T23:34:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.878+0000 7f2cfffff640 1 -- 172.21.15.47:0/319531194 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d10014440 con 0x7f2d1815fc20 2024-04-14T23:34:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.878+0000 7f2d1dc76640 1 -- 172.21.15.47:0/319531194 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d180ca8a0 con 0x7f2d1815fc20 2024-04-14T23:34:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.879+0000 7f2d1dc76640 1 -- 172.21.15.47:0/319531194 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d180681f0 con 0x7f2d1815fc20 2024-04-14T23:34:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.879+0000 7f2cfffff640 1 -- 172.21.15.47:0/319531194 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f2d1001c070 con 0x7f2d1815fc20 2024-04-14T23:34:53.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.880+0000 7f2cfffff640 1 --2- 172.21.15.47:0/319531194 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d0406b990 0x7f2d0406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:53.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.880+0000 7f2cfffff640 1 -- 172.21.15.47:0/319531194 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2d1008a730 con 0x7f2d1815fc20 2024-04-14T23:34:53.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.880+0000 7f2d177fe640 1 --2- 172.21.15.47:0/319531194 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d0406b990 0x7f2d0406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:53.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.881+0000 7f2d177fe640 1 --2- 172.21.15.47:0/319531194 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d0406b990 0x7f2d0406de50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d08006fd0 tx=0x7f2d08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:53.884+0000 7f2cfffff640 1 -- 172.21.15.47:0/319531194 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2d100589b0 con 0x7f2d1815fc20 2024-04-14T23:34:54.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.104+0000 7f2d1dc76640 1 -- 172.21.15.47:0/319531194 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2d180b5c40 con 0x7f2d1815fc20 2024-04-14T23:34:54.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.753+0000 7f2cfffff640 1 -- 172.21.15.47:0/319531194 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f2d1005ca50 con 0x7f2d1815fc20 2024-04-14T23:34:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.755+0000 7f2d1dc76640 1 -- 172.21.15.47:0/319531194 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d0406b990 msgr2=0x7f2d0406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.755+0000 7f2d1dc76640 1 --2- 172.21.15.47:0/319531194 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d0406b990 0x7f2d0406de50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d08006fd0 tx=0x7f2d08008040 comp rx=0 tx=0).stop 2024-04-14T23:34:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.755+0000 7f2d1dc76640 1 -- 172.21.15.47:0/319531194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1815fc20 msgr2=0x7f2d1815bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.755+0000 7f2d1dc76640 1 --2- 172.21.15.47:0/319531194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1815fc20 0x7f2d1815bdf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2d1000b970 tx=0x7f2d1000be30 comp rx=0 tx=0).stop 2024-04-14T23:34:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.755+0000 7f2d1dc76640 1 -- 172.21.15.47:0/319531194 shutdown_connections 2024-04-14T23:34:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.755+0000 7f2d1dc76640 1 --2- 172.21.15.47:0/319531194 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d0406b990 0x7f2d0406de50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.755+0000 7f2d1dc76640 1 --2- 172.21.15.47:0/319531194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1815fc20 0x7f2d1815bdf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.755+0000 7f2d1dc76640 1 --2- 172.21.15.47:0/319531194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d1815f5d0 0x7f2d181568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.755+0000 7f2d1dc76640 1 --2- 172.21.15.47:0/319531194 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d180cd4d0 0x7f2d180c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.755+0000 7f2d1dc76640 1 -- 172.21.15.47:0/319531194 >> 172.21.15.47:0/319531194 conn(0x7f2d180d1db0 msgr2=0x7f2d180ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.756+0000 7f2d1dc76640 1 -- 172.21.15.47:0/319531194 shutdown_connections 2024-04-14T23:34:54.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.756+0000 7f2d1dc76640 1 -- 172.21.15.47:0/319531194 wait complete. 2024-04-14T23:34:54.772 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-14T23:34:54.772 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T23:34:54.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.876+0000 7f22c9dfa640 1 Processor -- start 2024-04-14T23:34:54.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.876+0000 7f22c9dfa640 1 -- start start 2024-04-14T23:34:54.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.876+0000 7f22c9dfa640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f22c415e4a0 0x7f22c40d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:54.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.876+0000 7f22c9dfa640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22c40c83c0 con 0x7f22c40cfa80 2024-04-14T23:34:54.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.876+0000 7f22c9dfa640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22c40c86a0 con 0x7f22c40d1c40 2024-04-14T23:34:54.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.876+0000 7f22c9dfa640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f22c415e880 con 0x7f22c415e4a0 2024-04-14T23:34:54.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.877+0000 7f22c37fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f22c415e4a0 0x7f22c40d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:54.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.877+0000 7f22c3fff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f22c40cfa80 0x7f22c40c9b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55626/0 (socket says 172.21.15.47:55626) 2024-04-14T23:34:54.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.877+0000 7f22c3fff640 1 -- 172.21.15.47:0/1975300839 learned_addr learned my addr 172.21.15.47:0/1975300839 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:54.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.877+0000 7f22c37fe640 1 -- 172.21.15.47:0/1975300839 >> v1:172.21.15.191:6789/0 conn(0x7f22c40d1c40 legacy=0x7f22c40c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:54.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.877+0000 7f22c37fe640 1 -- 172.21.15.47:0/1975300839 >> v1:172.21.15.47:6789/0 conn(0x7f22c40cfa80 legacy=0x7f22c40c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:54.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.877+0000 7f22c27fc640 1 -- 172.21.15.47:0/1975300839 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2420440772 0 0) 0x7f22c40c83c0 con 0x7f22c40cfa80 2024-04-14T23:34:54.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.877+0000 7f22c37fe640 1 -- 172.21.15.47:0/1975300839 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c40c8980 con 0x7f22c415e4a0 2024-04-14T23:34:54.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.878+0000 7f22c37fe640 1 --2- 172.21.15.47:0/1975300839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22c415e4a0 0x7f22c40d2420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f22b40097a0 tx=0x7f22b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd813ded2a18dc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:54.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.878+0000 7f22c27fc640 1 -- 172.21.15.47:0/1975300839 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4035020 con 0x7f22c415e4a0 2024-04-14T23:34:54.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.878+0000 7f22c27fc640 1 -- 172.21.15.47:0/1975300839 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b4031830 con 0x7f22c415e4a0 2024-04-14T23:34:54.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.878+0000 7f22c27fc640 1 -- 172.21.15.47:0/1975300839 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4031c00 con 0x7f22c415e4a0 2024-04-14T23:34:54.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.878+0000 7f22c9dfa640 1 -- 172.21.15.47:0/1975300839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22c415e4a0 msgr2=0x7f22c40d2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:54.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.878+0000 7f22c9dfa640 1 --2- 172.21.15.47:0/1975300839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22c415e4a0 0x7f22c40d2420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f22b40097a0 tx=0x7f22b402b8d0 comp rx=0 tx=0).stop 2024-04-14T23:34:54.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.878+0000 7f22c9dfa640 1 -- 172.21.15.47:0/1975300839 shutdown_connections 2024-04-14T23:34:54.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.878+0000 7f22c9dfa640 1 --2- 172.21.15.47:0/1975300839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22c415e4a0 0x7f22c40d2420 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:54.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.878+0000 7f22c9dfa640 1 -- 172.21.15.47:0/1975300839 >> 172.21.15.47:0/1975300839 conn(0x7f22c40d3ef0 msgr2=0x7f22c40d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:54.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.878+0000 7f22c9dfa640 1 -- 172.21.15.47:0/1975300839 shutdown_connections 2024-04-14T23:34:54.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.878+0000 7f22c9dfa640 1 -- 172.21.15.47:0/1975300839 wait complete. 2024-04-14T23:34:54.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.880+0000 7f22c9dfa640 1 Processor -- start 2024-04-14T23:34:54.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.880+0000 7f22c9dfa640 1 -- start start 2024-04-14T23:34:54.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c9dfa640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22c40cfa80 0x7f22c4159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:54.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c9dfa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22c40d1c40 0x7f22c40c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:54.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c9dfa640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22c415e4a0 0x7f22c4160a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:54.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c9dfa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f22c4067bb0 con 0x7f22c40d1c40 2024-04-14T23:34:54.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c9dfa640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f22c40c8f40 con 0x7f22c40cfa80 2024-04-14T23:34:54.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c9dfa640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f22c4067d30 con 0x7f22c415e4a0 2024-04-14T23:34:54.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22c40d1c40 0x7f22c40c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:54.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22c40d1c40 0x7f22c40c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35834/0 (socket says 172.21.15.47:35834) 2024-04-14T23:34:54.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c2ffd640 1 -- 172.21.15.47:0/3984369500 learned_addr learned my addr 172.21.15.47:0/3984369500 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:54.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c37fe640 1 --2- 172.21.15.47:0/3984369500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22c40cfa80 0x7f22c4159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:54.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c3fff640 1 --2- 172.21.15.47:0/3984369500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22c415e4a0 0x7f22c4160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:54.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c2ffd640 1 -- 172.21.15.47:0/3984369500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22c415e4a0 msgr2=0x7f22c4160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:54.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c2ffd640 1 --2- 172.21.15.47:0/3984369500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22c415e4a0 0x7f22c4160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:54.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c2ffd640 1 -- 172.21.15.47:0/3984369500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22c40cfa80 msgr2=0x7f22c4159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:54.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c2ffd640 1 --2- 172.21.15.47:0/3984369500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22c40cfa80 0x7f22c4159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:54.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c2ffd640 1 -- 172.21.15.47:0/3984369500 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c4159e90 con 0x7f22c40d1c40 2024-04-14T23:34:54.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c37fe640 1 --2- 172.21.15.47:0/3984369500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22c40cfa80 0x7f22c4159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:54.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c3fff640 1 --2- 172.21.15.47:0/3984369500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22c415e4a0 0x7f22c4160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:54.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c2ffd640 1 --2- 172.21.15.47:0/3984369500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22c40d1c40 0x7f22c40c7920 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f22b800c430 tx=0x7f22b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:54.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22abfff640 1 -- 172.21.15.47:0/3984369500 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8011790 con 0x7f22c40d1c40 2024-04-14T23:34:54.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22abfff640 1 -- 172.21.15.47:0/3984369500 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b8017070 con 0x7f22c40d1c40 2024-04-14T23:34:54.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c9dfa640 1 -- 172.21.15.47:0/3984369500 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c41f7760 con 0x7f22c40d1c40 2024-04-14T23:34:54.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22abfff640 1 -- 172.21.15.47:0/3984369500 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8011b70 con 0x7f22c40d1c40 2024-04-14T23:34:54.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.881+0000 7f22c9dfa640 1 -- 172.21.15.47:0/3984369500 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c4159ba0 con 0x7f22c40d1c40 2024-04-14T23:34:54.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.882+0000 7f22c9dfa640 1 -- 172.21.15.47:0/3984369500 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c4075430 con 0x7f22c40d1c40 2024-04-14T23:34:54.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.883+0000 7f22abfff640 1 -- 172.21.15.47:0/3984369500 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f22b8011d10 con 0x7f22c40d1c40 2024-04-14T23:34:54.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.883+0000 7f22abfff640 1 --2- 172.21.15.47:0/3984369500 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f22b006b990 0x7f22b006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:54.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.883+0000 7f22abfff640 1 -- 172.21.15.47:0/3984369500 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f22b808aa30 con 0x7f22c40d1c40 2024-04-14T23:34:54.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.883+0000 7f22c37fe640 1 --2- 172.21.15.47:0/3984369500 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f22b006b990 0x7f22b006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:54.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.884+0000 7f22c37fe640 1 --2- 172.21.15.47:0/3984369500 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f22b006b990 0x7f22b006de50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f22b4036000 tx=0x7f22b403c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:54.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:54.887+0000 7f22abfff640 1 -- 172.21.15.47:0/3984369500 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f22b8059300 con 0x7f22c40d1c40 2024-04-14T23:34:55.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.109+0000 7f22c9dfa640 1 -- 172.21.15.47:0/3984369500 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22c40d21e0 con 0x7f22c40d1c40 2024-04-14T23:34:55.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.110+0000 7f22abfff640 1 -- 172.21.15.47:0/3984369500 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f22b8058c00 con 0x7f22c40d1c40 2024-04-14T23:34:55.113 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:55.113 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/416388535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":416388535},{"type":"v1","addr":"172.21.15.191:6837","nonce":416388535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/2830978927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2830978927},{"type":"v1","addr":"172.21.15.47:6833","nonce":2830978927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/4025654680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":4025654680},{"type":"v1","addr":"172.21.15.191:6836","nonce":4025654680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T23:34:38.059644+0000","modified":"2024-04-14T23:34:54.105483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/1169029730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1169029730},{"type":"v1","addr":"172.21.15.47:6835","nonce":1169029730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-14T23:34:55.114 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-04-14T23:34:55.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.112+0000 7f22c9dfa640 1 -- 172.21.15.47:0/3984369500 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f22b006b990 msgr2=0x7f22b006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.112+0000 7f22c9dfa640 1 --2- 172.21.15.47:0/3984369500 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f22b006b990 0x7f22b006de50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f22b4036000 tx=0x7f22b403c040 comp rx=0 tx=0).stop 2024-04-14T23:34:55.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.112+0000 7f22c9dfa640 1 -- 172.21.15.47:0/3984369500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22c40d1c40 msgr2=0x7f22c40c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.112+0000 7f22c9dfa640 1 --2- 172.21.15.47:0/3984369500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22c40d1c40 0x7f22c40c7920 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f22b800c430 tx=0x7f22b800c8f0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.112+0000 7f22c9dfa640 1 -- 172.21.15.47:0/3984369500 shutdown_connections 2024-04-14T23:34:55.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.112+0000 7f22c9dfa640 1 --2- 172.21.15.47:0/3984369500 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f22b006b990 0x7f22b006de50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.112+0000 7f22c9dfa640 1 --2- 172.21.15.47:0/3984369500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22c415e4a0 0x7f22c4160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.112+0000 7f22c9dfa640 1 --2- 172.21.15.47:0/3984369500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22c40d1c40 0x7f22c40c7920 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.112+0000 7f22c9dfa640 1 --2- 172.21.15.47:0/3984369500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22c40cfa80 0x7f22c4159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.112+0000 7f22c9dfa640 1 -- 172.21.15.47:0/3984369500 >> 172.21.15.47:0/3984369500 conn(0x7f22c40d3ef0 msgr2=0x7f22c40d2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:55.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.112+0000 7f22c9dfa640 1 -- 172.21.15.47:0/3984369500 shutdown_connections 2024-04-14T23:34:55.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.112+0000 7f22c9dfa640 1 -- 172.21.15.47:0/3984369500 wait complete. 2024-04-14T23:34:55.126 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:34:55.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.224+0000 7f44a53cc640 1 Processor -- start 2024-04-14T23:34:55.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.224+0000 7f44a53cc640 1 -- start start 2024-04-14T23:34:55.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.225+0000 7f44a53cc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44a00d2910 0x7f44a0168f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.225+0000 7f44a53cc640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a00b57a0 con 0x7f44a00d1e00 2024-04-14T23:34:55.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.225+0000 7f44a53cc640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a00d1620 con 0x7f44a015e270 2024-04-14T23:34:55.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.225+0000 7f44a53cc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f44a00b4300 con 0x7f44a00d2910 2024-04-14T23:34:55.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.225+0000 7f449e7fc640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f44a00d1e00 0x7f44a00d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55628/0 (socket says 172.21.15.47:55628) 2024-04-14T23:34:55.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.225+0000 7f449e7fc640 1 -- 172.21.15.47:0/2793090561 learned_addr learned my addr 172.21.15.47:0/2793090561 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:55.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.225+0000 7f449f7fe640 1 --2- 172.21.15.47:0/2793090561 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44a00d2910 0x7f44a0168f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.225+0000 7f449dffb640 1 -- 172.21.15.47:0/2793090561 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 307019182 0 0) 0x7f44a00b57a0 con 0x7f44a00d1e00 2024-04-14T23:34:55.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.225+0000 7f449dffb640 1 -- 172.21.15.47:0/2793090561 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f448c003520 con 0x7f44a00d1e00 2024-04-14T23:34:55.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449dffb640 1 -- 172.21.15.47:0/2793090561 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2292306769 0 0) 0x7f44a00d1620 con 0x7f44a015e270 2024-04-14T23:34:55.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449dffb640 1 -- 172.21.15.47:0/2793090561 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44a00b57a0 con 0x7f44a015e270 2024-04-14T23:34:55.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449dffb640 1 -- 172.21.15.47:0/2793090561 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1984112182 0 0) 0x7f448c003520 con 0x7f44a00d1e00 2024-04-14T23:34:55.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449dffb640 1 -- 172.21.15.47:0/2793090561 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44a00d2910 msgr2=0x7f44a0168f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:55.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449dffb640 1 --2- 172.21.15.47:0/2793090561 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44a00d2910 0x7f44a0168f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449dffb640 1 -- 172.21.15.47:0/2793090561 >> v1:172.21.15.191:6789/0 conn(0x7f44a015e270 legacy=0x7f44a00d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449dffb640 1 -- 172.21.15.47:0/2793090561 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a00b39d0 con 0x7f44a00d1e00 2024-04-14T23:34:55.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449dffb640 1 -- 172.21.15.47:0/2793090561 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f4488001670 con 0x7f44a00d1e00 2024-04-14T23:34:55.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449dffb640 1 -- 172.21.15.47:0/2793090561 >> v1:172.21.15.47:6789/0 conn(0x7f44a00d1e00 legacy=0x7f44a00d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449dffb640 1 --2- 172.21.15.47:0/2793090561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f448c003b70 0x7f448c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449dffb640 1 --2- 172.21.15.47:0/2793090561 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f448c004800 0x7f448c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449dffb640 1 --2- 172.21.15.47:0/2793090561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f448c0051c0 0x7f448c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449dffb640 1 -- 172.21.15.47:0/2793090561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44a00b4300 con 0x7f448c0051c0 2024-04-14T23:34:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449dffb640 1 -- 172.21.15.47:0/2793090561 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f448c00bf30 con 0x7f448c003b70 2024-04-14T23:34:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449dffb640 1 -- 172.21.15.47:0/2793090561 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f448c00c130 con 0x7f448c004800 2024-04-14T23:34:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449f7fe640 1 --2- 172.21.15.47:0/2793090561 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44a00d2910 0x7f44a0168f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449f7fe640 1 --2- 172.21.15.47:0/2793090561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f448c0051c0 0x7f448c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449effd640 1 --2- 172.21.15.47:0/2793090561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f448c003b70 0x7f448c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449e7fc640 1 --2- 172.21.15.47:0/2793090561 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f448c004800 0x7f448c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449f7fe640 1 -- 172.21.15.47:0/2793090561 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f448c004800 msgr2=0x7f448c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449f7fe640 1 --2- 172.21.15.47:0/2793090561 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f448c004800 0x7f448c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449f7fe640 1 -- 172.21.15.47:0/2793090561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f448c003b70 msgr2=0x7f448c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449f7fe640 1 --2- 172.21.15.47:0/2793090561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f448c003b70 0x7f448c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.226+0000 7f449f7fe640 1 -- 172.21.15.47:0/2793090561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448c003520 con 0x7f448c0051c0 2024-04-14T23:34:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.227+0000 7f449f7fe640 1 --2- 172.21.15.47:0/2793090561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f448c0051c0 0x7f448c00b9c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f44a0067ef0 tx=0x7f448c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f3a0bd11ad80ac server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.227+0000 7f449dffb640 1 -- 172.21.15.47:0/2793090561 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490009d40 con 0x7f448c0051c0 2024-04-14T23:34:55.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.227+0000 7f449dffb640 1 -- 172.21.15.47:0/2793090561 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f449002ccf0 con 0x7f448c0051c0 2024-04-14T23:34:55.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.227+0000 7f449dffb640 1 -- 172.21.15.47:0/2793090561 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490003bb0 con 0x7f448c0051c0 2024-04-14T23:34:55.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.228+0000 7f44a53cc640 1 -- 172.21.15.47:0/2793090561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f448c0051c0 msgr2=0x7f448c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.228+0000 7f44a53cc640 1 --2- 172.21.15.47:0/2793090561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f448c0051c0 0x7f448c00b9c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f44a0067ef0 tx=0x7f448c005830 comp rx=0 tx=0).stop 2024-04-14T23:34:55.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.228+0000 7f449f7fe640 1 -- 172.21.15.47:0/2793090561 reap_dead start 2024-04-14T23:34:55.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.228+0000 7f44a53cc640 1 -- 172.21.15.47:0/2793090561 shutdown_connections 2024-04-14T23:34:55.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.228+0000 7f44a53cc640 1 -- 172.21.15.47:0/2793090561 >> 172.21.15.47:0/2793090561 conn(0x7f44a00d3ed0 msgr2=0x7f44a00d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:55.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.228+0000 7f44a53cc640 1 -- 172.21.15.47:0/2793090561 shutdown_connections 2024-04-14T23:34:55.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.228+0000 7f44a53cc640 1 -- 172.21.15.47:0/2793090561 wait complete. 2024-04-14T23:34:55.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.229+0000 7f44a53cc640 1 Processor -- start 2024-04-14T23:34:55.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.229+0000 7f44a53cc640 1 -- start start 2024-04-14T23:34:55.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f44a53cc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44a01f7560 0x7f44a00cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f44a53cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44a00cc250 0x7f44a015c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f44a53cc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44a01f7940 0x7f44a015cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f44a53cc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44a00b0c60 con 0x7f44a00cc250 2024-04-14T23:34:55.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f44a53cc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f44a00b3f90 con 0x7f44a01f7940 2024-04-14T23:34:55.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f44a53cc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f44a015e650 con 0x7f44a01f7560 2024-04-14T23:34:55.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f449e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44a00cc250 0x7f44a015c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f449e7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44a00cc250 0x7f44a015c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35850/0 (socket says 172.21.15.47:35850) 2024-04-14T23:34:55.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f449e7fc640 1 -- 172.21.15.47:0/1472822887 learned_addr learned my addr 172.21.15.47:0/1472822887 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:55.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f449e7fc640 1 -- 172.21.15.47:0/1472822887 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44a01f7560 msgr2=0x7f44a00cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f449e7fc640 1 --2- 172.21.15.47:0/1472822887 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44a01f7560 0x7f44a00cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f449e7fc640 1 -- 172.21.15.47:0/1472822887 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44a01f7940 msgr2=0x7f44a015cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f449e7fc640 1 --2- 172.21.15.47:0/1472822887 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44a01f7940 0x7f44a015cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f449e7fc640 1 -- 172.21.15.47:0/1472822887 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a00cdc40 con 0x7f44a00cc250 2024-04-14T23:34:55.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f449e7fc640 1 --2- 172.21.15.47:0/1472822887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44a00cc250 0x7f44a015c660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4488004fc0 tx=0x7f44880074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:55.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f44977fe640 1 -- 172.21.15.47:0/1472822887 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448800f730 con 0x7f44a00cc250 2024-04-14T23:34:55.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f44977fe640 1 -- 172.21.15.47:0/1472822887 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4488018070 con 0x7f44a00cc250 2024-04-14T23:34:55.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f44a53cc640 1 -- 172.21.15.47:0/1472822887 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a00cdf20 con 0x7f44a00cc250 2024-04-14T23:34:55.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f44977fe640 1 -- 172.21.15.47:0/1472822887 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448800faf0 con 0x7f44a00cc250 2024-04-14T23:34:55.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.230+0000 7f44a53cc640 1 -- 172.21.15.47:0/1472822887 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a00b7070 con 0x7f44a00cc250 2024-04-14T23:34:55.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.231+0000 7f44a53cc640 1 -- 172.21.15.47:0/1472822887 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a0075430 con 0x7f44a00cc250 2024-04-14T23:34:55.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.232+0000 7f44977fe640 1 -- 172.21.15.47:0/1472822887 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f448800fc90 con 0x7f44a00cc250 2024-04-14T23:34:55.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.232+0000 7f44977fe640 1 --2- 172.21.15.47:0/1472822887 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f448006b990 0x7f448006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.232+0000 7f44977fe640 1 -- 172.21.15.47:0/1472822887 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f448808ab60 con 0x7f44a00cc250 2024-04-14T23:34:55.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.232+0000 7f449effd640 1 --2- 172.21.15.47:0/1472822887 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f448006b990 0x7f448006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.233+0000 7f449effd640 1 --2- 172.21.15.47:0/1472822887 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f448006b990 0x7f448006de50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f44980018b0 tx=0x7f4498009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:55.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.236+0000 7f44977fe640 1 -- 172.21.15.47:0/1472822887 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4488059430 con 0x7f44a00cc250 2024-04-14T23:34:55.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.419+0000 7f44a53cc640 1 -- 172.21.15.47:0/1472822887 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44a0074860 con 0x7f44a00cc250 2024-04-14T23:34:55.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.420+0000 7f44977fe640 1 -- 172.21.15.47:0/1472822887 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7f4488058d30 con 0x7f44a00cc250 2024-04-14T23:34:55.423 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:55.423 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:44.714882+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:34:55.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.422+0000 7f44a53cc640 1 -- 172.21.15.47:0/1472822887 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f448006b990 msgr2=0x7f448006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.422+0000 7f44a53cc640 1 --2- 172.21.15.47:0/1472822887 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f448006b990 0x7f448006de50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f44980018b0 tx=0x7f4498009040 comp rx=0 tx=0).stop 2024-04-14T23:34:55.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.422+0000 7f44a53cc640 1 -- 172.21.15.47:0/1472822887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44a00cc250 msgr2=0x7f44a015c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.422+0000 7f44a53cc640 1 --2- 172.21.15.47:0/1472822887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44a00cc250 0x7f44a015c660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4488004fc0 tx=0x7f44880074f0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.422+0000 7f44a53cc640 1 -- 172.21.15.47:0/1472822887 shutdown_connections 2024-04-14T23:34:55.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.422+0000 7f44a53cc640 1 --2- 172.21.15.47:0/1472822887 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f448006b990 0x7f448006de50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.422+0000 7f44a53cc640 1 --2- 172.21.15.47:0/1472822887 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44a01f7940 0x7f44a015cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.422+0000 7f44a53cc640 1 --2- 172.21.15.47:0/1472822887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44a00cc250 0x7f44a015c660 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.422+0000 7f44a53cc640 1 --2- 172.21.15.47:0/1472822887 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44a01f7560 0x7f44a00cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.422+0000 7f44a53cc640 1 -- 172.21.15.47:0/1472822887 >> 172.21.15.47:0/1472822887 conn(0x7f44a00d3ed0 msgr2=0x7f44a006cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:55.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.422+0000 7f44a53cc640 1 -- 172.21.15.47:0/1472822887 shutdown_connections 2024-04-14T23:34:55.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.422+0000 7f44a53cc640 1 -- 172.21.15.47:0/1472822887 wait complete. 2024-04-14T23:34:55.436 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-14T23:34:55.437 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T23:34:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.535+0000 7f6b82a69640 1 Processor -- start 2024-04-14T23:34:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.535+0000 7f6b82a69640 1 -- start start 2024-04-14T23:34:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.535+0000 7f6b82a69640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6b7c15e2b0 0x7f6b7c0d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.535+0000 7f6b82a69640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b7c0cf4c0 0x7f6b7c0c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.535+0000 7f6b82a69640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b7c15e690 con 0x7f6b7c0d2be0 2024-04-14T23:34:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.535+0000 7f6b82a69640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6b7c0cfb20 con 0x7f6b7c15e2b0 2024-04-14T23:34:55.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.535+0000 7f6b82a69640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6b7c0cfe00 con 0x7f6b7c0cf4c0 2024-04-14T23:34:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.536+0000 7f6b80805640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6b7c15e2b0 0x7f6b7c0d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.536+0000 7f6b80805640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6b7c15e2b0 0x7f6b7c0d26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35864/0 (socket says 172.21.15.47:35864) 2024-04-14T23:34:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.536+0000 7f6b80805640 1 -- 172.21.15.47:0/3877265322 learned_addr learned my addr 172.21.15.47:0/3877265322 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.536+0000 7f6b81006640 1 --2- 172.21.15.47:0/3877265322 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b7c0cf4c0 0x7f6b7c0c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.536+0000 7f6b80805640 1 -- 172.21.15.47:0/3877265322 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b7c0cf4c0 msgr2=0x7f6b7c0c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.536+0000 7f6b80805640 1 --2- 172.21.15.47:0/3877265322 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b7c0cf4c0 0x7f6b7c0c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.536+0000 7f6b80805640 1 -- 172.21.15.47:0/3877265322 >> v1:172.21.15.191:6789/0 conn(0x7f6b7c0d2be0 legacy=0x7f6b7c0cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.536+0000 7f6b80805640 1 -- 172.21.15.47:0/3877265322 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7c0d00e0 con 0x7f6b7c15e2b0 2024-04-14T23:34:55.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.536+0000 7f6b81006640 1 --2- 172.21.15.47:0/3877265322 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b7c0cf4c0 0x7f6b7c0c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.537+0000 7f6b80805640 1 --2- 172.21.15.47:0/3877265322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c15e2b0 0x7f6b7c0d26a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009870 tx=0x7f6b7002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460dc2ef4abbf48a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.537+0000 7f6b7b7fe640 1 -- 172.21.15.47:0/3877265322 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70034070 con 0x7f6b7c15e2b0 2024-04-14T23:34:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.537+0000 7f6b7b7fe640 1 -- 172.21.15.47:0/3877265322 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b70030840 con 0x7f6b7c15e2b0 2024-04-14T23:34:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.537+0000 7f6b7b7fe640 1 -- 172.21.15.47:0/3877265322 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70030c10 con 0x7f6b7c15e2b0 2024-04-14T23:34:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.537+0000 7f6b82a69640 1 -- 172.21.15.47:0/3877265322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c15e2b0 msgr2=0x7f6b7c0d26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.537+0000 7f6b82a69640 1 --2- 172.21.15.47:0/3877265322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c15e2b0 0x7f6b7c0d26a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009870 tx=0x7f6b7002b980 comp rx=0 tx=0).stop 2024-04-14T23:34:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.537+0000 7f6b82a69640 1 -- 172.21.15.47:0/3877265322 shutdown_connections 2024-04-14T23:34:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.537+0000 7f6b82a69640 1 --2- 172.21.15.47:0/3877265322 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b7c0cf4c0 0x7f6b7c0c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.537+0000 7f6b82a69640 1 --2- 172.21.15.47:0/3877265322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c15e2b0 0x7f6b7c0d26a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.537+0000 7f6b82a69640 1 -- 172.21.15.47:0/3877265322 >> 172.21.15.47:0/3877265322 conn(0x7f6b7c067940 msgr2=0x7f6b7c09d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.537+0000 7f6b82a69640 1 -- 172.21.15.47:0/3877265322 shutdown_connections 2024-04-14T23:34:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.537+0000 7f6b82a69640 1 -- 172.21.15.47:0/3877265322 wait complete. 2024-04-14T23:34:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.538+0000 7f6b82a69640 1 Processor -- start 2024-04-14T23:34:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.539+0000 7f6b82a69640 1 -- start start 2024-04-14T23:34:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.539+0000 7f6b82a69640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b7c0cf4c0 0x7f6b7c1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.539+0000 7f6b82a69640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b7c0d2be0 0x7f6b7c06be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.539+0000 7f6b82a69640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c15e2b0 0x7f6b7c06c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.539+0000 7f6b82a69640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c0c84a0 con 0x7f6b7c15e2b0 2024-04-14T23:34:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.539+0000 7f6b82a69640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c0d06a0 con 0x7f6b7c0d2be0 2024-04-14T23:34:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.539+0000 7f6b82a69640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6b7c0c8620 con 0x7f6b7c0cf4c0 2024-04-14T23:34:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.539+0000 7f6b81006640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c15e2b0 0x7f6b7c06c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.539+0000 7f6b81006640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c15e2b0 0x7f6b7c06c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35870/0 (socket says 172.21.15.47:35870) 2024-04-14T23:34:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.539+0000 7f6b81006640 1 -- 172.21.15.47:0/1762217950 learned_addr learned my addr 172.21.15.47:0/1762217950 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.540+0000 7f6b80805640 1 --2- 172.21.15.47:0/1762217950 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b7c0cf4c0 0x7f6b7c1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.540+0000 7f6b7bfff640 1 --2- 172.21.15.47:0/1762217950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b7c0d2be0 0x7f6b7c06be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.540+0000 7f6b81006640 1 -- 172.21.15.47:0/1762217950 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b7c0cf4c0 msgr2=0x7f6b7c1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.540+0000 7f6b81006640 1 --2- 172.21.15.47:0/1762217950 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b7c0cf4c0 0x7f6b7c1578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.540+0000 7f6b81006640 1 -- 172.21.15.47:0/1762217950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b7c0d2be0 msgr2=0x7f6b7c06be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.540+0000 7f6b81006640 1 --2- 172.21.15.47:0/1762217950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b7c0d2be0 0x7f6b7c06be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.540+0000 7f6b81006640 1 -- 172.21.15.47:0/1762217950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7c161550 con 0x7f6b7c15e2b0 2024-04-14T23:34:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.540+0000 7f6b81006640 1 --2- 172.21.15.47:0/1762217950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c15e2b0 0x7f6b7c06c3d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009fa0 tx=0x7f6b7400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.540+0000 7f6b797fa640 1 -- 172.21.15.47:0/1762217950 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7401a070 con 0x7f6b7c15e2b0 2024-04-14T23:34:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.540+0000 7f6b797fa640 1 -- 172.21.15.47:0/1762217950 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b74003bb0 con 0x7f6b7c15e2b0 2024-04-14T23:34:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.540+0000 7f6b82a69640 1 -- 172.21.15.47:0/1762217950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b7c1f48d0 con 0x7f6b7c15e2b0 2024-04-14T23:34:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.540+0000 7f6b797fa640 1 -- 172.21.15.47:0/1762217950 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74004030 con 0x7f6b7c15e2b0 2024-04-14T23:34:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.540+0000 7f6b82a69640 1 -- 172.21.15.47:0/1762217950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b7c1f4be0 con 0x7f6b7c15e2b0 2024-04-14T23:34:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.541+0000 7f6b82a69640 1 -- 172.21.15.47:0/1762217950 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b7c075430 con 0x7f6b7c15e2b0 2024-04-14T23:34:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.541+0000 7f6b797fa640 1 -- 172.21.15.47:0/1762217950 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6b7401d070 con 0x7f6b7c15e2b0 2024-04-14T23:34:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.542+0000 7f6b797fa640 1 --2- 172.21.15.47:0/1762217950 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6b6006b990 0x7f6b6006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.542+0000 7f6b797fa640 1 -- 172.21.15.47:0/1762217950 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6b7408ad60 con 0x7f6b7c15e2b0 2024-04-14T23:34:55.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.542+0000 7f6b80805640 1 --2- 172.21.15.47:0/1762217950 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6b6006b990 0x7f6b6006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.542+0000 7f6b80805640 1 --2- 172.21.15.47:0/1762217950 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6b6006b990 0x7f6b6006de50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6b70036000 tx=0x7f6b7003b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:55.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.546+0000 7f6b797fa640 1 -- 172.21.15.47:0/1762217950 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6b74010070 con 0x7f6b7c15e2b0 2024-04-14T23:34:55.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.725+0000 7f6b82a69640 1 -- 172.21.15.47:0/1762217950 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6b7c157df0 con 0x7f6b6006b990 2024-04-14T23:34:55.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.734+0000 7f6b797fa640 1 -- 172.21.15.47:0/1762217950 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f6b7c157df0 con 0x7f6b6006b990 2024-04-14T23:34:55.741 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:55.743 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-14T23:34:55.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.737+0000 7f6b82a69640 1 -- 172.21.15.47:0/1762217950 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6b6006b990 msgr2=0x7f6b6006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.737+0000 7f6b82a69640 1 --2- 172.21.15.47:0/1762217950 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6b6006b990 0x7f6b6006de50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6b70036000 tx=0x7f6b7003b040 comp rx=0 tx=0).stop 2024-04-14T23:34:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.737+0000 7f6b82a69640 1 -- 172.21.15.47:0/1762217950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c15e2b0 msgr2=0x7f6b7c06c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.737+0000 7f6b82a69640 1 --2- 172.21.15.47:0/1762217950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c15e2b0 0x7f6b7c06c3d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009fa0 tx=0x7f6b7400d560 comp rx=0 tx=0).stop 2024-04-14T23:34:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.738+0000 7f6b82a69640 1 -- 172.21.15.47:0/1762217950 shutdown_connections 2024-04-14T23:34:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.738+0000 7f6b82a69640 1 --2- 172.21.15.47:0/1762217950 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6b6006b990 0x7f6b6006de50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.738+0000 7f6b82a69640 1 --2- 172.21.15.47:0/1762217950 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c15e2b0 0x7f6b7c06c3d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.738+0000 7f6b82a69640 1 --2- 172.21.15.47:0/1762217950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b7c0d2be0 0x7f6b7c06be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.738+0000 7f6b82a69640 1 --2- 172.21.15.47:0/1762217950 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b7c0cf4c0 0x7f6b7c1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.738+0000 7f6b82a69640 1 -- 172.21.15.47:0/1762217950 >> 172.21.15.47:0/1762217950 conn(0x7f6b7c067940 msgr2=0x7f6b7c0d1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.738+0000 7f6b82a69640 1 -- 172.21.15.47:0/1762217950 shutdown_connections 2024-04-14T23:34:55.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.738+0000 7f6b82a69640 1 -- 172.21.15.47:0/1762217950 wait complete. 2024-04-14T23:34:55.751 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-14T23:34:54.361869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236100,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738620,"statfs":{"total":773094113280,"available":772852346880,"internally_reserved":0,"allocated":3383296,"data_stored":2048878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002543"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311249+0000","last_change":"2024-04-14T23:34:37.710684+0000","last_active":"2024-04-14T23:34:46.311249+0000","last_peered":"2024-04-14T23:34:46.311249+0000","last_clean":"2024-04-14T23:34:46.311249+0000","last_became_active":"2024-04-14T23:34:37.710401+0000","last_became_peered":"2024-04-14T23:34:37.710401+0000","last_unstale":"2024-04-14T23:34:46.311249+0000","last_undegraded":"2024-04-14T23:34:46.311249+0000","last_fullsized":"2024-04-14T23:34:46.311249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:24:08.806585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718660+0000","last_change":"2024-04-14T23:34:38.716947+0000","last_active":"2024-04-14T23:34:44.718660+0000","last_peered":"2024-04-14T23:34:44.718660+0000","last_clean":"2024-04-14T23:34:44.718660+0000","last_became_active":"2024-04-14T23:34:38.716643+0000","last_became_peered":"2024-04-14T23:34:38.716643+0000","last_unstale":"2024-04-14T23:34:44.718660+0000","last_undegraded":"2024-04-14T23:34:44.718660+0000","last_fullsized":"2024-04-14T23:34:44.718660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:27:36.965696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718020+0000","last_change":"2024-04-14T23:34:43.189638+0000","last_active":"2024-04-14T23:34:44.718020+0000","last_peered":"2024-04-14T23:34:44.718020+0000","last_clean":"2024-04-14T23:34:44.718020+0000","last_became_active":"2024-04-14T23:34:43.188302+0000","last_became_peered":"2024-04-14T23:34:43.188302+0000","last_unstale":"2024-04-14T23:34:44.718020+0000","last_undegraded":"2024-04-14T23:34:44.718020+0000","last_fullsized":"2024-04-14T23:34:44.718020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:22:18.103327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718787+0000","last_change":"2024-04-14T23:34:37.707154+0000","last_active":"2024-04-14T23:34:44.718787+0000","last_peered":"2024-04-14T23:34:44.718787+0000","last_clean":"2024-04-14T23:34:44.718787+0000","last_became_active":"2024-04-14T23:34:37.706646+0000","last_became_peered":"2024-04-14T23:34:37.706646+0000","last_unstale":"2024-04-14T23:34:44.718787+0000","last_undegraded":"2024-04-14T23:34:44.718787+0000","last_fullsized":"2024-04-14T23:34:44.718787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:24:08.806585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311859+0000","last_change":"2024-04-14T23:34:38.697913+0000","last_active":"2024-04-14T23:34:46.311859+0000","last_peered":"2024-04-14T23:34:46.311859+0000","last_clean":"2024-04-14T23:34:46.311859+0000","last_became_active":"2024-04-14T23:34:38.697206+0000","last_became_peered":"2024-04-14T23:34:38.697206+0000","last_unstale":"2024-04-14T23:34:46.311859+0000","last_undegraded":"2024-04-14T23:34:46.311859+0000","last_fullsized":"2024-04-14T23:34:46.311859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:09:45.484768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719041+0000","last_change":"2024-04-14T23:34:42.733619+0000","last_active":"2024-04-14T23:34:44.719041+0000","last_peered":"2024-04-14T23:34:44.719041+0000","last_clean":"2024-04-14T23:34:44.719041+0000","last_became_active":"2024-04-14T23:34:42.733164+0000","last_became_peered":"2024-04-14T23:34:42.733164+0000","last_unstale":"2024-04-14T23:34:44.719041+0000","last_undegraded":"2024-04-14T23:34:44.719041+0000","last_fullsized":"2024-04-14T23:34:44.719041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:28:10.218625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136525+0000","last_change":"2024-04-14T23:34:37.712565+0000","last_active":"2024-04-14T23:34:45.136525+0000","last_peered":"2024-04-14T23:34:45.136525+0000","last_clean":"2024-04-14T23:34:45.136525+0000","last_became_active":"2024-04-14T23:34:37.712304+0000","last_became_peered":"2024-04-14T23:34:37.712304+0000","last_unstale":"2024-04-14T23:34:45.136525+0000","last_undegraded":"2024-04-14T23:34:45.136525+0000","last_fullsized":"2024-04-14T23:34:45.136525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:52.026945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720469+0000","last_change":"2024-04-14T23:34:38.706895+0000","last_active":"2024-04-14T23:34:44.720469+0000","last_peered":"2024-04-14T23:34:44.720469+0000","last_clean":"2024-04-14T23:34:44.720469+0000","last_became_active":"2024-04-14T23:34:38.704429+0000","last_became_peered":"2024-04-14T23:34:38.704429+0000","last_unstale":"2024-04-14T23:34:44.720469+0000","last_undegraded":"2024-04-14T23:34:44.720469+0000","last_fullsized":"2024-04-14T23:34:44.720469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:22.876283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719267+0000","last_change":"2024-04-14T23:34:42.734180+0000","last_active":"2024-04-14T23:34:44.719267+0000","last_peered":"2024-04-14T23:34:44.719267+0000","last_clean":"2024-04-14T23:34:44.719267+0000","last_became_active":"2024-04-14T23:34:42.733249+0000","last_became_peered":"2024-04-14T23:34:42.733249+0000","last_unstale":"2024-04-14T23:34:44.719267+0000","last_undegraded":"2024-04-14T23:34:44.719267+0000","last_fullsized":"2024-04-14T23:34:44.719267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:50:07.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136305+0000","last_change":"2024-04-14T23:34:37.710172+0000","last_active":"2024-04-14T23:34:45.136305+0000","last_peered":"2024-04-14T23:34:45.136305+0000","last_clean":"2024-04-14T23:34:45.136305+0000","last_became_active":"2024-04-14T23:34:37.709859+0000","last_became_peered":"2024-04-14T23:34:37.709859+0000","last_unstale":"2024-04-14T23:34:45.136305+0000","last_undegraded":"2024-04-14T23:34:45.136305+0000","last_fullsized":"2024-04-14T23:34:45.136305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:03:17.126654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719993+0000","last_change":"2024-04-14T23:34:38.703533+0000","last_active":"2024-04-14T23:34:44.719993+0000","last_peered":"2024-04-14T23:34:44.719993+0000","last_clean":"2024-04-14T23:34:44.719993+0000","last_became_active":"2024-04-14T23:34:38.703228+0000","last_became_peered":"2024-04-14T23:34:38.703228+0000","last_unstale":"2024-04-14T23:34:44.719993+0000","last_undegraded":"2024-04-14T23:34:44.719993+0000","last_fullsized":"2024-04-14T23:34:44.719993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719336+0000","last_change":"2024-04-14T23:34:42.735315+0000","last_active":"2024-04-14T23:34:44.719336+0000","last_peered":"2024-04-14T23:34:44.719336+0000","last_clean":"2024-04-14T23:34:44.719336+0000","last_became_active":"2024-04-14T23:34:42.734932+0000","last_became_peered":"2024-04-14T23:34:42.734932+0000","last_unstale":"2024-04-14T23:34:44.719336+0000","last_undegraded":"2024-04-14T23:34:44.719336+0000","last_fullsized":"2024-04-14T23:34:44.719336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:12:56.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517099+0000","last_change":"2024-04-14T23:34:38.712701+0000","last_active":"2024-04-14T23:34:46.517099+0000","last_peered":"2024-04-14T23:34:46.517099+0000","last_clean":"2024-04-14T23:34:46.517099+0000","last_became_active":"2024-04-14T23:34:38.712434+0000","last_became_peered":"2024-04-14T23:34:38.712434+0000","last_unstale":"2024-04-14T23:34:46.517099+0000","last_undegraded":"2024-04-14T23:34:46.517099+0000","last_fullsized":"2024-04-14T23:34:46.517099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:27:36.965696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136371+0000","last_change":"2024-04-14T23:34:37.713312+0000","last_active":"2024-04-14T23:34:45.136371+0000","last_peered":"2024-04-14T23:34:45.136371+0000","last_clean":"2024-04-14T23:34:45.136371+0000","last_became_active":"2024-04-14T23:34:37.713015+0000","last_became_peered":"2024-04-14T23:34:37.713015+0000","last_unstale":"2024-04-14T23:34:45.136371+0000","last_undegraded":"2024-04-14T23:34:45.136371+0000","last_fullsized":"2024-04-14T23:34:45.136371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:25.981130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720659+0000","last_change":"2024-04-14T23:34:42.734239+0000","last_active":"2024-04-14T23:34:44.720659+0000","last_peered":"2024-04-14T23:34:44.720659+0000","last_clean":"2024-04-14T23:34:44.720659+0000","last_became_active":"2024-04-14T23:34:42.733043+0000","last_became_peered":"2024-04-14T23:34:42.733043+0000","last_unstale":"2024-04-14T23:34:44.720659+0000","last_undegraded":"2024-04-14T23:34:44.720659+0000","last_fullsized":"2024-04-14T23:34:44.720659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:24:22.674500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718328+0000","last_change":"2024-04-14T23:34:38.708368+0000","last_active":"2024-04-14T23:34:44.718328+0000","last_peered":"2024-04-14T23:34:44.718328+0000","last_clean":"2024-04-14T23:34:44.718328+0000","last_became_active":"2024-04-14T23:34:38.708065+0000","last_became_peered":"2024-04-14T23:34:38.708065+0000","last_unstale":"2024-04-14T23:34:44.718328+0000","last_undegraded":"2024-04-14T23:34:44.718328+0000","last_fullsized":"2024-04-14T23:34:44.718328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:09:47.574841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318514+0000","last_change":"2024-04-14T23:34:37.707159+0000","last_active":"2024-04-14T23:34:46.318514+0000","last_peered":"2024-04-14T23:34:46.318514+0000","last_clean":"2024-04-14T23:34:46.318514+0000","last_became_active":"2024-04-14T23:34:37.706777+0000","last_became_peered":"2024-04-14T23:34:37.706777+0000","last_unstale":"2024-04-14T23:34:46.318514+0000","last_undegraded":"2024-04-14T23:34:46.318514+0000","last_fullsized":"2024-04-14T23:34:46.318514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:23.167535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719596+0000","last_change":"2024-04-14T23:34:42.734697+0000","last_active":"2024-04-14T23:34:44.719596+0000","last_peered":"2024-04-14T23:34:44.719596+0000","last_clean":"2024-04-14T23:34:44.719596+0000","last_became_active":"2024-04-14T23:34:42.732974+0000","last_became_peered":"2024-04-14T23:34:42.732974+0000","last_unstale":"2024-04-14T23:34:44.719596+0000","last_undegraded":"2024-04-14T23:34:44.719596+0000","last_fullsized":"2024-04-14T23:34:44.719596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:18:47.542320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718187+0000","last_change":"2024-04-14T23:34:38.713694+0000","last_active":"2024-04-14T23:34:44.718187+0000","last_peered":"2024-04-14T23:34:44.718187+0000","last_clean":"2024-04-14T23:34:44.718187+0000","last_became_active":"2024-04-14T23:34:38.713374+0000","last_became_peered":"2024-04-14T23:34:38.713374+0000","last_unstale":"2024-04-14T23:34:44.718187+0000","last_undegraded":"2024-04-14T23:34:44.718187+0000","last_fullsized":"2024-04-14T23:34:44.718187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:40.949590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318481+0000","last_change":"2024-04-14T23:34:37.708516+0000","last_active":"2024-04-14T23:34:46.318481+0000","last_peered":"2024-04-14T23:34:46.318481+0000","last_clean":"2024-04-14T23:34:46.318481+0000","last_became_active":"2024-04-14T23:34:37.708219+0000","last_became_peered":"2024-04-14T23:34:37.708219+0000","last_unstale":"2024-04-14T23:34:46.318481+0000","last_undegraded":"2024-04-14T23:34:46.318481+0000","last_fullsized":"2024-04-14T23:34:46.318481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:29.023280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319235+0000","last_change":"2024-04-14T23:34:43.186688+0000","last_active":"2024-04-14T23:34:46.319235+0000","last_peered":"2024-04-14T23:34:46.319235+0000","last_clean":"2024-04-14T23:34:46.319235+0000","last_became_active":"2024-04-14T23:34:43.186305+0000","last_became_peered":"2024-04-14T23:34:43.186305+0000","last_unstale":"2024-04-14T23:34:46.319235+0000","last_undegraded":"2024-04-14T23:34:46.319235+0000","last_fullsized":"2024-04-14T23:34:46.319235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:12:56.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720326+0000","last_change":"2024-04-14T23:34:38.707888+0000","last_active":"2024-04-14T23:34:44.720326+0000","last_peered":"2024-04-14T23:34:44.720326+0000","last_clean":"2024-04-14T23:34:44.720326+0000","last_became_active":"2024-04-14T23:34:38.707601+0000","last_became_peered":"2024-04-14T23:34:38.707601+0000","last_unstale":"2024-04-14T23:34:44.720326+0000","last_undegraded":"2024-04-14T23:34:44.720326+0000","last_fullsized":"2024-04-14T23:34:44.720326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:18:41.946696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.135954+0000","last_change":"2024-04-14T23:34:37.712453+0000","last_active":"2024-04-14T23:34:45.135954+0000","last_peered":"2024-04-14T23:34:45.135954+0000","last_clean":"2024-04-14T23:34:45.135954+0000","last_became_active":"2024-04-14T23:34:37.712091+0000","last_became_peered":"2024-04-14T23:34:37.712091+0000","last_unstale":"2024-04-14T23:34:45.135954+0000","last_undegraded":"2024-04-14T23:34:45.135954+0000","last_fullsized":"2024-04-14T23:34:45.135954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:23.167535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719231+0000","last_change":"2024-04-14T23:34:42.730978+0000","last_active":"2024-04-14T23:34:44.719231+0000","last_peered":"2024-04-14T23:34:44.719231+0000","last_clean":"2024-04-14T23:34:44.719231+0000","last_became_active":"2024-04-14T23:34:42.730528+0000","last_became_peered":"2024-04-14T23:34:42.730528+0000","last_unstale":"2024-04-14T23:34:44.719231+0000","last_undegraded":"2024-04-14T23:34:44.719231+0000","last_fullsized":"2024-04-14T23:34:44.719231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:22:18.658809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.312044+0000","last_change":"2024-04-14T23:34:38.705602+0000","last_active":"2024-04-14T23:34:46.312044+0000","last_peered":"2024-04-14T23:34:46.312044+0000","last_clean":"2024-04-14T23:34:46.312044+0000","last_became_active":"2024-04-14T23:34:38.705305+0000","last_became_peered":"2024-04-14T23:34:38.705305+0000","last_unstale":"2024-04-14T23:34:46.312044+0000","last_undegraded":"2024-04-14T23:34:46.312044+0000","last_fullsized":"2024-04-14T23:34:46.312044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:12.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516709+0000","last_change":"2024-04-14T23:34:37.709059+0000","last_active":"2024-04-14T23:34:46.516709+0000","last_peered":"2024-04-14T23:34:46.516709+0000","last_clean":"2024-04-14T23:34:46.516709+0000","last_became_active":"2024-04-14T23:34:37.707857+0000","last_became_peered":"2024-04-14T23:34:37.707857+0000","last_unstale":"2024-04-14T23:34:46.516709+0000","last_undegraded":"2024-04-14T23:34:46.516709+0000","last_fullsized":"2024-04-14T23:34:46.516709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:02:03.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720072+0000","last_change":"2024-04-14T23:34:43.185206+0000","last_active":"2024-04-14T23:34:44.720072+0000","last_peered":"2024-04-14T23:34:44.720072+0000","last_clean":"2024-04-14T23:34:44.720072+0000","last_became_active":"2024-04-14T23:34:43.184816+0000","last_became_peered":"2024-04-14T23:34:43.184816+0000","last_unstale":"2024-04-14T23:34:44.720072+0000","last_undegraded":"2024-04-14T23:34:44.720072+0000","last_fullsized":"2024-04-14T23:34:44.720072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:16:46.008001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718884+0000","last_change":"2024-04-14T23:34:38.712982+0000","last_active":"2024-04-14T23:34:44.718884+0000","last_peered":"2024-04-14T23:34:44.718884+0000","last_clean":"2024-04-14T23:34:44.718884+0000","last_became_active":"2024-04-14T23:34:38.712714+0000","last_became_peered":"2024-04-14T23:34:38.712714+0000","last_unstale":"2024-04-14T23:34:44.718884+0000","last_undegraded":"2024-04-14T23:34:44.718884+0000","last_fullsized":"2024-04-14T23:34:44.718884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:44.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319185+0000","last_change":"2024-04-14T23:34:37.705495+0000","last_active":"2024-04-14T23:34:46.319185+0000","last_peered":"2024-04-14T23:34:46.319185+0000","last_clean":"2024-04-14T23:34:46.319185+0000","last_became_active":"2024-04-14T23:34:37.705184+0000","last_became_peered":"2024-04-14T23:34:37.705184+0000","last_unstale":"2024-04-14T23:34:46.319185+0000","last_undegraded":"2024-04-14T23:34:46.319185+0000","last_fullsized":"2024-04-14T23:34:46.319185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:18:40.942344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.717967+0000","last_change":"2024-04-14T23:34:43.189327+0000","last_active":"2024-04-14T23:34:44.717967+0000","last_peered":"2024-04-14T23:34:44.717967+0000","last_clean":"2024-04-14T23:34:44.717967+0000","last_became_active":"2024-04-14T23:34:43.188921+0000","last_became_peered":"2024-04-14T23:34:43.188921+0000","last_unstale":"2024-04-14T23:34:44.717967+0000","last_undegraded":"2024-04-14T23:34:44.717967+0000","last_fullsized":"2024-04-14T23:34:44.717967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:57:09.514981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319131+0000","last_change":"2024-04-14T23:34:38.707155+0000","last_active":"2024-04-14T23:34:46.319131+0000","last_peered":"2024-04-14T23:34:46.319131+0000","last_clean":"2024-04-14T23:34:46.319131+0000","last_became_active":"2024-04-14T23:34:38.706626+0000","last_became_peered":"2024-04-14T23:34:38.706626+0000","last_unstale":"2024-04-14T23:34:46.319131+0000","last_undegraded":"2024-04-14T23:34:46.319131+0000","last_fullsized":"2024-04-14T23:34:46.319131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:54:47.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136672+0000","last_change":"2024-04-14T23:34:37.713324+0000","last_active":"2024-04-14T23:34:45.136672+0000","last_peered":"2024-04-14T23:34:45.136672+0000","last_clean":"2024-04-14T23:34:45.136672+0000","last_became_active":"2024-04-14T23:34:37.713052+0000","last_became_peered":"2024-04-14T23:34:37.713052+0000","last_unstale":"2024-04-14T23:34:45.136672+0000","last_undegraded":"2024-04-14T23:34:45.136672+0000","last_fullsized":"2024-04-14T23:34:45.136672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:21:25.348015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311604+0000","last_change":"2024-04-14T23:34:43.187173+0000","last_active":"2024-04-14T23:34:46.311604+0000","last_peered":"2024-04-14T23:34:46.311604+0000","last_clean":"2024-04-14T23:34:46.311604+0000","last_became_active":"2024-04-14T23:34:43.185505+0000","last_became_peered":"2024-04-14T23:34:43.185505+0000","last_unstale":"2024-04-14T23:34:46.311604+0000","last_undegraded":"2024-04-14T23:34:46.311604+0000","last_fullsized":"2024-04-14T23:34:46.311604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:28:10.218625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720108+0000","last_change":"2024-04-14T23:34:38.708136+0000","last_active":"2024-04-14T23:34:44.720108+0000","last_peered":"2024-04-14T23:34:44.720108+0000","last_clean":"2024-04-14T23:34:44.720108+0000","last_became_active":"2024-04-14T23:34:38.707860+0000","last_became_peered":"2024-04-14T23:34:38.707860+0000","last_unstale":"2024-04-14T23:34:44.720108+0000","last_undegraded":"2024-04-14T23:34:44.720108+0000","last_fullsized":"2024-04-14T23:34:44.720108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319191+0000","last_change":"2024-04-14T23:34:37.703582+0000","last_active":"2024-04-14T23:34:46.319191+0000","last_peered":"2024-04-14T23:34:46.319191+0000","last_clean":"2024-04-14T23:34:46.319191+0000","last_became_active":"2024-04-14T23:34:37.703276+0000","last_became_peered":"2024-04-14T23:34:37.703276+0000","last_unstale":"2024-04-14T23:34:46.319191+0000","last_undegraded":"2024-04-14T23:34:46.319191+0000","last_fullsized":"2024-04-14T23:34:46.319191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:03:17.126654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318955+0000","last_change":"2024-04-14T23:34:42.738584+0000","last_active":"2024-04-14T23:34:46.318955+0000","last_peered":"2024-04-14T23:34:46.318955+0000","last_clean":"2024-04-14T23:34:46.318955+0000","last_became_active":"2024-04-14T23:34:42.738098+0000","last_became_peered":"2024-04-14T23:34:42.738098+0000","last_unstale":"2024-04-14T23:34:46.318955+0000","last_undegraded":"2024-04-14T23:34:46.318955+0000","last_fullsized":"2024-04-14T23:34:46.318955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:22:18.658809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719759+0000","last_change":"2024-04-14T23:34:38.710787+0000","last_active":"2024-04-14T23:34:44.719759+0000","last_peered":"2024-04-14T23:34:44.719759+0000","last_clean":"2024-04-14T23:34:44.719759+0000","last_became_active":"2024-04-14T23:34:38.710503+0000","last_became_peered":"2024-04-14T23:34:38.710503+0000","last_unstale":"2024-04-14T23:34:44.719759+0000","last_undegraded":"2024-04-14T23:34:44.719759+0000","last_fullsized":"2024-04-14T23:34:44.719759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:24.171888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720174+0000","last_change":"2024-04-14T23:34:37.704162+0000","last_active":"2024-04-14T23:34:44.720174+0000","last_peered":"2024-04-14T23:34:44.720174+0000","last_clean":"2024-04-14T23:34:44.720174+0000","last_became_active":"2024-04-14T23:34:37.703874+0000","last_became_peered":"2024-04-14T23:34:37.703874+0000","last_unstale":"2024-04-14T23:34:44.720174+0000","last_undegraded":"2024-04-14T23:34:44.720174+0000","last_fullsized":"2024-04-14T23:34:44.720174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:18:40.942344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319100+0000","last_change":"2024-04-14T23:34:42.731843+0000","last_active":"2024-04-14T23:34:46.319100+0000","last_peered":"2024-04-14T23:34:46.319100+0000","last_clean":"2024-04-14T23:34:46.319100+0000","last_became_active":"2024-04-14T23:34:42.730913+0000","last_became_peered":"2024-04-14T23:34:42.730913+0000","last_unstale":"2024-04-14T23:34:46.319100+0000","last_undegraded":"2024-04-14T23:34:46.319100+0000","last_fullsized":"2024-04-14T23:34:46.319100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:50:07.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318803+0000","last_change":"2024-04-14T23:34:38.706592+0000","last_active":"2024-04-14T23:34:46.318803+0000","last_peered":"2024-04-14T23:34:46.318803+0000","last_clean":"2024-04-14T23:34:46.318803+0000","last_became_active":"2024-04-14T23:34:38.706299+0000","last_became_peered":"2024-04-14T23:34:38.706299+0000","last_unstale":"2024-04-14T23:34:46.318803+0000","last_undegraded":"2024-04-14T23:34:46.318803+0000","last_fullsized":"2024-04-14T23:34:46.318803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:12.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806129+0000","last_change":"2024-04-14T23:34:37.703871+0000","last_active":"2024-04-14T23:34:45.806129+0000","last_peered":"2024-04-14T23:34:45.806129+0000","last_clean":"2024-04-14T23:34:45.806129+0000","last_became_active":"2024-04-14T23:34:37.703574+0000","last_became_peered":"2024-04-14T23:34:37.703574+0000","last_unstale":"2024-04-14T23:34:45.806129+0000","last_undegraded":"2024-04-14T23:34:45.806129+0000","last_fullsized":"2024-04-14T23:34:45.806129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:51:11.382828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319327+0000","last_change":"2024-04-14T23:34:42.739072+0000","last_active":"2024-04-14T23:34:46.319327+0000","last_peered":"2024-04-14T23:34:46.319327+0000","last_clean":"2024-04-14T23:34:46.319327+0000","last_became_active":"2024-04-14T23:34:42.738587+0000","last_became_peered":"2024-04-14T23:34:42.738587+0000","last_unstale":"2024-04-14T23:34:46.319327+0000","last_undegraded":"2024-04-14T23:34:46.319327+0000","last_fullsized":"2024-04-14T23:34:46.319327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:37:34.006119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311383+0000","last_change":"2024-04-14T23:34:38.704755+0000","last_active":"2024-04-14T23:34:46.311383+0000","last_peered":"2024-04-14T23:34:46.311383+0000","last_clean":"2024-04-14T23:34:46.311383+0000","last_became_active":"2024-04-14T23:34:38.704247+0000","last_became_peered":"2024-04-14T23:34:38.704247+0000","last_unstale":"2024-04-14T23:34:46.311383+0000","last_undegraded":"2024-04-14T23:34:46.311383+0000","last_fullsized":"2024-04-14T23:34:46.311383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:48:26.290955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.135983+0000","last_change":"2024-04-14T23:34:37.712348+0000","last_active":"2024-04-14T23:34:45.135983+0000","last_peered":"2024-04-14T23:34:45.135983+0000","last_clean":"2024-04-14T23:34:45.135983+0000","last_became_active":"2024-04-14T23:34:37.712043+0000","last_became_peered":"2024-04-14T23:34:37.712043+0000","last_unstale":"2024-04-14T23:34:45.135983+0000","last_undegraded":"2024-04-14T23:34:45.135983+0000","last_fullsized":"2024-04-14T23:34:45.135983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:48:25.286602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.312031+0000","last_change":"2024-04-14T23:34:43.186651+0000","last_active":"2024-04-14T23:34:46.312031+0000","last_peered":"2024-04-14T23:34:46.312031+0000","last_clean":"2024-04-14T23:34:46.312031+0000","last_became_active":"2024-04-14T23:34:43.186282+0000","last_became_peered":"2024-04-14T23:34:43.186282+0000","last_unstale":"2024-04-14T23:34:46.312031+0000","last_undegraded":"2024-04-14T23:34:46.312031+0000","last_fullsized":"2024-04-14T23:34:46.312031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:37:34.006119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718436+0000","last_change":"2024-04-14T23:34:38.709071+0000","last_active":"2024-04-14T23:34:44.718436+0000","last_peered":"2024-04-14T23:34:44.718436+0000","last_clean":"2024-04-14T23:34:44.718436+0000","last_became_active":"2024-04-14T23:34:38.708815+0000","last_became_peered":"2024-04-14T23:34:38.708815+0000","last_unstale":"2024-04-14T23:34:44.718436+0000","last_undegraded":"2024-04-14T23:34:44.718436+0000","last_fullsized":"2024-04-14T23:34:44.718436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:12.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720070+0000","last_change":"2024-04-14T23:34:37.704931+0000","last_active":"2024-04-14T23:34:44.720070+0000","last_peered":"2024-04-14T23:34:44.720070+0000","last_clean":"2024-04-14T23:34:44.720070+0000","last_became_active":"2024-04-14T23:34:37.704607+0000","last_became_peered":"2024-04-14T23:34:37.704607+0000","last_unstale":"2024-04-14T23:34:44.720070+0000","last_undegraded":"2024-04-14T23:34:44.720070+0000","last_fullsized":"2024-04-14T23:34:44.720070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:51:11.382828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136097+0000","last_change":"2024-04-14T23:34:27.438796+0000","last_active":"2024-04-14T23:34:45.136097+0000","last_peered":"2024-04-14T23:34:45.136097+0000","last_clean":"2024-04-14T23:34:45.136097+0000","last_became_active":"2024-04-14T23:34:27.437932+0000","last_became_peered":"2024-04-14T23:34:27.437932+0000","last_unstale":"2024-04-14T23:34:45.136097+0000","last_undegraded":"2024-04-14T23:34:45.136097+0000","last_fullsized":"2024-04-14T23:34:45.136097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_clean_scrub_stamp":"2024-04-14T23:34:26.390323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:11:13.484245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517493+0000","last_change":"2024-04-14T23:34:43.188245+0000","last_active":"2024-04-14T23:34:46.517493+0000","last_peered":"2024-04-14T23:34:46.517493+0000","last_clean":"2024-04-14T23:34:46.517493+0000","last_became_active":"2024-04-14T23:34:43.187808+0000","last_became_peered":"2024-04-14T23:34:43.187808+0000","last_unstale":"2024-04-14T23:34:46.517493+0000","last_undegraded":"2024-04-14T23:34:46.517493+0000","last_fullsized":"2024-04-14T23:34:46.517493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:28.129419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136392+0000","last_change":"2024-04-14T23:34:38.711963+0000","last_active":"2024-04-14T23:34:45.136392+0000","last_peered":"2024-04-14T23:34:45.136392+0000","last_clean":"2024-04-14T23:34:45.136392+0000","last_became_active":"2024-04-14T23:34:38.710515+0000","last_became_peered":"2024-04-14T23:34:38.710515+0000","last_unstale":"2024-04-14T23:34:45.136392+0000","last_undegraded":"2024-04-14T23:34:45.136392+0000","last_fullsized":"2024-04-14T23:34:45.136392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:29:53.179819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806129+0000","last_change":"2024-04-14T23:34:37.708620+0000","last_active":"2024-04-14T23:34:45.806129+0000","last_peered":"2024-04-14T23:34:45.806129+0000","last_clean":"2024-04-14T23:34:45.806129+0000","last_became_active":"2024-04-14T23:34:37.708280+0000","last_became_peered":"2024-04-14T23:34:37.708280+0000","last_unstale":"2024-04-14T23:34:45.806129+0000","last_undegraded":"2024-04-14T23:34:45.806129+0000","last_fullsized":"2024-04-14T23:34:45.806129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:29.023280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517179+0000","last_change":"2024-04-14T23:34:43.185307+0000","last_active":"2024-04-14T23:34:46.517179+0000","last_peered":"2024-04-14T23:34:46.517179+0000","last_clean":"2024-04-14T23:34:46.517179+0000","last_became_active":"2024-04-14T23:34:43.184870+0000","last_became_peered":"2024-04-14T23:34:43.184870+0000","last_unstale":"2024-04-14T23:34:46.517179+0000","last_undegraded":"2024-04-14T23:34:46.517179+0000","last_fullsized":"2024-04-14T23:34:46.517179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:29:57.202071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720547+0000","last_change":"2024-04-14T23:34:38.714634+0000","last_active":"2024-04-14T23:34:44.720547+0000","last_peered":"2024-04-14T23:34:44.720547+0000","last_clean":"2024-04-14T23:34:44.720547+0000","last_became_active":"2024-04-14T23:34:38.714357+0000","last_became_peered":"2024-04-14T23:34:38.714357+0000","last_unstale":"2024-04-14T23:34:44.720547+0000","last_undegraded":"2024-04-14T23:34:44.720547+0000","last_fullsized":"2024-04-14T23:34:44.720547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:29:53.179819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318527+0000","last_change":"2024-04-14T23:34:37.709513+0000","last_active":"2024-04-14T23:34:46.318527+0000","last_peered":"2024-04-14T23:34:46.318527+0000","last_clean":"2024-04-14T23:34:46.318527+0000","last_became_active":"2024-04-14T23:34:37.709235+0000","last_became_peered":"2024-04-14T23:34:37.709235+0000","last_unstale":"2024-04-14T23:34:46.318527+0000","last_undegraded":"2024-04-14T23:34:46.318527+0000","last_fullsized":"2024-04-14T23:34:46.318527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:52.026945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311747+0000","last_change":"2024-04-14T23:34:42.739900+0000","last_active":"2024-04-14T23:34:46.311747+0000","last_peered":"2024-04-14T23:34:46.311747+0000","last_clean":"2024-04-14T23:34:46.311747+0000","last_became_active":"2024-04-14T23:34:42.739539+0000","last_became_peered":"2024-04-14T23:34:42.739539+0000","last_unstale":"2024-04-14T23:34:46.311747+0000","last_undegraded":"2024-04-14T23:34:46.311747+0000","last_fullsized":"2024-04-14T23:34:46.311747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:22:18.658809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136800+0000","last_change":"2024-04-14T23:34:38.716624+0000","last_active":"2024-04-14T23:34:45.136800+0000","last_peered":"2024-04-14T23:34:45.136800+0000","last_clean":"2024-04-14T23:34:45.136800+0000","last_became_active":"2024-04-14T23:34:38.716353+0000","last_became_peered":"2024-04-14T23:34:38.716353+0000","last_unstale":"2024-04-14T23:34:45.136800+0000","last_undegraded":"2024-04-14T23:34:45.136800+0000","last_fullsized":"2024-04-14T23:34:45.136800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:28:06.196373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806146+0000","last_change":"2024-04-14T23:34:37.707669+0000","last_active":"2024-04-14T23:34:45.806146+0000","last_peered":"2024-04-14T23:34:45.806146+0000","last_clean":"2024-04-14T23:34:45.806146+0000","last_became_active":"2024-04-14T23:34:37.707312+0000","last_became_peered":"2024-04-14T23:34:37.707312+0000","last_unstale":"2024-04-14T23:34:45.806146+0000","last_undegraded":"2024-04-14T23:34:45.806146+0000","last_fullsized":"2024-04-14T23:34:45.806146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:02:03.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720259+0000","last_change":"2024-04-14T23:34:43.187817+0000","last_active":"2024-04-14T23:34:44.720259+0000","last_peered":"2024-04-14T23:34:44.720259+0000","last_clean":"2024-04-14T23:34:44.720259+0000","last_became_active":"2024-04-14T23:34:43.187119+0000","last_became_peered":"2024-04-14T23:34:43.187119+0000","last_unstale":"2024-04-14T23:34:44.720259+0000","last_undegraded":"2024-04-14T23:34:44.720259+0000","last_fullsized":"2024-04-14T23:34:44.720259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:12:56.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136660+0000","last_change":"2024-04-14T23:34:38.710233+0000","last_active":"2024-04-14T23:34:45.136660+0000","last_peered":"2024-04-14T23:34:45.136660+0000","last_clean":"2024-04-14T23:34:45.136660+0000","last_became_active":"2024-04-14T23:34:38.709977+0000","last_became_peered":"2024-04-14T23:34:38.709977+0000","last_unstale":"2024-04-14T23:34:45.136660+0000","last_undegraded":"2024-04-14T23:34:45.136660+0000","last_fullsized":"2024-04-14T23:34:45.136660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:54:48.080529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720245+0000","last_change":"2024-04-14T23:34:37.705808+0000","last_active":"2024-04-14T23:34:44.720245+0000","last_peered":"2024-04-14T23:34:44.720245+0000","last_clean":"2024-04-14T23:34:44.720245+0000","last_became_active":"2024-04-14T23:34:37.705482+0000","last_became_peered":"2024-04-14T23:34:37.705482+0000","last_unstale":"2024-04-14T23:34:44.720245+0000","last_undegraded":"2024-04-14T23:34:44.720245+0000","last_fullsized":"2024-04-14T23:34:44.720245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:15:08.407528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720487+0000","last_change":"2024-04-14T23:34:42.733535+0000","last_active":"2024-04-14T23:34:44.720487+0000","last_peered":"2024-04-14T23:34:44.720487+0000","last_clean":"2024-04-14T23:34:44.720487+0000","last_became_active":"2024-04-14T23:34:42.733097+0000","last_became_peered":"2024-04-14T23:34:42.733097+0000","last_unstale":"2024-04-14T23:34:44.720487+0000","last_undegraded":"2024-04-14T23:34:44.720487+0000","last_fullsized":"2024-04-14T23:34:44.720487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:06:02.832632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136148+0000","last_change":"2024-04-14T23:34:38.709532+0000","last_active":"2024-04-14T23:34:45.136148+0000","last_peered":"2024-04-14T23:34:45.136148+0000","last_clean":"2024-04-14T23:34:45.136148+0000","last_became_active":"2024-04-14T23:34:38.709258+0000","last_became_peered":"2024-04-14T23:34:38.709258+0000","last_unstale":"2024-04-14T23:34:45.136148+0000","last_undegraded":"2024-04-14T23:34:45.136148+0000","last_fullsized":"2024-04-14T23:34:45.136148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:57:26.195919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806275+0000","last_change":"2024-04-14T23:34:37.697607+0000","last_active":"2024-04-14T23:34:45.806275+0000","last_peered":"2024-04-14T23:34:45.806275+0000","last_clean":"2024-04-14T23:34:45.806275+0000","last_became_active":"2024-04-14T23:34:37.697298+0000","last_became_peered":"2024-04-14T23:34:37.697298+0000","last_unstale":"2024-04-14T23:34:45.806275+0000","last_undegraded":"2024-04-14T23:34:45.806275+0000","last_fullsized":"2024-04-14T23:34:45.806275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:59:31.580365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311852+0000","last_change":"2024-04-14T23:34:42.735706+0000","last_active":"2024-04-14T23:34:46.311852+0000","last_peered":"2024-04-14T23:34:46.311852+0000","last_clean":"2024-04-14T23:34:46.311852+0000","last_became_active":"2024-04-14T23:34:42.735271+0000","last_became_peered":"2024-04-14T23:34:42.735271+0000","last_unstale":"2024-04-14T23:34:46.311852+0000","last_undegraded":"2024-04-14T23:34:46.311852+0000","last_fullsized":"2024-04-14T23:34:46.311852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:12:56.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517020+0000","last_change":"2024-04-14T23:34:38.713087+0000","last_active":"2024-04-14T23:34:46.517020+0000","last_peered":"2024-04-14T23:34:46.517020+0000","last_clean":"2024-04-14T23:34:46.517020+0000","last_became_active":"2024-04-14T23:34:38.712034+0000","last_became_peered":"2024-04-14T23:34:38.712034+0000","last_unstale":"2024-04-14T23:34:46.517020+0000","last_undegraded":"2024-04-14T23:34:46.517020+0000","last_fullsized":"2024-04-14T23:34:46.517020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516575+0000","last_change":"2024-04-14T23:34:37.704849+0000","last_active":"2024-04-14T23:34:46.516575+0000","last_peered":"2024-04-14T23:34:46.516575+0000","last_clean":"2024-04-14T23:34:46.516575+0000","last_became_active":"2024-04-14T23:34:37.704557+0000","last_became_peered":"2024-04-14T23:34:37.704557+0000","last_unstale":"2024-04-14T23:34:46.516575+0000","last_undegraded":"2024-04-14T23:34:46.516575+0000","last_fullsized":"2024-04-14T23:34:46.516575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:51:11.382828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718861+0000","last_change":"2024-04-14T23:34:43.189855+0000","last_active":"2024-04-14T23:34:44.718861+0000","last_peered":"2024-04-14T23:34:44.718861+0000","last_clean":"2024-04-14T23:34:44.718861+0000","last_became_active":"2024-04-14T23:34:43.187647+0000","last_became_peered":"2024-04-14T23:34:43.187647+0000","last_unstale":"2024-04-14T23:34:44.718861+0000","last_undegraded":"2024-04-14T23:34:44.718861+0000","last_fullsized":"2024-04-14T23:34:44.718861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:43:12.062252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136349+0000","last_change":"2024-04-14T23:34:38.716708+0000","last_active":"2024-04-14T23:34:45.136349+0000","last_peered":"2024-04-14T23:34:45.136349+0000","last_clean":"2024-04-14T23:34:45.136349+0000","last_became_active":"2024-04-14T23:34:38.716155+0000","last_became_peered":"2024-04-14T23:34:38.716155+0000","last_unstale":"2024-04-14T23:34:45.136349+0000","last_undegraded":"2024-04-14T23:34:45.136349+0000","last_fullsized":"2024-04-14T23:34:45.136349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:19:41.725777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720069+0000","last_change":"2024-04-14T23:34:37.708685+0000","last_active":"2024-04-14T23:34:44.720069+0000","last_peered":"2024-04-14T23:34:44.720069+0000","last_clean":"2024-04-14T23:34:44.720069+0000","last_became_active":"2024-04-14T23:34:37.708139+0000","last_became_peered":"2024-04-14T23:34:37.708139+0000","last_unstale":"2024-04-14T23:34:44.720069+0000","last_undegraded":"2024-04-14T23:34:44.720069+0000","last_fullsized":"2024-04-14T23:34:44.720069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:23.167535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718415+0000","last_change":"2024-04-14T23:34:43.185556+0000","last_active":"2024-04-14T23:34:44.718415+0000","last_peered":"2024-04-14T23:34:44.718415+0000","last_clean":"2024-04-14T23:34:44.718415+0000","last_became_active":"2024-04-14T23:34:43.185132+0000","last_became_peered":"2024-04-14T23:34:43.185132+0000","last_unstale":"2024-04-14T23:34:44.718415+0000","last_undegraded":"2024-04-14T23:34:44.718415+0000","last_fullsized":"2024-04-14T23:34:44.718415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:42:28.109020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311653+0000","last_change":"2024-04-14T23:34:38.711429+0000","last_active":"2024-04-14T23:34:46.311653+0000","last_peered":"2024-04-14T23:34:46.311653+0000","last_clean":"2024-04-14T23:34:46.311653+0000","last_became_active":"2024-04-14T23:34:38.710919+0000","last_became_peered":"2024-04-14T23:34:38.710919+0000","last_unstale":"2024-04-14T23:34:46.311653+0000","last_undegraded":"2024-04-14T23:34:46.311653+0000","last_fullsized":"2024-04-14T23:34:46.311653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:32:33.112814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311200+0000","last_change":"2024-04-14T23:34:37.712359+0000","last_active":"2024-04-14T23:34:46.311200+0000","last_peered":"2024-04-14T23:34:46.311200+0000","last_clean":"2024-04-14T23:34:46.311200+0000","last_became_active":"2024-04-14T23:34:37.711899+0000","last_became_peered":"2024-04-14T23:34:37.711899+0000","last_unstale":"2024-04-14T23:34:46.311200+0000","last_undegraded":"2024-04-14T23:34:46.311200+0000","last_fullsized":"2024-04-14T23:34:46.311200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:15:08.407528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719927+0000","last_change":"2024-04-14T23:34:43.185490+0000","last_active":"2024-04-14T23:34:44.719927+0000","last_peered":"2024-04-14T23:34:44.719927+0000","last_clean":"2024-04-14T23:34:44.719927+0000","last_became_active":"2024-04-14T23:34:43.185080+0000","last_became_peered":"2024-04-14T23:34:43.185080+0000","last_unstale":"2024-04-14T23:34:44.719927+0000","last_undegraded":"2024-04-14T23:34:44.719927+0000","last_fullsized":"2024-04-14T23:34:44.719927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:50:07.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136350+0000","last_change":"2024-04-14T23:34:38.718154+0000","last_active":"2024-04-14T23:34:45.136350+0000","last_peered":"2024-04-14T23:34:45.136350+0000","last_clean":"2024-04-14T23:34:45.136350+0000","last_became_active":"2024-04-14T23:34:38.717760+0000","last_became_peered":"2024-04-14T23:34:38.717760+0000","last_unstale":"2024-04-14T23:34:45.136350+0000","last_undegraded":"2024-04-14T23:34:45.136350+0000","last_fullsized":"2024-04-14T23:34:45.136350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:08:52.379294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:47.717043+0000","last_change":"2024-04-14T23:34:37.710678+0000","last_active":"2024-04-14T23:34:47.717043+0000","last_peered":"2024-04-14T23:34:47.717043+0000","last_clean":"2024-04-14T23:34:47.717043+0000","last_became_active":"2024-04-14T23:34:37.710377+0000","last_became_peered":"2024-04-14T23:34:37.710377+0000","last_unstale":"2024-04-14T23:34:47.717043+0000","last_undegraded":"2024-04-14T23:34:47.717043+0000","last_fullsized":"2024-04-14T23:34:47.717043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:23.167535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318875+0000","last_change":"2024-04-14T23:34:42.735072+0000","last_active":"2024-04-14T23:34:46.318875+0000","last_peered":"2024-04-14T23:34:46.318875+0000","last_clean":"2024-04-14T23:34:46.318875+0000","last_became_active":"2024-04-14T23:34:42.734693+0000","last_became_peered":"2024-04-14T23:34:42.734693+0000","last_unstale":"2024-04-14T23:34:46.318875+0000","last_undegraded":"2024-04-14T23:34:46.318875+0000","last_fullsized":"2024-04-14T23:34:46.318875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:28:10.218625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720019+0000","last_change":"2024-04-14T23:34:38.714478+0000","last_active":"2024-04-14T23:34:44.720019+0000","last_peered":"2024-04-14T23:34:44.720019+0000","last_clean":"2024-04-14T23:34:44.720019+0000","last_became_active":"2024-04-14T23:34:38.714187+0000","last_became_peered":"2024-04-14T23:34:38.714187+0000","last_unstale":"2024-04-14T23:34:44.720019+0000","last_undegraded":"2024-04-14T23:34:44.720019+0000","last_fullsized":"2024-04-14T23:34:44.720019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:26.985483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318538+0000","last_change":"2024-04-14T23:34:37.706150+0000","last_active":"2024-04-14T23:34:46.318538+0000","last_peered":"2024-04-14T23:34:46.318538+0000","last_clean":"2024-04-14T23:34:46.318538+0000","last_became_active":"2024-04-14T23:34:37.705836+0000","last_became_peered":"2024-04-14T23:34:37.705836+0000","last_unstale":"2024-04-14T23:34:46.318538+0000","last_undegraded":"2024-04-14T23:34:46.318538+0000","last_fullsized":"2024-04-14T23:34:46.318538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:02:03.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719572+0000","last_change":"2024-04-14T23:34:42.733389+0000","last_active":"2024-04-14T23:34:44.719572+0000","last_peered":"2024-04-14T23:34:44.719572+0000","last_clean":"2024-04-14T23:34:44.719572+0000","last_became_active":"2024-04-14T23:34:42.732985+0000","last_became_peered":"2024-04-14T23:34:42.732985+0000","last_unstale":"2024-04-14T23:34:44.719572+0000","last_undegraded":"2024-04-14T23:34:44.719572+0000","last_fullsized":"2024-04-14T23:34:44.719572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:37:34.006119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311955+0000","last_change":"2024-04-14T23:34:38.710119+0000","last_active":"2024-04-14T23:34:46.311955+0000","last_peered":"2024-04-14T23:34:46.311955+0000","last_clean":"2024-04-14T23:34:46.311955+0000","last_became_active":"2024-04-14T23:34:38.709833+0000","last_became_peered":"2024-04-14T23:34:38.709833+0000","last_unstale":"2024-04-14T23:34:46.311955+0000","last_undegraded":"2024-04-14T23:34:46.311955+0000","last_fullsized":"2024-04-14T23:34:46.311955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:54:47.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720394+0000","last_change":"2024-04-14T23:34:37.707534+0000","last_active":"2024-04-14T23:34:44.720394+0000","last_peered":"2024-04-14T23:34:44.720394+0000","last_clean":"2024-04-14T23:34:44.720394+0000","last_became_active":"2024-04-14T23:34:37.707213+0000","last_became_peered":"2024-04-14T23:34:37.707213+0000","last_unstale":"2024-04-14T23:34:44.720394+0000","last_undegraded":"2024-04-14T23:34:44.720394+0000","last_fullsized":"2024-04-14T23:34:44.720394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:02:03.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718138+0000","last_change":"2024-04-14T23:34:42.728861+0000","last_active":"2024-04-14T23:34:44.718138+0000","last_peered":"2024-04-14T23:34:44.718138+0000","last_clean":"2024-04-14T23:34:44.718138+0000","last_became_active":"2024-04-14T23:34:42.727257+0000","last_became_peered":"2024-04-14T23:34:42.727257+0000","last_unstale":"2024-04-14T23:34:44.718138+0000","last_undegraded":"2024-04-14T23:34:44.718138+0000","last_fullsized":"2024-04-14T23:34:44.718138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:50:08.796670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720295+0000","last_change":"2024-04-14T23:34:38.701821+0000","last_active":"2024-04-14T23:34:44.720295+0000","last_peered":"2024-04-14T23:34:44.720295+0000","last_clean":"2024-04-14T23:34:44.720295+0000","last_became_active":"2024-04-14T23:34:38.701530+0000","last_became_peered":"2024-04-14T23:34:38.701530+0000","last_unstale":"2024-04-14T23:34:44.720295+0000","last_undegraded":"2024-04-14T23:34:44.720295+0000","last_fullsized":"2024-04-14T23:34:44.720295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:34:09.647113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516783+0000","last_change":"2024-04-14T23:34:37.703952+0000","last_active":"2024-04-14T23:34:46.516783+0000","last_peered":"2024-04-14T23:34:46.516783+0000","last_clean":"2024-04-14T23:34:46.516783+0000","last_became_active":"2024-04-14T23:34:37.703622+0000","last_became_peered":"2024-04-14T23:34:37.703622+0000","last_unstale":"2024-04-14T23:34:46.516783+0000","last_undegraded":"2024-04-14T23:34:46.516783+0000","last_fullsized":"2024-04-14T23:34:46.516783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:29.023280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718062+0000","last_change":"2024-04-14T23:34:43.190499+0000","last_active":"2024-04-14T23:34:44.718062+0000","last_peered":"2024-04-14T23:34:44.718062+0000","last_clean":"2024-04-14T23:34:44.718062+0000","last_became_active":"2024-04-14T23:34:43.190120+0000","last_became_peered":"2024-04-14T23:34:43.190120+0000","last_unstale":"2024-04-14T23:34:44.718062+0000","last_undegraded":"2024-04-14T23:34:44.718062+0000","last_fullsized":"2024-04-14T23:34:44.718062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:07:43.950068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311856+0000","last_change":"2024-04-14T23:34:43.188434+0000","last_active":"2024-04-14T23:34:46.311856+0000","last_peered":"2024-04-14T23:34:46.311856+0000","last_clean":"2024-04-14T23:34:46.311856+0000","last_became_active":"2024-04-14T23:34:43.188069+0000","last_became_peered":"2024-04-14T23:34:43.188069+0000","last_unstale":"2024-04-14T23:34:46.311856+0000","last_undegraded":"2024-04-14T23:34:46.311856+0000","last_fullsized":"2024-04-14T23:34:46.311856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:50:07.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318672+0000","last_change":"2024-04-14T23:34:38.713042+0000","last_active":"2024-04-14T23:34:46.318672+0000","last_peered":"2024-04-14T23:34:46.318672+0000","last_clean":"2024-04-14T23:34:46.318672+0000","last_became_active":"2024-04-14T23:34:38.712746+0000","last_became_peered":"2024-04-14T23:34:38.712746+0000","last_unstale":"2024-04-14T23:34:46.318672+0000","last_undegraded":"2024-04-14T23:34:46.318672+0000","last_fullsized":"2024-04-14T23:34:46.318672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:27:36.965696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719390+0000","last_change":"2024-04-14T23:34:37.709449+0000","last_active":"2024-04-14T23:34:44.719390+0000","last_peered":"2024-04-14T23:34:44.719390+0000","last_clean":"2024-04-14T23:34:44.719390+0000","last_became_active":"2024-04-14T23:34:37.709153+0000","last_became_peered":"2024-04-14T23:34:37.709153+0000","last_unstale":"2024-04-14T23:34:44.719390+0000","last_undegraded":"2024-04-14T23:34:44.719390+0000","last_fullsized":"2024-04-14T23:34:44.719390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:29.023280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517519+0000","last_change":"2024-04-14T23:34:42.734788+0000","last_active":"2024-04-14T23:34:46.517519+0000","last_peered":"2024-04-14T23:34:46.517519+0000","last_clean":"2024-04-14T23:34:46.517519+0000","last_became_active":"2024-04-14T23:34:42.734397+0000","last_became_peered":"2024-04-14T23:34:42.734397+0000","last_unstale":"2024-04-14T23:34:46.517519+0000","last_undegraded":"2024-04-14T23:34:46.517519+0000","last_fullsized":"2024-04-14T23:34:46.517519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:17.874980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718120+0000","last_change":"2024-04-14T23:34:38.713504+0000","last_active":"2024-04-14T23:34:44.718120+0000","last_peered":"2024-04-14T23:34:44.718120+0000","last_clean":"2024-04-14T23:34:44.718120+0000","last_became_active":"2024-04-14T23:34:38.712325+0000","last_became_peered":"2024-04-14T23:34:38.712325+0000","last_unstale":"2024-04-14T23:34:44.718120+0000","last_undegraded":"2024-04-14T23:34:44.718120+0000","last_fullsized":"2024-04-14T23:34:44.718120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:54:47.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718225+0000","last_change":"2024-04-14T23:34:37.711477+0000","last_active":"2024-04-14T23:34:44.718225+0000","last_peered":"2024-04-14T23:34:44.718225+0000","last_clean":"2024-04-14T23:34:44.718225+0000","last_became_active":"2024-04-14T23:34:37.710472+0000","last_became_peered":"2024-04-14T23:34:37.710472+0000","last_unstale":"2024-04-14T23:34:44.718225+0000","last_undegraded":"2024-04-14T23:34:44.718225+0000","last_fullsized":"2024-04-14T23:34:44.718225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:59:31.580365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516590+0000","last_change":"2024-04-14T23:34:37.700380+0000","last_active":"2024-04-14T23:34:46.516590+0000","last_peered":"2024-04-14T23:34:46.516590+0000","last_clean":"2024-04-14T23:34:46.516590+0000","last_became_active":"2024-04-14T23:34:37.699846+0000","last_became_peered":"2024-04-14T23:34:37.699846+0000","last_unstale":"2024-04-14T23:34:46.516590+0000","last_undegraded":"2024-04-14T23:34:46.516590+0000","last_fullsized":"2024-04-14T23:34:46.516590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:18:40.942344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311821+0000","last_change":"2024-04-14T23:34:38.701104+0000","last_active":"2024-04-14T23:34:46.311821+0000","last_peered":"2024-04-14T23:34:46.311821+0000","last_clean":"2024-04-14T23:34:46.311821+0000","last_became_active":"2024-04-14T23:34:38.700816+0000","last_became_peered":"2024-04-14T23:34:38.700816+0000","last_unstale":"2024-04-14T23:34:46.311821+0000","last_undegraded":"2024-04-14T23:34:46.311821+0000","last_fullsized":"2024-04-14T23:34:46.311821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806426+0000","last_change":"2024-04-14T23:34:42.729961+0000","last_active":"2024-04-14T23:34:45.806426+0000","last_peered":"2024-04-14T23:34:45.806426+0000","last_clean":"2024-04-14T23:34:45.806426+0000","last_became_active":"2024-04-14T23:34:42.729584+0000","last_became_peered":"2024-04-14T23:34:42.729584+0000","last_unstale":"2024-04-14T23:34:45.806426+0000","last_undegraded":"2024-04-14T23:34:45.806426+0000","last_fullsized":"2024-04-14T23:34:45.806426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:32:37.135066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718411+0000","last_change":"2024-04-14T23:34:37.711324+0000","last_active":"2024-04-14T23:34:44.718411+0000","last_peered":"2024-04-14T23:34:44.718411+0000","last_clean":"2024-04-14T23:34:44.718411+0000","last_became_active":"2024-04-14T23:34:37.710354+0000","last_became_peered":"2024-04-14T23:34:37.710354+0000","last_unstale":"2024-04-14T23:34:44.718411+0000","last_undegraded":"2024-04-14T23:34:44.718411+0000","last_fullsized":"2024-04-14T23:34:44.718411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:51:11.382828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719474+0000","last_change":"2024-04-14T23:34:38.708836+0000","last_active":"2024-04-14T23:34:44.719474+0000","last_peered":"2024-04-14T23:34:44.719474+0000","last_clean":"2024-04-14T23:34:44.719474+0000","last_became_active":"2024-04-14T23:34:38.708569+0000","last_became_peered":"2024-04-14T23:34:38.708569+0000","last_unstale":"2024-04-14T23:34:44.719474+0000","last_undegraded":"2024-04-14T23:34:44.719474+0000","last_fullsized":"2024-04-14T23:34:44.719474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:53.031298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718647+0000","last_change":"2024-04-14T23:34:42.729168+0000","last_active":"2024-04-14T23:34:44.718647+0000","last_peered":"2024-04-14T23:34:44.718647+0000","last_clean":"2024-04-14T23:34:44.718647+0000","last_became_active":"2024-04-14T23:34:42.727494+0000","last_became_peered":"2024-04-14T23:34:42.727494+0000","last_unstale":"2024-04-14T23:34:44.718647+0000","last_undegraded":"2024-04-14T23:34:44.718647+0000","last_fullsized":"2024-04-14T23:34:44.718647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:25:19.108275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516920+0000","last_change":"2024-04-14T23:34:38.714071+0000","last_active":"2024-04-14T23:34:46.516920+0000","last_peered":"2024-04-14T23:34:46.516920+0000","last_clean":"2024-04-14T23:34:46.516920+0000","last_became_active":"2024-04-14T23:34:38.713792+0000","last_became_peered":"2024-04-14T23:34:38.713792+0000","last_unstale":"2024-04-14T23:34:46.516920+0000","last_undegraded":"2024-04-14T23:34:46.516920+0000","last_fullsized":"2024-04-14T23:34:46.516920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:54:47.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806380+0000","last_change":"2024-04-14T23:34:38.710636+0000","last_active":"2024-04-14T23:34:45.806380+0000","last_peered":"2024-04-14T23:34:45.806380+0000","last_clean":"2024-04-14T23:34:45.806380+0000","last_became_active":"2024-04-14T23:34:38.710137+0000","last_became_peered":"2024-04-14T23:34:38.710137+0000","last_unstale":"2024-04-14T23:34:45.806380+0000","last_undegraded":"2024-04-14T23:34:45.806380+0000","last_fullsized":"2024-04-14T23:34:45.806380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:53.031298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719973+0000","last_change":"2024-04-14T23:34:38.712090+0000","last_active":"2024-04-14T23:34:44.719973+0000","last_peered":"2024-04-14T23:34:44.719973+0000","last_clean":"2024-04-14T23:34:44.719973+0000","last_became_active":"2024-04-14T23:34:38.711774+0000","last_became_peered":"2024-04-14T23:34:38.711774+0000","last_unstale":"2024-04-14T23:34:44.719973+0000","last_undegraded":"2024-04-14T23:34:44.719973+0000","last_fullsized":"2024-04-14T23:34:44.719973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:08:52.379294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311741+0000","last_change":"2024-04-14T23:34:38.710874+0000","last_active":"2024-04-14T23:34:46.311741+0000","last_peered":"2024-04-14T23:34:46.311741+0000","last_clean":"2024-04-14T23:34:46.311741+0000","last_became_active":"2024-04-14T23:34:38.710573+0000","last_became_peered":"2024-04-14T23:34:38.710573+0000","last_unstale":"2024-04-14T23:34:46.311741+0000","last_undegraded":"2024-04-14T23:34:46.311741+0000","last_fullsized":"2024-04-14T23:34:46.311741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:40.949590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718481+0000","last_change":"2024-04-14T23:34:38.712171+0000","last_active":"2024-04-14T23:34:44.718481+0000","last_peered":"2024-04-14T23:34:44.718481+0000","last_clean":"2024-04-14T23:34:44.718481+0000","last_became_active":"2024-04-14T23:34:38.711789+0000","last_became_peered":"2024-04-14T23:34:38.711789+0000","last_unstale":"2024-04-14T23:34:44.718481+0000","last_undegraded":"2024-04-14T23:34:44.718481+0000","last_fullsized":"2024-04-14T23:34:44.718481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:32:05.285392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319127+0000","last_change":"2024-04-14T23:34:38.717810+0000","last_active":"2024-04-14T23:34:46.319127+0000","last_peered":"2024-04-14T23:34:46.319127+0000","last_clean":"2024-04-14T23:34:46.319127+0000","last_became_active":"2024-04-14T23:34:38.717398+0000","last_became_peered":"2024-04-14T23:34:38.717398+0000","last_unstale":"2024-04-14T23:34:46.319127+0000","last_undegraded":"2024-04-14T23:34:46.319127+0000","last_fullsized":"2024-04-14T23:34:46.319127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517638+0000","last_change":"2024-04-14T23:34:38.714157+0000","last_active":"2024-04-14T23:34:46.517638+0000","last_peered":"2024-04-14T23:34:46.517638+0000","last_clean":"2024-04-14T23:34:46.517638+0000","last_became_active":"2024-04-14T23:34:38.712289+0000","last_became_peered":"2024-04-14T23:34:38.712289+0000","last_unstale":"2024-04-14T23:34:46.517638+0000","last_undegraded":"2024-04-14T23:34:46.517638+0000","last_fullsized":"2024-04-14T23:34:46.517638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:44.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718791+0000","last_change":"2024-04-14T23:34:38.711729+0000","last_active":"2024-04-14T23:34:44.718791+0000","last_peered":"2024-04-14T23:34:44.718791+0000","last_clean":"2024-04-14T23:34:44.718791+0000","last_became_active":"2024-04-14T23:34:38.711429+0000","last_became_peered":"2024-04-14T23:34:38.711429+0000","last_unstale":"2024-04-14T23:34:44.718791+0000","last_undegraded":"2024-04-14T23:34:44.718791+0000","last_fullsized":"2024-04-14T23:34:44.718791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719293+0000","last_change":"2024-04-14T23:34:38.715491+0000","last_active":"2024-04-14T23:34:44.719293+0000","last_peered":"2024-04-14T23:34:44.719293+0000","last_clean":"2024-04-14T23:34:44.719293+0000","last_became_active":"2024-04-14T23:34:38.714292+0000","last_became_peered":"2024-04-14T23:34:38.714292+0000","last_unstale":"2024-04-14T23:34:44.719293+0000","last_undegraded":"2024-04-14T23:34:44.719293+0000","last_fullsized":"2024-04-14T23:34:44.719293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:09:47.574841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718114+0000","last_change":"2024-04-14T23:34:38.709908+0000","last_active":"2024-04-14T23:34:44.718114+0000","last_peered":"2024-04-14T23:34:44.718114+0000","last_clean":"2024-04-14T23:34:44.718114+0000","last_became_active":"2024-04-14T23:34:38.709563+0000","last_became_peered":"2024-04-14T23:34:38.709563+0000","last_unstale":"2024-04-14T23:34:44.718114+0000","last_undegraded":"2024-04-14T23:34:44.718114+0000","last_fullsized":"2024-04-14T23:34:44.718114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719868+0000","last_change":"2024-04-14T23:34:38.708460+0000","last_active":"2024-04-14T23:34:44.719868+0000","last_peered":"2024-04-14T23:34:44.719868+0000","last_clean":"2024-04-14T23:34:44.719868+0000","last_became_active":"2024-04-14T23:34:38.707437+0000","last_became_peered":"2024-04-14T23:34:38.707437+0000","last_unstale":"2024-04-14T23:34:44.719868+0000","last_undegraded":"2024-04-14T23:34:44.719868+0000","last_fullsized":"2024-04-14T23:34:44.719868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:57:26.195919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311644+0000","last_change":"2024-04-14T23:34:38.702841+0000","last_active":"2024-04-14T23:34:46.311644+0000","last_peered":"2024-04-14T23:34:46.311644+0000","last_clean":"2024-04-14T23:34:46.311644+0000","last_became_active":"2024-04-14T23:34:38.702527+0000","last_became_peered":"2024-04-14T23:34:38.702527+0000","last_unstale":"2024-04-14T23:34:46.311644+0000","last_undegraded":"2024-04-14T23:34:46.311644+0000","last_fullsized":"2024-04-14T23:34:46.311644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517386+0000","last_change":"2024-04-14T23:34:38.714356+0000","last_active":"2024-04-14T23:34:46.517386+0000","last_peered":"2024-04-14T23:34:46.517386+0000","last_clean":"2024-04-14T23:34:46.517386+0000","last_became_active":"2024-04-14T23:34:38.713937+0000","last_became_peered":"2024-04-14T23:34:38.713937+0000","last_unstale":"2024-04-14T23:34:46.517386+0000","last_undegraded":"2024-04-14T23:34:46.517386+0000","last_fullsized":"2024-04-14T23:34:46.517386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:40.949590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136593+0000","last_change":"2024-04-14T23:34:38.711688+0000","last_active":"2024-04-14T23:34:45.136593+0000","last_peered":"2024-04-14T23:34:45.136593+0000","last_clean":"2024-04-14T23:34:45.136593+0000","last_became_active":"2024-04-14T23:34:38.711428+0000","last_became_peered":"2024-04-14T23:34:38.711428+0000","last_unstale":"2024-04-14T23:34:45.136593+0000","last_undegraded":"2024-04-14T23:34:45.136593+0000","last_fullsized":"2024-04-14T23:34:45.136593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:13.852728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806712+0000","last_change":"2024-04-14T23:34:38.715113+0000","last_active":"2024-04-14T23:34:45.806712+0000","last_peered":"2024-04-14T23:34:45.806712+0000","last_clean":"2024-04-14T23:34:45.806712+0000","last_became_active":"2024-04-14T23:34:38.714814+0000","last_became_peered":"2024-04-14T23:34:38.714814+0000","last_unstale":"2024-04-14T23:34:45.806712+0000","last_undegraded":"2024-04-14T23:34:45.806712+0000","last_fullsized":"2024-04-14T23:34:45.806712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:03:18.131006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720712+0000","last_change":"2024-04-14T23:34:38.704287+0000","last_active":"2024-04-14T23:34:44.720712+0000","last_peered":"2024-04-14T23:34:44.720712+0000","last_clean":"2024-04-14T23:34:44.720712+0000","last_became_active":"2024-04-14T23:34:38.702165+0000","last_became_peered":"2024-04-14T23:34:38.702165+0000","last_unstale":"2024-04-14T23:34:44.720712+0000","last_undegraded":"2024-04-14T23:34:44.720712+0000","last_fullsized":"2024-04-14T23:34:44.720712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:24.107167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719179+0000","last_change":"2024-04-14T23:34:38.706857+0000","last_active":"2024-04-14T23:34:44.719179+0000","last_peered":"2024-04-14T23:34:44.719179+0000","last_clean":"2024-04-14T23:34:44.719179+0000","last_became_active":"2024-04-14T23:34:38.705253+0000","last_became_peered":"2024-04-14T23:34:38.705253+0000","last_unstale":"2024-04-14T23:34:44.719179+0000","last_undegraded":"2024-04-14T23:34:44.719179+0000","last_fullsized":"2024-04-14T23:34:44.719179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:44.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318744+0000","last_change":"2024-04-14T23:34:38.711823+0000","last_active":"2024-04-14T23:34:46.318744+0000","last_peered":"2024-04-14T23:34:46.318744+0000","last_clean":"2024-04-14T23:34:46.318744+0000","last_became_active":"2024-04-14T23:34:38.711530+0000","last_became_peered":"2024-04-14T23:34:38.711530+0000","last_unstale":"2024-04-14T23:34:46.318744+0000","last_undegraded":"2024-04-14T23:34:46.318744+0000","last_fullsized":"2024-04-14T23:34:46.318744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:40.949590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311653+0000","last_change":"2024-04-14T23:34:38.705635+0000","last_active":"2024-04-14T23:34:46.311653+0000","last_peered":"2024-04-14T23:34:46.311653+0000","last_clean":"2024-04-14T23:34:46.311653+0000","last_became_active":"2024-04-14T23:34:38.705086+0000","last_became_peered":"2024-04-14T23:34:38.705086+0000","last_unstale":"2024-04-14T23:34:46.311653+0000","last_undegraded":"2024-04-14T23:34:46.311653+0000","last_fullsized":"2024-04-14T23:34:46.311653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:15:01.190987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718240+0000","last_change":"2024-04-14T23:34:38.710758+0000","last_active":"2024-04-14T23:34:44.718240+0000","last_peered":"2024-04-14T23:34:44.718240+0000","last_clean":"2024-04-14T23:34:44.718240+0000","last_became_active":"2024-04-14T23:34:38.710484+0000","last_became_peered":"2024-04-14T23:34:38.710484+0000","last_unstale":"2024-04-14T23:34:44.718240+0000","last_undegraded":"2024-04-14T23:34:44.718240+0000","last_fullsized":"2024-04-14T23:34:44.718240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:34:09.647113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720314+0000","last_change":"2024-04-14T23:34:38.711759+0000","last_active":"2024-04-14T23:34:44.720314+0000","last_peered":"2024-04-14T23:34:44.720314+0000","last_clean":"2024-04-14T23:34:44.720314+0000","last_became_active":"2024-04-14T23:34:38.711469+0000","last_became_peered":"2024-04-14T23:34:38.711469+0000","last_unstale":"2024-04-14T23:34:44.720314+0000","last_undegraded":"2024-04-14T23:34:44.720314+0000","last_fullsized":"2024-04-14T23:34:44.720314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:03:18.131006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517344+0000","last_change":"2024-04-14T23:34:38.710480+0000","last_active":"2024-04-14T23:34:46.517344+0000","last_peered":"2024-04-14T23:34:46.517344+0000","last_clean":"2024-04-14T23:34:46.517344+0000","last_became_active":"2024-04-14T23:34:38.710218+0000","last_became_peered":"2024-04-14T23:34:38.710218+0000","last_unstale":"2024-04-14T23:34:46.517344+0000","last_undegraded":"2024-04-14T23:34:46.517344+0000","last_fullsized":"2024-04-14T23:34:46.517344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:12.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517559+0000","last_change":"2024-04-14T23:34:38.713659+0000","last_active":"2024-04-14T23:34:46.517559+0000","last_peered":"2024-04-14T23:34:46.517559+0000","last_clean":"2024-04-14T23:34:46.517559+0000","last_became_active":"2024-04-14T23:34:38.713281+0000","last_became_peered":"2024-04-14T23:34:38.713281+0000","last_unstale":"2024-04-14T23:34:46.517559+0000","last_undegraded":"2024-04-14T23:34:46.517559+0000","last_fullsized":"2024-04-14T23:34:46.517559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136762+0000","last_change":"2024-04-14T23:34:38.713274+0000","last_active":"2024-04-14T23:34:45.136762+0000","last_peered":"2024-04-14T23:34:45.136762+0000","last_clean":"2024-04-14T23:34:45.136762+0000","last_became_active":"2024-04-14T23:34:38.711274+0000","last_became_peered":"2024-04-14T23:34:38.711274+0000","last_unstale":"2024-04-14T23:34:45.136762+0000","last_undegraded":"2024-04-14T23:34:45.136762+0000","last_fullsized":"2024-04-14T23:34:45.136762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:05:58.810380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.717969+0000","last_change":"2024-04-14T23:34:38.708235+0000","last_active":"2024-04-14T23:34:44.717969+0000","last_peered":"2024-04-14T23:34:44.717969+0000","last_clean":"2024-04-14T23:34:44.717969+0000","last_became_active":"2024-04-14T23:34:38.707779+0000","last_became_peered":"2024-04-14T23:34:38.707779+0000","last_unstale":"2024-04-14T23:34:44.717969+0000","last_undegraded":"2024-04-14T23:34:44.717969+0000","last_fullsized":"2024-04-14T23:34:44.717969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:09:45.484768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136144+0000","last_change":"2024-04-14T23:34:38.713218+0000","last_active":"2024-04-14T23:34:45.136144+0000","last_peered":"2024-04-14T23:34:45.136144+0000","last_clean":"2024-04-14T23:34:45.136144+0000","last_became_active":"2024-04-14T23:34:38.712930+0000","last_became_peered":"2024-04-14T23:34:38.712930+0000","last_unstale":"2024-04-14T23:34:45.136144+0000","last_undegraded":"2024-04-14T23:34:45.136144+0000","last_fullsized":"2024-04-14T23:34:45.136144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:32:05.285392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719753+0000","last_change":"2024-04-14T23:34:38.710158+0000","last_active":"2024-04-14T23:34:44.719753+0000","last_peered":"2024-04-14T23:34:44.719753+0000","last_clean":"2024-04-14T23:34:44.719753+0000","last_became_active":"2024-04-14T23:34:38.709903+0000","last_became_peered":"2024-04-14T23:34:38.709903+0000","last_unstale":"2024-04-14T23:34:44.719753+0000","last_undegraded":"2024-04-14T23:34:44.719753+0000","last_fullsized":"2024-04-14T23:34:44.719753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:32:05.285392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136196+0000","last_change":"2024-04-14T23:34:38.710654+0000","last_active":"2024-04-14T23:34:45.136196+0000","last_peered":"2024-04-14T23:34:45.136196+0000","last_clean":"2024-04-14T23:34:45.136196+0000","last_became_active":"2024-04-14T23:34:38.710267+0000","last_became_peered":"2024-04-14T23:34:38.710267+0000","last_unstale":"2024-04-14T23:34:45.136196+0000","last_undegraded":"2024-04-14T23:34:45.136196+0000","last_fullsized":"2024-04-14T23:34:45.136196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:22.876283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720393+0000","last_change":"2024-04-14T23:34:38.715159+0000","last_active":"2024-04-14T23:34:44.720393+0000","last_peered":"2024-04-14T23:34:44.720393+0000","last_clean":"2024-04-14T23:34:44.720393+0000","last_became_active":"2024-04-14T23:34:38.714918+0000","last_became_peered":"2024-04-14T23:34:38.714918+0000","last_unstale":"2024-04-14T23:34:44.720393+0000","last_undegraded":"2024-04-14T23:34:44.720393+0000","last_fullsized":"2024-04-14T23:34:44.720393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:19:41.725777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311726+0000","last_change":"2024-04-14T23:34:38.707456+0000","last_active":"2024-04-14T23:34:46.311726+0000","last_peered":"2024-04-14T23:34:46.311726+0000","last_clean":"2024-04-14T23:34:46.311726+0000","last_became_active":"2024-04-14T23:34:38.707143+0000","last_became_peered":"2024-04-14T23:34:38.707143+0000","last_unstale":"2024-04-14T23:34:46.311726+0000","last_undegraded":"2024-04-14T23:34:46.311726+0000","last_fullsized":"2024-04-14T23:34:46.311726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:27:36.965696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319134+0000","last_change":"2024-04-14T23:34:38.714188+0000","last_active":"2024-04-14T23:34:46.319134+0000","last_peered":"2024-04-14T23:34:46.319134+0000","last_clean":"2024-04-14T23:34:46.319134+0000","last_became_active":"2024-04-14T23:34:38.713845+0000","last_became_peered":"2024-04-14T23:34:38.713845+0000","last_unstale":"2024-04-14T23:34:46.319134+0000","last_undegraded":"2024-04-14T23:34:46.319134+0000","last_fullsized":"2024-04-14T23:34:46.319134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136688+0000","last_change":"2024-04-14T23:34:38.716139+0000","last_active":"2024-04-14T23:34:45.136688+0000","last_peered":"2024-04-14T23:34:45.136688+0000","last_clean":"2024-04-14T23:34:45.136688+0000","last_became_active":"2024-04-14T23:34:38.715878+0000","last_became_peered":"2024-04-14T23:34:38.715878+0000","last_unstale":"2024-04-14T23:34:45.136688+0000","last_undegraded":"2024-04-14T23:34:45.136688+0000","last_fullsized":"2024-04-14T23:34:45.136688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:24.107167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":111094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T23:34:55.757 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T23:34:55.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.890+0000 7f68f6d55640 1 Processor -- start 2024-04-14T23:34:55.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.890+0000 7f68f6d55640 1 -- start start 2024-04-14T23:34:55.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.891+0000 7f68f6d55640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f68f00d2b30 0x7f68f00cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.891+0000 7f68f6d55640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f00d1c40 0x7f68f00cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.891+0000 7f68f6d55640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f00c83c0 con 0x7f68f015e4a0 2024-04-14T23:34:55.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.891+0000 7f68f6d55640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f68f015e880 con 0x7f68f00d2b30 2024-04-14T23:34:55.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.891+0000 7f68f6d55640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f68f00c86a0 con 0x7f68f00d1c40 2024-04-14T23:34:55.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.891+0000 7f68effff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f68f00d2b30 0x7f68f00cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.891+0000 7f68effff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f68f00d2b30 0x7f68f00cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35882/0 (socket says 172.21.15.47:35882) 2024-04-14T23:34:55.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.891+0000 7f68f4af1640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f68f015e4a0 0x7f68f00d2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55634/0 (socket says 172.21.15.47:55634) 2024-04-14T23:34:55.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.891+0000 7f68f4af1640 1 -- 172.21.15.47:0/3868157621 learned_addr learned my addr 172.21.15.47:0/3868157621 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:55.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.891+0000 7f68f52f2640 1 --2- 172.21.15.47:0/3868157621 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f00d1c40 0x7f68f00cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.891+0000 7f68effff640 1 -- 172.21.15.47:0/3868157621 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f00d1c40 msgr2=0x7f68f00cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:55.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.891+0000 7f68effff640 1 --2- 172.21.15.47:0/3868157621 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f00d1c40 0x7f68f00cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.891+0000 7f68effff640 1 -- 172.21.15.47:0/3868157621 >> v1:172.21.15.47:6789/0 conn(0x7f68f015e4a0 legacy=0x7f68f00d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.891+0000 7f68effff640 1 -- 172.21.15.47:0/3868157621 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f00c8980 con 0x7f68f00d2b30 2024-04-14T23:34:55.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.891+0000 7f68ef7fe640 1 -- 172.21.15.47:0/3868157621 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 361637847 0 0) 0x7f68f00c83c0 con 0x7f68f015e4a0 2024-04-14T23:34:55.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.892+0000 7f68effff640 1 --2- 172.21.15.47:0/3868157621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f00d2b30 0x7f68f00cea70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f68dc0097a0 tx=0x7f68dc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b683ce0434ae559 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:55.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.892+0000 7f68ef7fe640 1 -- 172.21.15.47:0/3868157621 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68dc035020 con 0x7f68f00d2b30 2024-04-14T23:34:55.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.892+0000 7f68ef7fe640 1 -- 172.21.15.47:0/3868157621 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68dc031830 con 0x7f68f00d2b30 2024-04-14T23:34:55.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.892+0000 7f68ef7fe640 1 -- 172.21.15.47:0/3868157621 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68dc031c00 con 0x7f68f00d2b30 2024-04-14T23:34:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.893+0000 7f68f6d55640 1 -- 172.21.15.47:0/3868157621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f00d2b30 msgr2=0x7f68f00cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.893+0000 7f68f6d55640 1 --2- 172.21.15.47:0/3868157621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f00d2b30 0x7f68f00cea70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f68dc0097a0 tx=0x7f68dc02b8d0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.893+0000 7f68f6d55640 1 -- 172.21.15.47:0/3868157621 shutdown_connections 2024-04-14T23:34:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.893+0000 7f68f6d55640 1 --2- 172.21.15.47:0/3868157621 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f00d1c40 0x7f68f00cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.893+0000 7f68f6d55640 1 --2- 172.21.15.47:0/3868157621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f00d2b30 0x7f68f00cea70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.893+0000 7f68f6d55640 1 -- 172.21.15.47:0/3868157621 >> 172.21.15.47:0/3868157621 conn(0x7f68f00d3ef0 msgr2=0x7f68f00d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.893+0000 7f68f6d55640 1 -- 172.21.15.47:0/3868157621 shutdown_connections 2024-04-14T23:34:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.893+0000 7f68f6d55640 1 -- 172.21.15.47:0/3868157621 wait complete. 2024-04-14T23:34:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.894+0000 7f68f6d55640 1 Processor -- start 2024-04-14T23:34:55.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.894+0000 7f68f6d55640 1 -- start start 2024-04-14T23:34:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f6d55640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f00d1c40 0x7f68f0157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f6d55640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68f00d2b30 0x7f68f0159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f6d55640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f015e4a0 0x7f68f00cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f6d55640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68f0067bb0 con 0x7f68f00d1c40 2024-04-14T23:34:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f6d55640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f68f00c8f40 con 0x7f68f00d2b30 2024-04-14T23:34:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f6d55640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f68f0067d30 con 0x7f68f015e4a0 2024-04-14T23:34:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f4af1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f00d1c40 0x7f68f0157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f4af1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f00d1c40 0x7f68f0157aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35888/0 (socket says 172.21.15.47:35888) 2024-04-14T23:34:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f4af1640 1 -- 172.21.15.47:0/35856494 learned_addr learned my addr 172.21.15.47:0/35856494 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68effff640 1 --2- 172.21.15.47:0/35856494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68f00d2b30 0x7f68f0159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f52f2640 1 --2- 172.21.15.47:0/35856494 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f015e4a0 0x7f68f00cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f4af1640 1 -- 172.21.15.47:0/35856494 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f015e4a0 msgr2=0x7f68f00cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f4af1640 1 --2- 172.21.15.47:0/35856494 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f015e4a0 0x7f68f00cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f4af1640 1 -- 172.21.15.47:0/35856494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68f00d2b30 msgr2=0x7f68f0159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f4af1640 1 --2- 172.21.15.47:0/35856494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68f00d2b30 0x7f68f0159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f4af1640 1 -- 172.21.15.47:0/35856494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f00b7c70 con 0x7f68f00d1c40 2024-04-14T23:34:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68effff640 1 --2- 172.21.15.47:0/35856494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68f00d2b30 0x7f68f0159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f4af1640 1 --2- 172.21.15.47:0/35856494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f00d1c40 0x7f68f0157aa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f68e400c500 tx=0x7f68e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68ed7fa640 1 -- 172.21.15.47:0/35856494 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4018070 con 0x7f68f00d1c40 2024-04-14T23:34:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68ed7fa640 1 -- 172.21.15.47:0/35856494 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e4007580 con 0x7f68f00d1c40 2024-04-14T23:34:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f6d55640 1 -- 172.21.15.47:0/35856494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f00b7f50 con 0x7f68f00d1c40 2024-04-14T23:34:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68ed7fa640 1 -- 172.21.15.47:0/35856494 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4004a20 con 0x7f68f00d1c40 2024-04-14T23:34:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.895+0000 7f68f6d55640 1 -- 172.21.15.47:0/35856494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f00b8510 con 0x7f68f00d1c40 2024-04-14T23:34:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.896+0000 7f68f6d55640 1 -- 172.21.15.47:0/35856494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f0075430 con 0x7f68f00d1c40 2024-04-14T23:34:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.897+0000 7f68ed7fa640 1 -- 172.21.15.47:0/35856494 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f68e401b070 con 0x7f68f00d1c40 2024-04-14T23:34:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.897+0000 7f68ed7fa640 1 --2- 172.21.15.47:0/35856494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f68d406b9c0 0x7f68d406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.897+0000 7f68ed7fa640 1 -- 172.21.15.47:0/35856494 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f68e4089de0 con 0x7f68f00d1c40 2024-04-14T23:34:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.897+0000 7f68effff640 1 --2- 172.21.15.47:0/35856494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f68d406b9c0 0x7f68d406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:55.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.898+0000 7f68effff640 1 --2- 172.21.15.47:0/35856494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f68d406b9c0 0x7f68d406de80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f68dc036000 tx=0x7f68dc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:55.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:55.902+0000 7f68ed7fa640 1 -- 172.21.15.47:0/35856494 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f68e4058740 con 0x7f68f00d1c40 2024-04-14T23:34:56.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.080+0000 7f68f6d55640 1 -- 172.21.15.47:0/35856494 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f68f0157fe0 con 0x7f68d406b9c0 2024-04-14T23:34:56.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.089+0000 7f68ed7fa640 1 -- 172.21.15.47:0/35856494 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f68f0157fe0 con 0x7f68d406b9c0 2024-04-14T23:34:56.095 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:56.097 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-14T23:34:56.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.092+0000 7f68f6d55640 1 -- 172.21.15.47:0/35856494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f68d406b9c0 msgr2=0x7f68d406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.092+0000 7f68f6d55640 1 --2- 172.21.15.47:0/35856494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f68d406b9c0 0x7f68d406de80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f68dc036000 tx=0x7f68dc008030 comp rx=0 tx=0).stop 2024-04-14T23:34:56.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.092+0000 7f68f6d55640 1 -- 172.21.15.47:0/35856494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f00d1c40 msgr2=0x7f68f0157aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.092+0000 7f68f6d55640 1 --2- 172.21.15.47:0/35856494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f00d1c40 0x7f68f0157aa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f68e400c500 tx=0x7f68e400c9c0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.093+0000 7f68f6d55640 1 -- 172.21.15.47:0/35856494 shutdown_connections 2024-04-14T23:34:56.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.093+0000 7f68f6d55640 1 --2- 172.21.15.47:0/35856494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f68d406b9c0 0x7f68d406de80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.093+0000 7f68f6d55640 1 --2- 172.21.15.47:0/35856494 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f015e4a0 0x7f68f00cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.093+0000 7f68f6d55640 1 --2- 172.21.15.47:0/35856494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68f00d2b30 0x7f68f0159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.093+0000 7f68f6d55640 1 --2- 172.21.15.47:0/35856494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f00d1c40 0x7f68f0157aa0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.093+0000 7f68f6d55640 1 -- 172.21.15.47:0/35856494 >> 172.21.15.47:0/35856494 conn(0x7f68f00d3ef0 msgr2=0x7f68f0160cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:56.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.093+0000 7f68f6d55640 1 -- 172.21.15.47:0/35856494 shutdown_connections 2024-04-14T23:34:56.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.093+0000 7f68f6d55640 1 -- 172.21.15.47:0/35856494 wait complete. 2024-04-14T23:34:56.106 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-14T23:34:54.361869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236100,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738620,"statfs":{"total":773094113280,"available":772852346880,"internally_reserved":0,"allocated":3383296,"data_stored":2048878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002543"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311249+0000","last_change":"2024-04-14T23:34:37.710684+0000","last_active":"2024-04-14T23:34:46.311249+0000","last_peered":"2024-04-14T23:34:46.311249+0000","last_clean":"2024-04-14T23:34:46.311249+0000","last_became_active":"2024-04-14T23:34:37.710401+0000","last_became_peered":"2024-04-14T23:34:37.710401+0000","last_unstale":"2024-04-14T23:34:46.311249+0000","last_undegraded":"2024-04-14T23:34:46.311249+0000","last_fullsized":"2024-04-14T23:34:46.311249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:24:08.806585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718660+0000","last_change":"2024-04-14T23:34:38.716947+0000","last_active":"2024-04-14T23:34:44.718660+0000","last_peered":"2024-04-14T23:34:44.718660+0000","last_clean":"2024-04-14T23:34:44.718660+0000","last_became_active":"2024-04-14T23:34:38.716643+0000","last_became_peered":"2024-04-14T23:34:38.716643+0000","last_unstale":"2024-04-14T23:34:44.718660+0000","last_undegraded":"2024-04-14T23:34:44.718660+0000","last_fullsized":"2024-04-14T23:34:44.718660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:27:36.965696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718020+0000","last_change":"2024-04-14T23:34:43.189638+0000","last_active":"2024-04-14T23:34:44.718020+0000","last_peered":"2024-04-14T23:34:44.718020+0000","last_clean":"2024-04-14T23:34:44.718020+0000","last_became_active":"2024-04-14T23:34:43.188302+0000","last_became_peered":"2024-04-14T23:34:43.188302+0000","last_unstale":"2024-04-14T23:34:44.718020+0000","last_undegraded":"2024-04-14T23:34:44.718020+0000","last_fullsized":"2024-04-14T23:34:44.718020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:22:18.103327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718787+0000","last_change":"2024-04-14T23:34:37.707154+0000","last_active":"2024-04-14T23:34:44.718787+0000","last_peered":"2024-04-14T23:34:44.718787+0000","last_clean":"2024-04-14T23:34:44.718787+0000","last_became_active":"2024-04-14T23:34:37.706646+0000","last_became_peered":"2024-04-14T23:34:37.706646+0000","last_unstale":"2024-04-14T23:34:44.718787+0000","last_undegraded":"2024-04-14T23:34:44.718787+0000","last_fullsized":"2024-04-14T23:34:44.718787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:24:08.806585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311859+0000","last_change":"2024-04-14T23:34:38.697913+0000","last_active":"2024-04-14T23:34:46.311859+0000","last_peered":"2024-04-14T23:34:46.311859+0000","last_clean":"2024-04-14T23:34:46.311859+0000","last_became_active":"2024-04-14T23:34:38.697206+0000","last_became_peered":"2024-04-14T23:34:38.697206+0000","last_unstale":"2024-04-14T23:34:46.311859+0000","last_undegraded":"2024-04-14T23:34:46.311859+0000","last_fullsized":"2024-04-14T23:34:46.311859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:09:45.484768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719041+0000","last_change":"2024-04-14T23:34:42.733619+0000","last_active":"2024-04-14T23:34:44.719041+0000","last_peered":"2024-04-14T23:34:44.719041+0000","last_clean":"2024-04-14T23:34:44.719041+0000","last_became_active":"2024-04-14T23:34:42.733164+0000","last_became_peered":"2024-04-14T23:34:42.733164+0000","last_unstale":"2024-04-14T23:34:44.719041+0000","last_undegraded":"2024-04-14T23:34:44.719041+0000","last_fullsized":"2024-04-14T23:34:44.719041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:28:10.218625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136525+0000","last_change":"2024-04-14T23:34:37.712565+0000","last_active":"2024-04-14T23:34:45.136525+0000","last_peered":"2024-04-14T23:34:45.136525+0000","last_clean":"2024-04-14T23:34:45.136525+0000","last_became_active":"2024-04-14T23:34:37.712304+0000","last_became_peered":"2024-04-14T23:34:37.712304+0000","last_unstale":"2024-04-14T23:34:45.136525+0000","last_undegraded":"2024-04-14T23:34:45.136525+0000","last_fullsized":"2024-04-14T23:34:45.136525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:52.026945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720469+0000","last_change":"2024-04-14T23:34:38.706895+0000","last_active":"2024-04-14T23:34:44.720469+0000","last_peered":"2024-04-14T23:34:44.720469+0000","last_clean":"2024-04-14T23:34:44.720469+0000","last_became_active":"2024-04-14T23:34:38.704429+0000","last_became_peered":"2024-04-14T23:34:38.704429+0000","last_unstale":"2024-04-14T23:34:44.720469+0000","last_undegraded":"2024-04-14T23:34:44.720469+0000","last_fullsized":"2024-04-14T23:34:44.720469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:22.876283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719267+0000","last_change":"2024-04-14T23:34:42.734180+0000","last_active":"2024-04-14T23:34:44.719267+0000","last_peered":"2024-04-14T23:34:44.719267+0000","last_clean":"2024-04-14T23:34:44.719267+0000","last_became_active":"2024-04-14T23:34:42.733249+0000","last_became_peered":"2024-04-14T23:34:42.733249+0000","last_unstale":"2024-04-14T23:34:44.719267+0000","last_undegraded":"2024-04-14T23:34:44.719267+0000","last_fullsized":"2024-04-14T23:34:44.719267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:50:07.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136305+0000","last_change":"2024-04-14T23:34:37.710172+0000","last_active":"2024-04-14T23:34:45.136305+0000","last_peered":"2024-04-14T23:34:45.136305+0000","last_clean":"2024-04-14T23:34:45.136305+0000","last_became_active":"2024-04-14T23:34:37.709859+0000","last_became_peered":"2024-04-14T23:34:37.709859+0000","last_unstale":"2024-04-14T23:34:45.136305+0000","last_undegraded":"2024-04-14T23:34:45.136305+0000","last_fullsized":"2024-04-14T23:34:45.136305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:03:17.126654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719993+0000","last_change":"2024-04-14T23:34:38.703533+0000","last_active":"2024-04-14T23:34:44.719993+0000","last_peered":"2024-04-14T23:34:44.719993+0000","last_clean":"2024-04-14T23:34:44.719993+0000","last_became_active":"2024-04-14T23:34:38.703228+0000","last_became_peered":"2024-04-14T23:34:38.703228+0000","last_unstale":"2024-04-14T23:34:44.719993+0000","last_undegraded":"2024-04-14T23:34:44.719993+0000","last_fullsized":"2024-04-14T23:34:44.719993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719336+0000","last_change":"2024-04-14T23:34:42.735315+0000","last_active":"2024-04-14T23:34:44.719336+0000","last_peered":"2024-04-14T23:34:44.719336+0000","last_clean":"2024-04-14T23:34:44.719336+0000","last_became_active":"2024-04-14T23:34:42.734932+0000","last_became_peered":"2024-04-14T23:34:42.734932+0000","last_unstale":"2024-04-14T23:34:44.719336+0000","last_undegraded":"2024-04-14T23:34:44.719336+0000","last_fullsized":"2024-04-14T23:34:44.719336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:12:56.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517099+0000","last_change":"2024-04-14T23:34:38.712701+0000","last_active":"2024-04-14T23:34:46.517099+0000","last_peered":"2024-04-14T23:34:46.517099+0000","last_clean":"2024-04-14T23:34:46.517099+0000","last_became_active":"2024-04-14T23:34:38.712434+0000","last_became_peered":"2024-04-14T23:34:38.712434+0000","last_unstale":"2024-04-14T23:34:46.517099+0000","last_undegraded":"2024-04-14T23:34:46.517099+0000","last_fullsized":"2024-04-14T23:34:46.517099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:27:36.965696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136371+0000","last_change":"2024-04-14T23:34:37.713312+0000","last_active":"2024-04-14T23:34:45.136371+0000","last_peered":"2024-04-14T23:34:45.136371+0000","last_clean":"2024-04-14T23:34:45.136371+0000","last_became_active":"2024-04-14T23:34:37.713015+0000","last_became_peered":"2024-04-14T23:34:37.713015+0000","last_unstale":"2024-04-14T23:34:45.136371+0000","last_undegraded":"2024-04-14T23:34:45.136371+0000","last_fullsized":"2024-04-14T23:34:45.136371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:25.981130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720659+0000","last_change":"2024-04-14T23:34:42.734239+0000","last_active":"2024-04-14T23:34:44.720659+0000","last_peered":"2024-04-14T23:34:44.720659+0000","last_clean":"2024-04-14T23:34:44.720659+0000","last_became_active":"2024-04-14T23:34:42.733043+0000","last_became_peered":"2024-04-14T23:34:42.733043+0000","last_unstale":"2024-04-14T23:34:44.720659+0000","last_undegraded":"2024-04-14T23:34:44.720659+0000","last_fullsized":"2024-04-14T23:34:44.720659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:24:22.674500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718328+0000","last_change":"2024-04-14T23:34:38.708368+0000","last_active":"2024-04-14T23:34:44.718328+0000","last_peered":"2024-04-14T23:34:44.718328+0000","last_clean":"2024-04-14T23:34:44.718328+0000","last_became_active":"2024-04-14T23:34:38.708065+0000","last_became_peered":"2024-04-14T23:34:38.708065+0000","last_unstale":"2024-04-14T23:34:44.718328+0000","last_undegraded":"2024-04-14T23:34:44.718328+0000","last_fullsized":"2024-04-14T23:34:44.718328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:09:47.574841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318514+0000","last_change":"2024-04-14T23:34:37.707159+0000","last_active":"2024-04-14T23:34:46.318514+0000","last_peered":"2024-04-14T23:34:46.318514+0000","last_clean":"2024-04-14T23:34:46.318514+0000","last_became_active":"2024-04-14T23:34:37.706777+0000","last_became_peered":"2024-04-14T23:34:37.706777+0000","last_unstale":"2024-04-14T23:34:46.318514+0000","last_undegraded":"2024-04-14T23:34:46.318514+0000","last_fullsized":"2024-04-14T23:34:46.318514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:23.167535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719596+0000","last_change":"2024-04-14T23:34:42.734697+0000","last_active":"2024-04-14T23:34:44.719596+0000","last_peered":"2024-04-14T23:34:44.719596+0000","last_clean":"2024-04-14T23:34:44.719596+0000","last_became_active":"2024-04-14T23:34:42.732974+0000","last_became_peered":"2024-04-14T23:34:42.732974+0000","last_unstale":"2024-04-14T23:34:44.719596+0000","last_undegraded":"2024-04-14T23:34:44.719596+0000","last_fullsized":"2024-04-14T23:34:44.719596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:18:47.542320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718187+0000","last_change":"2024-04-14T23:34:38.713694+0000","last_active":"2024-04-14T23:34:44.718187+0000","last_peered":"2024-04-14T23:34:44.718187+0000","last_clean":"2024-04-14T23:34:44.718187+0000","last_became_active":"2024-04-14T23:34:38.713374+0000","last_became_peered":"2024-04-14T23:34:38.713374+0000","last_unstale":"2024-04-14T23:34:44.718187+0000","last_undegraded":"2024-04-14T23:34:44.718187+0000","last_fullsized":"2024-04-14T23:34:44.718187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:40.949590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318481+0000","last_change":"2024-04-14T23:34:37.708516+0000","last_active":"2024-04-14T23:34:46.318481+0000","last_peered":"2024-04-14T23:34:46.318481+0000","last_clean":"2024-04-14T23:34:46.318481+0000","last_became_active":"2024-04-14T23:34:37.708219+0000","last_became_peered":"2024-04-14T23:34:37.708219+0000","last_unstale":"2024-04-14T23:34:46.318481+0000","last_undegraded":"2024-04-14T23:34:46.318481+0000","last_fullsized":"2024-04-14T23:34:46.318481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:29.023280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319235+0000","last_change":"2024-04-14T23:34:43.186688+0000","last_active":"2024-04-14T23:34:46.319235+0000","last_peered":"2024-04-14T23:34:46.319235+0000","last_clean":"2024-04-14T23:34:46.319235+0000","last_became_active":"2024-04-14T23:34:43.186305+0000","last_became_peered":"2024-04-14T23:34:43.186305+0000","last_unstale":"2024-04-14T23:34:46.319235+0000","last_undegraded":"2024-04-14T23:34:46.319235+0000","last_fullsized":"2024-04-14T23:34:46.319235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:12:56.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720326+0000","last_change":"2024-04-14T23:34:38.707888+0000","last_active":"2024-04-14T23:34:44.720326+0000","last_peered":"2024-04-14T23:34:44.720326+0000","last_clean":"2024-04-14T23:34:44.720326+0000","last_became_active":"2024-04-14T23:34:38.707601+0000","last_became_peered":"2024-04-14T23:34:38.707601+0000","last_unstale":"2024-04-14T23:34:44.720326+0000","last_undegraded":"2024-04-14T23:34:44.720326+0000","last_fullsized":"2024-04-14T23:34:44.720326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:18:41.946696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.135954+0000","last_change":"2024-04-14T23:34:37.712453+0000","last_active":"2024-04-14T23:34:45.135954+0000","last_peered":"2024-04-14T23:34:45.135954+0000","last_clean":"2024-04-14T23:34:45.135954+0000","last_became_active":"2024-04-14T23:34:37.712091+0000","last_became_peered":"2024-04-14T23:34:37.712091+0000","last_unstale":"2024-04-14T23:34:45.135954+0000","last_undegraded":"2024-04-14T23:34:45.135954+0000","last_fullsized":"2024-04-14T23:34:45.135954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:23.167535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719231+0000","last_change":"2024-04-14T23:34:42.730978+0000","last_active":"2024-04-14T23:34:44.719231+0000","last_peered":"2024-04-14T23:34:44.719231+0000","last_clean":"2024-04-14T23:34:44.719231+0000","last_became_active":"2024-04-14T23:34:42.730528+0000","last_became_peered":"2024-04-14T23:34:42.730528+0000","last_unstale":"2024-04-14T23:34:44.719231+0000","last_undegraded":"2024-04-14T23:34:44.719231+0000","last_fullsized":"2024-04-14T23:34:44.719231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:22:18.658809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.312044+0000","last_change":"2024-04-14T23:34:38.705602+0000","last_active":"2024-04-14T23:34:46.312044+0000","last_peered":"2024-04-14T23:34:46.312044+0000","last_clean":"2024-04-14T23:34:46.312044+0000","last_became_active":"2024-04-14T23:34:38.705305+0000","last_became_peered":"2024-04-14T23:34:38.705305+0000","last_unstale":"2024-04-14T23:34:46.312044+0000","last_undegraded":"2024-04-14T23:34:46.312044+0000","last_fullsized":"2024-04-14T23:34:46.312044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:12.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516709+0000","last_change":"2024-04-14T23:34:37.709059+0000","last_active":"2024-04-14T23:34:46.516709+0000","last_peered":"2024-04-14T23:34:46.516709+0000","last_clean":"2024-04-14T23:34:46.516709+0000","last_became_active":"2024-04-14T23:34:37.707857+0000","last_became_peered":"2024-04-14T23:34:37.707857+0000","last_unstale":"2024-04-14T23:34:46.516709+0000","last_undegraded":"2024-04-14T23:34:46.516709+0000","last_fullsized":"2024-04-14T23:34:46.516709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:02:03.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720072+0000","last_change":"2024-04-14T23:34:43.185206+0000","last_active":"2024-04-14T23:34:44.720072+0000","last_peered":"2024-04-14T23:34:44.720072+0000","last_clean":"2024-04-14T23:34:44.720072+0000","last_became_active":"2024-04-14T23:34:43.184816+0000","last_became_peered":"2024-04-14T23:34:43.184816+0000","last_unstale":"2024-04-14T23:34:44.720072+0000","last_undegraded":"2024-04-14T23:34:44.720072+0000","last_fullsized":"2024-04-14T23:34:44.720072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:16:46.008001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718884+0000","last_change":"2024-04-14T23:34:38.712982+0000","last_active":"2024-04-14T23:34:44.718884+0000","last_peered":"2024-04-14T23:34:44.718884+0000","last_clean":"2024-04-14T23:34:44.718884+0000","last_became_active":"2024-04-14T23:34:38.712714+0000","last_became_peered":"2024-04-14T23:34:38.712714+0000","last_unstale":"2024-04-14T23:34:44.718884+0000","last_undegraded":"2024-04-14T23:34:44.718884+0000","last_fullsized":"2024-04-14T23:34:44.718884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:44.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319185+0000","last_change":"2024-04-14T23:34:37.705495+0000","last_active":"2024-04-14T23:34:46.319185+0000","last_peered":"2024-04-14T23:34:46.319185+0000","last_clean":"2024-04-14T23:34:46.319185+0000","last_became_active":"2024-04-14T23:34:37.705184+0000","last_became_peered":"2024-04-14T23:34:37.705184+0000","last_unstale":"2024-04-14T23:34:46.319185+0000","last_undegraded":"2024-04-14T23:34:46.319185+0000","last_fullsized":"2024-04-14T23:34:46.319185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:18:40.942344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.717967+0000","last_change":"2024-04-14T23:34:43.189327+0000","last_active":"2024-04-14T23:34:44.717967+0000","last_peered":"2024-04-14T23:34:44.717967+0000","last_clean":"2024-04-14T23:34:44.717967+0000","last_became_active":"2024-04-14T23:34:43.188921+0000","last_became_peered":"2024-04-14T23:34:43.188921+0000","last_unstale":"2024-04-14T23:34:44.717967+0000","last_undegraded":"2024-04-14T23:34:44.717967+0000","last_fullsized":"2024-04-14T23:34:44.717967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:57:09.514981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319131+0000","last_change":"2024-04-14T23:34:38.707155+0000","last_active":"2024-04-14T23:34:46.319131+0000","last_peered":"2024-04-14T23:34:46.319131+0000","last_clean":"2024-04-14T23:34:46.319131+0000","last_became_active":"2024-04-14T23:34:38.706626+0000","last_became_peered":"2024-04-14T23:34:38.706626+0000","last_unstale":"2024-04-14T23:34:46.319131+0000","last_undegraded":"2024-04-14T23:34:46.319131+0000","last_fullsized":"2024-04-14T23:34:46.319131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:54:47.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136672+0000","last_change":"2024-04-14T23:34:37.713324+0000","last_active":"2024-04-14T23:34:45.136672+0000","last_peered":"2024-04-14T23:34:45.136672+0000","last_clean":"2024-04-14T23:34:45.136672+0000","last_became_active":"2024-04-14T23:34:37.713052+0000","last_became_peered":"2024-04-14T23:34:37.713052+0000","last_unstale":"2024-04-14T23:34:45.136672+0000","last_undegraded":"2024-04-14T23:34:45.136672+0000","last_fullsized":"2024-04-14T23:34:45.136672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:21:25.348015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311604+0000","last_change":"2024-04-14T23:34:43.187173+0000","last_active":"2024-04-14T23:34:46.311604+0000","last_peered":"2024-04-14T23:34:46.311604+0000","last_clean":"2024-04-14T23:34:46.311604+0000","last_became_active":"2024-04-14T23:34:43.185505+0000","last_became_peered":"2024-04-14T23:34:43.185505+0000","last_unstale":"2024-04-14T23:34:46.311604+0000","last_undegraded":"2024-04-14T23:34:46.311604+0000","last_fullsized":"2024-04-14T23:34:46.311604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:28:10.218625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720108+0000","last_change":"2024-04-14T23:34:38.708136+0000","last_active":"2024-04-14T23:34:44.720108+0000","last_peered":"2024-04-14T23:34:44.720108+0000","last_clean":"2024-04-14T23:34:44.720108+0000","last_became_active":"2024-04-14T23:34:38.707860+0000","last_became_peered":"2024-04-14T23:34:38.707860+0000","last_unstale":"2024-04-14T23:34:44.720108+0000","last_undegraded":"2024-04-14T23:34:44.720108+0000","last_fullsized":"2024-04-14T23:34:44.720108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319191+0000","last_change":"2024-04-14T23:34:37.703582+0000","last_active":"2024-04-14T23:34:46.319191+0000","last_peered":"2024-04-14T23:34:46.319191+0000","last_clean":"2024-04-14T23:34:46.319191+0000","last_became_active":"2024-04-14T23:34:37.703276+0000","last_became_peered":"2024-04-14T23:34:37.703276+0000","last_unstale":"2024-04-14T23:34:46.319191+0000","last_undegraded":"2024-04-14T23:34:46.319191+0000","last_fullsized":"2024-04-14T23:34:46.319191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:03:17.126654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318955+0000","last_change":"2024-04-14T23:34:42.738584+0000","last_active":"2024-04-14T23:34:46.318955+0000","last_peered":"2024-04-14T23:34:46.318955+0000","last_clean":"2024-04-14T23:34:46.318955+0000","last_became_active":"2024-04-14T23:34:42.738098+0000","last_became_peered":"2024-04-14T23:34:42.738098+0000","last_unstale":"2024-04-14T23:34:46.318955+0000","last_undegraded":"2024-04-14T23:34:46.318955+0000","last_fullsized":"2024-04-14T23:34:46.318955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:22:18.658809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719759+0000","last_change":"2024-04-14T23:34:38.710787+0000","last_active":"2024-04-14T23:34:44.719759+0000","last_peered":"2024-04-14T23:34:44.719759+0000","last_clean":"2024-04-14T23:34:44.719759+0000","last_became_active":"2024-04-14T23:34:38.710503+0000","last_became_peered":"2024-04-14T23:34:38.710503+0000","last_unstale":"2024-04-14T23:34:44.719759+0000","last_undegraded":"2024-04-14T23:34:44.719759+0000","last_fullsized":"2024-04-14T23:34:44.719759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:24.171888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720174+0000","last_change":"2024-04-14T23:34:37.704162+0000","last_active":"2024-04-14T23:34:44.720174+0000","last_peered":"2024-04-14T23:34:44.720174+0000","last_clean":"2024-04-14T23:34:44.720174+0000","last_became_active":"2024-04-14T23:34:37.703874+0000","last_became_peered":"2024-04-14T23:34:37.703874+0000","last_unstale":"2024-04-14T23:34:44.720174+0000","last_undegraded":"2024-04-14T23:34:44.720174+0000","last_fullsized":"2024-04-14T23:34:44.720174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:18:40.942344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319100+0000","last_change":"2024-04-14T23:34:42.731843+0000","last_active":"2024-04-14T23:34:46.319100+0000","last_peered":"2024-04-14T23:34:46.319100+0000","last_clean":"2024-04-14T23:34:46.319100+0000","last_became_active":"2024-04-14T23:34:42.730913+0000","last_became_peered":"2024-04-14T23:34:42.730913+0000","last_unstale":"2024-04-14T23:34:46.319100+0000","last_undegraded":"2024-04-14T23:34:46.319100+0000","last_fullsized":"2024-04-14T23:34:46.319100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:50:07.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318803+0000","last_change":"2024-04-14T23:34:38.706592+0000","last_active":"2024-04-14T23:34:46.318803+0000","last_peered":"2024-04-14T23:34:46.318803+0000","last_clean":"2024-04-14T23:34:46.318803+0000","last_became_active":"2024-04-14T23:34:38.706299+0000","last_became_peered":"2024-04-14T23:34:38.706299+0000","last_unstale":"2024-04-14T23:34:46.318803+0000","last_undegraded":"2024-04-14T23:34:46.318803+0000","last_fullsized":"2024-04-14T23:34:46.318803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:12.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806129+0000","last_change":"2024-04-14T23:34:37.703871+0000","last_active":"2024-04-14T23:34:45.806129+0000","last_peered":"2024-04-14T23:34:45.806129+0000","last_clean":"2024-04-14T23:34:45.806129+0000","last_became_active":"2024-04-14T23:34:37.703574+0000","last_became_peered":"2024-04-14T23:34:37.703574+0000","last_unstale":"2024-04-14T23:34:45.806129+0000","last_undegraded":"2024-04-14T23:34:45.806129+0000","last_fullsized":"2024-04-14T23:34:45.806129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:51:11.382828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319327+0000","last_change":"2024-04-14T23:34:42.739072+0000","last_active":"2024-04-14T23:34:46.319327+0000","last_peered":"2024-04-14T23:34:46.319327+0000","last_clean":"2024-04-14T23:34:46.319327+0000","last_became_active":"2024-04-14T23:34:42.738587+0000","last_became_peered":"2024-04-14T23:34:42.738587+0000","last_unstale":"2024-04-14T23:34:46.319327+0000","last_undegraded":"2024-04-14T23:34:46.319327+0000","last_fullsized":"2024-04-14T23:34:46.319327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:37:34.006119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311383+0000","last_change":"2024-04-14T23:34:38.704755+0000","last_active":"2024-04-14T23:34:46.311383+0000","last_peered":"2024-04-14T23:34:46.311383+0000","last_clean":"2024-04-14T23:34:46.311383+0000","last_became_active":"2024-04-14T23:34:38.704247+0000","last_became_peered":"2024-04-14T23:34:38.704247+0000","last_unstale":"2024-04-14T23:34:46.311383+0000","last_undegraded":"2024-04-14T23:34:46.311383+0000","last_fullsized":"2024-04-14T23:34:46.311383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:48:26.290955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.135983+0000","last_change":"2024-04-14T23:34:37.712348+0000","last_active":"2024-04-14T23:34:45.135983+0000","last_peered":"2024-04-14T23:34:45.135983+0000","last_clean":"2024-04-14T23:34:45.135983+0000","last_became_active":"2024-04-14T23:34:37.712043+0000","last_became_peered":"2024-04-14T23:34:37.712043+0000","last_unstale":"2024-04-14T23:34:45.135983+0000","last_undegraded":"2024-04-14T23:34:45.135983+0000","last_fullsized":"2024-04-14T23:34:45.135983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:48:25.286602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.312031+0000","last_change":"2024-04-14T23:34:43.186651+0000","last_active":"2024-04-14T23:34:46.312031+0000","last_peered":"2024-04-14T23:34:46.312031+0000","last_clean":"2024-04-14T23:34:46.312031+0000","last_became_active":"2024-04-14T23:34:43.186282+0000","last_became_peered":"2024-04-14T23:34:43.186282+0000","last_unstale":"2024-04-14T23:34:46.312031+0000","last_undegraded":"2024-04-14T23:34:46.312031+0000","last_fullsized":"2024-04-14T23:34:46.312031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:37:34.006119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718436+0000","last_change":"2024-04-14T23:34:38.709071+0000","last_active":"2024-04-14T23:34:44.718436+0000","last_peered":"2024-04-14T23:34:44.718436+0000","last_clean":"2024-04-14T23:34:44.718436+0000","last_became_active":"2024-04-14T23:34:38.708815+0000","last_became_peered":"2024-04-14T23:34:38.708815+0000","last_unstale":"2024-04-14T23:34:44.718436+0000","last_undegraded":"2024-04-14T23:34:44.718436+0000","last_fullsized":"2024-04-14T23:34:44.718436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:12.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720070+0000","last_change":"2024-04-14T23:34:37.704931+0000","last_active":"2024-04-14T23:34:44.720070+0000","last_peered":"2024-04-14T23:34:44.720070+0000","last_clean":"2024-04-14T23:34:44.720070+0000","last_became_active":"2024-04-14T23:34:37.704607+0000","last_became_peered":"2024-04-14T23:34:37.704607+0000","last_unstale":"2024-04-14T23:34:44.720070+0000","last_undegraded":"2024-04-14T23:34:44.720070+0000","last_fullsized":"2024-04-14T23:34:44.720070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:51:11.382828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136097+0000","last_change":"2024-04-14T23:34:27.438796+0000","last_active":"2024-04-14T23:34:45.136097+0000","last_peered":"2024-04-14T23:34:45.136097+0000","last_clean":"2024-04-14T23:34:45.136097+0000","last_became_active":"2024-04-14T23:34:27.437932+0000","last_became_peered":"2024-04-14T23:34:27.437932+0000","last_unstale":"2024-04-14T23:34:45.136097+0000","last_undegraded":"2024-04-14T23:34:45.136097+0000","last_fullsized":"2024-04-14T23:34:45.136097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_clean_scrub_stamp":"2024-04-14T23:34:26.390323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:11:13.484245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517493+0000","last_change":"2024-04-14T23:34:43.188245+0000","last_active":"2024-04-14T23:34:46.517493+0000","last_peered":"2024-04-14T23:34:46.517493+0000","last_clean":"2024-04-14T23:34:46.517493+0000","last_became_active":"2024-04-14T23:34:43.187808+0000","last_became_peered":"2024-04-14T23:34:43.187808+0000","last_unstale":"2024-04-14T23:34:46.517493+0000","last_undegraded":"2024-04-14T23:34:46.517493+0000","last_fullsized":"2024-04-14T23:34:46.517493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:28.129419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136392+0000","last_change":"2024-04-14T23:34:38.711963+0000","last_active":"2024-04-14T23:34:45.136392+0000","last_peered":"2024-04-14T23:34:45.136392+0000","last_clean":"2024-04-14T23:34:45.136392+0000","last_became_active":"2024-04-14T23:34:38.710515+0000","last_became_peered":"2024-04-14T23:34:38.710515+0000","last_unstale":"2024-04-14T23:34:45.136392+0000","last_undegraded":"2024-04-14T23:34:45.136392+0000","last_fullsized":"2024-04-14T23:34:45.136392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:29:53.179819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806129+0000","last_change":"2024-04-14T23:34:37.708620+0000","last_active":"2024-04-14T23:34:45.806129+0000","last_peered":"2024-04-14T23:34:45.806129+0000","last_clean":"2024-04-14T23:34:45.806129+0000","last_became_active":"2024-04-14T23:34:37.708280+0000","last_became_peered":"2024-04-14T23:34:37.708280+0000","last_unstale":"2024-04-14T23:34:45.806129+0000","last_undegraded":"2024-04-14T23:34:45.806129+0000","last_fullsized":"2024-04-14T23:34:45.806129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:29.023280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517179+0000","last_change":"2024-04-14T23:34:43.185307+0000","last_active":"2024-04-14T23:34:46.517179+0000","last_peered":"2024-04-14T23:34:46.517179+0000","last_clean":"2024-04-14T23:34:46.517179+0000","last_became_active":"2024-04-14T23:34:43.184870+0000","last_became_peered":"2024-04-14T23:34:43.184870+0000","last_unstale":"2024-04-14T23:34:46.517179+0000","last_undegraded":"2024-04-14T23:34:46.517179+0000","last_fullsized":"2024-04-14T23:34:46.517179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:29:57.202071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720547+0000","last_change":"2024-04-14T23:34:38.714634+0000","last_active":"2024-04-14T23:34:44.720547+0000","last_peered":"2024-04-14T23:34:44.720547+0000","last_clean":"2024-04-14T23:34:44.720547+0000","last_became_active":"2024-04-14T23:34:38.714357+0000","last_became_peered":"2024-04-14T23:34:38.714357+0000","last_unstale":"2024-04-14T23:34:44.720547+0000","last_undegraded":"2024-04-14T23:34:44.720547+0000","last_fullsized":"2024-04-14T23:34:44.720547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:29:53.179819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318527+0000","last_change":"2024-04-14T23:34:37.709513+0000","last_active":"2024-04-14T23:34:46.318527+0000","last_peered":"2024-04-14T23:34:46.318527+0000","last_clean":"2024-04-14T23:34:46.318527+0000","last_became_active":"2024-04-14T23:34:37.709235+0000","last_became_peered":"2024-04-14T23:34:37.709235+0000","last_unstale":"2024-04-14T23:34:46.318527+0000","last_undegraded":"2024-04-14T23:34:46.318527+0000","last_fullsized":"2024-04-14T23:34:46.318527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:52.026945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311747+0000","last_change":"2024-04-14T23:34:42.739900+0000","last_active":"2024-04-14T23:34:46.311747+0000","last_peered":"2024-04-14T23:34:46.311747+0000","last_clean":"2024-04-14T23:34:46.311747+0000","last_became_active":"2024-04-14T23:34:42.739539+0000","last_became_peered":"2024-04-14T23:34:42.739539+0000","last_unstale":"2024-04-14T23:34:46.311747+0000","last_undegraded":"2024-04-14T23:34:46.311747+0000","last_fullsized":"2024-04-14T23:34:46.311747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:22:18.658809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136800+0000","last_change":"2024-04-14T23:34:38.716624+0000","last_active":"2024-04-14T23:34:45.136800+0000","last_peered":"2024-04-14T23:34:45.136800+0000","last_clean":"2024-04-14T23:34:45.136800+0000","last_became_active":"2024-04-14T23:34:38.716353+0000","last_became_peered":"2024-04-14T23:34:38.716353+0000","last_unstale":"2024-04-14T23:34:45.136800+0000","last_undegraded":"2024-04-14T23:34:45.136800+0000","last_fullsized":"2024-04-14T23:34:45.136800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:28:06.196373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806146+0000","last_change":"2024-04-14T23:34:37.707669+0000","last_active":"2024-04-14T23:34:45.806146+0000","last_peered":"2024-04-14T23:34:45.806146+0000","last_clean":"2024-04-14T23:34:45.806146+0000","last_became_active":"2024-04-14T23:34:37.707312+0000","last_became_peered":"2024-04-14T23:34:37.707312+0000","last_unstale":"2024-04-14T23:34:45.806146+0000","last_undegraded":"2024-04-14T23:34:45.806146+0000","last_fullsized":"2024-04-14T23:34:45.806146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:02:03.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720259+0000","last_change":"2024-04-14T23:34:43.187817+0000","last_active":"2024-04-14T23:34:44.720259+0000","last_peered":"2024-04-14T23:34:44.720259+0000","last_clean":"2024-04-14T23:34:44.720259+0000","last_became_active":"2024-04-14T23:34:43.187119+0000","last_became_peered":"2024-04-14T23:34:43.187119+0000","last_unstale":"2024-04-14T23:34:44.720259+0000","last_undegraded":"2024-04-14T23:34:44.720259+0000","last_fullsized":"2024-04-14T23:34:44.720259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:12:56.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136660+0000","last_change":"2024-04-14T23:34:38.710233+0000","last_active":"2024-04-14T23:34:45.136660+0000","last_peered":"2024-04-14T23:34:45.136660+0000","last_clean":"2024-04-14T23:34:45.136660+0000","last_became_active":"2024-04-14T23:34:38.709977+0000","last_became_peered":"2024-04-14T23:34:38.709977+0000","last_unstale":"2024-04-14T23:34:45.136660+0000","last_undegraded":"2024-04-14T23:34:45.136660+0000","last_fullsized":"2024-04-14T23:34:45.136660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:54:48.080529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720245+0000","last_change":"2024-04-14T23:34:37.705808+0000","last_active":"2024-04-14T23:34:44.720245+0000","last_peered":"2024-04-14T23:34:44.720245+0000","last_clean":"2024-04-14T23:34:44.720245+0000","last_became_active":"2024-04-14T23:34:37.705482+0000","last_became_peered":"2024-04-14T23:34:37.705482+0000","last_unstale":"2024-04-14T23:34:44.720245+0000","last_undegraded":"2024-04-14T23:34:44.720245+0000","last_fullsized":"2024-04-14T23:34:44.720245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:15:08.407528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720487+0000","last_change":"2024-04-14T23:34:42.733535+0000","last_active":"2024-04-14T23:34:44.720487+0000","last_peered":"2024-04-14T23:34:44.720487+0000","last_clean":"2024-04-14T23:34:44.720487+0000","last_became_active":"2024-04-14T23:34:42.733097+0000","last_became_peered":"2024-04-14T23:34:42.733097+0000","last_unstale":"2024-04-14T23:34:44.720487+0000","last_undegraded":"2024-04-14T23:34:44.720487+0000","last_fullsized":"2024-04-14T23:34:44.720487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:06:02.832632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136148+0000","last_change":"2024-04-14T23:34:38.709532+0000","last_active":"2024-04-14T23:34:45.136148+0000","last_peered":"2024-04-14T23:34:45.136148+0000","last_clean":"2024-04-14T23:34:45.136148+0000","last_became_active":"2024-04-14T23:34:38.709258+0000","last_became_peered":"2024-04-14T23:34:38.709258+0000","last_unstale":"2024-04-14T23:34:45.136148+0000","last_undegraded":"2024-04-14T23:34:45.136148+0000","last_fullsized":"2024-04-14T23:34:45.136148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:57:26.195919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806275+0000","last_change":"2024-04-14T23:34:37.697607+0000","last_active":"2024-04-14T23:34:45.806275+0000","last_peered":"2024-04-14T23:34:45.806275+0000","last_clean":"2024-04-14T23:34:45.806275+0000","last_became_active":"2024-04-14T23:34:37.697298+0000","last_became_peered":"2024-04-14T23:34:37.697298+0000","last_unstale":"2024-04-14T23:34:45.806275+0000","last_undegraded":"2024-04-14T23:34:45.806275+0000","last_fullsized":"2024-04-14T23:34:45.806275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:59:31.580365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311852+0000","last_change":"2024-04-14T23:34:42.735706+0000","last_active":"2024-04-14T23:34:46.311852+0000","last_peered":"2024-04-14T23:34:46.311852+0000","last_clean":"2024-04-14T23:34:46.311852+0000","last_became_active":"2024-04-14T23:34:42.735271+0000","last_became_peered":"2024-04-14T23:34:42.735271+0000","last_unstale":"2024-04-14T23:34:46.311852+0000","last_undegraded":"2024-04-14T23:34:46.311852+0000","last_fullsized":"2024-04-14T23:34:46.311852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:12:56.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517020+0000","last_change":"2024-04-14T23:34:38.713087+0000","last_active":"2024-04-14T23:34:46.517020+0000","last_peered":"2024-04-14T23:34:46.517020+0000","last_clean":"2024-04-14T23:34:46.517020+0000","last_became_active":"2024-04-14T23:34:38.712034+0000","last_became_peered":"2024-04-14T23:34:38.712034+0000","last_unstale":"2024-04-14T23:34:46.517020+0000","last_undegraded":"2024-04-14T23:34:46.517020+0000","last_fullsized":"2024-04-14T23:34:46.517020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516575+0000","last_change":"2024-04-14T23:34:37.704849+0000","last_active":"2024-04-14T23:34:46.516575+0000","last_peered":"2024-04-14T23:34:46.516575+0000","last_clean":"2024-04-14T23:34:46.516575+0000","last_became_active":"2024-04-14T23:34:37.704557+0000","last_became_peered":"2024-04-14T23:34:37.704557+0000","last_unstale":"2024-04-14T23:34:46.516575+0000","last_undegraded":"2024-04-14T23:34:46.516575+0000","last_fullsized":"2024-04-14T23:34:46.516575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:51:11.382828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718861+0000","last_change":"2024-04-14T23:34:43.189855+0000","last_active":"2024-04-14T23:34:44.718861+0000","last_peered":"2024-04-14T23:34:44.718861+0000","last_clean":"2024-04-14T23:34:44.718861+0000","last_became_active":"2024-04-14T23:34:43.187647+0000","last_became_peered":"2024-04-14T23:34:43.187647+0000","last_unstale":"2024-04-14T23:34:44.718861+0000","last_undegraded":"2024-04-14T23:34:44.718861+0000","last_fullsized":"2024-04-14T23:34:44.718861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:43:12.062252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136349+0000","last_change":"2024-04-14T23:34:38.716708+0000","last_active":"2024-04-14T23:34:45.136349+0000","last_peered":"2024-04-14T23:34:45.136349+0000","last_clean":"2024-04-14T23:34:45.136349+0000","last_became_active":"2024-04-14T23:34:38.716155+0000","last_became_peered":"2024-04-14T23:34:38.716155+0000","last_unstale":"2024-04-14T23:34:45.136349+0000","last_undegraded":"2024-04-14T23:34:45.136349+0000","last_fullsized":"2024-04-14T23:34:45.136349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:19:41.725777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720069+0000","last_change":"2024-04-14T23:34:37.708685+0000","last_active":"2024-04-14T23:34:44.720069+0000","last_peered":"2024-04-14T23:34:44.720069+0000","last_clean":"2024-04-14T23:34:44.720069+0000","last_became_active":"2024-04-14T23:34:37.708139+0000","last_became_peered":"2024-04-14T23:34:37.708139+0000","last_unstale":"2024-04-14T23:34:44.720069+0000","last_undegraded":"2024-04-14T23:34:44.720069+0000","last_fullsized":"2024-04-14T23:34:44.720069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:23.167535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718415+0000","last_change":"2024-04-14T23:34:43.185556+0000","last_active":"2024-04-14T23:34:44.718415+0000","last_peered":"2024-04-14T23:34:44.718415+0000","last_clean":"2024-04-14T23:34:44.718415+0000","last_became_active":"2024-04-14T23:34:43.185132+0000","last_became_peered":"2024-04-14T23:34:43.185132+0000","last_unstale":"2024-04-14T23:34:44.718415+0000","last_undegraded":"2024-04-14T23:34:44.718415+0000","last_fullsized":"2024-04-14T23:34:44.718415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:42:28.109020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311653+0000","last_change":"2024-04-14T23:34:38.711429+0000","last_active":"2024-04-14T23:34:46.311653+0000","last_peered":"2024-04-14T23:34:46.311653+0000","last_clean":"2024-04-14T23:34:46.311653+0000","last_became_active":"2024-04-14T23:34:38.710919+0000","last_became_peered":"2024-04-14T23:34:38.710919+0000","last_unstale":"2024-04-14T23:34:46.311653+0000","last_undegraded":"2024-04-14T23:34:46.311653+0000","last_fullsized":"2024-04-14T23:34:46.311653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:32:33.112814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311200+0000","last_change":"2024-04-14T23:34:37.712359+0000","last_active":"2024-04-14T23:34:46.311200+0000","last_peered":"2024-04-14T23:34:46.311200+0000","last_clean":"2024-04-14T23:34:46.311200+0000","last_became_active":"2024-04-14T23:34:37.711899+0000","last_became_peered":"2024-04-14T23:34:37.711899+0000","last_unstale":"2024-04-14T23:34:46.311200+0000","last_undegraded":"2024-04-14T23:34:46.311200+0000","last_fullsized":"2024-04-14T23:34:46.311200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:15:08.407528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719927+0000","last_change":"2024-04-14T23:34:43.185490+0000","last_active":"2024-04-14T23:34:44.719927+0000","last_peered":"2024-04-14T23:34:44.719927+0000","last_clean":"2024-04-14T23:34:44.719927+0000","last_became_active":"2024-04-14T23:34:43.185080+0000","last_became_peered":"2024-04-14T23:34:43.185080+0000","last_unstale":"2024-04-14T23:34:44.719927+0000","last_undegraded":"2024-04-14T23:34:44.719927+0000","last_fullsized":"2024-04-14T23:34:44.719927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:50:07.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136350+0000","last_change":"2024-04-14T23:34:38.718154+0000","last_active":"2024-04-14T23:34:45.136350+0000","last_peered":"2024-04-14T23:34:45.136350+0000","last_clean":"2024-04-14T23:34:45.136350+0000","last_became_active":"2024-04-14T23:34:38.717760+0000","last_became_peered":"2024-04-14T23:34:38.717760+0000","last_unstale":"2024-04-14T23:34:45.136350+0000","last_undegraded":"2024-04-14T23:34:45.136350+0000","last_fullsized":"2024-04-14T23:34:45.136350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:08:52.379294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:47.717043+0000","last_change":"2024-04-14T23:34:37.710678+0000","last_active":"2024-04-14T23:34:47.717043+0000","last_peered":"2024-04-14T23:34:47.717043+0000","last_clean":"2024-04-14T23:34:47.717043+0000","last_became_active":"2024-04-14T23:34:37.710377+0000","last_became_peered":"2024-04-14T23:34:37.710377+0000","last_unstale":"2024-04-14T23:34:47.717043+0000","last_undegraded":"2024-04-14T23:34:47.717043+0000","last_fullsized":"2024-04-14T23:34:47.717043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:23.167535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318875+0000","last_change":"2024-04-14T23:34:42.735072+0000","last_active":"2024-04-14T23:34:46.318875+0000","last_peered":"2024-04-14T23:34:46.318875+0000","last_clean":"2024-04-14T23:34:46.318875+0000","last_became_active":"2024-04-14T23:34:42.734693+0000","last_became_peered":"2024-04-14T23:34:42.734693+0000","last_unstale":"2024-04-14T23:34:46.318875+0000","last_undegraded":"2024-04-14T23:34:46.318875+0000","last_fullsized":"2024-04-14T23:34:46.318875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:28:10.218625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720019+0000","last_change":"2024-04-14T23:34:38.714478+0000","last_active":"2024-04-14T23:34:44.720019+0000","last_peered":"2024-04-14T23:34:44.720019+0000","last_clean":"2024-04-14T23:34:44.720019+0000","last_became_active":"2024-04-14T23:34:38.714187+0000","last_became_peered":"2024-04-14T23:34:38.714187+0000","last_unstale":"2024-04-14T23:34:44.720019+0000","last_undegraded":"2024-04-14T23:34:44.720019+0000","last_fullsized":"2024-04-14T23:34:44.720019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:26.985483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318538+0000","last_change":"2024-04-14T23:34:37.706150+0000","last_active":"2024-04-14T23:34:46.318538+0000","last_peered":"2024-04-14T23:34:46.318538+0000","last_clean":"2024-04-14T23:34:46.318538+0000","last_became_active":"2024-04-14T23:34:37.705836+0000","last_became_peered":"2024-04-14T23:34:37.705836+0000","last_unstale":"2024-04-14T23:34:46.318538+0000","last_undegraded":"2024-04-14T23:34:46.318538+0000","last_fullsized":"2024-04-14T23:34:46.318538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:02:03.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719572+0000","last_change":"2024-04-14T23:34:42.733389+0000","last_active":"2024-04-14T23:34:44.719572+0000","last_peered":"2024-04-14T23:34:44.719572+0000","last_clean":"2024-04-14T23:34:44.719572+0000","last_became_active":"2024-04-14T23:34:42.732985+0000","last_became_peered":"2024-04-14T23:34:42.732985+0000","last_unstale":"2024-04-14T23:34:44.719572+0000","last_undegraded":"2024-04-14T23:34:44.719572+0000","last_fullsized":"2024-04-14T23:34:44.719572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:37:34.006119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311955+0000","last_change":"2024-04-14T23:34:38.710119+0000","last_active":"2024-04-14T23:34:46.311955+0000","last_peered":"2024-04-14T23:34:46.311955+0000","last_clean":"2024-04-14T23:34:46.311955+0000","last_became_active":"2024-04-14T23:34:38.709833+0000","last_became_peered":"2024-04-14T23:34:38.709833+0000","last_unstale":"2024-04-14T23:34:46.311955+0000","last_undegraded":"2024-04-14T23:34:46.311955+0000","last_fullsized":"2024-04-14T23:34:46.311955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:54:47.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720394+0000","last_change":"2024-04-14T23:34:37.707534+0000","last_active":"2024-04-14T23:34:44.720394+0000","last_peered":"2024-04-14T23:34:44.720394+0000","last_clean":"2024-04-14T23:34:44.720394+0000","last_became_active":"2024-04-14T23:34:37.707213+0000","last_became_peered":"2024-04-14T23:34:37.707213+0000","last_unstale":"2024-04-14T23:34:44.720394+0000","last_undegraded":"2024-04-14T23:34:44.720394+0000","last_fullsized":"2024-04-14T23:34:44.720394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:02:03.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718138+0000","last_change":"2024-04-14T23:34:42.728861+0000","last_active":"2024-04-14T23:34:44.718138+0000","last_peered":"2024-04-14T23:34:44.718138+0000","last_clean":"2024-04-14T23:34:44.718138+0000","last_became_active":"2024-04-14T23:34:42.727257+0000","last_became_peered":"2024-04-14T23:34:42.727257+0000","last_unstale":"2024-04-14T23:34:44.718138+0000","last_undegraded":"2024-04-14T23:34:44.718138+0000","last_fullsized":"2024-04-14T23:34:44.718138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:50:08.796670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720295+0000","last_change":"2024-04-14T23:34:38.701821+0000","last_active":"2024-04-14T23:34:44.720295+0000","last_peered":"2024-04-14T23:34:44.720295+0000","last_clean":"2024-04-14T23:34:44.720295+0000","last_became_active":"2024-04-14T23:34:38.701530+0000","last_became_peered":"2024-04-14T23:34:38.701530+0000","last_unstale":"2024-04-14T23:34:44.720295+0000","last_undegraded":"2024-04-14T23:34:44.720295+0000","last_fullsized":"2024-04-14T23:34:44.720295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:34:09.647113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516783+0000","last_change":"2024-04-14T23:34:37.703952+0000","last_active":"2024-04-14T23:34:46.516783+0000","last_peered":"2024-04-14T23:34:46.516783+0000","last_clean":"2024-04-14T23:34:46.516783+0000","last_became_active":"2024-04-14T23:34:37.703622+0000","last_became_peered":"2024-04-14T23:34:37.703622+0000","last_unstale":"2024-04-14T23:34:46.516783+0000","last_undegraded":"2024-04-14T23:34:46.516783+0000","last_fullsized":"2024-04-14T23:34:46.516783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:29.023280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718062+0000","last_change":"2024-04-14T23:34:43.190499+0000","last_active":"2024-04-14T23:34:44.718062+0000","last_peered":"2024-04-14T23:34:44.718062+0000","last_clean":"2024-04-14T23:34:44.718062+0000","last_became_active":"2024-04-14T23:34:43.190120+0000","last_became_peered":"2024-04-14T23:34:43.190120+0000","last_unstale":"2024-04-14T23:34:44.718062+0000","last_undegraded":"2024-04-14T23:34:44.718062+0000","last_fullsized":"2024-04-14T23:34:44.718062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:07:43.950068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311856+0000","last_change":"2024-04-14T23:34:43.188434+0000","last_active":"2024-04-14T23:34:46.311856+0000","last_peered":"2024-04-14T23:34:46.311856+0000","last_clean":"2024-04-14T23:34:46.311856+0000","last_became_active":"2024-04-14T23:34:43.188069+0000","last_became_peered":"2024-04-14T23:34:43.188069+0000","last_unstale":"2024-04-14T23:34:46.311856+0000","last_undegraded":"2024-04-14T23:34:46.311856+0000","last_fullsized":"2024-04-14T23:34:46.311856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:50:07.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318672+0000","last_change":"2024-04-14T23:34:38.713042+0000","last_active":"2024-04-14T23:34:46.318672+0000","last_peered":"2024-04-14T23:34:46.318672+0000","last_clean":"2024-04-14T23:34:46.318672+0000","last_became_active":"2024-04-14T23:34:38.712746+0000","last_became_peered":"2024-04-14T23:34:38.712746+0000","last_unstale":"2024-04-14T23:34:46.318672+0000","last_undegraded":"2024-04-14T23:34:46.318672+0000","last_fullsized":"2024-04-14T23:34:46.318672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:27:36.965696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719390+0000","last_change":"2024-04-14T23:34:37.709449+0000","last_active":"2024-04-14T23:34:44.719390+0000","last_peered":"2024-04-14T23:34:44.719390+0000","last_clean":"2024-04-14T23:34:44.719390+0000","last_became_active":"2024-04-14T23:34:37.709153+0000","last_became_peered":"2024-04-14T23:34:37.709153+0000","last_unstale":"2024-04-14T23:34:44.719390+0000","last_undegraded":"2024-04-14T23:34:44.719390+0000","last_fullsized":"2024-04-14T23:34:44.719390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:29.023280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517519+0000","last_change":"2024-04-14T23:34:42.734788+0000","last_active":"2024-04-14T23:34:46.517519+0000","last_peered":"2024-04-14T23:34:46.517519+0000","last_clean":"2024-04-14T23:34:46.517519+0000","last_became_active":"2024-04-14T23:34:42.734397+0000","last_became_peered":"2024-04-14T23:34:42.734397+0000","last_unstale":"2024-04-14T23:34:46.517519+0000","last_undegraded":"2024-04-14T23:34:46.517519+0000","last_fullsized":"2024-04-14T23:34:46.517519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:17.874980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718120+0000","last_change":"2024-04-14T23:34:38.713504+0000","last_active":"2024-04-14T23:34:44.718120+0000","last_peered":"2024-04-14T23:34:44.718120+0000","last_clean":"2024-04-14T23:34:44.718120+0000","last_became_active":"2024-04-14T23:34:38.712325+0000","last_became_peered":"2024-04-14T23:34:38.712325+0000","last_unstale":"2024-04-14T23:34:44.718120+0000","last_undegraded":"2024-04-14T23:34:44.718120+0000","last_fullsized":"2024-04-14T23:34:44.718120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:54:47.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718225+0000","last_change":"2024-04-14T23:34:37.711477+0000","last_active":"2024-04-14T23:34:44.718225+0000","last_peered":"2024-04-14T23:34:44.718225+0000","last_clean":"2024-04-14T23:34:44.718225+0000","last_became_active":"2024-04-14T23:34:37.710472+0000","last_became_peered":"2024-04-14T23:34:37.710472+0000","last_unstale":"2024-04-14T23:34:44.718225+0000","last_undegraded":"2024-04-14T23:34:44.718225+0000","last_fullsized":"2024-04-14T23:34:44.718225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:59:31.580365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516590+0000","last_change":"2024-04-14T23:34:37.700380+0000","last_active":"2024-04-14T23:34:46.516590+0000","last_peered":"2024-04-14T23:34:46.516590+0000","last_clean":"2024-04-14T23:34:46.516590+0000","last_became_active":"2024-04-14T23:34:37.699846+0000","last_became_peered":"2024-04-14T23:34:37.699846+0000","last_unstale":"2024-04-14T23:34:46.516590+0000","last_undegraded":"2024-04-14T23:34:46.516590+0000","last_fullsized":"2024-04-14T23:34:46.516590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:18:40.942344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311821+0000","last_change":"2024-04-14T23:34:38.701104+0000","last_active":"2024-04-14T23:34:46.311821+0000","last_peered":"2024-04-14T23:34:46.311821+0000","last_clean":"2024-04-14T23:34:46.311821+0000","last_became_active":"2024-04-14T23:34:38.700816+0000","last_became_peered":"2024-04-14T23:34:38.700816+0000","last_unstale":"2024-04-14T23:34:46.311821+0000","last_undegraded":"2024-04-14T23:34:46.311821+0000","last_fullsized":"2024-04-14T23:34:46.311821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806426+0000","last_change":"2024-04-14T23:34:42.729961+0000","last_active":"2024-04-14T23:34:45.806426+0000","last_peered":"2024-04-14T23:34:45.806426+0000","last_clean":"2024-04-14T23:34:45.806426+0000","last_became_active":"2024-04-14T23:34:42.729584+0000","last_became_peered":"2024-04-14T23:34:42.729584+0000","last_unstale":"2024-04-14T23:34:45.806426+0000","last_undegraded":"2024-04-14T23:34:45.806426+0000","last_fullsized":"2024-04-14T23:34:45.806426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:32:37.135066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718411+0000","last_change":"2024-04-14T23:34:37.711324+0000","last_active":"2024-04-14T23:34:44.718411+0000","last_peered":"2024-04-14T23:34:44.718411+0000","last_clean":"2024-04-14T23:34:44.718411+0000","last_became_active":"2024-04-14T23:34:37.710354+0000","last_became_peered":"2024-04-14T23:34:37.710354+0000","last_unstale":"2024-04-14T23:34:44.718411+0000","last_undegraded":"2024-04-14T23:34:44.718411+0000","last_fullsized":"2024-04-14T23:34:44.718411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:51:11.382828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719474+0000","last_change":"2024-04-14T23:34:38.708836+0000","last_active":"2024-04-14T23:34:44.719474+0000","last_peered":"2024-04-14T23:34:44.719474+0000","last_clean":"2024-04-14T23:34:44.719474+0000","last_became_active":"2024-04-14T23:34:38.708569+0000","last_became_peered":"2024-04-14T23:34:38.708569+0000","last_unstale":"2024-04-14T23:34:44.719474+0000","last_undegraded":"2024-04-14T23:34:44.719474+0000","last_fullsized":"2024-04-14T23:34:44.719474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:53.031298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718647+0000","last_change":"2024-04-14T23:34:42.729168+0000","last_active":"2024-04-14T23:34:44.718647+0000","last_peered":"2024-04-14T23:34:44.718647+0000","last_clean":"2024-04-14T23:34:44.718647+0000","last_became_active":"2024-04-14T23:34:42.727494+0000","last_became_peered":"2024-04-14T23:34:42.727494+0000","last_unstale":"2024-04-14T23:34:44.718647+0000","last_undegraded":"2024-04-14T23:34:44.718647+0000","last_fullsized":"2024-04-14T23:34:44.718647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:25:19.108275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516920+0000","last_change":"2024-04-14T23:34:38.714071+0000","last_active":"2024-04-14T23:34:46.516920+0000","last_peered":"2024-04-14T23:34:46.516920+0000","last_clean":"2024-04-14T23:34:46.516920+0000","last_became_active":"2024-04-14T23:34:38.713792+0000","last_became_peered":"2024-04-14T23:34:38.713792+0000","last_unstale":"2024-04-14T23:34:46.516920+0000","last_undegraded":"2024-04-14T23:34:46.516920+0000","last_fullsized":"2024-04-14T23:34:46.516920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:54:47.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806380+0000","last_change":"2024-04-14T23:34:38.710636+0000","last_active":"2024-04-14T23:34:45.806380+0000","last_peered":"2024-04-14T23:34:45.806380+0000","last_clean":"2024-04-14T23:34:45.806380+0000","last_became_active":"2024-04-14T23:34:38.710137+0000","last_became_peered":"2024-04-14T23:34:38.710137+0000","last_unstale":"2024-04-14T23:34:45.806380+0000","last_undegraded":"2024-04-14T23:34:45.806380+0000","last_fullsized":"2024-04-14T23:34:45.806380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:53.031298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719973+0000","last_change":"2024-04-14T23:34:38.712090+0000","last_active":"2024-04-14T23:34:44.719973+0000","last_peered":"2024-04-14T23:34:44.719973+0000","last_clean":"2024-04-14T23:34:44.719973+0000","last_became_active":"2024-04-14T23:34:38.711774+0000","last_became_peered":"2024-04-14T23:34:38.711774+0000","last_unstale":"2024-04-14T23:34:44.719973+0000","last_undegraded":"2024-04-14T23:34:44.719973+0000","last_fullsized":"2024-04-14T23:34:44.719973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:08:52.379294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311741+0000","last_change":"2024-04-14T23:34:38.710874+0000","last_active":"2024-04-14T23:34:46.311741+0000","last_peered":"2024-04-14T23:34:46.311741+0000","last_clean":"2024-04-14T23:34:46.311741+0000","last_became_active":"2024-04-14T23:34:38.710573+0000","last_became_peered":"2024-04-14T23:34:38.710573+0000","last_unstale":"2024-04-14T23:34:46.311741+0000","last_undegraded":"2024-04-14T23:34:46.311741+0000","last_fullsized":"2024-04-14T23:34:46.311741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:40.949590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718481+0000","last_change":"2024-04-14T23:34:38.712171+0000","last_active":"2024-04-14T23:34:44.718481+0000","last_peered":"2024-04-14T23:34:44.718481+0000","last_clean":"2024-04-14T23:34:44.718481+0000","last_became_active":"2024-04-14T23:34:38.711789+0000","last_became_peered":"2024-04-14T23:34:38.711789+0000","last_unstale":"2024-04-14T23:34:44.718481+0000","last_undegraded":"2024-04-14T23:34:44.718481+0000","last_fullsized":"2024-04-14T23:34:44.718481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:32:05.285392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319127+0000","last_change":"2024-04-14T23:34:38.717810+0000","last_active":"2024-04-14T23:34:46.319127+0000","last_peered":"2024-04-14T23:34:46.319127+0000","last_clean":"2024-04-14T23:34:46.319127+0000","last_became_active":"2024-04-14T23:34:38.717398+0000","last_became_peered":"2024-04-14T23:34:38.717398+0000","last_unstale":"2024-04-14T23:34:46.319127+0000","last_undegraded":"2024-04-14T23:34:46.319127+0000","last_fullsized":"2024-04-14T23:34:46.319127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517638+0000","last_change":"2024-04-14T23:34:38.714157+0000","last_active":"2024-04-14T23:34:46.517638+0000","last_peered":"2024-04-14T23:34:46.517638+0000","last_clean":"2024-04-14T23:34:46.517638+0000","last_became_active":"2024-04-14T23:34:38.712289+0000","last_became_peered":"2024-04-14T23:34:38.712289+0000","last_unstale":"2024-04-14T23:34:46.517638+0000","last_undegraded":"2024-04-14T23:34:46.517638+0000","last_fullsized":"2024-04-14T23:34:46.517638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:44.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718791+0000","last_change":"2024-04-14T23:34:38.711729+0000","last_active":"2024-04-14T23:34:44.718791+0000","last_peered":"2024-04-14T23:34:44.718791+0000","last_clean":"2024-04-14T23:34:44.718791+0000","last_became_active":"2024-04-14T23:34:38.711429+0000","last_became_peered":"2024-04-14T23:34:38.711429+0000","last_unstale":"2024-04-14T23:34:44.718791+0000","last_undegraded":"2024-04-14T23:34:44.718791+0000","last_fullsized":"2024-04-14T23:34:44.718791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719293+0000","last_change":"2024-04-14T23:34:38.715491+0000","last_active":"2024-04-14T23:34:44.719293+0000","last_peered":"2024-04-14T23:34:44.719293+0000","last_clean":"2024-04-14T23:34:44.719293+0000","last_became_active":"2024-04-14T23:34:38.714292+0000","last_became_peered":"2024-04-14T23:34:38.714292+0000","last_unstale":"2024-04-14T23:34:44.719293+0000","last_undegraded":"2024-04-14T23:34:44.719293+0000","last_fullsized":"2024-04-14T23:34:44.719293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:09:47.574841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718114+0000","last_change":"2024-04-14T23:34:38.709908+0000","last_active":"2024-04-14T23:34:44.718114+0000","last_peered":"2024-04-14T23:34:44.718114+0000","last_clean":"2024-04-14T23:34:44.718114+0000","last_became_active":"2024-04-14T23:34:38.709563+0000","last_became_peered":"2024-04-14T23:34:38.709563+0000","last_unstale":"2024-04-14T23:34:44.718114+0000","last_undegraded":"2024-04-14T23:34:44.718114+0000","last_fullsized":"2024-04-14T23:34:44.718114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719868+0000","last_change":"2024-04-14T23:34:38.708460+0000","last_active":"2024-04-14T23:34:44.719868+0000","last_peered":"2024-04-14T23:34:44.719868+0000","last_clean":"2024-04-14T23:34:44.719868+0000","last_became_active":"2024-04-14T23:34:38.707437+0000","last_became_peered":"2024-04-14T23:34:38.707437+0000","last_unstale":"2024-04-14T23:34:44.719868+0000","last_undegraded":"2024-04-14T23:34:44.719868+0000","last_fullsized":"2024-04-14T23:34:44.719868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:57:26.195919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311644+0000","last_change":"2024-04-14T23:34:38.702841+0000","last_active":"2024-04-14T23:34:46.311644+0000","last_peered":"2024-04-14T23:34:46.311644+0000","last_clean":"2024-04-14T23:34:46.311644+0000","last_became_active":"2024-04-14T23:34:38.702527+0000","last_became_peered":"2024-04-14T23:34:38.702527+0000","last_unstale":"2024-04-14T23:34:46.311644+0000","last_undegraded":"2024-04-14T23:34:46.311644+0000","last_fullsized":"2024-04-14T23:34:46.311644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517386+0000","last_change":"2024-04-14T23:34:38.714356+0000","last_active":"2024-04-14T23:34:46.517386+0000","last_peered":"2024-04-14T23:34:46.517386+0000","last_clean":"2024-04-14T23:34:46.517386+0000","last_became_active":"2024-04-14T23:34:38.713937+0000","last_became_peered":"2024-04-14T23:34:38.713937+0000","last_unstale":"2024-04-14T23:34:46.517386+0000","last_undegraded":"2024-04-14T23:34:46.517386+0000","last_fullsized":"2024-04-14T23:34:46.517386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:40.949590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136593+0000","last_change":"2024-04-14T23:34:38.711688+0000","last_active":"2024-04-14T23:34:45.136593+0000","last_peered":"2024-04-14T23:34:45.136593+0000","last_clean":"2024-04-14T23:34:45.136593+0000","last_became_active":"2024-04-14T23:34:38.711428+0000","last_became_peered":"2024-04-14T23:34:38.711428+0000","last_unstale":"2024-04-14T23:34:45.136593+0000","last_undegraded":"2024-04-14T23:34:45.136593+0000","last_fullsized":"2024-04-14T23:34:45.136593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:13.852728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806712+0000","last_change":"2024-04-14T23:34:38.715113+0000","last_active":"2024-04-14T23:34:45.806712+0000","last_peered":"2024-04-14T23:34:45.806712+0000","last_clean":"2024-04-14T23:34:45.806712+0000","last_became_active":"2024-04-14T23:34:38.714814+0000","last_became_peered":"2024-04-14T23:34:38.714814+0000","last_unstale":"2024-04-14T23:34:45.806712+0000","last_undegraded":"2024-04-14T23:34:45.806712+0000","last_fullsized":"2024-04-14T23:34:45.806712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:03:18.131006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720712+0000","last_change":"2024-04-14T23:34:38.704287+0000","last_active":"2024-04-14T23:34:44.720712+0000","last_peered":"2024-04-14T23:34:44.720712+0000","last_clean":"2024-04-14T23:34:44.720712+0000","last_became_active":"2024-04-14T23:34:38.702165+0000","last_became_peered":"2024-04-14T23:34:38.702165+0000","last_unstale":"2024-04-14T23:34:44.720712+0000","last_undegraded":"2024-04-14T23:34:44.720712+0000","last_fullsized":"2024-04-14T23:34:44.720712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:24.107167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719179+0000","last_change":"2024-04-14T23:34:38.706857+0000","last_active":"2024-04-14T23:34:44.719179+0000","last_peered":"2024-04-14T23:34:44.719179+0000","last_clean":"2024-04-14T23:34:44.719179+0000","last_became_active":"2024-04-14T23:34:38.705253+0000","last_became_peered":"2024-04-14T23:34:38.705253+0000","last_unstale":"2024-04-14T23:34:44.719179+0000","last_undegraded":"2024-04-14T23:34:44.719179+0000","last_fullsized":"2024-04-14T23:34:44.719179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:44.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318744+0000","last_change":"2024-04-14T23:34:38.711823+0000","last_active":"2024-04-14T23:34:46.318744+0000","last_peered":"2024-04-14T23:34:46.318744+0000","last_clean":"2024-04-14T23:34:46.318744+0000","last_became_active":"2024-04-14T23:34:38.711530+0000","last_became_peered":"2024-04-14T23:34:38.711530+0000","last_unstale":"2024-04-14T23:34:46.318744+0000","last_undegraded":"2024-04-14T23:34:46.318744+0000","last_fullsized":"2024-04-14T23:34:46.318744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:40.949590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311653+0000","last_change":"2024-04-14T23:34:38.705635+0000","last_active":"2024-04-14T23:34:46.311653+0000","last_peered":"2024-04-14T23:34:46.311653+0000","last_clean":"2024-04-14T23:34:46.311653+0000","last_became_active":"2024-04-14T23:34:38.705086+0000","last_became_peered":"2024-04-14T23:34:38.705086+0000","last_unstale":"2024-04-14T23:34:46.311653+0000","last_undegraded":"2024-04-14T23:34:46.311653+0000","last_fullsized":"2024-04-14T23:34:46.311653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:15:01.190987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718240+0000","last_change":"2024-04-14T23:34:38.710758+0000","last_active":"2024-04-14T23:34:44.718240+0000","last_peered":"2024-04-14T23:34:44.718240+0000","last_clean":"2024-04-14T23:34:44.718240+0000","last_became_active":"2024-04-14T23:34:38.710484+0000","last_became_peered":"2024-04-14T23:34:38.710484+0000","last_unstale":"2024-04-14T23:34:44.718240+0000","last_undegraded":"2024-04-14T23:34:44.718240+0000","last_fullsized":"2024-04-14T23:34:44.718240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:34:09.647113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720314+0000","last_change":"2024-04-14T23:34:38.711759+0000","last_active":"2024-04-14T23:34:44.720314+0000","last_peered":"2024-04-14T23:34:44.720314+0000","last_clean":"2024-04-14T23:34:44.720314+0000","last_became_active":"2024-04-14T23:34:38.711469+0000","last_became_peered":"2024-04-14T23:34:38.711469+0000","last_unstale":"2024-04-14T23:34:44.720314+0000","last_undegraded":"2024-04-14T23:34:44.720314+0000","last_fullsized":"2024-04-14T23:34:44.720314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:03:18.131006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517344+0000","last_change":"2024-04-14T23:34:38.710480+0000","last_active":"2024-04-14T23:34:46.517344+0000","last_peered":"2024-04-14T23:34:46.517344+0000","last_clean":"2024-04-14T23:34:46.517344+0000","last_became_active":"2024-04-14T23:34:38.710218+0000","last_became_peered":"2024-04-14T23:34:38.710218+0000","last_unstale":"2024-04-14T23:34:46.517344+0000","last_undegraded":"2024-04-14T23:34:46.517344+0000","last_fullsized":"2024-04-14T23:34:46.517344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:12.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517559+0000","last_change":"2024-04-14T23:34:38.713659+0000","last_active":"2024-04-14T23:34:46.517559+0000","last_peered":"2024-04-14T23:34:46.517559+0000","last_clean":"2024-04-14T23:34:46.517559+0000","last_became_active":"2024-04-14T23:34:38.713281+0000","last_became_peered":"2024-04-14T23:34:38.713281+0000","last_unstale":"2024-04-14T23:34:46.517559+0000","last_undegraded":"2024-04-14T23:34:46.517559+0000","last_fullsized":"2024-04-14T23:34:46.517559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136762+0000","last_change":"2024-04-14T23:34:38.713274+0000","last_active":"2024-04-14T23:34:45.136762+0000","last_peered":"2024-04-14T23:34:45.136762+0000","last_clean":"2024-04-14T23:34:45.136762+0000","last_became_active":"2024-04-14T23:34:38.711274+0000","last_became_peered":"2024-04-14T23:34:38.711274+0000","last_unstale":"2024-04-14T23:34:45.136762+0000","last_undegraded":"2024-04-14T23:34:45.136762+0000","last_fullsized":"2024-04-14T23:34:45.136762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:05:58.810380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.717969+0000","last_change":"2024-04-14T23:34:38.708235+0000","last_active":"2024-04-14T23:34:44.717969+0000","last_peered":"2024-04-14T23:34:44.717969+0000","last_clean":"2024-04-14T23:34:44.717969+0000","last_became_active":"2024-04-14T23:34:38.707779+0000","last_became_peered":"2024-04-14T23:34:38.707779+0000","last_unstale":"2024-04-14T23:34:44.717969+0000","last_undegraded":"2024-04-14T23:34:44.717969+0000","last_fullsized":"2024-04-14T23:34:44.717969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:09:45.484768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136144+0000","last_change":"2024-04-14T23:34:38.713218+0000","last_active":"2024-04-14T23:34:45.136144+0000","last_peered":"2024-04-14T23:34:45.136144+0000","last_clean":"2024-04-14T23:34:45.136144+0000","last_became_active":"2024-04-14T23:34:38.712930+0000","last_became_peered":"2024-04-14T23:34:38.712930+0000","last_unstale":"2024-04-14T23:34:45.136144+0000","last_undegraded":"2024-04-14T23:34:45.136144+0000","last_fullsized":"2024-04-14T23:34:45.136144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:32:05.285392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719753+0000","last_change":"2024-04-14T23:34:38.710158+0000","last_active":"2024-04-14T23:34:44.719753+0000","last_peered":"2024-04-14T23:34:44.719753+0000","last_clean":"2024-04-14T23:34:44.719753+0000","last_became_active":"2024-04-14T23:34:38.709903+0000","last_became_peered":"2024-04-14T23:34:38.709903+0000","last_unstale":"2024-04-14T23:34:44.719753+0000","last_undegraded":"2024-04-14T23:34:44.719753+0000","last_fullsized":"2024-04-14T23:34:44.719753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:32:05.285392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136196+0000","last_change":"2024-04-14T23:34:38.710654+0000","last_active":"2024-04-14T23:34:45.136196+0000","last_peered":"2024-04-14T23:34:45.136196+0000","last_clean":"2024-04-14T23:34:45.136196+0000","last_became_active":"2024-04-14T23:34:38.710267+0000","last_became_peered":"2024-04-14T23:34:38.710267+0000","last_unstale":"2024-04-14T23:34:45.136196+0000","last_undegraded":"2024-04-14T23:34:45.136196+0000","last_fullsized":"2024-04-14T23:34:45.136196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:22.876283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720393+0000","last_change":"2024-04-14T23:34:38.715159+0000","last_active":"2024-04-14T23:34:44.720393+0000","last_peered":"2024-04-14T23:34:44.720393+0000","last_clean":"2024-04-14T23:34:44.720393+0000","last_became_active":"2024-04-14T23:34:38.714918+0000","last_became_peered":"2024-04-14T23:34:38.714918+0000","last_unstale":"2024-04-14T23:34:44.720393+0000","last_undegraded":"2024-04-14T23:34:44.720393+0000","last_fullsized":"2024-04-14T23:34:44.720393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:19:41.725777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311726+0000","last_change":"2024-04-14T23:34:38.707456+0000","last_active":"2024-04-14T23:34:46.311726+0000","last_peered":"2024-04-14T23:34:46.311726+0000","last_clean":"2024-04-14T23:34:46.311726+0000","last_became_active":"2024-04-14T23:34:38.707143+0000","last_became_peered":"2024-04-14T23:34:38.707143+0000","last_unstale":"2024-04-14T23:34:46.311726+0000","last_undegraded":"2024-04-14T23:34:46.311726+0000","last_fullsized":"2024-04-14T23:34:46.311726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:27:36.965696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319134+0000","last_change":"2024-04-14T23:34:38.714188+0000","last_active":"2024-04-14T23:34:46.319134+0000","last_peered":"2024-04-14T23:34:46.319134+0000","last_clean":"2024-04-14T23:34:46.319134+0000","last_became_active":"2024-04-14T23:34:38.713845+0000","last_became_peered":"2024-04-14T23:34:38.713845+0000","last_unstale":"2024-04-14T23:34:46.319134+0000","last_undegraded":"2024-04-14T23:34:46.319134+0000","last_fullsized":"2024-04-14T23:34:46.319134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136688+0000","last_change":"2024-04-14T23:34:38.716139+0000","last_active":"2024-04-14T23:34:45.136688+0000","last_peered":"2024-04-14T23:34:45.136688+0000","last_clean":"2024-04-14T23:34:45.136688+0000","last_became_active":"2024-04-14T23:34:38.715878+0000","last_became_peered":"2024-04-14T23:34:38.715878+0000","last_unstale":"2024-04-14T23:34:45.136688+0000","last_undegraded":"2024-04-14T23:34:45.136688+0000","last_fullsized":"2024-04-14T23:34:45.136688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:24.107167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":111094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T23:34:56.111 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-14T23:34:56.111 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-14T23:34:56.112 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-14T23:34:56.112 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-14T23:34:56.112 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-14T23:34:56.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.245+0000 7fa69bbc8640 1 Processor -- start 2024-04-14T23:34:56.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.245+0000 7fa69bbc8640 1 -- start start 2024-04-14T23:34:56.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.246+0000 7fa69bbc8640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa6940d1e00 0x7fa6940d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.246+0000 7fa69bbc8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa6940d2740 0x7fa6940b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.246+0000 7fa69bbc8640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6940d1620 con 0x7fa69415e270 2024-04-14T23:34:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.246+0000 7fa69bbc8640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa6940d2bb0 con 0x7fa6940d2740 2024-04-14T23:34:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.246+0000 7fa69bbc8640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fa6940b4300 con 0x7fa6940d1e00 2024-04-14T23:34:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.246+0000 7fa69a165640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa6940d2740 0x7fa6940b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.246+0000 7fa699964640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa69415e270 0x7fa6940d0f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55648/0 (socket says 172.21.15.47:55648) 2024-04-14T23:34:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.246+0000 7fa699964640 1 -- 172.21.15.47:0/2397207887 learned_addr learned my addr 172.21.15.47:0/2397207887 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.247+0000 7fa699163640 1 --2- 172.21.15.47:0/2397207887 >> v2:172.21.15.191:3300/0 conn(0x7fa6940d1e00 0x7fa6940d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.247+0000 7fa69a165640 1 -- 172.21.15.47:0/2397207887 >> v2:172.21.15.191:3300/0 conn(0x7fa6940d1e00 msgr2=0x7fa6940d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.247+0000 7fa69a165640 1 --2- 172.21.15.47:0/2397207887 >> v2:172.21.15.191:3300/0 conn(0x7fa6940d1e00 0x7fa6940d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.247+0000 7fa69a165640 1 -- 172.21.15.47:0/2397207887 >> v1:172.21.15.47:6789/0 conn(0x7fa69415e270 legacy=0x7fa6940d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.247+0000 7fa69a165640 1 -- 172.21.15.47:0/2397207887 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6940b39d0 con 0x7fa6940d2740 2024-04-14T23:34:56.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.247+0000 7fa698962640 1 -- 172.21.15.47:0/2397207887 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1352094856 0 0) 0x7fa6940d1620 con 0x7fa69415e270 2024-04-14T23:34:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.247+0000 7fa69a165640 1 --2- 172.21.15.47:0/2397207887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6940d2740 0x7fa6940b4790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa6940b9f80 tx=0x7fa68402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb20d7e565fcac92 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.247+0000 7fa698962640 1 -- 172.21.15.47:0/2397207887 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684039070 con 0x7fa6940d2740 2024-04-14T23:34:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.247+0000 7fa698962640 1 -- 172.21.15.47:0/2397207887 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa68402cd00 con 0x7fa6940d2740 2024-04-14T23:34:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.247+0000 7fa698962640 1 -- 172.21.15.47:0/2397207887 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684034660 con 0x7fa6940d2740 2024-04-14T23:34:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.248+0000 7fa69bbc8640 1 -- 172.21.15.47:0/2397207887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6940d2740 msgr2=0x7fa6940b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.248+0000 7fa69bbc8640 1 --2- 172.21.15.47:0/2397207887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6940d2740 0x7fa6940b4790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa6940b9f80 tx=0x7fa68402bf50 comp rx=0 tx=0).stop 2024-04-14T23:34:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.248+0000 7fa69bbc8640 1 -- 172.21.15.47:0/2397207887 shutdown_connections 2024-04-14T23:34:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.248+0000 7fa69bbc8640 1 --2- 172.21.15.47:0/2397207887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6940d2740 0x7fa6940b4790 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.248+0000 7fa69bbc8640 1 --2- 172.21.15.47:0/2397207887 >> v2:172.21.15.191:3300/0 conn(0x7fa6940d1e00 0x7fa6940d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.248+0000 7fa69bbc8640 1 -- 172.21.15.47:0/2397207887 >> 172.21.15.47:0/2397207887 conn(0x7fa6940d3ed0 msgr2=0x7fa6940d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:56.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.248+0000 7fa69bbc8640 1 -- 172.21.15.47:0/2397207887 shutdown_connections 2024-04-14T23:34:56.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.248+0000 7fa69bbc8640 1 -- 172.21.15.47:0/2397207887 wait complete. 2024-04-14T23:34:56.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.249+0000 7fa69bbc8640 1 Processor -- start 2024-04-14T23:34:56.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.249+0000 7fa69bbc8640 1 -- start start 2024-04-14T23:34:56.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.250+0000 7fa69bbc8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa6940d1e00 0x7fa6940c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.250+0000 7fa69bbc8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6940d2740 0x7fa6940c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.250+0000 7fa69bbc8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa69415e270 0x7fa6941533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.250+0000 7fa69bbc8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa6940b0c60 con 0x7fa69415e270 2024-04-14T23:34:56.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.250+0000 7fa69bbc8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa6940b3f90 con 0x7fa6940d2740 2024-04-14T23:34:56.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.250+0000 7fa69bbc8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa69415e650 con 0x7fa6940d1e00 2024-04-14T23:34:56.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.250+0000 7fa69a165640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa69415e270 0x7fa6941533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.250+0000 7fa69a165640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa69415e270 0x7fa6941533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35892/0 (socket says 172.21.15.47:35892) 2024-04-14T23:34:56.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.250+0000 7fa69a165640 1 -- 172.21.15.47:0/3201962484 learned_addr learned my addr 172.21.15.47:0/3201962484 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:56.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.250+0000 7fa699964640 1 --2- 172.21.15.47:0/3201962484 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa6940d1e00 0x7fa6940c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.250+0000 7fa699163640 1 --2- 172.21.15.47:0/3201962484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6940d2740 0x7fa6940c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.250+0000 7fa69a165640 1 -- 172.21.15.47:0/3201962484 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa6940d1e00 msgr2=0x7fa6940c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.250+0000 7fa69a165640 1 --2- 172.21.15.47:0/3201962484 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa6940d1e00 0x7fa6940c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.250+0000 7fa69a165640 1 -- 172.21.15.47:0/3201962484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6940d2740 msgr2=0x7fa6940c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.250+0000 7fa69a165640 1 --2- 172.21.15.47:0/3201962484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6940d2740 0x7fa6940c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.250+0000 7fa69a165640 1 -- 172.21.15.47:0/3201962484 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6940c8580 con 0x7fa69415e270 2024-04-14T23:34:56.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.251+0000 7fa69a165640 1 --2- 172.21.15.47:0/3201962484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa69415e270 0x7fa6941533f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa684009e80 tx=0x7fa684004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:56.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.251+0000 7fa6927fc640 1 -- 172.21.15.47:0/3201962484 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684039050 con 0x7fa69415e270 2024-04-14T23:34:56.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.251+0000 7fa6927fc640 1 -- 172.21.15.47:0/3201962484 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa684045070 con 0x7fa69415e270 2024-04-14T23:34:56.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.251+0000 7fa69bbc8640 1 -- 172.21.15.47:0/3201962484 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6940c8860 con 0x7fa69415e270 2024-04-14T23:34:56.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.251+0000 7fa6927fc640 1 -- 172.21.15.47:0/3201962484 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68403e830 con 0x7fa69415e270 2024-04-14T23:34:56.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.251+0000 7fa69bbc8640 1 -- 172.21.15.47:0/3201962484 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6940c8e20 con 0x7fa69415e270 2024-04-14T23:34:56.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.252+0000 7fa69bbc8640 1 -- 172.21.15.47:0/3201962484 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa694075430 con 0x7fa69415e270 2024-04-14T23:34:56.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.252+0000 7fa6927fc640 1 -- 172.21.15.47:0/3201962484 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fa68403e9d0 con 0x7fa69415e270 2024-04-14T23:34:56.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.252+0000 7fa6927fc640 1 --2- 172.21.15.47:0/3201962484 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa68006b9c0 0x7fa68006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.253+0000 7fa6927fc640 1 -- 172.21.15.47:0/3201962484 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa6840ad810 con 0x7fa69415e270 2024-04-14T23:34:56.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.253+0000 7fa699964640 1 --2- 172.21.15.47:0/3201962484 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa68006b9c0 0x7fa68006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.253+0000 7fa699964640 1 --2- 172.21.15.47:0/3201962484 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa68006b9c0 0x7fa68006de80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa68c000f60 tx=0x7fa68c007c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:56.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.257+0000 7fa6927fc640 1 -- 172.21.15.47:0/3201962484 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa684032e20 con 0x7fa69415e270 2024-04-14T23:34:56.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.489+0000 7fa69bbc8640 1 -- 172.21.15.47:0/3201962484 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa69406c710 con 0x7fa69415e270 2024-04-14T23:34:56.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.492+0000 7fa6927fc640 1 -- 172.21.15.47:0/3201962484 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172383 (secure 0 0 0) 0x7fa6840abe20 con 0x7fa69415e270 2024-04-14T23:34:56.497 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:56.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.494+0000 7fa69bbc8640 1 -- 172.21.15.47:0/3201962484 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa68006b9c0 msgr2=0x7fa68006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.494+0000 7fa69bbc8640 1 --2- 172.21.15.47:0/3201962484 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa68006b9c0 0x7fa68006de80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa68c000f60 tx=0x7fa68c007c00 comp rx=0 tx=0).stop 2024-04-14T23:34:56.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.494+0000 7fa69bbc8640 1 -- 172.21.15.47:0/3201962484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa69415e270 msgr2=0x7fa6941533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.494+0000 7fa69bbc8640 1 --2- 172.21.15.47:0/3201962484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa69415e270 0x7fa6941533f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa684009e80 tx=0x7fa684004a40 comp rx=0 tx=0).stop 2024-04-14T23:34:56.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.494+0000 7fa69bbc8640 1 -- 172.21.15.47:0/3201962484 shutdown_connections 2024-04-14T23:34:56.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.494+0000 7fa69bbc8640 1 --2- 172.21.15.47:0/3201962484 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa68006b9c0 0x7fa68006de80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.494+0000 7fa69bbc8640 1 --2- 172.21.15.47:0/3201962484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa69415e270 0x7fa6941533f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.494+0000 7fa69bbc8640 1 --2- 172.21.15.47:0/3201962484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6940d2740 0x7fa6940c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.494+0000 7fa69bbc8640 1 --2- 172.21.15.47:0/3201962484 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa6940d1e00 0x7fa6940c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.494+0000 7fa69bbc8640 1 -- 172.21.15.47:0/3201962484 >> 172.21.15.47:0/3201962484 conn(0x7fa6940d3ed0 msgr2=0x7fa69406bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:56.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.494+0000 7fa69bbc8640 1 -- 172.21.15.47:0/3201962484 shutdown_connections 2024-04-14T23:34:56.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.494+0000 7fa69bbc8640 1 -- 172.21.15.47:0/3201962484 wait complete. 2024-04-14T23:34:56.508 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2137390424},{"type":"v1","addr":"172.21.15.191:6833","nonce":2137390424}]},"active_addr":"172.21.15.191:6833/2137390424","active_change":"2024-04-14T23:34:18.347572+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":639882408}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":3108728412}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":2509588157}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":3149887799}]}]} 2024-04-14T23:34:56.511 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-14T23:34:56.511 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-14T23:34:56.511 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:34:56.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.610+0000 7fe7a5ade640 1 Processor -- start 2024-04-14T23:34:56.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.610+0000 7fe7a5ade640 1 -- start start 2024-04-14T23:34:56.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.610+0000 7fe7a5ade640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe7a00d2db0 0x7fe7a00cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.610+0000 7fe7a5ade640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe7a00cf2f0 0x7fe7a00c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.610+0000 7fe7a5ade640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a015e690 con 0x7fe7a015e2b0 2024-04-14T23:34:56.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.610+0000 7fe7a5ade640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe7a00cfb20 con 0x7fe7a00cf2f0 2024-04-14T23:34:56.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.610+0000 7fe7a5ade640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fe7a00cfe00 con 0x7fe7a00d2db0 2024-04-14T23:34:56.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.611+0000 7fe79ffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe7a00cf2f0 0x7fe7a00c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.611+0000 7fe79ffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe7a00cf2f0 0x7fe7a00c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35902/0 (socket says 172.21.15.47:35902) 2024-04-14T23:34:56.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.611+0000 7fe79ffff640 1 -- 172.21.15.47:0/401661299 learned_addr learned my addr 172.21.15.47:0/401661299 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:56.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.611+0000 7fe79f7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe7a015e2b0 0x7fe7a00d26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55650/0 (socket says 172.21.15.47:55650) 2024-04-14T23:34:56.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.611+0000 7fe79effd640 1 --2- 172.21.15.47:0/401661299 >> v2:172.21.15.191:3300/0 conn(0x7fe7a00d2db0 0x7fe7a00cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.611+0000 7fe79ffff640 1 -- 172.21.15.47:0/401661299 >> v2:172.21.15.191:3300/0 conn(0x7fe7a00d2db0 msgr2=0x7fe7a00cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:56.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.611+0000 7fe79ffff640 1 --2- 172.21.15.47:0/401661299 >> v2:172.21.15.191:3300/0 conn(0x7fe7a00d2db0 0x7fe7a00cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.611+0000 7fe79ffff640 1 -- 172.21.15.47:0/401661299 >> v1:172.21.15.47:6789/0 conn(0x7fe7a015e2b0 legacy=0x7fe7a00d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.611+0000 7fe79e7fc640 1 -- 172.21.15.47:0/401661299 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051660120 0 0) 0x7fe7a015e690 con 0x7fe7a015e2b0 2024-04-14T23:34:56.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.611+0000 7fe79ffff640 1 -- 172.21.15.47:0/401661299 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a00d00e0 con 0x7fe7a00cf2f0 2024-04-14T23:34:56.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.611+0000 7fe79effd640 1 --2- 172.21.15.47:0/401661299 >> v2:172.21.15.191:3300/0 conn(0x7fe7a00d2db0 0x7fe7a00cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:56.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.612+0000 7fe79ffff640 1 --2- 172.21.15.47:0/401661299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7a00cf2f0 0x7fe7a00c7f60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe7a006bca0 tx=0x7fe79802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe97d3d2c972829 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:56.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.612+0000 7fe79e7fc640 1 -- 172.21.15.47:0/401661299 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79802cb20 con 0x7fe7a00cf2f0 2024-04-14T23:34:56.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.612+0000 7fe79e7fc640 1 -- 172.21.15.47:0/401661299 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe79802ccc0 con 0x7fe7a00cf2f0 2024-04-14T23:34:56.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.612+0000 7fe79e7fc640 1 -- 172.21.15.47:0/401661299 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe798034610 con 0x7fe7a00cf2f0 2024-04-14T23:34:56.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.612+0000 7fe7a5ade640 1 -- 172.21.15.47:0/401661299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7a00cf2f0 msgr2=0x7fe7a00c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.612+0000 7fe7a5ade640 1 --2- 172.21.15.47:0/401661299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7a00cf2f0 0x7fe7a00c7f60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe7a006bca0 tx=0x7fe79802bf80 comp rx=0 tx=0).stop 2024-04-14T23:34:56.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.612+0000 7fe7a5ade640 1 -- 172.21.15.47:0/401661299 shutdown_connections 2024-04-14T23:34:56.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.612+0000 7fe7a5ade640 1 --2- 172.21.15.47:0/401661299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7a00cf2f0 0x7fe7a00c7f60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.612+0000 7fe7a5ade640 1 --2- 172.21.15.47:0/401661299 >> v2:172.21.15.191:3300/0 conn(0x7fe7a00d2db0 0x7fe7a00cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.612+0000 7fe7a5ade640 1 -- 172.21.15.47:0/401661299 >> 172.21.15.47:0/401661299 conn(0x7fe7a0067940 msgr2=0x7fe7a009d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:56.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.612+0000 7fe7a5ade640 1 -- 172.21.15.47:0/401661299 shutdown_connections 2024-04-14T23:34:56.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.612+0000 7fe7a5ade640 1 -- 172.21.15.47:0/401661299 wait complete. 2024-04-14T23:34:56.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.613+0000 7fe7a5ade640 1 Processor -- start 2024-04-14T23:34:56.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.614+0000 7fe7a5ade640 1 -- start start 2024-04-14T23:34:56.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.614+0000 7fe7a5ade640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7a00cf2f0 0x7fe7a01f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.614+0000 7fe7a5ade640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7a00d2db0 0x7fe7a00c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.614+0000 7fe7a5ade640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7a015e2b0 0x7fe7a00c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.614+0000 7fe7a5ade640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a00cf740 con 0x7fe7a015e2b0 2024-04-14T23:34:56.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.614+0000 7fe7a5ade640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a00d06a0 con 0x7fe7a00d2db0 2024-04-14T23:34:56.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.614+0000 7fe7a5ade640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a00cf8c0 con 0x7fe7a00cf2f0 2024-04-14T23:34:56.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe79ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7a015e2b0 0x7fe7a00c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe79ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7a015e2b0 0x7fe7a00c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35910/0 (socket says 172.21.15.47:35910) 2024-04-14T23:34:56.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe79ffff640 1 -- 172.21.15.47:0/1429571423 learned_addr learned my addr 172.21.15.47:0/1429571423 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:56.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe79f7fe640 1 --2- 172.21.15.47:0/1429571423 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7a00cf2f0 0x7fe7a01f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe79effd640 1 --2- 172.21.15.47:0/1429571423 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7a00d2db0 0x7fe7a00c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe79ffff640 1 -- 172.21.15.47:0/1429571423 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7a00cf2f0 msgr2=0x7fe7a01f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe79ffff640 1 --2- 172.21.15.47:0/1429571423 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7a00cf2f0 0x7fe7a01f3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe79ffff640 1 -- 172.21.15.47:0/1429571423 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7a00d2db0 msgr2=0x7fe7a00c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe79ffff640 1 --2- 172.21.15.47:0/1429571423 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7a00d2db0 0x7fe7a00c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe79ffff640 1 -- 172.21.15.47:0/1429571423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a00b7b50 con 0x7fe7a015e2b0 2024-04-14T23:34:56.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe79f7fe640 1 --2- 172.21.15.47:0/1429571423 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7a00cf2f0 0x7fe7a01f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:56.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe79effd640 1 --2- 172.21.15.47:0/1429571423 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7a00d2db0 0x7fe7a00c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:56.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe79ffff640 1 --2- 172.21.15.47:0/1429571423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7a015e2b0 0x7fe7a00c9270 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe798036040 tx=0x7fe798004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:56.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe787fff640 1 -- 172.21.15.47:0/1429571423 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe798043030 con 0x7fe7a015e2b0 2024-04-14T23:34:56.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe787fff640 1 -- 172.21.15.47:0/1429571423 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe79803e450 con 0x7fe7a015e2b0 2024-04-14T23:34:56.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe7a5ade640 1 -- 172.21.15.47:0/1429571423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a00b7e30 con 0x7fe7a015e2b0 2024-04-14T23:34:56.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe787fff640 1 -- 172.21.15.47:0/1429571423 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe798009510 con 0x7fe7a015e2b0 2024-04-14T23:34:56.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.615+0000 7fe7a5ade640 1 -- 172.21.15.47:0/1429571423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a01f3c60 con 0x7fe7a015e2b0 2024-04-14T23:34:56.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.616+0000 7fe7a5ade640 1 -- 172.21.15.47:0/1429571423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7a0075430 con 0x7fe7a015e2b0 2024-04-14T23:34:56.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.617+0000 7fe787fff640 1 -- 172.21.15.47:0/1429571423 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe798046070 con 0x7fe7a015e2b0 2024-04-14T23:34:56.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.617+0000 7fe787fff640 1 --2- 172.21.15.47:0/1429571423 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe78c06b990 0x7fe78c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.617+0000 7fe787fff640 1 -- 172.21.15.47:0/1429571423 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe7980ad020 con 0x7fe7a015e2b0 2024-04-14T23:34:56.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.617+0000 7fe79f7fe640 1 --2- 172.21.15.47:0/1429571423 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe78c06b990 0x7fe78c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.618+0000 7fe79f7fe640 1 --2- 172.21.15.47:0/1429571423 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe78c06b990 0x7fe78c06de50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe790000f60 tx=0x7fe790009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:56.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.621+0000 7fe787fff640 1 -- 172.21.15.47:0/1429571423 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe79804d070 con 0x7fe7a015e2b0 2024-04-14T23:34:56.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.804+0000 7fe7a5ade640 1 -- 172.21.15.47:0/1429571423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7a01f3e30 con 0x7fe7a015e2b0 2024-04-14T23:34:56.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.806+0000 7fe787fff640 1 -- 172.21.15.47:0/1429571423 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7fe79807b990 con 0x7fe7a015e2b0 2024-04-14T23:34:56.809 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:56.809 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:44.714882+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:34:56.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.808+0000 7fe7a5ade640 1 -- 172.21.15.47:0/1429571423 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe78c06b990 msgr2=0x7fe78c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.808+0000 7fe7a5ade640 1 --2- 172.21.15.47:0/1429571423 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe78c06b990 0x7fe78c06de50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe790000f60 tx=0x7fe790009040 comp rx=0 tx=0).stop 2024-04-14T23:34:56.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.808+0000 7fe7a5ade640 1 -- 172.21.15.47:0/1429571423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7a015e2b0 msgr2=0x7fe7a00c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.808+0000 7fe7a5ade640 1 --2- 172.21.15.47:0/1429571423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7a015e2b0 0x7fe7a00c9270 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe798036040 tx=0x7fe798004a40 comp rx=0 tx=0).stop 2024-04-14T23:34:56.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.808+0000 7fe7a5ade640 1 -- 172.21.15.47:0/1429571423 shutdown_connections 2024-04-14T23:34:56.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.808+0000 7fe7a5ade640 1 --2- 172.21.15.47:0/1429571423 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe78c06b990 0x7fe78c06de50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.808+0000 7fe7a5ade640 1 --2- 172.21.15.47:0/1429571423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7a015e2b0 0x7fe7a00c9270 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.808+0000 7fe7a5ade640 1 --2- 172.21.15.47:0/1429571423 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7a00d2db0 0x7fe7a00c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.808+0000 7fe7a5ade640 1 --2- 172.21.15.47:0/1429571423 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7a00cf2f0 0x7fe7a01f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.808+0000 7fe7a5ade640 1 -- 172.21.15.47:0/1429571423 >> 172.21.15.47:0/1429571423 conn(0x7fe7a0067940 msgr2=0x7fe7a015d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:56.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.808+0000 7fe7a5ade640 1 -- 172.21.15.47:0/1429571423 shutdown_connections 2024-04-14T23:34:56.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.808+0000 7fe7a5ade640 1 -- 172.21.15.47:0/1429571423 wait complete. 2024-04-14T23:34:56.822 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-14T23:34:56.822 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:34:56.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.920+0000 7f944f5fa640 1 Processor -- start 2024-04-14T23:34:56.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.920+0000 7f944f5fa640 1 -- start start 2024-04-14T23:34:56.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.921+0000 7f944f5fa640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f94480d0140 0x7f944815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.921+0000 7f944f5fa640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f944815baf0 0x7f9448071a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.921+0000 7f944f5fa640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f944815c370 con 0x7f944806e340 2024-04-14T23:34:56.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.921+0000 7f944f5fa640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f944815ead0 con 0x7f94480d0140 2024-04-14T23:34:56.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.921+0000 7f944f5fa640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f944815edb0 con 0x7f944815baf0 2024-04-14T23:34:56.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.921+0000 7f944d396640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f944806e340 0x7f94480cfa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55664/0 (socket says 172.21.15.47:55664) 2024-04-14T23:34:56.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.921+0000 7f944d396640 1 -- 172.21.15.47:0/2682491085 learned_addr learned my addr 172.21.15.47:0/2682491085 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:56.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.921+0000 7f944db97640 1 --2- 172.21.15.47:0/2682491085 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f944815baf0 0x7f9448071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.921+0000 7f944cb95640 1 --2- 172.21.15.47:0/2682491085 >> v2:172.21.15.191:3300/0 conn(0x7f94480d0140 0x7f944815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f9447fff640 1 -- 172.21.15.47:0/2682491085 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3310426710 0 0) 0x7f944815c370 con 0x7f944806e340 2024-04-14T23:34:56.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f9447fff640 1 -- 172.21.15.47:0/2682491085 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9430003520 con 0x7f944806e340 2024-04-14T23:34:56.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f9447fff640 1 -- 172.21.15.47:0/2682491085 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2384503641 0 0) 0x7f9430003520 con 0x7f944806e340 2024-04-14T23:34:56.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f9447fff640 1 -- 172.21.15.47:0/2682491085 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f944815baf0 msgr2=0x7f9448071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:56.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f9447fff640 1 --2- 172.21.15.47:0/2682491085 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f944815baf0 0x7f9448071a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f9447fff640 1 -- 172.21.15.47:0/2682491085 >> v2:172.21.15.191:3300/0 conn(0x7f94480d0140 msgr2=0x7f944815b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:56.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f9447fff640 1 --2- 172.21.15.47:0/2682491085 >> v2:172.21.15.191:3300/0 conn(0x7f94480d0140 0x7f944815b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f9447fff640 1 -- 172.21.15.47:0/2682491085 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944815f090 con 0x7f944806e340 2024-04-14T23:34:56.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f9447fff640 1 -- 172.21.15.47:0/2682491085 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f9440001670 con 0x7f944806e340 2024-04-14T23:34:56.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f9447fff640 1 -- 172.21.15.47:0/2682491085 >> v1:172.21.15.47:6789/0 conn(0x7f944806e340 legacy=0x7f94480cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f9447fff640 1 --2- 172.21.15.47:0/2682491085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94300039b0 0x7f9430003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f9447fff640 1 --2- 172.21.15.47:0/2682491085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9430004800 0x7f9430004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f9447fff640 1 --2- 172.21.15.47:0/2682491085 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94300051c0 0x7f943000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f9447fff640 1 -- 172.21.15.47:0/2682491085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f944815ead0 con 0x7f94300039b0 2024-04-14T23:34:56.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f9447fff640 1 -- 172.21.15.47:0/2682491085 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f944815edb0 con 0x7f9430004800 2024-04-14T23:34:56.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f9447fff640 1 -- 172.21.15.47:0/2682491085 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f943000bf30 con 0x7f94300051c0 2024-04-14T23:34:56.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f944db97640 1 --2- 172.21.15.47:0/2682491085 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f944815baf0 0x7f9448071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:56.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f944cb95640 1 --2- 172.21.15.47:0/2682491085 >> v2:172.21.15.191:3300/0 conn(0x7f94480d0140 0x7f944815b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:56.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f944d396640 1 --2- 172.21.15.47:0/2682491085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94300039b0 0x7f9430003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f944db97640 1 --2- 172.21.15.47:0/2682491085 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94300051c0 0x7f943000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f944d396640 1 -- 172.21.15.47:0/2682491085 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94300051c0 msgr2=0x7f943000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:56.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f944cb95640 1 --2- 172.21.15.47:0/2682491085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9430004800 0x7f9430004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f944d396640 1 --2- 172.21.15.47:0/2682491085 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94300051c0 0x7f943000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f944d396640 1 -- 172.21.15.47:0/2682491085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9430004800 msgr2=0x7f9430004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:56.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f944d396640 1 --2- 172.21.15.47:0/2682491085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9430004800 0x7f9430004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f944d396640 1 -- 172.21.15.47:0/2682491085 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9430003520 con 0x7f94300039b0 2024-04-14T23:34:56.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.922+0000 7f944cb95640 1 --2- 172.21.15.47:0/2682491085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9430004800 0x7f9430004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:56.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.923+0000 7f944d396640 1 --2- 172.21.15.47:0/2682491085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94300039b0 0x7f9430003dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f944000c290 tx=0x7f9430005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3282eb4a183f9880 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:56.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.923+0000 7f9447fff640 1 -- 172.21.15.47:0/2682491085 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440007d50 con 0x7f94300039b0 2024-04-14T23:34:56.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.923+0000 7f9447fff640 1 -- 172.21.15.47:0/2682491085 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9440030070 con 0x7f94300039b0 2024-04-14T23:34:56.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.923+0000 7f9447fff640 1 -- 172.21.15.47:0/2682491085 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944002cd50 con 0x7f94300039b0 2024-04-14T23:34:56.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.924+0000 7f944f5fa640 1 -- 172.21.15.47:0/2682491085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94300039b0 msgr2=0x7f9430003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.924+0000 7f944f5fa640 1 --2- 172.21.15.47:0/2682491085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94300039b0 0x7f9430003dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f944000c290 tx=0x7f9430005830 comp rx=0 tx=0).stop 2024-04-14T23:34:56.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.924+0000 7f944db97640 1 -- 172.21.15.47:0/2682491085 reap_dead start 2024-04-14T23:34:56.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.924+0000 7f944f5fa640 1 -- 172.21.15.47:0/2682491085 shutdown_connections 2024-04-14T23:34:56.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.924+0000 7f944f5fa640 1 -- 172.21.15.47:0/2682491085 >> 172.21.15.47:0/2682491085 conn(0x7f944806b200 msgr2=0x7f944806b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:56.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.924+0000 7f944f5fa640 1 -- 172.21.15.47:0/2682491085 shutdown_connections 2024-04-14T23:34:56.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.924+0000 7f944f5fa640 1 -- 172.21.15.47:0/2682491085 wait complete. 2024-04-14T23:34:56.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.925+0000 7f944f5fa640 1 Processor -- start 2024-04-14T23:34:56.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.925+0000 7f944f5fa640 1 -- start start 2024-04-14T23:34:56.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944f5fa640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94300039b0 0x7f944814e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944f5fa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94481e53e0 0x7f94481e5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944f5fa640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f944814fd40 0x7f94481501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944f5fa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f944815bf80 con 0x7f94481e53e0 2024-04-14T23:34:56.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944f5fa640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f944815f890 con 0x7f944814fd40 2024-04-14T23:34:56.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944f5fa640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f944815c100 con 0x7f94300039b0 2024-04-14T23:34:56.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944cb95640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94481e53e0 0x7f94481e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944cb95640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94481e53e0 0x7f94481e5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35930/0 (socket says 172.21.15.47:35930) 2024-04-14T23:34:56.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944cb95640 1 -- 172.21.15.47:0/22926634 learned_addr learned my addr 172.21.15.47:0/22926634 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:56.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944d396640 1 --2- 172.21.15.47:0/22926634 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94300039b0 0x7f944814e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944db97640 1 --2- 172.21.15.47:0/22926634 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f944814fd40 0x7f94481501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944cb95640 1 -- 172.21.15.47:0/22926634 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94300039b0 msgr2=0x7f944814e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944cb95640 1 --2- 172.21.15.47:0/22926634 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94300039b0 0x7f944814e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944cb95640 1 -- 172.21.15.47:0/22926634 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f944814fd40 msgr2=0x7f94481501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:56.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944cb95640 1 --2- 172.21.15.47:0/22926634 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f944814fd40 0x7f94481501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:56.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944cb95640 1 -- 172.21.15.47:0/22926634 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944814efa0 con 0x7f94481e53e0 2024-04-14T23:34:56.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944d396640 1 --2- 172.21.15.47:0/22926634 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94300039b0 0x7f944814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:56.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944db97640 1 --2- 172.21.15.47:0/22926634 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f944814fd40 0x7f94481501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:56.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944cb95640 1 --2- 172.21.15.47:0/22926634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94481e53e0 0x7f94481e5860 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f943c0109d0 tx=0x7f943c010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:56.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f9445ffb640 1 -- 172.21.15.47:0/22926634 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c00f040 con 0x7f94481e53e0 2024-04-14T23:34:56.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f9445ffb640 1 -- 172.21.15.47:0/22926634 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f943c00ec80 con 0x7f94481e53e0 2024-04-14T23:34:56.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f944f5fa640 1 -- 172.21.15.47:0/22926634 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9448151b40 con 0x7f94481e53e0 2024-04-14T23:34:56.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.926+0000 7f9445ffb640 1 -- 172.21.15.47:0/22926634 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c01c400 con 0x7f94481e53e0 2024-04-14T23:34:56.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.927+0000 7f944f5fa640 1 -- 172.21.15.47:0/22926634 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944814f540 con 0x7f94481e53e0 2024-04-14T23:34:56.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.928+0000 7f944f5fa640 1 -- 172.21.15.47:0/22926634 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9448075430 con 0x7f94481e53e0 2024-04-14T23:34:56.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.928+0000 7f9445ffb640 1 -- 172.21.15.47:0/22926634 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f943c01c5a0 con 0x7f94481e53e0 2024-04-14T23:34:56.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.928+0000 7f9445ffb640 1 --2- 172.21.15.47:0/22926634 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f943406b990 0x7f943406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:56.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.929+0000 7f9445ffb640 1 -- 172.21.15.47:0/22926634 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f943c08b240 con 0x7f94481e53e0 2024-04-14T23:34:56.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.929+0000 7f944d396640 1 --2- 172.21.15.47:0/22926634 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f943406b990 0x7f943406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:56.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.929+0000 7f944d396640 1 --2- 172.21.15.47:0/22926634 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f943406b990 0x7f943406de50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9440034000 tx=0x7f9440007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:56.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:56.933+0000 7f9445ffb640 1 -- 172.21.15.47:0/22926634 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f943c018030 con 0x7f94481e53e0 2024-04-14T23:34:57.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.113+0000 7f944f5fa640 1 -- 172.21.15.47:0/22926634 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9448158de0 con 0x7f94481e53e0 2024-04-14T23:34:57.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.115+0000 7f9445ffb640 1 -- 172.21.15.47:0/22926634 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7f943c082e20 con 0x7f94481e53e0 2024-04-14T23:34:57.118 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:34:57.118 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:44.714882+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:34:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.116+0000 7f944f5fa640 1 -- 172.21.15.47:0/22926634 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f943406b990 msgr2=0x7f943406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.116+0000 7f944f5fa640 1 --2- 172.21.15.47:0/22926634 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f943406b990 0x7f943406de50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9440034000 tx=0x7f9440007000 comp rx=0 tx=0).stop 2024-04-14T23:34:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.116+0000 7f944f5fa640 1 -- 172.21.15.47:0/22926634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94481e53e0 msgr2=0x7f94481e5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.116+0000 7f944f5fa640 1 --2- 172.21.15.47:0/22926634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94481e53e0 0x7f94481e5860 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f943c0109d0 tx=0x7f943c010e90 comp rx=0 tx=0).stop 2024-04-14T23:34:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.116+0000 7f944f5fa640 1 -- 172.21.15.47:0/22926634 shutdown_connections 2024-04-14T23:34:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.116+0000 7f944f5fa640 1 --2- 172.21.15.47:0/22926634 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f943406b990 0x7f943406de50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.116+0000 7f944f5fa640 1 --2- 172.21.15.47:0/22926634 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f944814fd40 0x7f94481501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.116+0000 7f944f5fa640 1 --2- 172.21.15.47:0/22926634 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94481e53e0 0x7f94481e5860 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.116+0000 7f944f5fa640 1 --2- 172.21.15.47:0/22926634 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94300039b0 0x7f944814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.116+0000 7f944f5fa640 1 -- 172.21.15.47:0/22926634 >> 172.21.15.47:0/22926634 conn(0x7f944806b200 msgr2=0x7f944815cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.117+0000 7f944f5fa640 1 -- 172.21.15.47:0/22926634 shutdown_connections 2024-04-14T23:34:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.117+0000 7f944f5fa640 1 -- 172.21.15.47:0/22926634 wait complete. 2024-04-14T23:34:57.131 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-14T23:34:57.132 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-14T23:34:57.132 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-14T23:34:57.132 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-14T23:34:57.133 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-14T23:34:57.133 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-14T23:34:57.133 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-14T23:34:57.134 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-14T23:34:57.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.304+0000 7f838b5bb640 1 Processor -- start 2024-04-14T23:34:57.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.304+0000 7f838b5bb640 1 -- start start 2024-04-14T23:34:57.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.305+0000 7f7b8edaa640 1 Processor -- start 2024-04-14T23:34:57.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.305+0000 7f7b8edaa640 1 -- start start 2024-04-14T23:34:57.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.305+0000 7fa1b2176640 1 Processor -- start 2024-04-14T23:34:57.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.305+0000 7fa1b2176640 1 -- start start 2024-04-14T23:34:57.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.306+0000 7f838b5bb640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f83841625b0 0x7f83840ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.306+0000 7f838b5bb640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83840b47f0 con 0x7f8384071f10 2024-04-14T23:34:57.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.306+0000 7f838b5bb640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83840b4a60 con 0x7f838415df30 2024-04-14T23:34:57.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.306+0000 7f838b5bb640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f83840b4d40 con 0x7f83841625b0 2024-04-14T23:34:57.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.306+0000 7f8388b56640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f83841625b0 0x7f83840ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.306+0000 7f8388b56640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f83841625b0 0x7f83840ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35942/0 (socket says 172.21.15.47:35942) 2024-04-14T23:34:57.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.306+0000 7f8389b58640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8384071f10 0x7f838406dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55674/0 (socket says 172.21.15.47:55674) 2024-04-14T23:34:57.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.306+0000 7f8389b58640 1 -- 172.21.15.47:0/1664281176 learned_addr learned my addr 172.21.15.47:0/1664281176 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:57.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.306+0000 7f7b8edaa640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7b8815d630 0x7f7b88140e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.306+0000 7f7b8edaa640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b88071ef0 0x7f7b8806d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.306+0000 7f7b8edaa640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b88141360 con 0x7f7b88072350 2024-04-14T23:34:57.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.306+0000 7f7b8edaa640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f7b8815da10 con 0x7f7b8815d630 2024-04-14T23:34:57.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.306+0000 7f7b8edaa640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7b88072860 con 0x7f7b88071ef0 2024-04-14T23:34:57.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7fa1b2176640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa1a4050190 0x7fa1a4038070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7fa1b2176640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa1a4053c60 0x7fa1a4006a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7fa1b2176640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1a40544b0 con 0x7fa1a40df210 2024-04-14T23:34:57.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7fa1b2176640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa1a40541d0 con 0x7fa1a4050190 2024-04-14T23:34:57.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7fa1b2176640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fa1a4005f20 con 0x7fa1a4053c60 2024-04-14T23:34:57.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7f8388b56640 1 -- 172.21.15.47:0/1664281176 >> v1:172.21.15.191:6789/0 conn(0x7f838415df30 legacy=0x7f8384071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7f8388b56640 1 -- 172.21.15.47:0/1664281176 >> v1:172.21.15.47:6789/0 conn(0x7f8384071f10 legacy=0x7f838406dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7f8388b56640 1 -- 172.21.15.47:0/1664281176 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838406d6a0 con 0x7f83841625b0 2024-04-14T23:34:57.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7fa1b0973640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa1a4050190 0x7fa1a4038070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7fa1b0973640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa1a4050190 0x7fa1a4038070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35946/0 (socket says 172.21.15.47:35946) 2024-04-14T23:34:57.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7fa1b0973640 1 -- 172.21.15.47:0/556908249 learned_addr learned my addr 172.21.15.47:0/556908249 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7fa1b1975640 1 --2- 172.21.15.47:0/556908249 >> v2:172.21.15.191:3300/0 conn(0x7fa1a4053c60 0x7fa1a4006a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7f7b8d347640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f7b88072350 0x7f7b880b3e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.47:42320/0 (socket says 172.21.15.47:42320) 2024-04-14T23:34:57.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7f7b8d347640 1 -- 172.21.15.47:0/3879020978 learned_addr learned my addr 172.21.15.47:0/3879020978 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:57.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7fa1b0973640 1 -- 172.21.15.47:0/556908249 >> v2:172.21.15.191:3300/0 conn(0x7fa1a4053c60 msgr2=0x7fa1a4006a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7f7b87fff640 1 --2- 172.21.15.47:0/3879020978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b88071ef0 0x7f7b8806d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7fa1b0973640 1 --2- 172.21.15.47:0/556908249 >> v2:172.21.15.191:3300/0 conn(0x7fa1a4053c60 0x7fa1a4006a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7f7b8cb46640 1 --2- 172.21.15.47:0/3879020978 >> v2:172.21.15.191:3300/0 conn(0x7f7b8815d630 0x7f7b88140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.308+0000 7f026cfd8640 1 Processor -- start 2024-04-14T23:34:57.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.308+0000 7f026cfd8640 1 -- start start 2024-04-14T23:34:57.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7fa1b0973640 1 -- 172.21.15.47:0/556908249 >> v1:172.21.15.191:6789/0 conn(0x7fa1a40df210 legacy=0x7fa1a404fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7fa1b0973640 1 -- 172.21.15.47:0/556908249 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a4006200 con 0x7fa1a4050190 2024-04-14T23:34:57.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.307+0000 7fa1b1975640 1 --2- 172.21.15.47:0/556908249 >> v2:172.21.15.191:3300/0 conn(0x7fa1a4053c60 0x7fa1a4006a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:57.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.308+0000 7f8388b56640 1 --2- 172.21.15.47:0/1664281176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83841625b0 0x7f83840ad8a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f83840b4ec0 tx=0x7f837c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c0f32b9c38e762 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.309+0000 7f837bfff640 1 -- 172.21.15.47:0/1664281176 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c039070 con 0x7f83841625b0 2024-04-14T23:34:57.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.309+0000 7f837bfff640 1 -- 172.21.15.47:0/1664281176 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f837c02cc60 con 0x7f83841625b0 2024-04-14T23:34:57.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.309+0000 7f837bfff640 1 -- 172.21.15.47:0/1664281176 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c039070 con 0x7f83841625b0 2024-04-14T23:34:57.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.308+0000 7f7b877fe640 1 -- 172.21.15.47:0/3879020978 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3702644494 0 0) 0x7f7b88141360 con 0x7f7b88072350 2024-04-14T23:34:57.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.308+0000 7f7b877fe640 1 -- 172.21.15.47:0/3879020978 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b70003520 con 0x7f7b88072350 2024-04-14T23:34:57.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.308+0000 7f7b87fff640 1 -- 172.21.15.47:0/3879020978 >> v2:172.21.15.191:3300/0 conn(0x7f7b8815d630 msgr2=0x7f7b88140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.308+0000 7f7b87fff640 1 --2- 172.21.15.47:0/3879020978 >> v2:172.21.15.191:3300/0 conn(0x7f7b8815d630 0x7f7b88140e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.308+0000 7f7b87fff640 1 -- 172.21.15.47:0/3879020978 >> v1:172.21.15.191:6789/0 conn(0x7f7b88072350 legacy=0x7f7b880b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.308+0000 7f7b87fff640 1 -- 172.21.15.47:0/3879020978 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b880b3050 con 0x7f7b88071ef0 2024-04-14T23:34:57.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.309+0000 7f7b87fff640 1 --2- 172.21.15.47:0/3879020978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b88071ef0 0x7f7b8806d720 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7b780097a0 tx=0x7f7b7802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e81ebe93d46c515e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.309+0000 7fa1b0973640 1 --2- 172.21.15.47:0/556908249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1a4050190 0x7fa1a4038070 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac075040 tx=0x7fa1ac0ab300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2d56e7ac96a754 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f026cfd8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f026806f120 0x7f02681606b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f838b5bb640 1 -- 172.21.15.47:0/1664281176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83841625b0 msgr2=0x7f83840ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f838b5bb640 1 --2- 172.21.15.47:0/1664281176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83841625b0 0x7f83840ad8a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f83840b4ec0 tx=0x7f837c02beb0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7fa1a3fff640 1 -- 172.21.15.47:0/556908249 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac0b3440 con 0x7fa1a4050190 2024-04-14T23:34:57.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7fa1a3fff640 1 -- 172.21.15.47:0/556908249 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1ac0b35e0 con 0x7fa1a4050190 2024-04-14T23:34:57.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f7b877fe640 1 -- 172.21.15.47:0/3879020978 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b780315a0 con 0x7f7b88071ef0 2024-04-14T23:34:57.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f838b5bb640 1 -- 172.21.15.47:0/1664281176 shutdown_connections 2024-04-14T23:34:57.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f838b5bb640 1 --2- 172.21.15.47:0/1664281176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83841625b0 0x7f83840ad8a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f838b5bb640 1 -- 172.21.15.47:0/1664281176 >> 172.21.15.47:0/1664281176 conn(0x7f83840b1770 msgr2=0x7f83840b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7fa1a3fff640 1 -- 172.21.15.47:0/556908249 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac0b3a50 con 0x7fa1a4050190 2024-04-14T23:34:57.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f026cfd8640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02680cb5c0 con 0x7f026806b910 2024-04-14T23:34:57.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f026cfd8640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f026806f600 con 0x7f026815c0e0 2024-04-14T23:34:57.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f026cfd8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f026806f8e0 con 0x7f026806f120 2024-04-14T23:34:57.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f7b877fe640 1 -- 172.21.15.47:0/3879020978 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b78037070 con 0x7f7b88071ef0 2024-04-14T23:34:57.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f7b877fe640 1 -- 172.21.15.47:0/3879020978 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b780319a0 con 0x7f7b88071ef0 2024-04-14T23:34:57.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f838b5bb640 1 -- 172.21.15.47:0/1664281176 shutdown_connections 2024-04-14T23:34:57.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.311+0000 7f7b8edaa640 1 -- 172.21.15.47:0/3879020978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b88071ef0 msgr2=0x7f7b8806d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.311+0000 7fa1b2176640 1 -- 172.21.15.47:0/556908249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1a4050190 msgr2=0x7fa1a4038070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.311+0000 7fa1b2176640 1 --2- 172.21.15.47:0/556908249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1a4050190 0x7fa1a4038070 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac075040 tx=0x7fa1ac0ab300 comp rx=0 tx=0).stop 2024-04-14T23:34:57.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.311+0000 7fa1b2176640 1 -- 172.21.15.47:0/556908249 shutdown_connections 2024-04-14T23:34:57.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.311+0000 7fa1b2176640 1 --2- 172.21.15.47:0/556908249 >> v2:172.21.15.191:3300/0 conn(0x7fa1a4053c60 0x7fa1a4006a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.311+0000 7fa1b2176640 1 --2- 172.21.15.47:0/556908249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1a4050190 0x7fa1a4038070 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.311+0000 7fa1b2176640 1 -- 172.21.15.47:0/556908249 >> 172.21.15.47:0/556908249 conn(0x7fa1a4009fa0 msgr2=0x7fa1a400a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.311+0000 7fa1b2176640 1 -- 172.21.15.47:0/556908249 shutdown_connections 2024-04-14T23:34:57.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.311+0000 7fa1b2176640 1 -- 172.21.15.47:0/556908249 wait complete. 2024-04-14T23:34:57.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.311+0000 7f7b8edaa640 1 --2- 172.21.15.47:0/3879020978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b88071ef0 0x7f7b8806d720 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7b780097a0 tx=0x7f7b7802b840 comp rx=0 tx=0).stop 2024-04-14T23:34:57.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.312+0000 7f7b8edaa640 1 -- 172.21.15.47:0/3879020978 shutdown_connections 2024-04-14T23:34:57.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.312+0000 7f7b8edaa640 1 --2- 172.21.15.47:0/3879020978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b88071ef0 0x7f7b8806d720 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.312+0000 7f7b8edaa640 1 --2- 172.21.15.47:0/3879020978 >> v2:172.21.15.191:3300/0 conn(0x7f7b8815d630 0x7f7b88140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.312+0000 7f7b8edaa640 1 -- 172.21.15.47:0/3879020978 >> 172.21.15.47:0/3879020978 conn(0x7f7b880b1770 msgr2=0x7f7b880b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f838b5bb640 1 -- 172.21.15.47:0/1664281176 wait complete. 2024-04-14T23:34:57.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.312+0000 7f838b5bb640 1 Processor -- start 2024-04-14T23:34:57.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.312+0000 7fe06d6d5640 1 Processor -- start 2024-04-14T23:34:57.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.312+0000 7fe06d6d5640 1 -- start start 2024-04-14T23:34:57.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.312+0000 7f7b8edaa640 1 -- 172.21.15.47:0/3879020978 shutdown_connections 2024-04-14T23:34:57.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.312+0000 7f7b8edaa640 1 -- 172.21.15.47:0/3879020978 wait complete. 2024-04-14T23:34:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f0266d9d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f026806f120 0x7f02681606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f0266d9d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f026806f120 0x7f02681606b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58140/0 (socket says 172.21.15.47:58140) 2024-04-14T23:34:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.310+0000 7f0266d9d640 1 -- 172.21.15.47:0/3663813920 learned_addr learned my addr 172.21.15.47:0/3663813920 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.311+0000 7f026559a640 1 -- 172.21.15.47:0/3663813920 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529534883 0 0) 0x7f026806f600 con 0x7f026815c0e0 2024-04-14T23:34:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.311+0000 7f026559a640 1 -- 172.21.15.47:0/3663813920 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0250003520 con 0x7f026815c0e0 2024-04-14T23:34:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.311+0000 7f0266d9d640 1 -- 172.21.15.47:0/3663813920 >> v1:172.21.15.191:6789/0 conn(0x7f026815c0e0 legacy=0x7f026806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.311+0000 7f0266d9d640 1 -- 172.21.15.47:0/3663813920 >> v1:172.21.15.47:6789/0 conn(0x7f026806b910 legacy=0x7f026806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.311+0000 7f0266d9d640 1 -- 172.21.15.47:0/3663813920 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026806fbc0 con 0x7f026806f120 2024-04-14T23:34:57.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.313+0000 7f0266d9d640 1 --2- 172.21.15.47:0/3663813920 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f026806f120 0x7f02681606b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f025c0098a0 tx=0x7f025c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1549d3f36ecd3660 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.313+0000 7fa1b2176640 1 Processor -- start 2024-04-14T23:34:57.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.313+0000 7f026559a640 1 -- 172.21.15.47:0/3663813920 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c034070 con 0x7f026806f120 2024-04-14T23:34:57.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.313+0000 7fa1b2176640 1 -- start start 2024-04-14T23:34:57.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.312+0000 7f838b5bb640 1 -- start start 2024-04-14T23:34:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.313+0000 7fe06d6d5640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe0680b2a70 0x7fe068070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.313+0000 7fe06d6d5640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe068071210 0x7fe06815a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.313+0000 7fe06d6d5640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe06813d8a0 con 0x7fe06806edc0 2024-04-14T23:34:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.313+0000 7fe06d6d5640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fe06813d650 con 0x7fe0680b2a70 2024-04-14T23:34:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.313+0000 7fe06d6d5640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe06813db80 con 0x7fe068071210 2024-04-14T23:34:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.314+0000 7fe0667fc640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe0680b2a70 0x7fe068070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.314+0000 7fe0667fc640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe0680b2a70 0x7fe068070cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:35452/0 (socket says 172.21.15.47:35452) 2024-04-14T23:34:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.314+0000 7fe0667fc640 1 -- 172.21.15.47:0/4012278010 learned_addr learned my addr 172.21.15.47:0/4012278010 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.313+0000 7f026559a640 1 -- 172.21.15.47:0/3663813920 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f025c030840 con 0x7f026806f120 2024-04-14T23:34:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.314+0000 7fe0677fe640 1 --2- 172.21.15.47:0/4012278010 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe068071210 0x7fe06815a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.313+0000 7f026559a640 1 -- 172.21.15.47:0/3663813920 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c030bf0 con 0x7f026806f120 2024-04-14T23:34:57.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.314+0000 7fe0667fc640 1 -- 172.21.15.47:0/4012278010 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe068071210 msgr2=0x7fe06815a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.314+0000 7f026cfd8640 1 -- 172.21.15.47:0/3663813920 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f026806f120 msgr2=0x7f02681606b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.314+0000 7f026cfd8640 1 --2- 172.21.15.47:0/3663813920 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f026806f120 0x7f02681606b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f025c0098a0 tx=0x7f025c02b980 comp rx=0 tx=0).stop 2024-04-14T23:34:57.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.314+0000 7fa1b2176640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4050190 0x7fa1a40e20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.314+0000 7f7b8edaa640 1 Processor -- start 2024-04-14T23:34:57.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.314+0000 7fe0667fc640 1 --2- 172.21.15.47:0/4012278010 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe068071210 0x7fe06815a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7f7b8edaa640 1 -- start start 2024-04-14T23:34:57.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7f026cfd8640 1 -- 172.21.15.47:0/3663813920 shutdown_connections 2024-04-14T23:34:57.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7f026cfd8640 1 --2- 172.21.15.47:0/3663813920 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f026806f120 0x7f02681606b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7f026cfd8640 1 -- 172.21.15.47:0/3663813920 >> 172.21.15.47:0/3663813920 conn(0x7f02680d0c20 msgr2=0x7f02680d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7fa1b2176640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1a4053c60 0x7fa1a40d1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.313+0000 7f838b5bb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8384071f10 0x7f83840cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.313+0000 7f838b5bb640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f838415df30 0x7f838414a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.313+0000 7f838b5bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83840b11a0 0x7f838415c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7fa1b1174640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4050190 0x7fa1a40e20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7fa1b1174640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4050190 0x7fa1a40e20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58168/0 (socket says 172.21.15.47:58168) 2024-04-14T23:34:57.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7fa1b1174640 1 -- 172.21.15.47:0/3402981970 learned_addr learned my addr 172.21.15.47:0/3402981970 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7fa1b0973640 1 --2- 172.21.15.47:0/3402981970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1a4053c60 0x7fa1a40d1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7fa1b2176640 1 --2- 172.21.15.47:0/3402981970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1a40df210 0x7fa1a40d4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7f838b5bb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f838415e310 con 0x7f83840b11a0 2024-04-14T23:34:57.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7f838b5bb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f838406f550 con 0x7f8384071f10 2024-04-14T23:34:57.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7f838b5bb640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f838406f1b0 con 0x7f838415df30 2024-04-14T23:34:57.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7fa1b2176640 1 -- 172.21.15.47:0/3402981970 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a4037a80 con 0x7fa1a4053c60 2024-04-14T23:34:57.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7f8388b56640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f838415df30 0x7f838414a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7fa1b1975640 1 --2- 172.21.15.47:0/3402981970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1a40df210 0x7fa1a40d4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7f8389b58640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83840b11a0 0x7f838415c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7f8389357640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8384071f10 0x7f83840cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.314+0000 7fe0667fc640 1 -- 172.21.15.47:0/4012278010 >> v1:172.21.15.47:6789/0 conn(0x7fe06806edc0 legacy=0x7fe06813ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.314+0000 7fe0667fc640 1 -- 172.21.15.47:0/4012278010 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06813de60 con 0x7fe0680b2a70 2024-04-14T23:34:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7fa1b2176640 1 -- 172.21.15.47:0/3402981970 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a4037900 con 0x7fa1a40df210 2024-04-14T23:34:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7f026cfd8640 1 -- 172.21.15.47:0/3663813920 shutdown_connections 2024-04-14T23:34:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7f8389357640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8384071f10 0x7f83840cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:35456/0 (socket says 172.21.15.47:35456) 2024-04-14T23:34:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7f8389357640 1 -- 172.21.15.47:0/2897087968 learned_addr learned my addr 172.21.15.47:0/2897087968 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.315+0000 7f8389b58640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83840b11a0 0x7f838415c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35948/0 (socket says 172.21.15.47:35948) 2024-04-14T23:34:57.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.316+0000 7fa1b2176640 1 -- 172.21.15.47:0/3402981970 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa1a40df5f0 con 0x7fa1a4050190 2024-04-14T23:34:57.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.316+0000 7fe0667fc640 1 --2- 172.21.15.47:0/4012278010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0680b2a70 0x7fe068070cd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009870 tx=0x7fe05c02ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=637b43cbd554699c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.316+0000 7f026cfd8640 1 -- 172.21.15.47:0/3663813920 wait complete. 2024-04-14T23:34:57.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.316+0000 7f8389357640 1 -- 172.21.15.47:0/2897087968 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f838415df30 msgr2=0x7f838414a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.316+0000 7f8389357640 1 --2- 172.21.15.47:0/2897087968 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f838415df30 0x7f838414a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.316+0000 7f7b8edaa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b88071ef0 0x7f7b881f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.316+0000 7f8389357640 1 -- 172.21.15.47:0/2897087968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83840b11a0 msgr2=0x7f838415c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.316+0000 7f8389357640 1 --2- 172.21.15.47:0/2897087968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83840b11a0 0x7f838415c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.316+0000 7f7b8edaa640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b88072350 0x7f7b88156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.316+0000 7f8389357640 1 -- 172.21.15.47:0/2897087968 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83840ce500 con 0x7f8384071f10 2024-04-14T23:34:57.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.316+0000 7fe065ffb640 1 -- 172.21.15.47:0/4012278010 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c02f850 con 0x7fe0680b2a70 2024-04-14T23:34:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.316+0000 7fe065ffb640 1 -- 172.21.15.47:0/4012278010 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe05c02f9f0 con 0x7fe0680b2a70 2024-04-14T23:34:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.316+0000 7fe065ffb640 1 -- 172.21.15.47:0/4012278010 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c02fe00 con 0x7fe0680b2a70 2024-04-14T23:34:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.316+0000 7fa1b1174640 1 -- 172.21.15.47:0/3402981970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1a40df210 msgr2=0x7fa1a40d4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.316+0000 7f7b8edaa640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b8815d630 0x7f7b880b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.316+0000 7fa1b1174640 1 --2- 172.21.15.47:0/3402981970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1a40df210 0x7fa1a40d4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7fa1b1174640 1 -- 172.21.15.47:0/3402981970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1a4053c60 msgr2=0x7fa1a40d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f7b8cb46640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b88071ef0 0x7f7b881f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f7b8edaa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7b880b38f0 con 0x7f7b88071ef0 2024-04-14T23:34:57.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f7b8edaa640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7b880b3610 con 0x7f7b88072350 2024-04-14T23:34:57.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f7b8edaa640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7b88072da0 con 0x7f7b8815d630 2024-04-14T23:34:57.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f7b8cb46640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b88071ef0 0x7f7b881f2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35972/0 (socket says 172.21.15.47:35972) 2024-04-14T23:34:57.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f7b8cb46640 1 -- 172.21.15.47:0/1275059066 learned_addr learned my addr 172.21.15.47:0/1275059066 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f7b87fff640 1 --2- 172.21.15.47:0/1275059066 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b88072350 0x7f7b88156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f8389b58640 1 --2- 172.21.15.47:0/2897087968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83840b11a0 0x7f838415c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:57.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f8388b56640 1 --2- 172.21.15.47:0/2897087968 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f838415df30 0x7f838414a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:57.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f8389357640 1 --2- 172.21.15.47:0/2897087968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8384071f10 0x7f83840cd1f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f837400c440 tx=0x7f837400c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7fa1b1174640 1 --2- 172.21.15.47:0/3402981970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1a4053c60 0x7fa1a40d1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f7b8d347640 1 --2- 172.21.15.47:0/1275059066 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b8815d630 0x7f7b880b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f7b8d347640 1 -- 172.21.15.47:0/1275059066 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b88072350 msgr2=0x7f7b88156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f7b8d347640 1 --2- 172.21.15.47:0/1275059066 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b88072350 0x7f7b88156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f7b8d347640 1 -- 172.21.15.47:0/1275059066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b88071ef0 msgr2=0x7f7b881f2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f7b8d347640 1 --2- 172.21.15.47:0/1275059066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b88071ef0 0x7f7b881f2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f7b8d347640 1 -- 172.21.15.47:0/1275059066 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b881f35c0 con 0x7f7b8815d630 2024-04-14T23:34:57.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f7b8cb46640 1 --2- 172.21.15.47:0/1275059066 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b88071ef0 0x7f7b881f2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:57.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7fa1b1174640 1 -- 172.21.15.47:0/3402981970 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a404bf60 con 0x7fa1a4050190 2024-04-14T23:34:57.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7fa1b0973640 1 --2- 172.21.15.47:0/3402981970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1a4053c60 0x7fa1a40d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:57.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f8379ffb640 1 -- 172.21.15.47:0/2897087968 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8374017070 con 0x7f8384071f10 2024-04-14T23:34:57.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f838b5bb640 1 -- 172.21.15.47:0/2897087968 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83840cd8f0 con 0x7f8384071f10 2024-04-14T23:34:57.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7fa1b1174640 1 --2- 172.21.15.47:0/3402981970 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4050190 0x7fa1a40e20f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800b3f0 tx=0x7fa1a800b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7fb8fe036640 1 Processor -- start 2024-04-14T23:34:57.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7fb8fe036640 1 -- start start 2024-04-14T23:34:57.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7f7b8d347640 1 --2- 172.21.15.47:0/1275059066 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b8815d630 0x7f7b880b42d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7b80001900 tx=0x7f7b80001dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7f026cfd8640 1 Processor -- start 2024-04-14T23:34:57.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7f026cfd8640 1 -- start start 2024-04-14T23:34:57.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.317+0000 7f838b5bb640 1 -- 172.21.15.47:0/2897087968 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83840cdeb0 con 0x7f8384071f10 2024-04-14T23:34:57.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7f8379ffb640 1 -- 172.21.15.47:0/2897087968 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83740035f0 con 0x7f8384071f10 2024-04-14T23:34:57.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7f8379ffb640 1 -- 172.21.15.47:0/2897087968 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83740039e0 con 0x7f8384071f10 2024-04-14T23:34:57.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7fe06d6d5640 1 -- 172.21.15.47:0/4012278010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0680b2a70 msgr2=0x7fe068070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7fe06d6d5640 1 --2- 172.21.15.47:0/4012278010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0680b2a70 0x7fe068070cd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009870 tx=0x7fe05c02ba30 comp rx=0 tx=0).stop 2024-04-14T23:34:57.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7fe06d6d5640 1 -- 172.21.15.47:0/4012278010 shutdown_connections 2024-04-14T23:34:57.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7fe06d6d5640 1 --2- 172.21.15.47:0/4012278010 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe068071210 0x7fe06815a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7fe06d6d5640 1 --2- 172.21.15.47:0/4012278010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0680b2a70 0x7fe068070cd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7fe06d6d5640 1 -- 172.21.15.47:0/4012278010 >> 172.21.15.47:0/4012278010 conn(0x7fe06806b200 msgr2=0x7fe06806b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7fa1a1ffb640 1 -- 172.21.15.47:0/3402981970 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8015020 con 0x7fa1a4050190 2024-04-14T23:34:57.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7f7b857fa640 1 -- 172.21.15.47:0/1275059066 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80018070 con 0x7f7b8815d630 2024-04-14T23:34:57.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7f7b857fa640 1 -- 172.21.15.47:0/1275059066 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b800082d0 con 0x7f7b8815d630 2024-04-14T23:34:57.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7f7b8edaa640 1 -- 172.21.15.47:0/1275059066 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b881f38a0 con 0x7f7b8815d630 2024-04-14T23:34:57.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.319+0000 7f7b8edaa640 1 -- 172.21.15.47:0/1275059066 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b880a9b20 con 0x7f7b8815d630 2024-04-14T23:34:57.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7fe06d6d5640 1 -- 172.21.15.47:0/4012278010 shutdown_connections 2024-04-14T23:34:57.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.318+0000 7fe06d6d5640 1 -- 172.21.15.47:0/4012278010 wait complete. 2024-04-14T23:34:57.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.319+0000 7fa1a1ffb640 1 -- 172.21.15.47:0/3402981970 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a8011830 con 0x7fa1a4050190 2024-04-14T23:34:57.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.319+0000 7f026cfd8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f026806b910 0x7f026806e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.319+0000 7f026cfd8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f026815c0e0 0x7f0268153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.319+0000 7fb8fe036640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb8f806cce0 0x7fb8f80cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.319+0000 7fb8fe036640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8f80cf8f0 0x7fb8f80727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.319+0000 7fb8fe036640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f815e200 con 0x7fb8f8073f50 2024-04-14T23:34:57.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.319+0000 7fb8fe036640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb8f815eb30 con 0x7fb8f806cce0 2024-04-14T23:34:57.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.319+0000 7fb8fe036640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f815e4e0 con 0x7fb8f80cf8f0 2024-04-14T23:34:57.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.319+0000 7f026cfd8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02681540c0 0x7f02680c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.319+0000 7fb8f7fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8f80cf8f0 0x7fb8f80727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.319+0000 7fb8f7fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8f80cf8f0 0x7fb8f80727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58184/0 (socket says 172.21.15.47:58184) 2024-04-14T23:34:57.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.319+0000 7fb8f7fff640 1 -- 172.21.15.47:0/32432571 learned_addr learned my addr 172.21.15.47:0/32432571 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7fb8f7fff640 1 -- 172.21.15.47:0/32432571 >> v2:172.21.15.47:3300/0 conn(0x7fb8f806cce0 msgr2=0x7fb8f80cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7fe06d6d5640 1 Processor -- start 2024-04-14T23:34:57.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7fa1a1ffb640 1 -- 172.21.15.47:0/3402981970 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8011c20 con 0x7fa1a4050190 2024-04-14T23:34:57.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7fa1b2176640 1 -- 172.21.15.47:0/3402981970 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a404c240 con 0x7fa1a4050190 2024-04-14T23:34:57.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7fb8f6ffd640 1 --2- 172.21.15.47:0/32432571 >> v2:172.21.15.47:3300/0 conn(0x7fb8f806cce0 0x7fb8f80cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7fe06d6d5640 1 -- start start 2024-04-14T23:34:57.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7fa1b2176640 1 -- 172.21.15.47:0/3402981970 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a404c800 con 0x7fa1a4050190 2024-04-14T23:34:57.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7f0266d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02681540c0 0x7f02680c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7f7b857fa640 1 -- 172.21.15.47:0/1275059066 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8000d900 con 0x7f7b8815d630 2024-04-14T23:34:57.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7f838b5bb640 1 -- 172.21.15.47:0/2897087968 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8364001030 con 0x7f8384071f10 2024-04-14T23:34:57.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7f026cfd8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0268160190 con 0x7f02681540c0 2024-04-14T23:34:57.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7f0265d9b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f026815c0e0 0x7f0268153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7f0265d9b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f026815c0e0 0x7f0268153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58186/0 (socket says 172.21.15.47:58186) 2024-04-14T23:34:57.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.321+0000 7f7b6effd640 1 -- 172.21.15.47:0/1275059066 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b881f3dc0 con 0x7f7b8815d630 2024-04-14T23:34:57.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7f0265d9b640 1 -- 172.21.15.47:0/3091098961 learned_addr learned my addr 172.21.15.47:0/3091098961 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.321+0000 7f026cfd8640 1 -- 172.21.15.47:0/3091098961 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f026815feb0 con 0x7f026806b910 2024-04-14T23:34:57.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.321+0000 7f026cfd8640 1 -- 172.21.15.47:0/3091098961 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f02680d1740 con 0x7f026815c0e0 2024-04-14T23:34:57.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.321+0000 7fe06d6d5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe06806edc0 0x7fe068169090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.321+0000 7fe06d6d5640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe068071210 0x7fe068167270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.321+0000 7fe06d6d5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0680b2a70 0x7fe0680b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.321+0000 7fe06d6d5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe06815b020 con 0x7fe0680b2a70 2024-04-14T23:34:57.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.321+0000 7fe06d6d5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe06815aea0 con 0x7fe06806edc0 2024-04-14T23:34:57.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.321+0000 7fe06d6d5640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe06815b1a0 con 0x7fe068071210 2024-04-14T23:34:57.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7fb8f7fff640 1 --2- 172.21.15.47:0/32432571 >> v2:172.21.15.47:3300/0 conn(0x7fb8f806cce0 0x7fb8f80cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7fb8f7fff640 1 -- 172.21.15.47:0/32432571 >> v1:172.21.15.47:6789/0 conn(0x7fb8f8073f50 legacy=0x7fb8f80d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.320+0000 7fb8f7fff640 1 -- 172.21.15.47:0/32432571 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f815e7c0 con 0x7fb8f80cf8f0 2024-04-14T23:34:57.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.321+0000 7fb8f6ffd640 1 --2- 172.21.15.47:0/32432571 >> v2:172.21.15.47:3300/0 conn(0x7fb8f806cce0 0x7fb8f80cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:57.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.321+0000 7f026659c640 1 --2- 172.21.15.47:0/3091098961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f026806b910 0x7f026806e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.321+0000 7fe0667fc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe068071210 0x7fe068167270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.321+0000 7fe0667fc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe068071210 0x7fe068167270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58196/0 (socket says 172.21.15.47:58196) 2024-04-14T23:34:57.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.321+0000 7fe0667fc640 1 -- 172.21.15.47:0/3134629195 learned_addr learned my addr 172.21.15.47:0/3134629195 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7fe0677fe640 1 --2- 172.21.15.47:0/3134629195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0680b2a70 0x7fe0680b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7f7b857fa640 1 -- 172.21.15.47:0/1275059066 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f7b8001b070 con 0x7f7b8815d630 2024-04-14T23:34:57.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7fa1b2176640 1 -- 172.21.15.47:0/3402981970 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa1a404ca40 con 0x7fa1a4050190 2024-04-14T23:34:57.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7fe0667fc640 1 -- 172.21.15.47:0/3134629195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe06806edc0 msgr2=0x7fe068169090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-14T23:34:57.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7fe0667fc640 1 --2- 172.21.15.47:0/3134629195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe06806edc0 0x7fe068169090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7fe0667fc640 1 -- 172.21.15.47:0/3134629195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0680b2a70 msgr2=0x7fe0680b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7fe0667fc640 1 --2- 172.21.15.47:0/3134629195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0680b2a70 0x7fe0680b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7fe0667fc640 1 -- 172.21.15.47:0/3134629195 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0680b30f0 con 0x7fe068071210 2024-04-14T23:34:57.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7f0266d9d640 1 -- 172.21.15.47:0/3091098961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f026815c0e0 msgr2=0x7f0268153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7f0266d9d640 1 --2- 172.21.15.47:0/3091098961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f026815c0e0 0x7f0268153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7f0266d9d640 1 -- 172.21.15.47:0/3091098961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f026806b910 msgr2=0x7f026806e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7f0266d9d640 1 --2- 172.21.15.47:0/3091098961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f026806b910 0x7f026806e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7f0266d9d640 1 -- 172.21.15.47:0/3091098961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02680c9ed0 con 0x7f02681540c0 2024-04-14T23:34:57.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7fa1a1ffb640 1 -- 172.21.15.47:0/3402981970 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fa1a8018020 con 0x7fa1a4050190 2024-04-14T23:34:57.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7fe0667fc640 1 --2- 172.21.15.47:0/3134629195 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe068071210 0x7fe068167270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe05c000c00 tx=0x7fe05c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7f7b857fa640 1 --2- 172.21.15.47:0/1275059066 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7b7406ba60 0x7f7b7406df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7fe04f7fe640 1 -- 172.21.15.47:0/3134629195 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c037d00 con 0x7fe068071210 2024-04-14T23:34:57.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7fe04f7fe640 1 -- 172.21.15.47:0/3134629195 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe05c047070 con 0x7fe068071210 2024-04-14T23:34:57.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7fe04f7fe640 1 -- 172.21.15.47:0/3134629195 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c0426c0 con 0x7fe068071210 2024-04-14T23:34:57.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7fa1a1ffb640 1 --2- 172.21.15.47:0/3402981970 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa19006ba60 0x7fa19006df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7f7b857fa640 1 -- 172.21.15.47:0/1275059066 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7b8008a130 con 0x7f7b8815d630 2024-04-14T23:34:57.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7f0266d9d640 1 --2- 172.21.15.47:0/3091098961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02681540c0 0x7f02680c6470 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f025c033000 tx=0x7f025c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7fa1a1ffb640 1 -- 172.21.15.47:0/3402981970 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa1a808a610 con 0x7fa1a4050190 2024-04-14T23:34:57.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7f0256ffd640 1 -- 172.21.15.47:0/3091098961 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c034040 con 0x7f02681540c0 2024-04-14T23:34:57.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7fe06d6d5640 1 -- 172.21.15.47:0/3134629195 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0680b33d0 con 0x7fe068071210 2024-04-14T23:34:57.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7f7b857fa640 1 --2- 172.21.15.47:0/1275059066 >> [v2:172.21.15.47:6816/4047754630,v1:172.21.15.47:6817/4047754630] conn(0x7f7b740751e0 0x7f7b74077620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7f0256ffd640 1 -- 172.21.15.47:0/3091098961 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f025c003820 con 0x7f02681540c0 2024-04-14T23:34:57.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7f0256ffd640 1 -- 172.21.15.47:0/3091098961 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c003bf0 con 0x7f02681540c0 2024-04-14T23:34:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7f8379ffb640 1 -- 172.21.15.47:0/2897087968 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f837401a070 con 0x7f8384071f10 2024-04-14T23:34:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7f8379ffb640 1 --2- 172.21.15.47:0/2897087968 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f836806ba10 0x7f836806ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7f7b8cb46640 1 --2- 172.21.15.47:0/1275059066 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7b7406ba60 0x7f7b7406df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7f026cfd8640 1 -- 172.21.15.47:0/3091098961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02680ca1b0 con 0x7f02681540c0 2024-04-14T23:34:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7fa1a1ffb640 1 --2- 172.21.15.47:0/3402981970 >> [v2:172.21.15.47:6800/634215866,v1:172.21.15.47:6801/634215866] conn(0x7fa190075160 0x7fa1900775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7fa1a1ffb640 1 -- 172.21.15.47:0/3402981970 --> [v2:172.21.15.47:6800/634215866,v1:172.21.15.47:6801/634215866] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1a8015e50 con 0x7fa190075160 2024-04-14T23:34:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7fa1a1ffb640 1 -- 172.21.15.47:0/3402981970 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa1a8091050 con 0x7fa1a4050190 2024-04-14T23:34:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7f8388b56640 1 --2- 172.21.15.47:0/2897087968 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f836806ba10 0x7f836806ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7fe06d6d5640 1 -- 172.21.15.47:0/3134629195 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0680b3990 con 0x7fe068071210 2024-04-14T23:34:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7f8379ffb640 1 -- 172.21.15.47:0/2897087968 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8374056690 con 0x7f8384071f10 2024-04-14T23:34:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.322+0000 7fb8f7fff640 1 --2- 172.21.15.47:0/32432571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8f80cf8f0 0x7fb8f80727b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009e50 tx=0x7fb8f002bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f1ee4c78e013ddc server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.323+0000 7f7b87fff640 1 --2- 172.21.15.47:0/1275059066 >> [v2:172.21.15.47:6816/4047754630,v1:172.21.15.47:6817/4047754630] conn(0x7f7b740751e0 0x7f7b74077620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.324+0000 7f7b87fff640 1 --2- 172.21.15.47:0/1275059066 >> [v2:172.21.15.47:6816/4047754630,v1:172.21.15.47:6817/4047754630] conn(0x7f7b740751e0 0x7f7b74077620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.324+0000 7f7b857fa640 1 -- 172.21.15.47:0/1275059066 --> [v2:172.21.15.47:6816/4047754630,v1:172.21.15.47:6817/4047754630] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b800082d0 con 0x7f7b740751e0 2024-04-14T23:34:57.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.324+0000 7fb8f67fc640 1 -- 172.21.15.47:0/32432571 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f002cb90 con 0x7fb8f80cf8f0 2024-04-14T23:34:57.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.324+0000 7fb8f67fc640 1 -- 172.21.15.47:0/32432571 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8f002cd30 con 0x7fb8f80cf8f0 2024-04-14T23:34:57.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.324+0000 7fe06d6d5640 1 -- 172.21.15.47:0/3134629195 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe048001030 con 0x7fe068071210 2024-04-14T23:34:57.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.324+0000 7fa1b1975640 1 --2- 172.21.15.47:0/3402981970 >> [v2:172.21.15.47:6800/634215866,v1:172.21.15.47:6801/634215866] conn(0x7fa190075160 0x7fa1900775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.324+0000 7fa1b0973640 1 --2- 172.21.15.47:0/3402981970 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa19006ba60 0x7fa19006df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.325+0000 7f7b857fa640 1 -- 172.21.15.47:0/1275059066 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7b80091050 con 0x7f7b8815d630 2024-04-14T23:34:57.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.325+0000 7fa1b1975640 1 --2- 172.21.15.47:0/3402981970 >> [v2:172.21.15.47:6800/634215866,v1:172.21.15.47:6801/634215866] conn(0x7fa190075160 0x7fa1900775a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.324+0000 7f8379ffb640 1 --2- 172.21.15.47:0/2897087968 >> [v2:172.21.15.191:6816/1990913951,v1:172.21.15.191:6817/1990913951] conn(0x7f8368075de0 0x7f8368078280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.324+0000 7f8379ffb640 1 -- 172.21.15.47:0/2897087968 --> [v2:172.21.15.191:6816/1990913951,v1:172.21.15.191:6817/1990913951] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8368078950 con 0x7f8368075de0 2024-04-14T23:34:57.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.324+0000 7f8389b58640 1 --2- 172.21.15.47:0/2897087968 >> [v2:172.21.15.191:6816/1990913951,v1:172.21.15.191:6817/1990913951] conn(0x7f8368075de0 0x7f8368078280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.324+0000 7f8379ffb640 1 -- 172.21.15.47:0/2897087968 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8374055020 con 0x7f8384071f10 2024-04-14T23:34:57.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.325+0000 7f7b8cb46640 1 --2- 172.21.15.47:0/1275059066 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7b7406ba60 0x7f7b7406df20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009bb0 tx=0x7f7b7c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.325+0000 7f8388b56640 1 --2- 172.21.15.47:0/2897087968 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f836806ba10 0x7f836806ded0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f837c036000 tx=0x7f837c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.325+0000 7fb8fe036640 1 -- 172.21.15.47:0/32432571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8f80cf8f0 msgr2=0x7fb8f80727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.325+0000 7fb8fe036640 1 --2- 172.21.15.47:0/32432571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8f80cf8f0 0x7fb8f80727b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009e50 tx=0x7fb8f002bff0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.325+0000 7f7b857fa640 1 -- 172.21.15.47:0/1275059066 <== osd.3 v2:172.21.15.47:6816/4047754630 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b800082d0 con 0x7f7b740751e0 2024-04-14T23:34:57.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.325+0000 7f026cfd8640 1 -- 172.21.15.47:0/3091098961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02680ca770 con 0x7f02681540c0 2024-04-14T23:34:57.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.325+0000 7f8817fff640 1 Processor -- start 2024-04-14T23:34:57.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.325+0000 7f8817fff640 1 -- start start 2024-04-14T23:34:57.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.326+0000 7f0256ffd640 1 -- 172.21.15.47:0/3091098961 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f025c04a060 con 0x7f02681540c0 2024-04-14T23:34:57.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.325+0000 7fa1b0973640 1 --2- 172.21.15.47:0/3402981970 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa19006ba60 0x7fa19006df20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400b500 tx=0x7fa1ac08e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.326+0000 7f8389b58640 1 --2- 172.21.15.47:0/2897087968 >> [v2:172.21.15.191:6816/1990913951,v1:172.21.15.191:6817/1990913951] conn(0x7f8368075de0 0x7f8368078280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.326+0000 7fe04f7fe640 1 -- 172.21.15.47:0/3134629195 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe05c040050 con 0x7fe068071210 2024-04-14T23:34:57.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.326+0000 7fa1a1ffb640 1 -- 172.21.15.47:0/3402981970 <== osd.0 v2:172.21.15.47:6800/634215866 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa1a8015e50 con 0x7fa190075160 2024-04-14T23:34:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.326+0000 7fb8fe036640 1 -- 172.21.15.47:0/32432571 shutdown_connections 2024-04-14T23:34:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.326+0000 7fb8fe036640 1 --2- 172.21.15.47:0/32432571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8f80cf8f0 0x7fb8f80727b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.326+0000 7fb8fe036640 1 --2- 172.21.15.47:0/32432571 >> v2:172.21.15.47:3300/0 conn(0x7fb8f806cce0 0x7fb8f80cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.326+0000 7fb8fe036640 1 -- 172.21.15.47:0/32432571 >> 172.21.15.47:0/32432571 conn(0x7fb8f80b1af0 msgr2=0x7fb8f80b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.326+0000 7fb8fe036640 1 -- 172.21.15.47:0/32432571 shutdown_connections 2024-04-14T23:34:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.326+0000 7f0256ffd640 1 --2- 172.21.15.47:0/3091098961 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f024806b9e0 0x7f024806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7fe04f7fe640 1 --2- 172.21.15.47:0/3134629195 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe05406b990 0x7fe05406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.326+0000 7f8817fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f881815c100 0x7f881806caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7f8817fff640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8818072370 con 0x7f88180af060 2024-04-14T23:34:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7f8817fff640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8818072650 con 0x7f881806d970 2024-04-14T23:34:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7f8817fff640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f881806d340 con 0x7f881815c100 2024-04-14T23:34:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7fe04f7fe640 1 -- 172.21.15.47:0/3134629195 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe05c0ae110 con 0x7fe068071210 2024-04-14T23:34:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7fe04f7fe640 1 --2- 172.21.15.47:0/3134629195 >> [v2:172.21.15.191:6800/2802066933,v1:172.21.15.191:6803/2802066933] conn(0x7fe054075090 0x7fe0540774d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7fe04f7fe640 1 -- 172.21.15.47:0/3134629195 --> [v2:172.21.15.191:6800/2802066933,v1:172.21.15.191:6803/2802066933] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe05c03de50 con 0x7fe054075090 2024-04-14T23:34:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7fe04f7fe640 1 -- 172.21.15.47:0/3134629195 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe05c0ae5a0 con 0x7fe068071210 2024-04-14T23:34:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7f88167fc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f881815c100 0x7f881806caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7f88167fc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f881815c100 0x7f881806caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58204/0 (socket says 172.21.15.47:58204) 2024-04-14T23:34:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7f88167fc640 1 -- 172.21.15.47:0/2392655623 learned_addr learned my addr 172.21.15.47:0/2392655623 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7f0256ffd640 1 -- 172.21.15.47:0/3091098961 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f025c0ac250 con 0x7f02681540c0 2024-04-14T23:34:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7f026659c640 1 --2- 172.21.15.47:0/3091098961 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f024806b9e0 0x7f024806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7f8379ffb640 1 -- 172.21.15.47:0/2897087968 <== osd.5 v2:172.21.15.191:6816/1990913951 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8368078950 con 0x7f8368075de0 2024-04-14T23:34:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7fe0677fe640 1 --2- 172.21.15.47:0/3134629195 >> [v2:172.21.15.191:6800/2802066933,v1:172.21.15.191:6803/2802066933] conn(0x7fe054075090 0x7fe0540774d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7f8815ffb640 1 -- 172.21.15.47:0/2392655623 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 504885034 0 0) 0x7f8818072370 con 0x7f88180af060 2024-04-14T23:34:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7f88167fc640 1 -- 172.21.15.47:0/2392655623 >> v1:172.21.15.191:6789/0 conn(0x7f881806d970 legacy=0x7f881806dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.327+0000 7f88167fc640 1 -- 172.21.15.47:0/2392655623 >> v1:172.21.15.47:6789/0 conn(0x7f88180af060 legacy=0x7f88180cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.328+0000 7f026659c640 1 --2- 172.21.15.47:0/3091098961 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f024806b9e0 0x7f024806dea0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f02580011e0 tx=0x7f0258009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.328+0000 7fe066ffd640 1 --2- 172.21.15.47:0/3134629195 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe05406b990 0x7fe05406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.328+0000 7f026cfd8640 1 --2- 172.21.15.47:0/3091098961 >> [v2:172.21.15.191:6801/2576967079,v1:172.21.15.191:6802/2576967079] conn(0x7f0268072530 0x7f0268152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.328+0000 7f026cfd8640 1 -- 172.21.15.47:0/3091098961 --> [v2:172.21.15.191:6801/2576967079,v1:172.21.15.191:6802/2576967079] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02680cacc0 con 0x7f0268072530 2024-04-14T23:34:57.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.328+0000 7f88167fc640 1 -- 172.21.15.47:0/2392655623 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8818072930 con 0x7f881815c100 2024-04-14T23:34:57.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.326+0000 7fb8fe036640 1 -- 172.21.15.47:0/32432571 wait complete. 2024-04-14T23:34:57.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.328+0000 7fb8fe036640 1 Processor -- start 2024-04-14T23:34:57.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.328+0000 7f0265d9b640 1 --2- 172.21.15.47:0/3091098961 >> [v2:172.21.15.191:6801/2576967079,v1:172.21.15.191:6802/2576967079] conn(0x7f0268072530 0x7f0268152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.329+0000 7fb8fe036640 1 -- start start 2024-04-14T23:34:57.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.329+0000 7fe066ffd640 1 --2- 172.21.15.47:0/3134629195 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe05406b990 0x7fe05406de50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe058000f60 tx=0x7fe0580079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.329+0000 7fe0677fe640 1 --2- 172.21.15.47:0/3134629195 >> [v2:172.21.15.191:6800/2802066933,v1:172.21.15.191:6803/2802066933] conn(0x7fe054075090 0x7fe0540774d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.329+0000 7f0265d9b640 1 --2- 172.21.15.47:0/3091098961 >> [v2:172.21.15.191:6801/2576967079,v1:172.21.15.191:6802/2576967079] conn(0x7f0268072530 0x7f0268152110 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.329+0000 7f88167fc640 1 --2- 172.21.15.47:0/2392655623 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f881815c100 0x7f881806caf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8808009e80 tx=0x7f880802bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=786e757ad60daa55 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.329+0000 7f8815ffb640 1 -- 172.21.15.47:0/2392655623 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880802cb70 con 0x7f881815c100 2024-04-14T23:34:57.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.329+0000 7f8815ffb640 1 -- 172.21.15.47:0/2392655623 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f880802cd10 con 0x7f881815c100 2024-04-14T23:34:57.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7fe04f7fe640 1 -- 172.21.15.47:0/3134629195 <== osd.6 v2:172.21.15.191:6800/2802066933 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe05c03de50 con 0x7fe054075090 2024-04-14T23:34:57.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7f0256ffd640 1 -- 172.21.15.47:0/3091098961 <== osd.4 v2:172.21.15.191:6801/2576967079 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0260005190 con 0x7f0268072530 2024-04-14T23:34:57.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.329+0000 7f8815ffb640 1 -- 172.21.15.47:0/2392655623 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8808034610 con 0x7f881815c100 2024-04-14T23:34:57.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7f8817fff640 1 -- 172.21.15.47:0/2392655623 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f881815c100 msgr2=0x7f881806caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7f8817fff640 1 --2- 172.21.15.47:0/2392655623 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f881815c100 0x7f881806caf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8808009e80 tx=0x7f880802bfd0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7fb8fe036640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8f806cce0 0x7fb8f814db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7fb8fe036640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8f8073f50 0x7fb8f814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7fb8fe036640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8f80cf8f0 0x7fb8f809cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7fb8f77fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8f806cce0 0x7fb8f814db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7fb8f77fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8f806cce0 0x7fb8f814db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:35498/0 (socket says 172.21.15.47:35498) 2024-04-14T23:34:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7f8817fff640 1 -- 172.21.15.47:0/2392655623 shutdown_connections 2024-04-14T23:34:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7f8817fff640 1 --2- 172.21.15.47:0/2392655623 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f881815c100 0x7f881806caf0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7f8817fff640 1 -- 172.21.15.47:0/2392655623 >> 172.21.15.47:0/2392655623 conn(0x7f88180cf9f0 msgr2=0x7f88180cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7f8817fff640 1 -- 172.21.15.47:0/2392655623 shutdown_connections 2024-04-14T23:34:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7f8817fff640 1 -- 172.21.15.47:0/2392655623 wait complete. 2024-04-14T23:34:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.332+0000 7f8817fff640 1 Processor -- start 2024-04-14T23:34:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7fb8f77fe640 1 -- 172.21.15.47:0/3086361580 learned_addr learned my addr 172.21.15.47:0/3086361580 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7fb8f7fff640 1 --2- 172.21.15.47:0/3086361580 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8f80cf8f0 0x7fb8f809cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7fb8fe036640 1 -- 172.21.15.47:0/3086361580 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f815a640 con 0x7fb8f8073f50 2024-04-14T23:34:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7fb8fe036640 1 -- 172.21.15.47:0/3086361580 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f815a4c0 con 0x7fb8f806cce0 2024-04-14T23:34:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.330+0000 7fb8fe036640 1 -- 172.21.15.47:0/3086361580 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f8072cf0 con 0x7fb8f80cf8f0 2024-04-14T23:34:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.331+0000 7fb8f77fe640 1 -- 172.21.15.47:0/3086361580 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8f80cf8f0 msgr2=0x7fb8f809cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.331+0000 7fb8f77fe640 1 --2- 172.21.15.47:0/3086361580 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8f80cf8f0 0x7fb8f809cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.331+0000 7fb8f77fe640 1 -- 172.21.15.47:0/3086361580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8f8073f50 msgr2=0x7fb8f814c6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T23:34:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.331+0000 7fb8f77fe640 1 --2- 172.21.15.47:0/3086361580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8f8073f50 0x7fb8f814c6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.331+0000 7fb8f77fe640 1 -- 172.21.15.47:0/3086361580 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f815d490 con 0x7fb8f806cce0 2024-04-14T23:34:57.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.332+0000 7f8817fff640 1 -- start start 2024-04-14T23:34:57.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.334+0000 7f8817fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f881806d970 0x7f8818140740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.334+0000 7f8817fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88180af060 0x7f881814b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.334+0000 7f8817fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f881814be30 0x7f881815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.334+0000 7f8817fff640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f88180ce490 con 0x7f881806d970 2024-04-14T23:34:57.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.334+0000 7f88177fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f881814be30 0x7f881815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.334+0000 7f88177fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f881814be30 0x7f881815ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58232/0 (socket says 172.21.15.47:58232) 2024-04-14T23:34:57.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.334+0000 7f88177fe640 1 -- 172.21.15.47:0/3451037175 learned_addr learned my addr 172.21.15.47:0/3451037175 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.334+0000 7f8816ffd640 1 --2- 172.21.15.47:0/3451037175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f881806d970 0x7f8818140740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.334+0000 7f8817fff640 1 -- 172.21.15.47:0/3451037175 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f88180cd8f0 con 0x7f88180af060 2024-04-14T23:34:57.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.334+0000 7f8817fff640 1 -- 172.21.15.47:0/3451037175 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f88180ce610 con 0x7f881814be30 2024-04-14T23:34:57.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.332+0000 7f799bfaa640 1 Processor -- start 2024-04-14T23:34:57.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.332+0000 7f799bfaa640 1 -- start start 2024-04-14T23:34:57.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.333+0000 7f799bfaa640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f799414b490 0x7f79941660f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.333+0000 7f799bfaa640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f799414be40 0x7f79940b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.333+0000 7f799bfaa640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7994071fc0 con 0x7f7994072d40 2024-04-14T23:34:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.333+0000 7f799bfaa640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f79940728b0 con 0x7f799414be40 2024-04-14T23:34:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.333+0000 7f799bfaa640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7994166f00 con 0x7f799414b490 2024-04-14T23:34:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.334+0000 7f799a547640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f799414be40 0x7f79940b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.334+0000 7f799a547640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f799414be40 0x7f79940b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36024/0 (socket says 172.21.15.47:36024) 2024-04-14T23:34:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.334+0000 7f799a547640 1 -- 172.21.15.47:0/4273955726 learned_addr learned my addr 172.21.15.47:0/4273955726 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.334+0000 7f799a547640 1 -- 172.21.15.47:0/4273955726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f799414b490 msgr2=0x7f79941660f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T23:34:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.334+0000 7f799a547640 1 --2- 172.21.15.47:0/4273955726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f799414b490 0x7f79941660f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.334+0000 7f799a547640 1 -- 172.21.15.47:0/4273955726 >> v1:172.21.15.47:6789/0 conn(0x7f7994072d40 legacy=0x7f7994166630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.335+0000 7f88167fc640 1 --2- 172.21.15.47:0/3451037175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88180af060 0x7f881814b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.335+0000 7f799a547640 1 -- 172.21.15.47:0/4273955726 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7994072260 con 0x7f799414be40 2024-04-14T23:34:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.331+0000 7fb8f77fe640 1 --2- 172.21.15.47:0/3086361580 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8f806cce0 0x7fb8f814db00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400c450 tx=0x7fb8e400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.331+0000 7fb8e3fff640 1 -- 172.21.15.47:0/3086361580 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e40052d0 con 0x7fb8f806cce0 2024-04-14T23:34:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.331+0000 7fb8e3fff640 1 -- 172.21.15.47:0/3086361580 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e4005470 con 0x7fb8f806cce0 2024-04-14T23:34:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.331+0000 7fb8e3fff640 1 -- 172.21.15.47:0/3086361580 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4012870 con 0x7fb8f806cce0 2024-04-14T23:34:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.332+0000 7fb8fe036640 1 -- 172.21.15.47:0/3086361580 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f8159da0 con 0x7fb8f806cce0 2024-04-14T23:34:57.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.333+0000 7fb8fe036640 1 -- 172.21.15.47:0/3086361580 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f814d300 con 0x7fb8f806cce0 2024-04-14T23:34:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.336+0000 7f8816ffd640 1 -- 172.21.15.47:0/3451037175 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f881814be30 msgr2=0x7f881815ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.336+0000 7f8816ffd640 1 --2- 172.21.15.47:0/3451037175 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f881814be30 0x7f881815ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.336+0000 7f8816ffd640 1 -- 172.21.15.47:0/3451037175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88180af060 msgr2=0x7f881814b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.336+0000 7f8816ffd640 1 --2- 172.21.15.47:0/3451037175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88180af060 0x7f881814b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.336+0000 7f8816ffd640 1 -- 172.21.15.47:0/3451037175 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8818144c80 con 0x7f881806d970 2024-04-14T23:34:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.336+0000 7f8816ffd640 1 --2- 172.21.15.47:0/3451037175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f881806d970 0x7f8818140740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f881000c390 tx=0x7f881000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.336+0000 7f799a547640 1 --2- 172.21.15.47:0/4273955726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f799414be40 0x7f79940b2e50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7990009870 tx=0x7f799002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a30d1114d1a2924 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.336+0000 7fb8e3fff640 1 -- 172.21.15.47:0/3086361580 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb8e4012a10 con 0x7fb8f806cce0 2024-04-14T23:34:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.337+0000 7f7998d44640 1 -- 172.21.15.47:0/4273955726 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990034070 con 0x7f799414be40 2024-04-14T23:34:57.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.337+0000 7f7998d44640 1 -- 172.21.15.47:0/4273955726 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7990030860 con 0x7f799414be40 2024-04-14T23:34:57.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.337+0000 7fb8e3fff640 1 --2- 172.21.15.47:0/3086361580 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb8dc06ba60 0x7fb8dc06df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.337+0000 7fb8fe036640 1 -- 172.21.15.47:0/3086361580 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb8f814cbf0 con 0x7fb8f806cce0 2024-04-14T23:34:57.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.337+0000 7fb8e3fff640 1 -- 172.21.15.47:0/3086361580 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb8e408a690 con 0x7fb8f806cce0 2024-04-14T23:34:57.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.337+0000 7f87ff7fe640 1 -- 172.21.15.47:0/3451037175 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8810017070 con 0x7f881806d970 2024-04-14T23:34:57.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.337+0000 7f87ff7fe640 1 -- 172.21.15.47:0/3451037175 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88100052d0 con 0x7f881806d970 2024-04-14T23:34:57.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.337+0000 7f87ff7fe640 1 -- 172.21.15.47:0/3451037175 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88100037f0 con 0x7f881806d970 2024-04-14T23:34:57.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.337+0000 7f8817fff640 1 -- 172.21.15.47:0/3451037175 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8818140dd0 con 0x7f881806d970 2024-04-14T23:34:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.338+0000 7f799bfaa640 1 -- 172.21.15.47:0/4273955726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f799414be40 msgr2=0x7f79940b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.338+0000 7f799bfaa640 1 --2- 172.21.15.47:0/4273955726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f799414be40 0x7f79940b2e50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7990009870 tx=0x7f799002b9a0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.338+0000 7f799bfaa640 1 -- 172.21.15.47:0/4273955726 shutdown_connections 2024-04-14T23:34:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.338+0000 7f799bfaa640 1 --2- 172.21.15.47:0/4273955726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f799414be40 0x7f79940b2e50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.338+0000 7f799bfaa640 1 --2- 172.21.15.47:0/4273955726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f799414b490 0x7f79941660f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.338+0000 7f799bfaa640 1 -- 172.21.15.47:0/4273955726 >> 172.21.15.47:0/4273955726 conn(0x7f79940b1770 msgr2=0x7f79940b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.337+0000 7fb8e3fff640 1 --2- 172.21.15.47:0/3086361580 >> [v2:172.21.15.47:6824/3466488958,v1:172.21.15.47:6825/3466488958] conn(0x7fb8dc075160 0x7fb8dc0775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.337+0000 7fb8e3fff640 1 -- 172.21.15.47:0/3086361580 --> [v2:172.21.15.47:6824/3466488958,v1:172.21.15.47:6825/3466488958] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8dc077c70 con 0x7fb8dc075160 2024-04-14T23:34:57.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.337+0000 7fb8e3fff640 1 -- 172.21.15.47:0/3086361580 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb8e4054b70 con 0x7fb8f806cce0 2024-04-14T23:34:57.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.337+0000 7fb8f7fff640 1 --2- 172.21.15.47:0/3086361580 >> [v2:172.21.15.47:6824/3466488958,v1:172.21.15.47:6825/3466488958] conn(0x7fb8dc075160 0x7fb8dc0775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.338+0000 7fb8f7fff640 1 --2- 172.21.15.47:0/3086361580 >> [v2:172.21.15.47:6824/3466488958,v1:172.21.15.47:6825/3466488958] conn(0x7fb8dc075160 0x7fb8dc0775a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.338+0000 7fb8f6ffd640 1 --2- 172.21.15.47:0/3086361580 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb8dc06ba60 0x7fb8dc06df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.339+0000 7f799bfaa640 1 -- 172.21.15.47:0/4273955726 shutdown_connections 2024-04-14T23:34:57.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.339+0000 7f799bfaa640 1 -- 172.21.15.47:0/4273955726 wait complete. 2024-04-14T23:34:57.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.339+0000 7f8817fff640 1 -- 172.21.15.47:0/3451037175 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88181597f0 con 0x7f881806d970 2024-04-14T23:34:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.339+0000 7fb8e3fff640 1 -- 172.21.15.47:0/3086361580 <== osd.1 v2:172.21.15.47:6824/3466488958 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb8dc077c70 con 0x7fb8dc075160 2024-04-14T23:34:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.340+0000 7f87ff7fe640 1 -- 172.21.15.47:0/3451037175 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f881001a070 con 0x7f881806d970 2024-04-14T23:34:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.341+0000 7f87ff7fe640 1 --2- 172.21.15.47:0/3451037175 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f880406b9e0 0x7f880406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.341+0000 7f87ff7fe640 1 -- 172.21.15.47:0/3451037175 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8810089be0 con 0x7f881806d970 2024-04-14T23:34:57.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.341+0000 7f799bfaa640 1 Processor -- start 2024-04-14T23:34:57.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.341+0000 7f799bfaa640 1 -- start start 2024-04-14T23:34:57.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.342+0000 7f799bfaa640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7994072d40 0x7f7994161bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.342+0000 7f799bfaa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f799414b490 0x7f79940cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.342+0000 7f7999d46640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7994072d40 0x7f7994161bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.342+0000 7f7999d46640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7994072d40 0x7f7994161bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58242/0 (socket says 172.21.15.47:58242) 2024-04-14T23:34:57.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.342+0000 7f88167fc640 1 --2- 172.21.15.47:0/3451037175 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f880406b9e0 0x7f880406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.342+0000 7f799bfaa640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f799414be40 0x7f7994134fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.342+0000 7f799bfaa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f799414ba70 con 0x7f799414b490 2024-04-14T23:34:57.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.342+0000 7f7999545640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f799414b490 0x7f79940cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.342+0000 7f7999545640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f799414b490 0x7f79940cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36036/0 (socket says 172.21.15.47:36036) 2024-04-14T23:34:57.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.343+0000 7f7999545640 1 -- 172.21.15.47:0/3664125883 learned_addr learned my addr 172.21.15.47:0/3664125883 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.343+0000 7f799bfaa640 1 -- 172.21.15.47:0/3664125883 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f799414b8f0 con 0x7f799414be40 2024-04-14T23:34:57.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.343+0000 7f799bfaa640 1 -- 172.21.15.47:0/3664125883 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f799414bbf0 con 0x7f7994072d40 2024-04-14T23:34:57.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.343+0000 7f799a547640 1 --2- 172.21.15.47:0/3664125883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f799414be40 0x7f7994134fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.343+0000 7f8817fff640 1 --2- 172.21.15.47:0/3451037175 >> [v2:172.21.15.191:6820/4231525383,v1:172.21.15.191:6823/4231525383] conn(0x7f881815c100 0x7f8818159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.343+0000 7f7999d46640 1 -- 172.21.15.47:0/3664125883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f799414be40 msgr2=0x7f7994134fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.343+0000 7f7999d46640 1 --2- 172.21.15.47:0/3664125883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f799414be40 0x7f7994134fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.343+0000 7f7999d46640 1 -- 172.21.15.47:0/3664125883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f799414b490 msgr2=0x7f79940cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.343+0000 7f7999d46640 1 --2- 172.21.15.47:0/3664125883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f799414b490 0x7f79940cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.343+0000 7f7999d46640 1 -- 172.21.15.47:0/3664125883 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79941616c0 con 0x7f7994072d40 2024-04-14T23:34:57.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.343+0000 7f8817fff640 1 -- 172.21.15.47:0/3451037175 --> [v2:172.21.15.191:6820/4231525383,v1:172.21.15.191:6823/4231525383] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8818144e60 con 0x7f881815c100 2024-04-14T23:34:57.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.343+0000 7f7999545640 1 --2- 172.21.15.47:0/3664125883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f799414b490 0x7f79940cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:57.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.344+0000 7f88177fe640 1 --2- 172.21.15.47:0/3451037175 >> [v2:172.21.15.191:6820/4231525383,v1:172.21.15.191:6823/4231525383] conn(0x7f881815c100 0x7f8818159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.344+0000 7f7999d46640 1 --2- 172.21.15.47:0/3664125883 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7994072d40 0x7f7994161bc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f798400b440 tx=0x7f798400b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.341+0000 7fb8f6ffd640 1 --2- 172.21.15.47:0/3086361580 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb8dc06ba60 0x7fb8dc06df20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec006b10 tx=0x7fb8ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.344+0000 7f798a7fc640 1 -- 172.21.15.47:0/3664125883 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7984015020 con 0x7f7994072d40 2024-04-14T23:34:57.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.344+0000 7f799bfaa640 1 -- 172.21.15.47:0/3664125883 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79940ccb90 con 0x7f7994072d40 2024-04-14T23:34:57.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.344+0000 7f799bfaa640 1 -- 172.21.15.47:0/3664125883 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f79940cd140 con 0x7f7994072d40 2024-04-14T23:34:57.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.344+0000 7f798a7fc640 1 -- 172.21.15.47:0/3664125883 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7984011850 con 0x7f7994072d40 2024-04-14T23:34:57.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.345+0000 7f88177fe640 1 --2- 172.21.15.47:0/3451037175 >> [v2:172.21.15.191:6820/4231525383,v1:172.21.15.191:6823/4231525383] conn(0x7f881815c100 0x7f8818159a30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.346+0000 7f87ff7fe640 1 -- 172.21.15.47:0/3451037175 <== osd.7 v2:172.21.15.191:6820/4231525383 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8818144e60 con 0x7f881815c100 2024-04-14T23:34:57.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.346+0000 7f88167fc640 1 --2- 172.21.15.47:0/3451037175 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f880406b9e0 0x7f880406dea0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8808035000 tx=0x7f8808030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.345+0000 7f798a7fc640 1 -- 172.21.15.47:0/3664125883 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7984011c40 con 0x7f7994072d40 2024-04-14T23:34:57.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.347+0000 7f798a7fc640 1 -- 172.21.15.47:0/3664125883 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f7984018020 con 0x7f7994072d40 2024-04-14T23:34:57.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.348+0000 7f798a7fc640 1 --2- 172.21.15.47:0/3664125883 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f797806ba60 0x7f797806df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.348+0000 7f798a7fc640 1 -- 172.21.15.47:0/3664125883 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f798408a530 con 0x7f7994072d40 2024-04-14T23:34:57.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.348+0000 7f7999545640 1 --2- 172.21.15.47:0/3664125883 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f797806ba60 0x7f797806df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.349+0000 7f7999545640 1 --2- 172.21.15.47:0/3664125883 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f797806ba60 0x7f797806df20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7994135b80 tx=0x7f798c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.349+0000 7f7977fff640 1 --2- 172.21.15.47:0/3664125883 >> [v2:172.21.15.47:6808/313696127,v1:172.21.15.47:6809/313696127] conn(0x7f79940a9490 0x7f7994163f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.349+0000 7f7977fff640 1 -- 172.21.15.47:0/3664125883 --> [v2:172.21.15.47:6808/313696127,v1:172.21.15.47:6809/313696127] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7994075430 con 0x7f79940a9490 2024-04-14T23:34:57.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.349+0000 7f799a547640 1 --2- 172.21.15.47:0/3664125883 >> [v2:172.21.15.47:6808/313696127,v1:172.21.15.47:6809/313696127] conn(0x7f79940a9490 0x7f7994163f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.350+0000 7f799a547640 1 --2- 172.21.15.47:0/3664125883 >> [v2:172.21.15.47:6808/313696127,v1:172.21.15.47:6809/313696127] conn(0x7f79940a9490 0x7f7994163f20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.351+0000 7f798a7fc640 1 -- 172.21.15.47:0/3664125883 <== osd.2 v2:172.21.15.47:6808/313696127 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7994075430 con 0x7f79940a9490 2024-04-14T23:34:57.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.359+0000 7f838b5bb640 1 -- 172.21.15.47:0/2897087968 --> [v2:172.21.15.191:6816/1990913951,v1:172.21.15.191:6817/1990913951] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8364002dd0 con 0x7f8368075de0 2024-04-14T23:34:57.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.360+0000 7fa1b2176640 1 -- 172.21.15.47:0/3402981970 --> [v2:172.21.15.47:6800/634215866,v1:172.21.15.47:6801/634215866] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa1a4005380 con 0x7fa190075160 2024-04-14T23:34:57.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.360+0000 7f8379ffb640 1 -- 172.21.15.47:0/2897087968 <== osd.5 v2:172.21.15.191:6816/1990913951 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8364002dd0 con 0x7f8368075de0 2024-04-14T23:34:57.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.360+0000 7fa1a1ffb640 1 -- 172.21.15.47:0/3402981970 <== osd.0 v2:172.21.15.47:6800/634215866 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa1a4005380 con 0x7fa190075160 2024-04-14T23:34:57.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.360+0000 7f836f7fe640 1 -- 172.21.15.47:0/2897087968 >> [v2:172.21.15.191:6816/1990913951,v1:172.21.15.191:6817/1990913951] conn(0x7f8368075de0 msgr2=0x7f8368078280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.360+0000 7f836f7fe640 1 --2- 172.21.15.47:0/2897087968 >> [v2:172.21.15.191:6816/1990913951,v1:172.21.15.191:6817/1990913951] conn(0x7f8368075de0 0x7f8368078280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.360+0000 7f7b6effd640 1 -- 172.21.15.47:0/1275059066 --> [v2:172.21.15.47:6816/4047754630,v1:172.21.15.47:6817/4047754630] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7b88075430 con 0x7f7b740751e0 2024-04-14T23:34:57.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7f836f7fe640 1 -- 172.21.15.47:0/2897087968 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f836806ba10 msgr2=0x7f836806ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7f836f7fe640 1 --2- 172.21.15.47:0/2897087968 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f836806ba10 0x7f836806ded0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f837c036000 tx=0x7f837c030000 comp rx=0 tx=0).stop 2024-04-14T23:34:57.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7fa1b2176640 1 -- 172.21.15.47:0/3402981970 >> [v2:172.21.15.47:6800/634215866,v1:172.21.15.47:6801/634215866] conn(0x7fa190075160 msgr2=0x7fa1900775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7f836f7fe640 1 -- 172.21.15.47:0/2897087968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8384071f10 msgr2=0x7f83840cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7fa1b2176640 1 --2- 172.21.15.47:0/3402981970 >> [v2:172.21.15.47:6800/634215866,v1:172.21.15.47:6801/634215866] conn(0x7fa190075160 0x7fa1900775a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7f836f7fe640 1 --2- 172.21.15.47:0/2897087968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8384071f10 0x7f83840cd1f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f837400c440 tx=0x7f837400c900 comp rx=0 tx=0).stop 2024-04-14T23:34:57.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7f8389b58640 1 -- 172.21.15.47:0/2897087968 reap_dead start 2024-04-14T23:34:57.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7f836f7fe640 1 -- 172.21.15.47:0/2897087968 shutdown_connections 2024-04-14T23:34:57.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7f836f7fe640 1 -- 172.21.15.47:0/2897087968 >> 172.21.15.47:0/2897087968 conn(0x7f83840b1770 msgr2=0x7f838414c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7fa1b2176640 1 -- 172.21.15.47:0/3402981970 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa19006ba60 msgr2=0x7fa19006df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7fa1b2176640 1 --2- 172.21.15.47:0/3402981970 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa19006ba60 0x7fa19006df20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400b500 tx=0x7fa1ac08e040 comp rx=0 tx=0).stop 2024-04-14T23:34:57.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7fa1b2176640 1 -- 172.21.15.47:0/3402981970 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4050190 msgr2=0x7fa1a40e20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7fa1b2176640 1 --2- 172.21.15.47:0/3402981970 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1a4050190 0x7fa1a40e20f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800b3f0 tx=0x7fa1a800b8b0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7fa1b1975640 1 -- 172.21.15.47:0/3402981970 reap_dead start 2024-04-14T23:34:57.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7fa1b2176640 1 -- 172.21.15.47:0/3402981970 shutdown_connections 2024-04-14T23:34:57.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7fa1b2176640 1 -- 172.21.15.47:0/3402981970 >> 172.21.15.47:0/3402981970 conn(0x7fa1a4009fa0 msgr2=0x7fa1a4033ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7f7b857fa640 1 -- 172.21.15.47:0/1275059066 <== osd.3 v2:172.21.15.47:6816/4047754630 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7b88075430 con 0x7f7b740751e0 2024-04-14T23:34:57.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7f836f7fe640 1 -- 172.21.15.47:0/2897087968 shutdown_connections 2024-04-14T23:34:57.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.361+0000 7f836f7fe640 1 -- 172.21.15.47:0/2897087968 wait complete. 2024-04-14T23:34:57.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.362+0000 7fa1b2176640 1 -- 172.21.15.47:0/3402981970 shutdown_connections 2024-04-14T23:34:57.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.362+0000 7fa1b2176640 1 -- 172.21.15.47:0/3402981970 wait complete. 2024-04-14T23:34:57.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.362+0000 7f026cfd8640 1 -- 172.21.15.47:0/3091098961 --> [v2:172.21.15.191:6801/2576967079,v1:172.21.15.191:6802/2576967079] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0268075430 con 0x7f0268072530 2024-04-14T23:34:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.362+0000 7f7b6effd640 1 -- 172.21.15.47:0/1275059066 >> [v2:172.21.15.47:6816/4047754630,v1:172.21.15.47:6817/4047754630] conn(0x7f7b740751e0 msgr2=0x7f7b74077620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.362+0000 7f7b6effd640 1 --2- 172.21.15.47:0/1275059066 >> [v2:172.21.15.47:6816/4047754630,v1:172.21.15.47:6817/4047754630] conn(0x7f7b740751e0 0x7f7b74077620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.362+0000 7f7b6effd640 1 -- 172.21.15.47:0/1275059066 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7b7406ba60 msgr2=0x7f7b7406df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.362+0000 7f7b6effd640 1 --2- 172.21.15.47:0/1275059066 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7b7406ba60 0x7f7b7406df20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009bb0 tx=0x7f7b7c008040 comp rx=0 tx=0).stop 2024-04-14T23:34:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.362+0000 7f7b6effd640 1 -- 172.21.15.47:0/1275059066 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b8815d630 msgr2=0x7f7b880b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.362+0000 7f7b6effd640 1 --2- 172.21.15.47:0/1275059066 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b8815d630 0x7f7b880b42d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7b80001900 tx=0x7f7b80001dc0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.362+0000 7f7b8d347640 1 -- 172.21.15.47:0/1275059066 reap_dead start 2024-04-14T23:34:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.362+0000 7f7b6effd640 1 -- 172.21.15.47:0/1275059066 shutdown_connections 2024-04-14T23:34:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.362+0000 7f7b6effd640 1 -- 172.21.15.47:0/1275059066 >> 172.21.15.47:0/1275059066 conn(0x7f7b880b1770 msgr2=0x7f7b880b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.363+0000 7f0256ffd640 1 -- 172.21.15.47:0/3091098961 <== osd.4 v2:172.21.15.191:6801/2576967079 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0268075430 con 0x7f0268072530 2024-04-14T23:34:57.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.363+0000 7fe06d6d5640 1 -- 172.21.15.47:0/3134629195 --> [v2:172.21.15.191:6800/2802066933,v1:172.21.15.191:6803/2802066933] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe048002d50 con 0x7fe054075090 2024-04-14T23:34:57.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.363+0000 7f7b6effd640 1 -- 172.21.15.47:0/1275059066 shutdown_connections 2024-04-14T23:34:57.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.363+0000 7f7b6effd640 1 -- 172.21.15.47:0/1275059066 wait complete. 2024-04-14T23:34:57.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.363+0000 7f026cfd8640 1 -- 172.21.15.47:0/3091098961 >> [v2:172.21.15.191:6801/2576967079,v1:172.21.15.191:6802/2576967079] conn(0x7f0268072530 msgr2=0x7f0268152110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.363+0000 7f026cfd8640 1 --2- 172.21.15.47:0/3091098961 >> [v2:172.21.15.191:6801/2576967079,v1:172.21.15.191:6802/2576967079] conn(0x7f0268072530 0x7f0268152110 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.363+0000 7f026cfd8640 1 -- 172.21.15.47:0/3091098961 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f024806b9e0 msgr2=0x7f024806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.363+0000 7f026cfd8640 1 --2- 172.21.15.47:0/3091098961 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f024806b9e0 0x7f024806dea0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f02580011e0 tx=0x7f0258009040 comp rx=0 tx=0).stop 2024-04-14T23:34:57.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.363+0000 7f026cfd8640 1 -- 172.21.15.47:0/3091098961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02681540c0 msgr2=0x7f02680c6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.363+0000 7f026cfd8640 1 --2- 172.21.15.47:0/3091098961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02681540c0 0x7f02680c6470 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f025c033000 tx=0x7f025c0046c0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.363+0000 7f0266d9d640 1 -- 172.21.15.47:0/3091098961 reap_dead start 2024-04-14T23:34:57.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.364+0000 7fe04f7fe640 1 -- 172.21.15.47:0/3134629195 <== osd.6 v2:172.21.15.191:6800/2802066933 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe048002d50 con 0x7fe054075090 2024-04-14T23:34:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.364+0000 7f026cfd8640 1 -- 172.21.15.47:0/3091098961 shutdown_connections 2024-04-14T23:34:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.364+0000 7f026cfd8640 1 -- 172.21.15.47:0/3091098961 >> 172.21.15.47:0/3091098961 conn(0x7f02680d0c20 msgr2=0x7f02680d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.364+0000 7f026cfd8640 1 -- 172.21.15.47:0/3091098961 shutdown_connections 2024-04-14T23:34:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.364+0000 7f026cfd8640 1 -- 172.21.15.47:0/3091098961 wait complete. 2024-04-14T23:34:57.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.364+0000 7fe06d6d5640 1 -- 172.21.15.47:0/3134629195 >> [v2:172.21.15.191:6800/2802066933,v1:172.21.15.191:6803/2802066933] conn(0x7fe054075090 msgr2=0x7fe0540774d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.365+0000 7fe06d6d5640 1 --2- 172.21.15.47:0/3134629195 >> [v2:172.21.15.191:6800/2802066933,v1:172.21.15.191:6803/2802066933] conn(0x7fe054075090 0x7fe0540774d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.365+0000 7fe06d6d5640 1 -- 172.21.15.47:0/3134629195 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe05406b990 msgr2=0x7fe05406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.365+0000 7fe06d6d5640 1 --2- 172.21.15.47:0/3134629195 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe05406b990 0x7fe05406de50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe058000f60 tx=0x7fe0580079b0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.365+0000 7fe06d6d5640 1 -- 172.21.15.47:0/3134629195 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe068071210 msgr2=0x7fe068167270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.365+0000 7fe06d6d5640 1 --2- 172.21.15.47:0/3134629195 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe068071210 0x7fe068167270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe05c000c00 tx=0x7fe05c0046c0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.365+0000 7fe0677fe640 1 -- 172.21.15.47:0/3134629195 reap_dead start 2024-04-14T23:34:57.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.365+0000 7fe06d6d5640 1 -- 172.21.15.47:0/3134629195 shutdown_connections 2024-04-14T23:34:57.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.365+0000 7fe06d6d5640 1 -- 172.21.15.47:0/3134629195 >> 172.21.15.47:0/3134629195 conn(0x7fe06806b200 msgr2=0x7fe0680b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.365+0000 7fe06d6d5640 1 -- 172.21.15.47:0/3134629195 shutdown_connections 2024-04-14T23:34:57.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.366+0000 7fe06d6d5640 1 -- 172.21.15.47:0/3134629195 wait complete. 2024-04-14T23:34:57.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.371+0000 7fb8fe036640 1 -- 172.21.15.47:0/3086361580 --> [v2:172.21.15.47:6824/3466488958,v1:172.21.15.47:6825/3466488958] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb8f814cbf0 con 0x7fb8dc075160 2024-04-14T23:34:57.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.371+0000 7fb8e3fff640 1 -- 172.21.15.47:0/3086361580 <== osd.1 v2:172.21.15.47:6824/3466488958 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb8f00343f0 con 0x7fb8dc075160 2024-04-14T23:34:57.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.372+0000 7fb8e1ffb640 1 -- 172.21.15.47:0/3086361580 >> [v2:172.21.15.47:6824/3466488958,v1:172.21.15.47:6825/3466488958] conn(0x7fb8dc075160 msgr2=0x7fb8dc0775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.372+0000 7fb8e1ffb640 1 --2- 172.21.15.47:0/3086361580 >> [v2:172.21.15.47:6824/3466488958,v1:172.21.15.47:6825/3466488958] conn(0x7fb8dc075160 0x7fb8dc0775a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.372+0000 7fb8e1ffb640 1 -- 172.21.15.47:0/3086361580 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb8dc06ba60 msgr2=0x7fb8dc06df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.372+0000 7fb8e1ffb640 1 --2- 172.21.15.47:0/3086361580 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb8dc06ba60 0x7fb8dc06df20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec006b10 tx=0x7fb8ec008040 comp rx=0 tx=0).stop 2024-04-14T23:34:57.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.372+0000 7fb8e1ffb640 1 -- 172.21.15.47:0/3086361580 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8f806cce0 msgr2=0x7fb8f814db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.372+0000 7fb8e1ffb640 1 --2- 172.21.15.47:0/3086361580 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8f806cce0 0x7fb8f814db00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400c450 tx=0x7fb8e400c910 comp rx=0 tx=0).stop 2024-04-14T23:34:57.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.372+0000 7fb8f7fff640 1 -- 172.21.15.47:0/3086361580 reap_dead start 2024-04-14T23:34:57.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.373+0000 7fb8e1ffb640 1 -- 172.21.15.47:0/3086361580 shutdown_connections 2024-04-14T23:34:57.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.373+0000 7fb8e1ffb640 1 -- 172.21.15.47:0/3086361580 >> 172.21.15.47:0/3086361580 conn(0x7fb8f80b1af0 msgr2=0x7fb8f814e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.373+0000 7fb8e1ffb640 1 -- 172.21.15.47:0/3086361580 shutdown_connections 2024-04-14T23:34:57.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.373+0000 7fb8e1ffb640 1 -- 172.21.15.47:0/3086361580 wait complete. 2024-04-14T23:34:57.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.376+0000 7f8817fff640 1 -- 172.21.15.47:0/3451037175 --> [v2:172.21.15.191:6820/4231525383,v1:172.21.15.191:6823/4231525383] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f881815fed0 con 0x7f881815c100 2024-04-14T23:34:57.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.377+0000 7f87ff7fe640 1 -- 172.21.15.47:0/3451037175 <== osd.7 v2:172.21.15.191:6820/4231525383 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f881815fed0 con 0x7f881815c100 2024-04-14T23:34:57.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.380+0000 7f8817fff640 1 -- 172.21.15.47:0/3451037175 >> [v2:172.21.15.191:6820/4231525383,v1:172.21.15.191:6823/4231525383] conn(0x7f881815c100 msgr2=0x7f8818159a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.380+0000 7f8817fff640 1 --2- 172.21.15.47:0/3451037175 >> [v2:172.21.15.191:6820/4231525383,v1:172.21.15.191:6823/4231525383] conn(0x7f881815c100 0x7f8818159a30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.423 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-04-14T23:34:57.423 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-04-14T23:34:57.424 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-14T23:34:57.425 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-14T23:34:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.381+0000 7f8817fff640 1 -- 172.21.15.47:0/3451037175 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f880406b9e0 msgr2=0x7f880406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.381+0000 7f8817fff640 1 --2- 172.21.15.47:0/3451037175 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f880406b9e0 0x7f880406dea0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8808035000 tx=0x7f8808030000 comp rx=0 tx=0).stop 2024-04-14T23:34:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.381+0000 7f8817fff640 1 -- 172.21.15.47:0/3451037175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f881806d970 msgr2=0x7f8818140740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.381+0000 7f8817fff640 1 --2- 172.21.15.47:0/3451037175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f881806d970 0x7f8818140740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f881000c390 tx=0x7f881000c850 comp rx=0 tx=0).stop 2024-04-14T23:34:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.381+0000 7f88177fe640 1 -- 172.21.15.47:0/3451037175 reap_dead start 2024-04-14T23:34:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.381+0000 7f8817fff640 1 -- 172.21.15.47:0/3451037175 shutdown_connections 2024-04-14T23:34:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.381+0000 7f8817fff640 1 -- 172.21.15.47:0/3451037175 >> 172.21.15.47:0/3451037175 conn(0x7f88180cf9f0 msgr2=0x7f881806e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.382+0000 7f8817fff640 1 -- 172.21.15.47:0/3451037175 shutdown_connections 2024-04-14T23:34:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.382+0000 7f8817fff640 1 -- 172.21.15.47:0/3451037175 wait complete. 2024-04-14T23:34:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.382+0000 7f7977fff640 1 -- 172.21.15.47:0/3664125883 --> [v2:172.21.15.47:6808/313696127,v1:172.21.15.47:6809/313696127] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f79941646b0 con 0x7f79940a9490 2024-04-14T23:34:57.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.383+0000 7f798a7fc640 1 -- 172.21.15.47:0/3664125883 <== osd.2 v2:172.21.15.47:6808/313696127 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f79941646b0 con 0x7f79940a9490 2024-04-14T23:34:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.383+0000 7f7977fff640 1 -- 172.21.15.47:0/3664125883 >> [v2:172.21.15.47:6808/313696127,v1:172.21.15.47:6809/313696127] conn(0x7f79940a9490 msgr2=0x7f7994163f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.383+0000 7f7977fff640 1 --2- 172.21.15.47:0/3664125883 >> [v2:172.21.15.47:6808/313696127,v1:172.21.15.47:6809/313696127] conn(0x7f79940a9490 0x7f7994163f20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.384+0000 7f7977fff640 1 -- 172.21.15.47:0/3664125883 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f797806ba60 msgr2=0x7f797806df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.384+0000 7f7977fff640 1 --2- 172.21.15.47:0/3664125883 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f797806ba60 0x7f797806df20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7994135b80 tx=0x7f798c009040 comp rx=0 tx=0).stop 2024-04-14T23:34:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.384+0000 7f7977fff640 1 -- 172.21.15.47:0/3664125883 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7994072d40 msgr2=0x7f7994161bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.384+0000 7f7977fff640 1 --2- 172.21.15.47:0/3664125883 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7994072d40 0x7f7994161bc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f798400b440 tx=0x7f798400b900 comp rx=0 tx=0).stop 2024-04-14T23:34:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.384+0000 7f799a547640 1 -- 172.21.15.47:0/3664125883 reap_dead start 2024-04-14T23:34:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.384+0000 7f7977fff640 1 -- 172.21.15.47:0/3664125883 shutdown_connections 2024-04-14T23:34:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.384+0000 7f7977fff640 1 -- 172.21.15.47:0/3664125883 >> 172.21.15.47:0/3664125883 conn(0x7f79940b1770 msgr2=0x7f799414a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.384+0000 7f7977fff640 1 -- 172.21.15.47:0/3664125883 shutdown_connections 2024-04-14T23:34:57.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.384+0000 7f7977fff640 1 -- 172.21.15.47:0/3664125883 wait complete. 2024-04-14T23:34:57.429 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-04-14T23:34:57.429 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-14T23:34:57.430 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-04-14T23:34:57.430 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-14T23:34:57.431 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-04-14T23:34:57.431 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-14T23:34:57.432 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-04-14T23:34:57.432 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-14T23:34:57.433 INFO:teuthology.orchestra.run.smithi047.stdout:55834574858 2024-04-14T23:34:57.433 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-14T23:34:57.434 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-04-14T23:34:57.435 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-14T23:34:57.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.635+0000 7f31ee368640 1 Processor -- start 2024-04-14T23:34:57.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.635+0000 7f31ee368640 1 -- start start 2024-04-14T23:34:57.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.637+0000 7f31ee368640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e806eff0 0x7f31e80b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.637+0000 7f31ee368640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f31e806cd50 0x7f31e806d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.637+0000 7f31ee368640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e8071030 con 0x7f31e8071b10 2024-04-14T23:34:57.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.637+0000 7f31ee368640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f31e806d6f0 con 0x7f31e806cd50 2024-04-14T23:34:57.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.637+0000 7f31ee368640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f31e8070b00 con 0x7f31e806eff0 2024-04-14T23:34:57.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.637+0000 7f31e7fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e806eff0 0x7f31e80b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.637+0000 7f31e7fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e806eff0 0x7f31e80b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58246/0 (socket says 172.21.15.47:58246) 2024-04-14T23:34:57.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.637+0000 7f31e7fff640 1 -- 172.21.15.47:0/3664923902 learned_addr learned my addr 172.21.15.47:0/3664923902 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.637+0000 7f31e77fe640 1 --2- 172.21.15.47:0/3664923902 >> v2:172.21.15.191:3300/0 conn(0x7f31e806cd50 0x7f31e806d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.638+0000 7f31e7fff640 1 -- 172.21.15.47:0/3664923902 >> v2:172.21.15.191:3300/0 conn(0x7f31e806cd50 msgr2=0x7f31e806d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.638+0000 7f31e7fff640 1 --2- 172.21.15.47:0/3664923902 >> v2:172.21.15.191:3300/0 conn(0x7f31e806cd50 0x7f31e806d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.638+0000 7f31e7fff640 1 -- 172.21.15.47:0/3664923902 >> v1:172.21.15.191:6789/0 conn(0x7f31e8071b10 legacy=0x7f31e8071f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.638+0000 7f31e7fff640 1 -- 172.21.15.47:0/3664923902 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e8071310 con 0x7f31e806eff0 2024-04-14T23:34:57.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.639+0000 7f00d26f3640 1 Processor -- start 2024-04-14T23:34:57.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.639+0000 7f31e7fff640 1 --2- 172.21.15.47:0/3664923902 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e806eff0 0x7f31e80b3ba0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009870 tx=0x7f31dc02b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d211f355e8ccc17 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.639+0000 7f00d26f3640 1 -- start start 2024-04-14T23:34:57.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.639+0000 7f31e6ffd640 1 -- 172.21.15.47:0/3664923902 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc034070 con 0x7f31e806eff0 2024-04-14T23:34:57.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.639+0000 7f31e6ffd640 1 -- 172.21.15.47:0/3664923902 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc030880 con 0x7f31e806eff0 2024-04-14T23:34:57.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.640+0000 7f376f02d640 1 Processor -- start 2024-04-14T23:34:57.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.640+0000 7f376f02d640 1 -- start start 2024-04-14T23:34:57.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.640+0000 7f31e6ffd640 1 -- 172.21.15.47:0/3664923902 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc030c90 con 0x7f31e806eff0 2024-04-14T23:34:57.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.640+0000 7f00d26f3640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f00c4038280 0x7f00c40eba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.640+0000 7f00d26f3640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c40061a0 0x7f00c4006630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.640+0000 7f00d26f3640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00c40e7c00 con 0x7f00c40e7820 2024-04-14T23:34:57.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.640+0000 7f00d26f3640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f00c40ebf50 con 0x7f00c4038280 2024-04-14T23:34:57.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.640+0000 7f00d26f3640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f00c4057f20 con 0x7f00c40061a0 2024-04-14T23:34:57.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.640+0000 7f31ee368640 1 -- 172.21.15.47:0/3664923902 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e806eff0 msgr2=0x7f31e80b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.640+0000 7f31ee368640 1 --2- 172.21.15.47:0/3664923902 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e806eff0 0x7f31e80b3ba0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009870 tx=0x7f31dc02b9c0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f8441073640 1 Processor -- start 2024-04-14T23:34:57.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f00d1ef2640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c40061a0 0x7f00c4006630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f00d1ef2640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c40061a0 0x7f00c4006630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58256/0 (socket says 172.21.15.47:58256) 2024-04-14T23:34:57.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f00d1ef2640 1 -- 172.21.15.47:0/2015730436 learned_addr learned my addr 172.21.15.47:0/2015730436 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f01a6b15640 1 Processor -- start 2024-04-14T23:34:57.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f01a6b15640 1 -- start start 2024-04-14T23:34:57.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f8441073640 1 -- start start 2024-04-14T23:34:57.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f31ee368640 1 -- 172.21.15.47:0/3664923902 shutdown_connections 2024-04-14T23:34:57.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f6c30a4e640 1 Processor -- start 2024-04-14T23:34:57.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f00d0ef0640 1 --2- 172.21.15.47:0/2015730436 >> v2:172.21.15.47:3300/0 conn(0x7f00c4038280 0x7f00c40eba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f31ee368640 1 --2- 172.21.15.47:0/3664923902 >> v2:172.21.15.191:3300/0 conn(0x7f31e806cd50 0x7f31e806d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f31ee368640 1 --2- 172.21.15.47:0/3664923902 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e806eff0 0x7f31e80b3ba0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f31ee368640 1 -- 172.21.15.47:0/3664923902 >> 172.21.15.47:0/3664923902 conn(0x7f31e806b890 msgr2=0x7f31e80b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.642+0000 7f31ee368640 1 -- 172.21.15.47:0/3664923902 shutdown_connections 2024-04-14T23:34:57.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.642+0000 7f31ee368640 1 -- 172.21.15.47:0/3664923902 wait complete. 2024-04-14T23:34:57.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f376f02d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f37680b3d70 0x7f37680720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f376f02d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f376806e4f0 0x7f376806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f376f02d640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3768072a50 con 0x7f3768162270 2024-04-14T23:34:57.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f376f02d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f37680b4500 con 0x7f37680b3d70 2024-04-14T23:34:57.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f376f02d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f37680b47e0 con 0x7f376806e4f0 2024-04-14T23:34:57.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f376cdc9640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f3768162270 0x7f37680b4fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.47:42400/0 (socket says 172.21.15.47:42400) 2024-04-14T23:34:57.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f376cdc9640 1 -- 172.21.15.47:0/1316579333 learned_addr learned my addr 172.21.15.47:0/1316579333 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:57.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.642+0000 7f376d5ca640 1 --2- 172.21.15.47:0/1316579333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f376806e4f0 0x7f376806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.642+0000 7f37677fe640 1 -- 172.21.15.47:0/1316579333 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 503897875 0 0) 0x7f3768072a50 con 0x7f3768162270 2024-04-14T23:34:57.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.642+0000 7f37677fe640 1 -- 172.21.15.47:0/1316579333 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3750003520 con 0x7f3768162270 2024-04-14T23:34:57.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.642+0000 7f00d0ef0640 1 -- 172.21.15.47:0/2015730436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c40061a0 msgr2=0x7f00c4006630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.642+0000 7f376d5ca640 1 -- 172.21.15.47:0/1316579333 >> v2:172.21.15.47:3300/0 conn(0x7f37680b3d70 msgr2=0x7f37680720e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T23:34:57.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.642+0000 7f00d0ef0640 1 --2- 172.21.15.47:0/2015730436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c40061a0 0x7f00c4006630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.642+0000 7f00d0ef0640 1 -- 172.21.15.47:0/2015730436 >> v1:172.21.15.191:6789/0 conn(0x7f00c40e7820 legacy=0x7f00c40eb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.642+0000 7f00d0ef0640 1 -- 172.21.15.47:0/2015730436 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c4058200 con 0x7f00c4038280 2024-04-14T23:34:57.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.642+0000 7f376d5ca640 1 --2- 172.21.15.47:0/1316579333 >> v2:172.21.15.47:3300/0 conn(0x7f37680b3d70 0x7f37680720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.642+0000 7f376d5ca640 1 -- 172.21.15.47:0/1316579333 >> v1:172.21.15.191:6789/0 conn(0x7f3768162270 legacy=0x7f37680b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.642+0000 7f376d5ca640 1 -- 172.21.15.47:0/1316579333 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37680b4ac0 con 0x7f376806e4f0 2024-04-14T23:34:57.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.642+0000 7f8441073640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84340398c0 0x7f843404fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f01a6b15640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f01a0157a70 0x7f01a00cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f10b62bc640 1 Processor -- start 2024-04-14T23:34:57.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f843bfff640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f84340dfeb0 0x7f84340525f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.47:42406/0 (socket says 172.21.15.47:42406) 2024-04-14T23:34:57.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.641+0000 7f6c30a4e640 1 -- start start 2024-04-14T23:34:57.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f6c30a4e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c240eacf0 0x7f6c2404fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f10b62bc640 1 -- start start 2024-04-14T23:34:57.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f01a48b1640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f01a0157a70 0x7f01a00cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f01a48b1640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f01a0157a70 0x7f01a00cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:35520/0 (socket says 172.21.15.47:35520) 2024-04-14T23:34:57.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f01a48b1640 1 -- 172.21.15.47:0/1131636058 learned_addr learned my addr 172.21.15.47:0/1131636058 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f01a6b15640 1 --2- 172.21.15.47:0/1131636058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01a00aee40 0x7f01a00cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f00d0ef0640 1 --2- 172.21.15.47:0/2015730436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c4038280 0x7f00c40eba10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f00c40ec0d0 tx=0x7f00cc0a6f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6497d278c4cd036 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f01a6b15640 1 -- 172.21.15.47:0/1131636058 --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01a015dce0 con 0x7f01a00b3250 2024-04-14T23:34:57.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f01a6b15640 1 -- 172.21.15.47:0/1131636058 --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f01a015dfc0 con 0x7f01a0157a70 2024-04-14T23:34:57.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f01a50b2640 1 --2- 172.21.15.47:0/1131636058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01a00aee40 0x7f01a00cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f01a6b15640 1 -- 172.21.15.47:0/1131636058 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f01a015e2a0 con 0x7f01a00aee40 2024-04-14T23:34:57.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f31ee368640 1 Processor -- start 2024-04-14T23:34:57.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f31ee368640 1 -- start start 2024-04-14T23:34:57.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f376d5ca640 1 --2- 172.21.15.47:0/1316579333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f376806e4f0 0x7f376806e980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f375c0097a0 tx=0x7f375c02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f3f6932db2ad9a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f6c2b7fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c240eacf0 0x7f6c2404fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f6c2b7fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c240eacf0 0x7f6c2404fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58286/0 (socket says 172.21.15.47:58286) 2024-04-14T23:34:57.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f6c2b7fe640 1 -- 172.21.15.47:0/1965801584 learned_addr learned my addr 172.21.15.47:0/1965801584 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f6c30a4e640 1 --2- 172.21.15.47:0/1965801584 >> v2:172.21.15.47:3300/0 conn(0x7f6c24006e90 0x7f6c24007320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1965801584 --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c24053710 con 0x7f6c2404ffc0 2024-04-14T23:34:57.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f00d1ef2640 1 --2- 172.21.15.47:0/2015730436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c40061a0 0x7f00c4006630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:57.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f6c2bfff640 1 --2- 172.21.15.47:0/1965801584 >> v2:172.21.15.47:3300/0 conn(0x7f6c24006e90 0x7f6c24007320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1965801584 --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6c24054320 con 0x7f6c24006e90 2024-04-14T23:34:57.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1965801584 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6c240539f0 con 0x7f6c240eacf0 2024-04-14T23:34:57.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f01a50b2640 1 -- 172.21.15.47:0/1131636058 >> v2:172.21.15.191:3300/0 conn(0x7f01a0157a70 msgr2=0x7f01a00cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f01a50b2640 1 --2- 172.21.15.47:0/1131636058 >> v2:172.21.15.191:3300/0 conn(0x7f01a0157a70 0x7f01a00cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f37677fe640 1 -- 172.21.15.47:0/1316579333 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c031780 con 0x7f376806e4f0 2024-04-14T23:34:57.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f01a50b2640 1 -- 172.21.15.47:0/1131636058 >> v1:172.21.15.47:6789/0 conn(0x7f01a00b3250 legacy=0x7f01a006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f01a50b2640 1 -- 172.21.15.47:0/1131636058 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a015e580 con 0x7f01a00aee40 2024-04-14T23:34:57.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f37677fe640 1 -- 172.21.15.47:0/1316579333 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c037070 con 0x7f376806e4f0 2024-04-14T23:34:57.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f37677fe640 1 -- 172.21.15.47:0/1316579333 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c031b40 con 0x7f376806e4f0 2024-04-14T23:34:57.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f6c2a7fc640 1 -- 172.21.15.47:0/1965801584 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2994182156 0 0) 0x7f6c24053710 con 0x7f6c2404ffc0 2024-04-14T23:34:57.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f6c2a7fc640 1 -- 172.21.15.47:0/1965801584 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c1c003520 con 0x7f6c2404ffc0 2024-04-14T23:34:57.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f8441073640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8434039dc0 con 0x7f8434054340 2024-04-14T23:34:57.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f8441073640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f843403a0a0 con 0x7f84340dfeb0 2024-04-14T23:34:57.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f8441073640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f843404f070 con 0x7f84340398c0 2024-04-14T23:34:57.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f843b7fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84340398c0 0x7f843404fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f843b7fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84340398c0 0x7f843404fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58274/0 (socket says 172.21.15.47:58274) 2024-04-14T23:34:57.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.643+0000 7f843b7fe640 1 -- 172.21.15.47:0/1498343942 learned_addr learned my addr 172.21.15.47:0/1498343942 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f843b7fe640 1 -- 172.21.15.47:0/1498343942 >> v1:172.21.15.191:6789/0 conn(0x7f84340dfeb0 legacy=0x7f84340525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f6c2b7fe640 1 -- 172.21.15.47:0/1965801584 >> v2:172.21.15.47:3300/0 conn(0x7f6c24006e90 msgr2=0x7f6c24007320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f6c2b7fe640 1 --2- 172.21.15.47:0/1965801584 >> v2:172.21.15.47:3300/0 conn(0x7f6c24006e90 0x7f6c24007320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f6c2b7fe640 1 -- 172.21.15.47:0/1965801584 >> v1:172.21.15.191:6789/0 conn(0x7f6c2404ffc0 legacy=0x7f6c24037bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f6c2b7fe640 1 -- 172.21.15.47:0/1965801584 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c24053cd0 con 0x7f6c240eacf0 2024-04-14T23:34:57.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f843affd640 1 -- 172.21.15.47:0/1498343942 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098230437 0 0) 0x7f843403a0a0 con 0x7f84340dfeb0 2024-04-14T23:34:57.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f10b62bc640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f10b015a4f0 0x7f10b0070f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.644+0000 7f31ee368640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e806cd50 0x7f31e8164780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f31ee368640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e806eff0 0x7f31e8160db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f31ee368640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31e8071b10 0x7f31e8165cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f31ee368640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f31e816aad0 con 0x7f31e8071b10 2024-04-14T23:34:57.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f10b62bc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f10b0071460 0x7f10b015e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f31ee368640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f31e80b40e0 con 0x7f31e806eff0 2024-04-14T23:34:57.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f31ee368640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f31e816ac50 con 0x7f31e806cd50 2024-04-14T23:34:57.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f00c3fff640 1 -- 172.21.15.47:0/2015730436 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0a7af0 con 0x7f00c4038280 2024-04-14T23:34:57.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f31e7fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e806cd50 0x7f31e8164780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f31e7fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e806cd50 0x7f31e8164780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58300/0 (socket says 172.21.15.47:58300) 2024-04-14T23:34:57.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f31e7fff640 1 -- 172.21.15.47:0/3749819560 learned_addr learned my addr 172.21.15.47:0/3749819560 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f31ec905640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31e8071b10 0x7f31e8165cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f31e77fe640 1 --2- 172.21.15.47:0/3749819560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e806eff0 0x7f31e8160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f00c3fff640 1 -- 172.21.15.47:0/2015730436 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00cc0a7c90 con 0x7f00c4038280 2024-04-14T23:34:57.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f843b7fe640 1 -- 172.21.15.47:0/1498343942 >> v1:172.21.15.47:6789/0 conn(0x7f8434054340 legacy=0x7f84340506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f843b7fe640 1 -- 172.21.15.47:0/1498343942 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843404f350 con 0x7f84340398c0 2024-04-14T23:34:57.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f376f02d640 1 -- 172.21.15.47:0/1316579333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f376806e4f0 msgr2=0x7f376806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f376f02d640 1 --2- 172.21.15.47:0/1316579333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f376806e4f0 0x7f376806e980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f375c0097a0 tx=0x7f375c02b820 comp rx=0 tx=0).stop 2024-04-14T23:34:57.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f6c2bfff640 1 --2- 172.21.15.47:0/1965801584 >> v2:172.21.15.47:3300/0 conn(0x7f6c24006e90 0x7f6c24007320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:57.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f376f02d640 1 -- 172.21.15.47:0/1316579333 shutdown_connections 2024-04-14T23:34:57.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f376f02d640 1 --2- 172.21.15.47:0/1316579333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f376806e4f0 0x7f376806e980 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f01a50b2640 1 --2- 172.21.15.47:0/1131636058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01a00aee40 0x7f01a00cfec0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f01a00d0630 tx=0x7f019802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93889f8b0f24a20e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f376f02d640 1 --2- 172.21.15.47:0/1316579333 >> v2:172.21.15.47:3300/0 conn(0x7f37680b3d70 0x7f37680720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f376f02d640 1 -- 172.21.15.47:0/1316579333 >> 172.21.15.47:0/1316579333 conn(0x7f37680b1d20 msgr2=0x7f37680b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7fbfbd836640 1 Processor -- start 2024-04-14T23:34:57.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7fbfbd836640 1 -- start start 2024-04-14T23:34:57.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f01977fe640 1 -- 172.21.15.47:0/1131636058 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198039070 con 0x7f01a00aee40 2024-04-14T23:34:57.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f00d26f3640 1 -- 172.21.15.47:0/2015730436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c4038280 msgr2=0x7f00c40eba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f00d26f3640 1 --2- 172.21.15.47:0/2015730436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c4038280 0x7f00c40eba10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f00c40ec0d0 tx=0x7f00cc0a6f50 comp rx=0 tx=0).stop 2024-04-14T23:34:57.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f00d26f3640 1 -- 172.21.15.47:0/2015730436 shutdown_connections 2024-04-14T23:34:57.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f00d26f3640 1 --2- 172.21.15.47:0/2015730436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c40061a0 0x7f00c4006630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f00d26f3640 1 --2- 172.21.15.47:0/2015730436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c4038280 0x7f00c40eba10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f00d26f3640 1 -- 172.21.15.47:0/2015730436 >> 172.21.15.47:0/2015730436 conn(0x7f00c40559e0 msgr2=0x7f00c4055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f01977fe640 1 -- 172.21.15.47:0/1131636058 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01980316f0 con 0x7f01a00aee40 2024-04-14T23:34:57.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f01977fe640 1 -- 172.21.15.47:0/1131636058 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198031ac0 con 0x7f01a00aee40 2024-04-14T23:34:57.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f31e77fe640 1 -- 172.21.15.47:0/3749819560 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e806cd50 msgr2=0x7f31e8164780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f31e77fe640 1 --2- 172.21.15.47:0/3749819560 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e806cd50 0x7f31e8164780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f31e77fe640 1 -- 172.21.15.47:0/3749819560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31e8071b10 msgr2=0x7f31e8165cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f31e77fe640 1 --2- 172.21.15.47:0/3749819560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31e8071b10 0x7f31e8165cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f31e77fe640 1 -- 172.21.15.47:0/3749819560 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e815fd50 con 0x7f31e806eff0 2024-04-14T23:34:57.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f31e77fe640 1 --2- 172.21.15.47:0/3749819560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e806eff0 0x7f31e8160db0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f31d800d5f0 tx=0x7f31d800dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f31e4ff9640 1 -- 172.21.15.47:0/3749819560 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d80125f0 con 0x7f31e806eff0 2024-04-14T23:34:57.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f31ee368640 1 -- 172.21.15.47:0/3749819560 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e815fff0 con 0x7f31e806eff0 2024-04-14T23:34:57.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f31e4ff9640 1 -- 172.21.15.47:0/3749819560 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d8019070 con 0x7f31e806eff0 2024-04-14T23:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f10b4ab9640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f10b015a4f0 0x7f10b0070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f10b4ab9640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f10b015a4f0 0x7f10b0070f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:35524/0 (socket says 172.21.15.47:35524) 2024-04-14T23:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f10b62bc640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b015aad0 con 0x7f10b01545f0 2024-04-14T23:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f10b62bc640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f10b015adb0 con 0x7f10b0071460 2024-04-14T23:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f10b62bc640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f10b015b090 con 0x7f10b015a4f0 2024-04-14T23:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f10b4ab9640 1 -- 172.21.15.47:0/63591332 learned_addr learned my addr 172.21.15.47:0/63591332 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f10b5abb640 1 --2- 172.21.15.47:0/63591332 >> v2:172.21.15.47:3300/0 conn(0x7f10b0071460 0x7f10b015e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f6c2b7fe640 1 --2- 172.21.15.47:0/1965801584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c240eacf0 0x7f6c2404fa80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009870 tx=0x7f6c2002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b36d9e2cf5c3d50 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f6c2a7fc640 1 -- 172.21.15.47:0/1965801584 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20034070 con 0x7f6c240eacf0 2024-04-14T23:34:57.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f6c2a7fc640 1 -- 172.21.15.47:0/1965801584 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c20030840 con 0x7f6c240eacf0 2024-04-14T23:34:57.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f6c2a7fc640 1 -- 172.21.15.47:0/1965801584 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20030c10 con 0x7f6c240eacf0 2024-04-14T23:34:57.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f10b5abb640 1 -- 172.21.15.47:0/63591332 >> v2:172.21.15.191:3300/0 conn(0x7f10b015a4f0 msgr2=0x7f10b0070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f10b5abb640 1 --2- 172.21.15.47:0/63591332 >> v2:172.21.15.191:3300/0 conn(0x7f10b015a4f0 0x7f10b0070f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f10b5abb640 1 -- 172.21.15.47:0/63591332 >> v1:172.21.15.191:6789/0 conn(0x7f10b01545f0 legacy=0x7f10b00aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:57.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f10b5abb640 1 -- 172.21.15.47:0/63591332 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b015b370 con 0x7f10b0071460 2024-04-14T23:34:57.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f376f02d640 1 -- 172.21.15.47:0/1316579333 shutdown_connections 2024-04-14T23:34:57.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.645+0000 7f376f02d640 1 -- 172.21.15.47:0/1316579333 wait complete. 2024-04-14T23:34:57.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.646+0000 7f31ee368640 1 -- 172.21.15.47:0/3749819560 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e81605b0 con 0x7f31e806eff0 2024-04-14T23:34:57.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f01a6b15640 1 -- 172.21.15.47:0/1131636058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01a00aee40 msgr2=0x7f01a00cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f01a6b15640 1 --2- 172.21.15.47:0/1131636058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01a00aee40 0x7f01a00cfec0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f01a00d0630 tx=0x7f019802b790 comp rx=0 tx=0).stop 2024-04-14T23:34:57.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7fbfbd836640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfb8072d40 0x7fbfb8166800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7fbfbd836640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb8071fc0 con 0x7fbfb814be40 2024-04-14T23:34:57.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f01a6b15640 1 -- 172.21.15.47:0/1131636058 shutdown_connections 2024-04-14T23:34:57.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f01a6b15640 1 --2- 172.21.15.47:0/1131636058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01a00aee40 0x7f01a00cfec0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f01a6b15640 1 --2- 172.21.15.47:0/1131636058 >> v2:172.21.15.191:3300/0 conn(0x7f01a0157a70 0x7f01a00cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f01a6b15640 1 -- 172.21.15.47:0/1131636058 >> 172.21.15.47:0/1131636058 conn(0x7f01a006b200 msgr2=0x7f01a006b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7fbfbd836640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb8166f00 con 0x7fbfb814b490 2024-04-14T23:34:57.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7fbfbd836640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb80728b0 con 0x7fbfb8072d40 2024-04-14T23:34:57.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1965801584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c240eacf0 msgr2=0x7f6c2404fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f6c30a4e640 1 --2- 172.21.15.47:0/1965801584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c240eacf0 0x7f6c2404fa80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009870 tx=0x7f6c2002b980 comp rx=0 tx=0).stop 2024-04-14T23:34:57.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f00d26f3640 1 -- 172.21.15.47:0/2015730436 shutdown_connections 2024-04-14T23:34:57.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f31e4ff9640 1 -- 172.21.15.47:0/3749819560 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d80125f0 con 0x7f31e806eff0 2024-04-14T23:34:57.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7fbfb6ffd640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fbfb814b490 0x7fbfb81660f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.47:42442/0 (socket says 172.21.15.47:42442) 2024-04-14T23:34:57.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f01a6b15640 1 -- 172.21.15.47:0/1131636058 shutdown_connections 2024-04-14T23:34:57.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f01a6b15640 1 -- 172.21.15.47:0/1131636058 wait complete. 2024-04-14T23:34:57.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7fbfb6ffd640 1 -- 172.21.15.47:0/1879238786 learned_addr learned my addr 172.21.15.47:0/1879238786 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:57.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f376f02d640 1 Processor -- start 2024-04-14T23:34:57.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f376f02d640 1 -- start start 2024-04-14T23:34:57.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1965801584 shutdown_connections 2024-04-14T23:34:57.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f6c30a4e640 1 --2- 172.21.15.47:0/1965801584 >> v2:172.21.15.47:3300/0 conn(0x7f6c24006e90 0x7f6c24007320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f6c30a4e640 1 --2- 172.21.15.47:0/1965801584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c240eacf0 0x7f6c2404fa80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1965801584 >> 172.21.15.47:0/1965801584 conn(0x7f6c24009fa0 msgr2=0x7f6c2400a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7fbfb67fc640 1 --2- 172.21.15.47:0/1879238786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfb8072d40 0x7fbfb8166800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7fbfb5ffb640 1 -- 172.21.15.47:0/1879238786 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4033325816 0 0) 0x7fbfb8166f00 con 0x7fbfb814b490 2024-04-14T23:34:57.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f843b7fe640 1 --2- 172.21.15.47:0/1498343942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84340398c0 0x7f843404fb50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f842800df00 tx=0x7f84280342c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adaf7dd502211deb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.648+0000 7f10b5abb640 1 --2- 172.21.15.47:0/63591332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10b0071460 0x7f10b015e0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f10b00d0980 tx=0x7f10a0033fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733ab1d057f966c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.648+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1965801584 shutdown_connections 2024-04-14T23:34:57.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7fbfb5ffb640 1 -- 172.21.15.47:0/1879238786 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfa0003520 con 0x7fbfb814b490 2024-04-14T23:34:57.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.648+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1965801584 wait complete. 2024-04-14T23:34:57.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.648+0000 7fbfb5ffb640 1 -- 172.21.15.47:0/1879238786 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3845115809 0 0) 0x7fbfb8071fc0 con 0x7fbfb814be40 2024-04-14T23:34:57.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.648+0000 7fbfb5ffb640 1 -- 172.21.15.47:0/1879238786 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfb8166f00 con 0x7fbfb814be40 2024-04-14T23:34:57.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.648+0000 7fbfb67fc640 1 -- 172.21.15.47:0/1879238786 >> v1:172.21.15.191:6789/0 conn(0x7fbfb814b490 legacy=0x7fbfb81660f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.648+0000 7fbfb67fc640 1 -- 172.21.15.47:0/1879238786 >> v1:172.21.15.47:6789/0 conn(0x7fbfb814be40 legacy=0x7fbfb80b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.648+0000 7fbfb67fc640 1 -- 172.21.15.47:0/1879238786 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb8072260 con 0x7fbfb8072d40 2024-04-14T23:34:57.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.648+0000 7f10a7fff640 1 -- 172.21.15.47:0/63591332 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0034d80 con 0x7f10b0071460 2024-04-14T23:34:57.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.648+0000 7f10a7fff640 1 -- 172.21.15.47:0/63591332 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a00110d0 con 0x7f10b0071460 2024-04-14T23:34:57.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.648+0000 7f31ee368640 1 -- 172.21.15.47:0/3749819560 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e80753c0 con 0x7f31e806eff0 2024-04-14T23:34:57.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.648+0000 7f10a7fff640 1 -- 172.21.15.47:0/63591332 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a00114a0 con 0x7f10b0071460 2024-04-14T23:34:57.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.647+0000 7f00d26f3640 1 -- 172.21.15.47:0/2015730436 wait complete. 2024-04-14T23:34:57.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f843affd640 1 -- 172.21.15.47:0/1498343942 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8428034e60 con 0x7f84340398c0 2024-04-14T23:34:57.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f843affd640 1 -- 172.21.15.47:0/1498343942 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842803c3f0 con 0x7f84340398c0 2024-04-14T23:34:57.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f843affd640 1 -- 172.21.15.47:0/1498343942 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842803c7c0 con 0x7f84340398c0 2024-04-14T23:34:57.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f376f02d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f376806e4f0 0x7f37681f8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f376f02d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37680b3d70 0x7f3768151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f376f02d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3768162270 0x7f37680c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f376cdc9640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f376806e4f0 0x7f37681f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f376cdc9640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f376806e4f0 0x7f37681f8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58322/0 (socket says 172.21.15.47:58322) 2024-04-14T23:34:57.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f376cdc9640 1 -- 172.21.15.47:0/3951307584 learned_addr learned my addr 172.21.15.47:0/3951307584 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f376f02d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f37681627d0 con 0x7f37680b3d70 2024-04-14T23:34:57.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f376f02d640 1 -- 172.21.15.47:0/3951307584 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3768162650 con 0x7f3768162270 2024-04-14T23:34:57.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f376f02d640 1 -- 172.21.15.47:0/3951307584 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f37680cd4f0 con 0x7f376806e4f0 2024-04-14T23:34:57.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f00d26f3640 1 Processor -- start 2024-04-14T23:34:57.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f376d5ca640 1 --2- 172.21.15.47:0/3951307584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3768162270 0x7f37680c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f01a6b15640 1 Processor -- start 2024-04-14T23:34:57.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f10b62bc640 1 -- 172.21.15.47:0/63591332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10b0071460 msgr2=0x7f10b015e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f10b62bc640 1 --2- 172.21.15.47:0/63591332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10b0071460 0x7f10b015e0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f10b00d0980 tx=0x7f10a0033fd0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f01a6b15640 1 -- start start 2024-04-14T23:34:57.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f00d26f3640 1 -- start start 2024-04-14T23:34:57.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f3767fff640 1 --2- 172.21.15.47:0/3951307584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37680b3d70 0x7f3768151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f376cdc9640 1 -- 172.21.15.47:0/3951307584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3768162270 msgr2=0x7f37680c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f376cdc9640 1 --2- 172.21.15.47:0/3951307584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3768162270 0x7f37680c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f376cdc9640 1 -- 172.21.15.47:0/3951307584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37680b3d70 msgr2=0x7f3768151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f376cdc9640 1 --2- 172.21.15.47:0/3951307584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37680b3d70 0x7f3768151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.649+0000 7f376cdc9640 1 -- 172.21.15.47:0/3951307584 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37681f8ea0 con 0x7f376806e4f0 2024-04-14T23:34:57.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f3767fff640 1 --2- 172.21.15.47:0/3951307584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37680b3d70 0x7f3768151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:57.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f8441073640 1 -- 172.21.15.47:0/1498343942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84340398c0 msgr2=0x7f843404fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f8441073640 1 --2- 172.21.15.47:0/1498343942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84340398c0 0x7f843404fb50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f842800df00 tx=0x7f84280342c0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f376cdc9640 1 --2- 172.21.15.47:0/3951307584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f376806e4f0 0x7f37681f8960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f376000cbb0 tx=0x7f376000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f8441073640 1 -- 172.21.15.47:0/1498343942 shutdown_connections 2024-04-14T23:34:57.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f8441073640 1 --2- 172.21.15.47:0/1498343942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84340398c0 0x7f843404fb50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f8441073640 1 -- 172.21.15.47:0/1498343942 >> 172.21.15.47:0/1498343942 conn(0x7f8434009fa0 msgr2=0x7f843400a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f6c30a4e640 1 Processor -- start 2024-04-14T23:34:57.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f31e4ff9640 1 -- 172.21.15.47:0/3749819560 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f31d8012790 con 0x7f31e806eff0 2024-04-14T23:34:57.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f10b62bc640 1 -- 172.21.15.47:0/63591332 shutdown_connections 2024-04-14T23:34:57.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f10b62bc640 1 --2- 172.21.15.47:0/63591332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10b0071460 0x7f10b015e0a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f10b62bc640 1 --2- 172.21.15.47:0/63591332 >> v2:172.21.15.191:3300/0 conn(0x7f10b015a4f0 0x7f10b0070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7fbfb67fc640 1 --2- 172.21.15.47:0/1879238786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfb8072d40 0x7fbfb8166800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0097d0 tx=0x7fbfac02b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=153055305b90c8e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f10b62bc640 1 -- 172.21.15.47:0/63591332 >> 172.21.15.47:0/63591332 conn(0x7f10b006b3e0 msgr2=0x7f10b006b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f6c30a4e640 1 -- start start 2024-04-14T23:34:57.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f10b62bc640 1 -- 172.21.15.47:0/63591332 shutdown_connections 2024-04-14T23:34:57.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f10b62bc640 1 -- 172.21.15.47:0/63591332 wait complete. 2024-04-14T23:34:57.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f31e4ff9640 1 --2- 172.21.15.47:0/3749819560 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f31d406bd90 0x7f31d406e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f31e4ff9640 1 -- 172.21.15.47:0/3749819560 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f31d800f040 con 0x7f31e806eff0 2024-04-14T23:34:57.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7f8441073640 1 -- 172.21.15.47:0/1498343942 shutdown_connections 2024-04-14T23:34:57.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7f01a6b15640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01a00aee40 0x7f01a014b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7f00d26f3640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c40061a0 0x7f00c417c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7f00d26f3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c4038280 0x7f00c40d7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7f01a6b15640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01a00b3250 0x7f01a014f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7f01a48b1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01a00aee40 0x7f01a014b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7f01a48b1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01a00aee40 0x7f01a014b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58338/0 (socket says 172.21.15.47:58338) 2024-04-14T23:34:57.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f37657fa640 1 -- 172.21.15.47:0/3951307584 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760017070 con 0x7f376806e4f0 2024-04-14T23:34:57.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.650+0000 7f37657fa640 1 -- 172.21.15.47:0/3951307584 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f376000ad40 con 0x7f376806e4f0 2024-04-14T23:34:57.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7f37657fa640 1 -- 172.21.15.47:0/3951307584 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760012600 con 0x7f376806e4f0 2024-04-14T23:34:57.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7f376f02d640 1 -- 172.21.15.47:0/3951307584 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37680c6350 con 0x7f376806e4f0 2024-04-14T23:34:57.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7f376f02d640 1 -- 172.21.15.47:0/3951307584 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f37680c6910 con 0x7f376806e4f0 2024-04-14T23:34:57.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7f31e7fff640 1 --2- 172.21.15.47:0/3749819560 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f31d406bd90 0x7f31d406e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7f00d16f1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c40061a0 0x7f00c417c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7f00d16f1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c40061a0 0x7f00c417c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58348/0 (socket says 172.21.15.47:58348) 2024-04-14T23:34:57.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7fbfb5ffb640 1 -- 172.21.15.47:0/1879238786 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac034070 con 0x7fbfb8072d40 2024-04-14T23:34:57.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7f0197fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01a00b3250 0x7f01a014f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7fbfb5ffb640 1 -- 172.21.15.47:0/1879238786 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfac030800 con 0x7fbfb8072d40 2024-04-14T23:34:57.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7fbfb5ffb640 1 -- 172.21.15.47:0/1879238786 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac030bd0 con 0x7fbfb8072d40 2024-04-14T23:34:57.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7f0197fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01a00b3250 0x7f01a014f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36078/0 (socket says 172.21.15.47:36078) 2024-04-14T23:34:57.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.651+0000 7f01a48b1640 1 -- 172.21.15.47:0/1361789822 learned_addr learned my addr 172.21.15.47:0/1361789822 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f01a6b15640 1 --2- 172.21.15.47:0/1361789822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01a0157a70 0x7f01a014f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f10b62bc640 1 Processor -- start 2024-04-14T23:34:57.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f6c30a4e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c24006e90 0x7f6c24046120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f00d26f3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c40e7820 0x7f00c400d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f10b62bc640 1 -- start start 2024-04-14T23:34:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f6c30a4e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c2404ffc0 0x7f6c240ddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f00d26f3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f00c40ec1a0 con 0x7f00c4038280 2024-04-14T23:34:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f00d26f3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f00c40587c0 con 0x7f00c40e7820 2024-04-14T23:34:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f8441073640 1 -- 172.21.15.47:0/1498343942 wait complete. 2024-04-14T23:34:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f6c2b7fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c24006e90 0x7f6c24046120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f6c2b7fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c24006e90 0x7f6c24046120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58360/0 (socket says 172.21.15.47:58360) 2024-04-14T23:34:57.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f00d26f3640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f00c4058ce0 con 0x7f00c40061a0 2024-04-14T23:34:57.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f00d16f1640 1 -- 172.21.15.47:0/516375901 learned_addr learned my addr 172.21.15.47:0/516375901 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f00d0ef0640 1 --2- 172.21.15.47:0/516375901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c4038280 0x7f00c40d7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f6c2b7fe640 1 -- 172.21.15.47:0/1538016499 learned_addr learned my addr 172.21.15.47:0/1538016499 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f31e7fff640 1 --2- 172.21.15.47:0/3749819560 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f31d406bd90 0x7f31d406e250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f31dc02ba00 tx=0x7f31dc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f6c2affd640 1 --2- 172.21.15.47:0/1538016499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c2404ffc0 0x7f6c240ddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f6c30a4e640 1 --2- 172.21.15.47:0/1538016499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c240eacf0 0x7f6c2404a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1538016499 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6c24054930 con 0x7f6c240eacf0 2024-04-14T23:34:57.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7fbfbd836640 1 -- 172.21.15.47:0/1879238786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfb8072d40 msgr2=0x7fbfb8166800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7fbfbd836640 1 --2- 172.21.15.47:0/1879238786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfb8072d40 0x7fbfb8166800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0097d0 tx=0x7fbfac02b940 comp rx=0 tx=0).stop 2024-04-14T23:34:57.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1538016499 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6c240547b0 con 0x7f6c2404ffc0 2024-04-14T23:34:57.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f00d0ef0640 1 -- 172.21.15.47:0/516375901 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c40061a0 msgr2=0x7f00c417c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1538016499 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2404f540 con 0x7f6c24006e90 2024-04-14T23:34:57.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f00d0ef0640 1 --2- 172.21.15.47:0/516375901 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c40061a0 0x7f00c417c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f00d0ef0640 1 -- 172.21.15.47:0/516375901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c40e7820 msgr2=0x7f00c400d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f00d0ef0640 1 --2- 172.21.15.47:0/516375901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c40e7820 0x7f00c400d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f00d0ef0640 1 -- 172.21.15.47:0/516375901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c4185fe0 con 0x7f00c4038280 2024-04-14T23:34:57.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7fbfbd836640 1 -- 172.21.15.47:0/1879238786 shutdown_connections 2024-04-14T23:34:57.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7fbfbd836640 1 --2- 172.21.15.47:0/1879238786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfb8072d40 0x7fbfb8166800 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7fbfbd836640 1 -- 172.21.15.47:0/1879238786 >> 172.21.15.47:0/1879238786 conn(0x7fbfb80b1770 msgr2=0x7fbfb80b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:57.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f376f02d640 1 -- 172.21.15.47:0/3951307584 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3768075430 con 0x7f376806e4f0 2024-04-14T23:34:57.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7fbfbd836640 1 -- 172.21.15.47:0/1879238786 shutdown_connections 2024-04-14T23:34:57.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f01a6b15640 1 -- 172.21.15.47:0/1361789822 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f01a00aea60 con 0x7f01a00b3250 2024-04-14T23:34:57.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f01a6b15640 1 -- 172.21.15.47:0/1361789822 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f01a0071090 con 0x7f01a0157a70 2024-04-14T23:34:57.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.652+0000 7f01a6b15640 1 -- 172.21.15.47:0/1361789822 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f01a00aebe0 con 0x7f01a00aee40 2024-04-14T23:34:57.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7fbfbd836640 1 -- 172.21.15.47:0/1879238786 wait complete. 2024-04-14T23:34:57.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f6c2bfff640 1 --2- 172.21.15.47:0/1538016499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c240eacf0 0x7f6c2404a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f01a50b2640 1 --2- 172.21.15.47:0/1361789822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01a0157a70 0x7f01a014f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f10b62bc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10b0071460 0x7f10b01514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f10b62bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10b01545f0 0x7f10b0158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f00d0ef0640 1 --2- 172.21.15.47:0/516375901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c4038280 0x7f00c40d7ea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f00cc069900 tx=0x7f00cc0744d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f6c2b7fe640 1 -- 172.21.15.47:0/1538016499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c2404ffc0 msgr2=0x7f6c240ddeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f6c2b7fe640 1 --2- 172.21.15.47:0/1538016499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c2404ffc0 0x7f6c240ddeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f6c2b7fe640 1 -- 172.21.15.47:0/1538016499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c240eacf0 msgr2=0x7f6c2404a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f6c2b7fe640 1 --2- 172.21.15.47:0/1538016499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c240eacf0 0x7f6c2404a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f6c2b7fe640 1 -- 172.21.15.47:0/1538016499 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c240474a0 con 0x7f6c24006e90 2024-04-14T23:34:57.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f10b62bc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10b015a4f0 0x7f10b0158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f10b62bc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f10b006edd0 con 0x7f10b01545f0 2024-04-14T23:34:57.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f10b62bc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f10b006ec50 con 0x7f10b0071460 2024-04-14T23:34:57.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f10b62bc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f10b015e5e0 con 0x7f10b015a4f0 2024-04-14T23:34:57.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f10b52ba640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10b0071460 0x7f10b01514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f8441073640 1 Processor -- start 2024-04-14T23:34:57.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f37657fa640 1 -- 172.21.15.47:0/3951307584 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f376001a070 con 0x7f376806e4f0 2024-04-14T23:34:57.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f01a50b2640 1 -- 172.21.15.47:0/1361789822 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01a00aee40 msgr2=0x7f01a014b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f01a50b2640 1 --2- 172.21.15.47:0/1361789822 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01a00aee40 0x7f01a014b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f01a50b2640 1 -- 172.21.15.47:0/1361789822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01a00b3250 msgr2=0x7f01a014f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f01a50b2640 1 --2- 172.21.15.47:0/1361789822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01a00b3250 0x7f01a014f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f01a50b2640 1 -- 172.21.15.47:0/1361789822 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a014fdc0 con 0x7f01a0157a70 2024-04-14T23:34:57.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f8441073640 1 -- start start 2024-04-14T23:34:57.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f10b52ba640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10b0071460 0x7f10b01514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:35580/0 (socket says 172.21.15.47:35580) 2024-04-14T23:34:57.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.653+0000 7f10b52ba640 1 -- 172.21.15.47:0/2467600456 learned_addr learned my addr 172.21.15.47:0/2467600456 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f10b5abb640 1 --2- 172.21.15.47:0/2467600456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10b015a4f0 0x7f10b0158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f6c2b7fe640 1 --2- 172.21.15.47:0/1538016499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c24006e90 0x7f6c24046120 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009990 tx=0x7f6c200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f10b4ab9640 1 --2- 172.21.15.47:0/2467600456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10b01545f0 0x7f10b0158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f00c1ffb640 1 -- 172.21.15.47:0/516375901 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0c0070 con 0x7f00c4038280 2024-04-14T23:34:57.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f01a50b2640 1 --2- 172.21.15.47:0/1361789822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01a0157a70 0x7f01a014f880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0198033000 tx=0x7f01980046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f00d26f3640 1 -- 172.21.15.47:0/516375901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c41862c0 con 0x7f00c4038280 2024-04-14T23:34:57.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f00c1ffb640 1 -- 172.21.15.47:0/516375901 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00cc06eac0 con 0x7f00c4038280 2024-04-14T23:34:57.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f00c1ffb640 1 -- 172.21.15.47:0/516375901 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0ba400 con 0x7f00c4038280 2024-04-14T23:34:57.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f10b52ba640 1 -- 172.21.15.47:0/2467600456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10b015a4f0 msgr2=0x7f10b0158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f10b52ba640 1 --2- 172.21.15.47:0/2467600456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10b015a4f0 0x7f10b0158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f37657fa640 1 --2- 172.21.15.47:0/3951307584 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f375406b9e0 0x7f375406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f37657fa640 1 -- 172.21.15.47:0/3951307584 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f376008a8a0 con 0x7f376806e4f0 2024-04-14T23:34:57.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f10b52ba640 1 -- 172.21.15.47:0/2467600456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10b01545f0 msgr2=0x7f10b0158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f10b52ba640 1 --2- 172.21.15.47:0/2467600456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10b01545f0 0x7f10b0158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f3767fff640 1 --2- 172.21.15.47:0/3951307584 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f375406b9e0 0x7f375406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f10b52ba640 1 -- 172.21.15.47:0/2467600456 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b00afc30 con 0x7f10b0071460 2024-04-14T23:34:57.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f10b4ab9640 1 --2- 172.21.15.47:0/2467600456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10b01545f0 0x7f10b0158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:57.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f10b5abb640 1 --2- 172.21.15.47:0/2467600456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10b015a4f0 0x7f10b0158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:57.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.654+0000 7f00d26f3640 1 -- 172.21.15.47:0/516375901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c400b5b0 con 0x7f00c4038280 2024-04-14T23:34:57.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.655+0000 7f10b52ba640 1 --2- 172.21.15.47:0/2467600456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10b0071460 0x7f10b01514c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f10a800c7c0 tx=0x7f10a800cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.655+0000 7fbfbd836640 1 Processor -- start 2024-04-14T23:34:57.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.655+0000 7f8441073640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84340398c0 0x7f8434046f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.655+0000 7f8441073640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8434054340 0x7f843404ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.655+0000 7f3767fff640 1 --2- 172.21.15.47:0/3951307584 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f375406b9e0 0x7f375406dea0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f37680cbfd0 tx=0x7f3758008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.655+0000 7fbfbd836640 1 -- start start 2024-04-14T23:34:57.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.655+0000 7f843bfff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84340398c0 0x7f8434046f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.655+0000 7f843bfff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84340398c0 0x7f8434046f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58374/0 (socket says 172.21.15.47:58374) 2024-04-14T23:34:57.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.655+0000 7f843bfff640 1 -- 172.21.15.47:0/1165386848 learned_addr learned my addr 172.21.15.47:0/1165386848 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.655+0000 7f843b7fe640 1 --2- 172.21.15.47:0/1165386848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8434054340 0x7f843404ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.655+0000 7f00d26f3640 1 -- 172.21.15.47:0/516375901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c40057e0 con 0x7f00c4038280 2024-04-14T23:34:57.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.655+0000 7f8441073640 1 --2- 172.21.15.47:0/1165386848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84340dfeb0 0x7f84340dd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f00c1ffb640 1 -- 172.21.15.47:0/516375901 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f00cc0c3070 con 0x7f00c4038280 2024-04-14T23:34:57.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f8440872640 1 --2- 172.21.15.47:0/1165386848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84340dfeb0 0x7f84340dd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f8441073640 1 -- 172.21.15.47:0/1165386848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8434052d00 con 0x7f84340dfeb0 2024-04-14T23:34:57.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f8441073640 1 -- 172.21.15.47:0/1165386848 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f84340e0290 con 0x7f8434054340 2024-04-14T23:34:57.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f8441073640 1 -- 172.21.15.47:0/1165386848 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f84340d8c50 con 0x7f84340398c0 2024-04-14T23:34:57.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f10a5ffb640 1 -- 172.21.15.47:0/2467600456 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8016020 con 0x7f10b0071460 2024-04-14T23:34:57.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f01957fa640 1 -- 172.21.15.47:0/1361789822 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198043020 con 0x7f01a0157a70 2024-04-14T23:34:57.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f01957fa640 1 -- 172.21.15.47:0/1361789822 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0198034480 con 0x7f01a0157a70 2024-04-14T23:34:57.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f01957fa640 1 -- 172.21.15.47:0/1361789822 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198039040 con 0x7f01a0157a70 2024-04-14T23:34:57.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f10a5ffb640 1 -- 172.21.15.47:0/2467600456 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a800aa50 con 0x7f10b0071460 2024-04-14T23:34:57.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f00c1ffb640 1 --2- 172.21.15.47:0/516375901 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f00b006b9e0 0x7f00b006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f10b62bc640 1 -- 172.21.15.47:0/2467600456 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b00aff10 con 0x7f10b0071460 2024-04-14T23:34:57.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f01a6b15640 1 -- 172.21.15.47:0/1361789822 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a014b980 con 0x7f01a0157a70 2024-04-14T23:34:57.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f01a6b15640 1 -- 172.21.15.47:0/1361789822 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a0150310 con 0x7f01a0157a70 2024-04-14T23:34:57.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7fbfbd836640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfb8072d40 0x7fbfb8161e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f31e4ff9640 1 -- 172.21.15.47:0/3749819560 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f31d8022020 con 0x7f31e806eff0 2024-04-14T23:34:57.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f10a5ffb640 1 -- 172.21.15.47:0/2467600456 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8012420 con 0x7f10b0071460 2024-04-14T23:34:57.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f10b62bc640 1 -- 172.21.15.47:0/2467600456 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b00cdd10 con 0x7f10b0071460 2024-04-14T23:34:57.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.656+0000 7f00d16f1640 1 --2- 172.21.15.47:0/516375901 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f00b006b9e0 0x7f00b006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.657+0000 7f00c1ffb640 1 -- 172.21.15.47:0/516375901 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f00cc127c00 con 0x7f00c4038280 2024-04-14T23:34:57.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.657+0000 7f00d16f1640 1 --2- 172.21.15.47:0/516375901 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f00b006b9e0 0x7f00b006dea0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f00c8004ee0 tx=0x7f00c8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.658+0000 7f10b62bc640 1 -- 172.21.15.47:0/2467600456 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b0075460 con 0x7f10b0071460 2024-04-14T23:34:57.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.657+0000 7f843bfff640 1 -- 172.21.15.47:0/1165386848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8434054340 msgr2=0x7f843404ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.657+0000 7f843bfff640 1 --2- 172.21.15.47:0/1165386848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8434054340 0x7f843404ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.657+0000 7f843bfff640 1 -- 172.21.15.47:0/1165386848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84340dfeb0 msgr2=0x7f84340dd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.657+0000 7f843bfff640 1 --2- 172.21.15.47:0/1165386848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84340dfeb0 0x7f84340dd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.657+0000 7f843bfff640 1 -- 172.21.15.47:0/1165386848 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84340485e0 con 0x7f84340398c0 2024-04-14T23:34:57.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.657+0000 7f843bfff640 1 --2- 172.21.15.47:0/1165386848 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84340398c0 0x7f8434046f80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f843000c3f0 tx=0x7f843000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.658+0000 7f8440872640 1 --2- 172.21.15.47:0/1165386848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84340dfeb0 0x7f84340dd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:57.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.658+0000 7f01a6b15640 1 -- 172.21.15.47:0/1361789822 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a00753c0 con 0x7f01a0157a70 2024-04-14T23:34:57.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.657+0000 7fbfbd836640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb814b490 0x7fbfb81f9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.657+0000 7fbfbd836640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfb814be40 0x7fbfb8145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.657+0000 7fbfbd836640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb814ba70 con 0x7fbfb814b490 2024-04-14T23:34:57.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.657+0000 7fbfbd836640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb814b8f0 con 0x7fbfb8072d40 2024-04-14T23:34:57.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.657+0000 7fbfbd836640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb814bbf0 con 0x7fbfb814be40 2024-04-14T23:34:57.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.658+0000 7fbfb67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb814b490 0x7fbfb81f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.658+0000 7fbfb67fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb814b490 0x7fbfb81f9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36132/0 (socket says 172.21.15.47:36132) 2024-04-14T23:34:57.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.658+0000 7fbfb67fc640 1 -- 172.21.15.47:0/92026686 learned_addr learned my addr 172.21.15.47:0/92026686 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:57.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.658+0000 7fbfb77fe640 1 --2- 172.21.15.47:0/92026686 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfb814be40 0x7fbfb8145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.658+0000 7fbfb77fe640 1 -- 172.21.15.47:0/92026686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfb8072d40 msgr2=0x7fbfb8161e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.658+0000 7fbfb77fe640 1 --2- 172.21.15.47:0/92026686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfb8072d40 0x7fbfb8161e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.658+0000 7fbfb77fe640 1 -- 172.21.15.47:0/92026686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb814b490 msgr2=0x7fbfb81f9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:57.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.658+0000 7f01957fa640 1 -- 172.21.15.47:0/1361789822 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0198046020 con 0x7f01a0157a70 2024-04-14T23:34:57.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.658+0000 7fbfb77fe640 1 --2- 172.21.15.47:0/92026686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb814b490 0x7fbfb81f9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:57.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.658+0000 7fbfb77fe640 1 -- 172.21.15.47:0/92026686 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb8162360 con 0x7fbfb814be40 2024-04-14T23:34:57.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.658+0000 7fbfb77fe640 1 --2- 172.21.15.47:0/92026686 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfb814be40 0x7fbfb8145bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00011e0 tx=0x7fbfb0001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.659+0000 7f01957fa640 1 --2- 172.21.15.47:0/1361789822 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f018c06ba10 0x7f018c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.659+0000 7f01957fa640 1 -- 172.21.15.47:0/1361789822 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f01980ac170 con 0x7f01a0157a70 2024-04-14T23:34:57.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.659+0000 7f01a48b1640 1 --2- 172.21.15.47:0/1361789822 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f018c06ba10 0x7f018c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.659+0000 7f10a5ffb640 1 -- 172.21.15.47:0/2467600456 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f10a8019020 con 0x7f10b0071460 2024-04-14T23:34:57.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.659+0000 7f8438ff9640 1 -- 172.21.15.47:0/1165386848 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84300074e0 con 0x7f84340398c0 2024-04-14T23:34:57.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.659+0000 7fbf9ffff640 1 -- 172.21.15.47:0/92026686 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0017070 con 0x7fbfb814be40 2024-04-14T23:34:57.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7f8438ff9640 1 -- 172.21.15.47:0/1165386848 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84300047e0 con 0x7f84340398c0 2024-04-14T23:34:57.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7f37657fa640 1 -- 172.21.15.47:0/3951307584 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3760058b00 con 0x7f376806e4f0 2024-04-14T23:34:57.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7fbfbd836640 1 -- 172.21.15.47:0/92026686 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb81f9580 con 0x7fbfb814be40 2024-04-14T23:34:57.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7fbfbd836640 1 -- 172.21.15.47:0/92026686 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb8164690 con 0x7fbfb814be40 2024-04-14T23:34:57.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7f10a5ffb640 1 --2- 172.21.15.47:0/2467600456 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f109406b990 0x7f109406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7f6c17fff640 1 -- 172.21.15.47:0/1538016499 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20034040 con 0x7f6c24006e90 2024-04-14T23:34:57.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7f6c17fff640 1 -- 172.21.15.47:0/1538016499 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c20039d70 con 0x7f6c24006e90 2024-04-14T23:34:57.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7f6c17fff640 1 -- 172.21.15.47:0/1538016499 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20043610 con 0x7f6c24006e90 2024-04-14T23:34:57.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7fbf9ffff640 1 -- 172.21.15.47:0/92026686 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb00052f0 con 0x7fbfb814be40 2024-04-14T23:34:57.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7fbf9ffff640 1 -- 172.21.15.47:0/92026686 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0003830 con 0x7fbfb814be40 2024-04-14T23:34:57.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7f10b4ab9640 1 --2- 172.21.15.47:0/2467600456 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f109406b990 0x7f109406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7f10a5ffb640 1 -- 172.21.15.47:0/2467600456 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f10a808abc0 con 0x7f10b0071460 2024-04-14T23:34:57.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7f10b4ab9640 1 --2- 172.21.15.47:0/2467600456 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f109406b990 0x7f109406de50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f10b00ae330 tx=0x7f10ac009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1538016499 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c24046660 con 0x7f6c24006e90 2024-04-14T23:34:57.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1538016499 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c24046c00 con 0x7f6c24006e90 2024-04-14T23:34:57.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.661+0000 7f01a48b1640 1 --2- 172.21.15.47:0/1361789822 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f018c06ba10 0x7f018c06ded0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f019c008fd0 tx=0x7f019c00c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7f8438ff9640 1 -- 172.21.15.47:0/1165386848 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8430004b90 con 0x7f84340398c0 2024-04-14T23:34:57.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7f8441073640 1 -- 172.21.15.47:0/1165386848 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84340d8ea0 con 0x7f84340398c0 2024-04-14T23:34:57.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.660+0000 7f8441073640 1 -- 172.21.15.47:0/1165386848 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f84340d9460 con 0x7f84340398c0 2024-04-14T23:34:57.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.662+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1538016499 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c24005380 con 0x7f6c24006e90 2024-04-14T23:34:57.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.662+0000 7f8438ff9640 1 -- 172.21.15.47:0/1165386848 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f8430011070 con 0x7f84340398c0 2024-04-14T23:34:57.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.662+0000 7f8441073640 1 -- 172.21.15.47:0/1165386848 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841c005290 con 0x7f84340398c0 2024-04-14T23:34:57.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.662+0000 7f8438ff9640 1 --2- 172.21.15.47:0/1165386848 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f842006b990 0x7f842006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.663+0000 7f8438ff9640 1 -- 172.21.15.47:0/1165386848 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f843008a740 con 0x7f84340398c0 2024-04-14T23:34:57.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.663+0000 7f843b7fe640 1 --2- 172.21.15.47:0/1165386848 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f842006b990 0x7f842006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.662+0000 7fbfbd836640 1 -- 172.21.15.47:0/92026686 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf98005290 con 0x7fbfb814be40 2024-04-14T23:34:57.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.663+0000 7f6c17fff640 1 -- 172.21.15.47:0/1538016499 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6c20037070 con 0x7f6c24006e90 2024-04-14T23:34:57.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.663+0000 7f6c17fff640 1 --2- 172.21.15.47:0/1538016499 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6c1006ba60 0x7f6c1006df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.663+0000 7f10a5ffb640 1 -- 172.21.15.47:0/2467600456 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f10a8020070 con 0x7f10b0071460 2024-04-14T23:34:57.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.664+0000 7f6c17fff640 1 -- 172.21.15.47:0/1538016499 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6c200acc20 con 0x7f6c24006e90 2024-04-14T23:34:57.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.664+0000 7f6c2affd640 1 --2- 172.21.15.47:0/1538016499 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6c1006ba60 0x7f6c1006df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.663+0000 7fbf9ffff640 1 -- 172.21.15.47:0/92026686 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fbfb001a070 con 0x7fbfb814be40 2024-04-14T23:34:57.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.664+0000 7f843b7fe640 1 --2- 172.21.15.47:0/1165386848 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f842006b990 0x7f842006de50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f842803d000 tx=0x7f8428038000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.664+0000 7fbf9ffff640 1 --2- 172.21.15.47:0/92026686 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbfa406b9c0 0x7fbfa406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.664+0000 7fbf9ffff640 1 -- 172.21.15.47:0/92026686 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbfb0089b90 con 0x7fbfb814be40 2024-04-14T23:34:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.664+0000 7f00c1ffb640 1 -- 172.21.15.47:0/516375901 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f00cc12d020 con 0x7f00c4038280 2024-04-14T23:34:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.664+0000 7fbfb6ffd640 1 --2- 172.21.15.47:0/92026686 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbfa406b9c0 0x7fbfa406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.665+0000 7f6c2affd640 1 --2- 172.21.15.47:0/1538016499 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6c1006ba60 0x7f6c1006df20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6c18007fd0 tx=0x7f6c18009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.665+0000 7fbfb6ffd640 1 --2- 172.21.15.47:0/92026686 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbfa406b9c0 0x7fbfa406de80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8002000 tx=0x7fbfa80015f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:57.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.668+0000 7f8438ff9640 1 -- 172.21.15.47:0/1165386848 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8430058f70 con 0x7f84340398c0 2024-04-14T23:34:57.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.669+0000 7f01957fa640 1 -- 172.21.15.47:0/1361789822 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f019804d030 con 0x7f01a0157a70 2024-04-14T23:34:57.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.672+0000 7f6c17fff640 1 -- 172.21.15.47:0/1538016499 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6c2003e070 con 0x7f6c24006e90 2024-04-14T23:34:57.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:57.677+0000 7fbf9ffff640 1 -- 172.21.15.47:0/92026686 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbfb8162360 con 0x7fbfb814be40 2024-04-14T23:34:58.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.071+0000 7f31ee368640 1 -- 172.21.15.47:0/3749819560 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f31e80b0c00 con 0x7f31e806eff0 2024-04-14T23:34:58.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.072+0000 7f31e4ff9640 1 -- 172.21.15.47:0/3749819560 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f31d8022020 con 0x7f31e806eff0 2024-04-14T23:34:58.075 INFO:teuthology.orchestra.run.smithi047.stdout:55834574856 2024-04-14T23:34:58.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.075+0000 7f31ce7fc640 1 -- 172.21.15.47:0/3749819560 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f31d406bd90 msgr2=0x7f31d406e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:58.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.075+0000 7f31ce7fc640 1 --2- 172.21.15.47:0/3749819560 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f31d406bd90 0x7f31d406e250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f31dc02ba00 tx=0x7f31dc008030 comp rx=0 tx=0).stop 2024-04-14T23:34:58.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.076+0000 7f31ce7fc640 1 -- 172.21.15.47:0/3749819560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e806eff0 msgr2=0x7f31e8160db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:58.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.076+0000 7f31ce7fc640 1 --2- 172.21.15.47:0/3749819560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e806eff0 0x7f31e8160db0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f31d800d5f0 tx=0x7f31d800dab0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.076+0000 7f31ce7fc640 1 -- 172.21.15.47:0/3749819560 shutdown_connections 2024-04-14T23:34:58.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.076+0000 7f31ce7fc640 1 --2- 172.21.15.47:0/3749819560 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f31d406bd90 0x7f31d406e250 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.076+0000 7f31ce7fc640 1 --2- 172.21.15.47:0/3749819560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31e8071b10 0x7f31e8165cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.076+0000 7f31ce7fc640 1 --2- 172.21.15.47:0/3749819560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e806eff0 0x7f31e8160db0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.076+0000 7f31ce7fc640 1 --2- 172.21.15.47:0/3749819560 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e806cd50 0x7f31e8164780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.076+0000 7f31ce7fc640 1 -- 172.21.15.47:0/3749819560 >> 172.21.15.47:0/3749819560 conn(0x7f31e806b890 msgr2=0x7f31e816dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:58.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.076+0000 7f31ce7fc640 1 -- 172.21.15.47:0/3749819560 shutdown_connections 2024-04-14T23:34:58.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.076+0000 7f31ce7fc640 1 -- 172.21.15.47:0/3749819560 wait complete. 2024-04-14T23:34:58.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.084+0000 7f376f02d640 1 -- 172.21.15.47:0/3951307584 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f37680b2fe0 con 0x7f376806e4f0 2024-04-14T23:34:58.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.084+0000 7f37657fa640 1 -- 172.21.15.47:0/3951307584 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f376005cba0 con 0x7f376806e4f0 2024-04-14T23:34:58.088 INFO:teuthology.orchestra.run.smithi047.stdout:55834574856 2024-04-14T23:34:58.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.088+0000 7f374effd640 1 -- 172.21.15.47:0/3951307584 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f375406b9e0 msgr2=0x7f375406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:58.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.088+0000 7f374effd640 1 --2- 172.21.15.47:0/3951307584 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f375406b9e0 0x7f375406dea0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f37680cbfd0 tx=0x7f3758008040 comp rx=0 tx=0).stop 2024-04-14T23:34:58.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.088+0000 7f374effd640 1 -- 172.21.15.47:0/3951307584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f376806e4f0 msgr2=0x7f37681f8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:58.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.088+0000 7f374effd640 1 --2- 172.21.15.47:0/3951307584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f376806e4f0 0x7f37681f8960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f376000cbb0 tx=0x7f376000a430 comp rx=0 tx=0).stop 2024-04-14T23:34:58.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.089+0000 7f374effd640 1 -- 172.21.15.47:0/3951307584 shutdown_connections 2024-04-14T23:34:58.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.089+0000 7f374effd640 1 --2- 172.21.15.47:0/3951307584 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f375406b9e0 0x7f375406dea0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.089+0000 7f374effd640 1 --2- 172.21.15.47:0/3951307584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3768162270 0x7f37680c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.089+0000 7f374effd640 1 --2- 172.21.15.47:0/3951307584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37680b3d70 0x7f3768151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.089+0000 7f374effd640 1 --2- 172.21.15.47:0/3951307584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f376806e4f0 0x7f37681f8960 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.089+0000 7f374effd640 1 -- 172.21.15.47:0/3951307584 >> 172.21.15.47:0/3951307584 conn(0x7f37680b1d20 msgr2=0x7f37680cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:58.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.089+0000 7f374effd640 1 -- 172.21.15.47:0/3951307584 shutdown_connections 2024-04-14T23:34:58.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.090+0000 7f374effd640 1 -- 172.21.15.47:0/3951307584 wait complete. 2024-04-14T23:34:58.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.090+0000 7f00d26f3640 1 -- 172.21.15.47:0/516375901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f00c40e7120 con 0x7f00c4038280 2024-04-14T23:34:58.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.090+0000 7f00c1ffb640 1 -- 172.21.15.47:0/516375901 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f00cc0b5070 con 0x7f00c4038280 2024-04-14T23:34:58.094 INFO:teuthology.orchestra.run.smithi047.stdout:55834574856 2024-04-14T23:34:58.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-04-14T23:34:58.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.093+0000 7f00d26f3640 1 -- 172.21.15.47:0/516375901 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f00b006b9e0 msgr2=0x7f00b006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:58.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.093+0000 7f00d26f3640 1 --2- 172.21.15.47:0/516375901 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f00b006b9e0 0x7f00b006dea0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f00c8004ee0 tx=0x7f00c8009040 comp rx=0 tx=0).stop 2024-04-14T23:34:58.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.093+0000 7f00d26f3640 1 -- 172.21.15.47:0/516375901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c4038280 msgr2=0x7f00c40d7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:58.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.093+0000 7f00d26f3640 1 --2- 172.21.15.47:0/516375901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c4038280 0x7f00c40d7ea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f00cc069900 tx=0x7f00cc0744d0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.094+0000 7f00d26f3640 1 -- 172.21.15.47:0/516375901 shutdown_connections 2024-04-14T23:34:58.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.094+0000 7f00d26f3640 1 --2- 172.21.15.47:0/516375901 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f00b006b9e0 0x7f00b006dea0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.094+0000 7f00d26f3640 1 --2- 172.21.15.47:0/516375901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c40e7820 0x7f00c400d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.094+0000 7f00d26f3640 1 --2- 172.21.15.47:0/516375901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c4038280 0x7f00c40d7ea0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.094+0000 7f00d26f3640 1 --2- 172.21.15.47:0/516375901 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c40061a0 0x7f00c417c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.094+0000 7f00d26f3640 1 -- 172.21.15.47:0/516375901 >> 172.21.15.47:0/516375901 conn(0x7f00c40559e0 msgr2=0x7f00c404f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:58.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.094+0000 7f00d26f3640 1 -- 172.21.15.47:0/516375901 shutdown_connections 2024-04-14T23:34:58.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.094+0000 7f00d26f3640 1 -- 172.21.15.47:0/516375901 wait complete. 2024-04-14T23:34:58.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.094+0000 7f01a6b15640 1 -- 172.21.15.47:0/1361789822 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f01a0154b80 con 0x7f01a0157a70 2024-04-14T23:34:58.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.095+0000 7f01957fa640 1 -- 172.21.15.47:0/1361789822 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f01a014b980 con 0x7f01a0157a70 2024-04-14T23:34:58.099 INFO:teuthology.orchestra.run.smithi047.stdout:55834574856 2024-04-14T23:34:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.099+0000 7f01a6b15640 1 -- 172.21.15.47:0/1361789822 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f018c06ba10 msgr2=0x7f018c06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.099+0000 7f01a6b15640 1 --2- 172.21.15.47:0/1361789822 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f018c06ba10 0x7f018c06ded0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f019c008fd0 tx=0x7f019c00c040 comp rx=0 tx=0).stop 2024-04-14T23:34:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.099+0000 7f01a6b15640 1 -- 172.21.15.47:0/1361789822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01a0157a70 msgr2=0x7f01a014f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.099+0000 7f01a6b15640 1 --2- 172.21.15.47:0/1361789822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01a0157a70 0x7f01a014f880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0198033000 tx=0x7f01980046c0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.099+0000 7f01a6b15640 1 -- 172.21.15.47:0/1361789822 shutdown_connections 2024-04-14T23:34:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.099+0000 7f01a6b15640 1 --2- 172.21.15.47:0/1361789822 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f018c06ba10 0x7f018c06ded0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.099+0000 7f01a6b15640 1 --2- 172.21.15.47:0/1361789822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01a0157a70 0x7f01a014f880 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.099+0000 7f01a6b15640 1 --2- 172.21.15.47:0/1361789822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01a00b3250 0x7f01a014f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.099+0000 7f01a6b15640 1 --2- 172.21.15.47:0/1361789822 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01a00aee40 0x7f01a014b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.099+0000 7f01a6b15640 1 -- 172.21.15.47:0/1361789822 >> 172.21.15.47:0/1361789822 conn(0x7f01a006b200 msgr2=0x7f01a00b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.099+0000 7f01a6b15640 1 -- 172.21.15.47:0/1361789822 shutdown_connections 2024-04-14T23:34:58.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.099+0000 7f01a6b15640 1 -- 172.21.15.47:0/1361789822 wait complete. 2024-04-14T23:34:58.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.102+0000 7fbfbd836640 1 -- 172.21.15.47:0/92026686 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fbf98005850 con 0x7fbfb814be40 2024-04-14T23:34:58.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.103+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1538016499 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6c24047ba0 con 0x7f6c24006e90 2024-04-14T23:34:58.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.103+0000 7fbf9ffff640 1 -- 172.21.15.47:0/92026686 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbfb0057ea0 con 0x7fbfb814be40 2024-04-14T23:34:58.106 INFO:teuthology.orchestra.run.smithi047.stdout:55834574856 2024-04-14T23:34:58.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.103+0000 7f6c17fff640 1 -- 172.21.15.47:0/1538016499 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6c2007af10 con 0x7f6c24006e90 2024-04-14T23:34:58.107 INFO:teuthology.orchestra.run.smithi047.stdout:55834574856 2024-04-14T23:34:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.106+0000 7fbfbd836640 1 -- 172.21.15.47:0/92026686 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbfa406b9c0 msgr2=0x7fbfa406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.106+0000 7fbfbd836640 1 --2- 172.21.15.47:0/92026686 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbfa406b9c0 0x7fbfa406de80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8002000 tx=0x7fbfa80015f0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.106+0000 7fbfbd836640 1 -- 172.21.15.47:0/92026686 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfb814be40 msgr2=0x7fbfb8145bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.106+0000 7fbfbd836640 1 --2- 172.21.15.47:0/92026686 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfb814be40 0x7fbfb8145bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00011e0 tx=0x7fbfb0001e70 comp rx=0 tx=0).stop 2024-04-14T23:34:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7fbfbd836640 1 -- 172.21.15.47:0/92026686 shutdown_connections 2024-04-14T23:34:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7fbfbd836640 1 --2- 172.21.15.47:0/92026686 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbfa406b9c0 0x7fbfa406de80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7fbfbd836640 1 --2- 172.21.15.47:0/92026686 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfb814be40 0x7fbfb8145bd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7fbfbd836640 1 --2- 172.21.15.47:0/92026686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb814b490 0x7fbfb81f9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7fbfbd836640 1 --2- 172.21.15.47:0/92026686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfb8072d40 0x7fbfb8161e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7fbfbd836640 1 -- 172.21.15.47:0/92026686 >> 172.21.15.47:0/92026686 conn(0x7fbfb80b1770 msgr2=0x7fbfb80b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:58.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.106+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1538016499 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6c1006ba60 msgr2=0x7f6c1006df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:58.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7f6c30a4e640 1 --2- 172.21.15.47:0/1538016499 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6c1006ba60 0x7f6c1006df20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6c18007fd0 tx=0x7f6c18009040 comp rx=0 tx=0).stop 2024-04-14T23:34:58.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1538016499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c24006e90 msgr2=0x7f6c24046120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:58.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7f6c30a4e640 1 --2- 172.21.15.47:0/1538016499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c24006e90 0x7f6c24046120 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009990 tx=0x7f6c200046c0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1538016499 shutdown_connections 2024-04-14T23:34:58.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7f6c30a4e640 1 --2- 172.21.15.47:0/1538016499 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6c1006ba60 0x7f6c1006df20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7f6c30a4e640 1 --2- 172.21.15.47:0/1538016499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c240eacf0 0x7f6c2404a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7f6c30a4e640 1 --2- 172.21.15.47:0/1538016499 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c2404ffc0 0x7f6c240ddeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7f6c30a4e640 1 --2- 172.21.15.47:0/1538016499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c24006e90 0x7f6c24046120 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1538016499 >> 172.21.15.47:0/1538016499 conn(0x7f6c24009fa0 msgr2=0x7f6c24049ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:58.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1538016499 shutdown_connections 2024-04-14T23:34:58.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7fbfbd836640 1 -- 172.21.15.47:0/92026686 shutdown_connections 2024-04-14T23:34:58.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.107+0000 7f6c30a4e640 1 -- 172.21.15.47:0/1538016499 wait complete. 2024-04-14T23:34:58.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.108+0000 7fbfbd836640 1 -- 172.21.15.47:0/92026686 wait complete. 2024-04-14T23:34:58.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-04-14T23:34:58.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.111+0000 7f8441073640 1 -- 172.21.15.47:0/1165386848 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f841c005580 con 0x7f84340398c0 2024-04-14T23:34:58.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.111+0000 7f8438ff9640 1 -- 172.21.15.47:0/1165386848 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8430058870 con 0x7f84340398c0 2024-04-14T23:34:58.114 INFO:teuthology.orchestra.run.smithi047.stdout:55834574856 2024-04-14T23:34:58.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-04-14T23:34:58.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.114+0000 7f8441073640 1 -- 172.21.15.47:0/1165386848 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f842006b990 msgr2=0x7f842006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:58.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.114+0000 7f8441073640 1 --2- 172.21.15.47:0/1165386848 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f842006b990 0x7f842006de50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f842803d000 tx=0x7f8428038000 comp rx=0 tx=0).stop 2024-04-14T23:34:58.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.114+0000 7f8441073640 1 -- 172.21.15.47:0/1165386848 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84340398c0 msgr2=0x7f8434046f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:58.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.114+0000 7f8441073640 1 --2- 172.21.15.47:0/1165386848 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84340398c0 0x7f8434046f80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f843000c3f0 tx=0x7f843000c8b0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.114+0000 7f8441073640 1 -- 172.21.15.47:0/1165386848 shutdown_connections 2024-04-14T23:34:58.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.114+0000 7f8441073640 1 --2- 172.21.15.47:0/1165386848 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f842006b990 0x7f842006de50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.114+0000 7f8441073640 1 --2- 172.21.15.47:0/1165386848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84340dfeb0 0x7f84340dd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.114+0000 7f8441073640 1 --2- 172.21.15.47:0/1165386848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8434054340 0x7f843404ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.114+0000 7f8441073640 1 --2- 172.21.15.47:0/1165386848 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84340398c0 0x7f8434046f80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.114+0000 7f8441073640 1 -- 172.21.15.47:0/1165386848 >> 172.21.15.47:0/1165386848 conn(0x7f8434009fa0 msgr2=0x7f8434006d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:58.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.114+0000 7f10b62bc640 1 -- 172.21.15.47:0/2467600456 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f10b00b00e0 con 0x7f10b0071460 2024-04-14T23:34:58.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.114+0000 7f8441073640 1 -- 172.21.15.47:0/1165386848 shutdown_connections 2024-04-14T23:34:58.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.114+0000 7f8441073640 1 -- 172.21.15.47:0/1165386848 wait complete. 2024-04-14T23:34:58.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.115+0000 7f10a5ffb640 1 -- 172.21.15.47:0/2467600456 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f10a8058ea0 con 0x7f10b0071460 2024-04-14T23:34:58.119 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-04-14T23:34:58.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-04-14T23:34:58.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.118+0000 7f10b62bc640 1 -- 172.21.15.47:0/2467600456 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f109406b990 msgr2=0x7f109406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:58.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.118+0000 7f10b62bc640 1 --2- 172.21.15.47:0/2467600456 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f109406b990 0x7f109406de50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f10b00ae330 tx=0x7f10ac009240 comp rx=0 tx=0).stop 2024-04-14T23:34:58.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.118+0000 7f10b62bc640 1 -- 172.21.15.47:0/2467600456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10b0071460 msgr2=0x7f10b01514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:58.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.118+0000 7f10b62bc640 1 --2- 172.21.15.47:0/2467600456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10b0071460 0x7f10b01514c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f10a800c7c0 tx=0x7f10a800cc80 comp rx=0 tx=0).stop 2024-04-14T23:34:58.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.118+0000 7f10b62bc640 1 -- 172.21.15.47:0/2467600456 shutdown_connections 2024-04-14T23:34:58.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.118+0000 7f10b62bc640 1 --2- 172.21.15.47:0/2467600456 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f109406b990 0x7f109406de50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.118+0000 7f10b62bc640 1 --2- 172.21.15.47:0/2467600456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10b015a4f0 0x7f10b0158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.118+0000 7f10b62bc640 1 --2- 172.21.15.47:0/2467600456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10b01545f0 0x7f10b0158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.118+0000 7f10b62bc640 1 --2- 172.21.15.47:0/2467600456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10b0071460 0x7f10b01514c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:58.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.118+0000 7f10b62bc640 1 -- 172.21.15.47:0/2467600456 >> 172.21.15.47:0/2467600456 conn(0x7f10b006b3e0 msgr2=0x7f10b015b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:58.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.118+0000 7f10b62bc640 1 -- 172.21.15.47:0/2467600456 shutdown_connections 2024-04-14T23:34:58.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:58.118+0000 7f10b62bc640 1 -- 172.21.15.47:0/2467600456 wait complete. 2024-04-14T23:34:58.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2024-04-14T23:34:58.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-04-14T23:34:58.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-04-14T23:34:58.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-04-14T23:34:59.096 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-14T23:34:59.114 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-14T23:34:59.117 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-14T23:34:59.121 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-14T23:34:59.132 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-14T23:34:59.133 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-14T23:34:59.133 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-14T23:34:59.135 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-14T23:34:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.264+0000 7fba6fc84640 1 Processor -- start 2024-04-14T23:34:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.264+0000 7fba6fc84640 1 -- start start 2024-04-14T23:34:59.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.265+0000 7fba6fc84640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba68165920 0x7fba6806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.265+0000 7fba6fc84640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fba68071c10 0x7fba681627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.265+0000 7fba6fc84640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fba6806ccc0 0x7fba6806d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.265+0000 7fba6fc84640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fba680b30a0 con 0x7fba68071c10 2024-04-14T23:34:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.265+0000 7fba6fc84640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fba680721b0 con 0x7fba6806ccc0 2024-04-14T23:34:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.265+0000 7fba6fc84640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fba680b2a50 con 0x7fba68165920 2024-04-14T23:34:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.266+0000 7fba6d21f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fba68071c10 0x7fba681627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.266+0000 7fba6d21f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fba68071c10 0x7fba681627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36138/0 (socket says 172.21.15.47:36138) 2024-04-14T23:34:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.266+0000 7fba6d21f640 1 -- 172.21.15.47:0/491902395 learned_addr learned my addr 172.21.15.47:0/491902395 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.266+0000 7fba6e221640 1 --2- 172.21.15.47:0/491902395 >> v2:172.21.15.191:3300/0 conn(0x7fba6806ccc0 0x7fba6806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.266+0000 7fba6d21f640 1 -- 172.21.15.47:0/491902395 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba68165920 msgr2=0x7fba6806ee80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T23:34:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.266+0000 7fba6d21f640 1 --2- 172.21.15.47:0/491902395 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba68165920 0x7fba6806ee80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.266+0000 7fba6d21f640 1 -- 172.21.15.47:0/491902395 >> v2:172.21.15.191:3300/0 conn(0x7fba6806ccc0 msgr2=0x7fba6806d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.266+0000 7fba6d21f640 1 --2- 172.21.15.47:0/491902395 >> v2:172.21.15.191:3300/0 conn(0x7fba6806ccc0 0x7fba6806d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.266+0000 7fba6d21f640 1 -- 172.21.15.47:0/491902395 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba680b2d30 con 0x7fba68071c10 2024-04-14T23:34:59.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.268+0000 7fba6d21f640 1 --2- 172.21.15.47:0/491902395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba68071c10 0x7fba681627a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fba68072760 tx=0x7fba6402b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df7258541a5a07c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.268+0000 7fba6ca1e640 1 -- 172.21.15.47:0/491902395 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64035020 con 0x7fba68071c10 2024-04-14T23:34:59.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.269+0000 7fba6ca1e640 1 -- 172.21.15.47:0/491902395 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba64031890 con 0x7fba68071c10 2024-04-14T23:34:59.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.270+0000 7fba6fc84640 1 -- 172.21.15.47:0/491902395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba68071c10 msgr2=0x7fba681627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.270+0000 7fba6fc84640 1 --2- 172.21.15.47:0/491902395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba68071c10 0x7fba681627a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fba68072760 tx=0x7fba6402b930 comp rx=0 tx=0).stop 2024-04-14T23:34:59.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.270+0000 7fba6fc84640 1 -- 172.21.15.47:0/491902395 shutdown_connections 2024-04-14T23:34:59.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.270+0000 7fba6fc84640 1 --2- 172.21.15.47:0/491902395 >> v2:172.21.15.191:3300/0 conn(0x7fba6806ccc0 0x7fba6806d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.270+0000 7fba6fc84640 1 --2- 172.21.15.47:0/491902395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba68071c10 0x7fba681627a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.270+0000 7fba6fc84640 1 --2- 172.21.15.47:0/491902395 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba68165920 0x7fba6806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.270+0000 7fba6fc84640 1 -- 172.21.15.47:0/491902395 >> 172.21.15.47:0/491902395 conn(0x7fba6806b890 msgr2=0x7fba680b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.271+0000 7fba6fc84640 1 -- 172.21.15.47:0/491902395 shutdown_connections 2024-04-14T23:34:59.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.271+0000 7fba6fc84640 1 -- 172.21.15.47:0/491902395 wait complete. 2024-04-14T23:34:59.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.273+0000 7fba6fc84640 1 Processor -- start 2024-04-14T23:34:59.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.273+0000 7fba6fc84640 1 -- start start 2024-04-14T23:34:59.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.274+0000 7fba6fc84640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba6806ccc0 0x7fba6814d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.275+0000 7fba6fc84640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba68071c10 0x7fba681639d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.275+0000 7fba6fc84640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba68165920 0x7fba68163f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.275+0000 7fba6d21f640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba68071c10 0x7fba681639d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.275+0000 7fba6d21f640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba68071c10 0x7fba681639d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58392/0 (socket says 172.21.15.47:58392) 2024-04-14T23:34:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.275+0000 7fba6e221640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba68165920 0x7fba68163f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.275+0000 7fba6e221640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba68165920 0x7fba68163f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36142/0 (socket says 172.21.15.47:36142) 2024-04-14T23:34:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.276+0000 7fba6d21f640 1 -- 172.21.15.47:0/1292437952 learned_addr learned my addr 172.21.15.47:0/1292437952 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.276+0000 7fba6fc84640 1 -- 172.21.15.47:0/1292437952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fba680b36b0 con 0x7fba68165920 2024-04-14T23:34:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.276+0000 7fba6fc84640 1 -- 172.21.15.47:0/1292437952 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fba680b3530 con 0x7fba6806ccc0 2024-04-14T23:34:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.276+0000 7fba6fc84640 1 -- 172.21.15.47:0/1292437952 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fba680b3830 con 0x7fba68071c10 2024-04-14T23:34:59.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.277+0000 7fba6e221640 1 -- 172.21.15.47:0/1292437952 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba68071c10 msgr2=0x7fba681639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.277+0000 7fba6e221640 1 --2- 172.21.15.47:0/1292437952 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba68071c10 0x7fba681639d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.277+0000 7fba6e221640 1 -- 172.21.15.47:0/1292437952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba6806ccc0 msgr2=0x7fba6814d310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T23:34:59.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.277+0000 7fba6e221640 1 --2- 172.21.15.47:0/1292437952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba6806ccc0 0x7fba6814d310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.277+0000 7fba6e221640 1 -- 172.21.15.47:0/1292437952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6814cbf0 con 0x7fba68165920 2024-04-14T23:34:59.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.278+0000 7fba6e221640 1 --2- 172.21.15.47:0/1292437952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba68165920 0x7fba68163f10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fba6000eeb0 tx=0x7fba6000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.278+0000 7fba5e7fc640 1 -- 172.21.15.47:0/1292437952 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba60018020 con 0x7fba68165920 2024-04-14T23:34:59.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.278+0000 7fba6fc84640 1 -- 172.21.15.47:0/1292437952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6814c070 con 0x7fba68165920 2024-04-14T23:34:59.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.278+0000 7fba6fc84640 1 -- 172.21.15.47:0/1292437952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba6814c630 con 0x7fba68165920 2024-04-14T23:34:59.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.282+0000 7fba5e7fc640 1 -- 172.21.15.47:0/1292437952 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba6000bdd0 con 0x7fba68165920 2024-04-14T23:34:59.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.283+0000 7fba5e7fc640 1 -- 172.21.15.47:0/1292437952 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba60014620 con 0x7fba68165920 2024-04-14T23:34:59.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.283+0000 7fba5e7fc640 1 -- 172.21.15.47:0/1292437952 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fba60005d10 con 0x7fba68165920 2024-04-14T23:34:59.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.284+0000 7fba5e7fc640 1 --2- 172.21.15.47:0/1292437952 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fba4c06ba90 0x7fba4c06df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.285+0000 7fba6da20640 1 --2- 172.21.15.47:0/1292437952 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fba4c06ba90 0x7fba4c06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.285+0000 7fba5e7fc640 1 -- 172.21.15.47:0/1292437952 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fba6008b580 con 0x7fba68165920 2024-04-14T23:34:59.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.285+0000 7fba6da20640 1 --2- 172.21.15.47:0/1292437952 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fba4c06ba90 0x7fba4c06df50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba58006fd0 tx=0x7fba58006b40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.286+0000 7fba6fc84640 1 -- 172.21.15.47:0/1292437952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba50005290 con 0x7fba68165920 2024-04-14T23:34:59.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.295+0000 7fba5e7fc640 1 -- 172.21.15.47:0/1292437952 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fba60022030 con 0x7fba68165920 2024-04-14T23:34:59.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.316+0000 7fd397508640 1 Processor -- start 2024-04-14T23:34:59.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.316+0000 7ff9c2cd5640 1 Processor -- start 2024-04-14T23:34:59.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.316+0000 7fd397508640 1 -- start start 2024-04-14T23:34:59.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.316+0000 7ff9c2cd5640 1 -- start start 2024-04-14T23:34:59.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.317+0000 7fd397508640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd390163890 0x7fd390165f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.317+0000 7fd397508640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd390166b50 0x7fd3901664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.317+0000 7fd397508640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd390070d70 con 0x7fd39014bf50 2024-04-14T23:34:59.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.317+0000 7fd397508640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fd3901630b0 con 0x7fd390163890 2024-04-14T23:34:59.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.317+0000 7fd397508640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd3901632d0 con 0x7fd390166b50 2024-04-14T23:34:59.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7fd394aa3640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd390163890 0x7fd390165f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7fd394aa3640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd390163890 0x7fd390165f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:35620/0 (socket says 172.21.15.47:35620) 2024-04-14T23:34:59.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7fd394aa3640 1 -- 172.21.15.47:0/1365243698 learned_addr learned my addr 172.21.15.47:0/1365243698 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7fd395aa5640 1 --2- 172.21.15.47:0/1365243698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd390166b50 0x7fd3901664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7ff9c2cd5640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff9bc163890 0x7ff9bc165f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7ff9c2cd5640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff9bc166b50 0x7ff9bc1664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7ff9c2cd5640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9bc070d70 con 0x7ff9bc14bf50 2024-04-14T23:34:59.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7ff9c2cd5640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff9bc1630b0 con 0x7ff9bc163890 2024-04-14T23:34:59.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7ff9c2cd5640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7ff9bc1632d0 con 0x7ff9bc166b50 2024-04-14T23:34:59.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7ff9bbfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff9bc163890 0x7ff9bc165f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7ff9bbfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff9bc163890 0x7ff9bc165f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36158/0 (socket says 172.21.15.47:36158) 2024-04-14T23:34:59.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7ff9bbfff640 1 -- 172.21.15.47:0/4211323112 learned_addr learned my addr 172.21.15.47:0/4211323112 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7ff9c1272640 1 --2- 172.21.15.47:0/4211323112 >> v2:172.21.15.191:3300/0 conn(0x7ff9bc166b50 0x7ff9bc1664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.319+0000 7f9be7166640 1 Processor -- start 2024-04-14T23:34:59.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.319+0000 7f9be7166640 1 -- start start 2024-04-14T23:34:59.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.319+0000 7f69161be640 1 Processor -- start 2024-04-14T23:34:59.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7fd394aa3640 1 -- 172.21.15.47:0/1365243698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd390166b50 msgr2=0x7fd3901664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:59.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7fd394aa3640 1 --2- 172.21.15.47:0/1365243698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd390166b50 0x7fd3901664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7fd394aa3640 1 -- 172.21.15.47:0/1365243698 >> v1:172.21.15.47:6789/0 conn(0x7fd39014bf50 legacy=0x7fd3901629a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:59.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.318+0000 7fd394aa3640 1 -- 172.21.15.47:0/1365243698 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3901635b0 con 0x7fd390163890 2024-04-14T23:34:59.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.319+0000 7ff9bbfff640 1 -- 172.21.15.47:0/4211323112 >> v2:172.21.15.191:3300/0 conn(0x7ff9bc166b50 msgr2=0x7ff9bc1664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:59.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.319+0000 7ff9bbfff640 1 --2- 172.21.15.47:0/4211323112 >> v2:172.21.15.191:3300/0 conn(0x7ff9bc166b50 0x7ff9bc1664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.319+0000 7ff9bbfff640 1 -- 172.21.15.47:0/4211323112 >> v1:172.21.15.47:6789/0 conn(0x7ff9bc14bf50 legacy=0x7ff9bc1629a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.319+0000 7ff9bbfff640 1 -- 172.21.15.47:0/4211323112 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9bc1635b0 con 0x7ff9bc163890 2024-04-14T23:34:59.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.319+0000 7f69161be640 1 -- start start 2024-04-14T23:34:59.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.319+0000 7f6371c84640 1 Processor -- start 2024-04-14T23:34:59.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.319+0000 7fd394aa3640 1 --2- 172.21.15.47:0/1365243698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd390163890 0x7fd390165f90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd388009e50 tx=0x7fd38802bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=630d1e4a584c4d3c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.319+0000 7f6371c84640 1 -- start start 2024-04-14T23:34:59.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.320+0000 7fd387fff640 1 -- 172.21.15.47:0/1365243698 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38802caa0 con 0x7fd390163890 2024-04-14T23:34:59.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.320+0000 7fd387fff640 1 -- 172.21.15.47:0/1365243698 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38802cc40 con 0x7fd390163890 2024-04-14T23:34:59.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.320+0000 7f9be7166640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9be015bed0 0x7f9be0073210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.320+0000 7f9be7166640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9be00af860 0x7f9be00b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.320+0000 7f9be7166640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be00b3d00 con 0x7f9be0074620 2024-04-14T23:34:59.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.320+0000 7f69161be640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69100d0300 0x7f69100ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.320+0000 7f69161be640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69100c8360 con 0x7f6910161680 2024-04-14T23:34:59.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.320+0000 7f69161be640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69100c8640 con 0x7f69100d2950 2024-04-14T23:34:59.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.320+0000 7f69161be640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f69100c8c90 con 0x7f69100d0300 2024-04-14T23:34:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.320+0000 7f9be7166640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f9be00b3fc0 con 0x7f9be015bed0 2024-04-14T23:34:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.320+0000 7f9be7166640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f9be00af3d0 con 0x7f9be00af860 2024-04-14T23:34:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f9be6965640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9be00af860 0x7f9be00b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f69159bd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69100d0300 0x7f69100ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f69159bd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69100d0300 0x7f69100ceff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58414/0 (socket says 172.21.15.47:58414) 2024-04-14T23:34:59.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f69159bd640 1 -- 172.21.15.47:0/1332586279 learned_addr learned my addr 172.21.15.47:0/1332586279 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f69151bc640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6910161680 0x7f69100d2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55778/0 (socket says 172.21.15.47:55778) 2024-04-14T23:34:59.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f9be6965640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9be00af860 0x7f9be00b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58412/0 (socket says 172.21.15.47:58412) 2024-04-14T23:34:59.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f69159bd640 1 -- 172.21.15.47:0/1332586279 >> v1:172.21.15.191:6789/0 conn(0x7f69100d2950 legacy=0x7f69100ce8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T23:34:59.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f69159bd640 1 -- 172.21.15.47:0/1332586279 >> v1:172.21.15.47:6789/0 conn(0x7f6910161680 legacy=0x7f69100d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:59.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7fc23bc05640 1 Processor -- start 2024-04-14T23:34:59.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7fd397508640 1 -- 172.21.15.47:0/1365243698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd390163890 msgr2=0x7fd390165f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7fd397508640 1 --2- 172.21.15.47:0/1365243698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd390163890 0x7fd390165f90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd388009e50 tx=0x7fd38802bf00 comp rx=0 tx=0).stop 2024-04-14T23:34:59.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f6371c84640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f636c06d720 0x7f636c06db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f6371c84640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f636c06e070 con 0x7f636c0b2260 2024-04-14T23:34:59.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f6371c84640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f636c0b3330 con 0x7f636c15d3c0 2024-04-14T23:34:59.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f6371c84640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f636c072860 con 0x7f636c06d720 2024-04-14T23:34:59.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f9be6965640 1 -- 172.21.15.47:0/4255628601 learned_addr learned my addr 172.21.15.47:0/4255628601 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f636b7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f636c0b2260 0x7f636c140e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55792/0 (socket says 172.21.15.47:55792) 2024-04-14T23:34:59.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f636b7fe640 1 -- 172.21.15.47:0/1868080558 learned_addr learned my addr 172.21.15.47:0/1868080558 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:34:59.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7fd397508640 1 -- 172.21.15.47:0/1365243698 shutdown_connections 2024-04-14T23:34:59.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7fd397508640 1 --2- 172.21.15.47:0/1365243698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd390166b50 0x7fd3901664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7fd397508640 1 --2- 172.21.15.47:0/1365243698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd390163890 0x7fd390165f90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7fd397508640 1 -- 172.21.15.47:0/1365243698 >> 172.21.15.47:0/1365243698 conn(0x7fd39006b200 msgr2=0x7fd39006b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f69159bd640 1 -- 172.21.15.47:0/1332586279 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69100c8920 con 0x7f69100d0300 2024-04-14T23:34:59.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.320+0000 7ff9bbfff640 1 --2- 172.21.15.47:0/4211323112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9bc163890 0x7ff9bc165f90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0729d0 tx=0x7ff9b002b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac74738b70cc86e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7ff9bb7fe640 1 -- 172.21.15.47:0/4211323112 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0037070 con 0x7ff9bc163890 2024-04-14T23:34:59.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7ff9bb7fe640 1 -- 172.21.15.47:0/4211323112 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b0030710 con 0x7ff9bc163890 2024-04-14T23:34:59.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7fd397508640 1 -- 172.21.15.47:0/1365243698 shutdown_connections 2024-04-14T23:34:59.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7fd397508640 1 -- 172.21.15.47:0/1365243698 wait complete. 2024-04-14T23:34:59.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636bfff640 1 --2- 172.21.15.47:0/1868080558 >> v2:172.21.15.47:3300/0 conn(0x7f636c06d720 0x7f636c06db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636a7fc640 1 -- 172.21.15.47:0/1868080558 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3913583020 0 0) 0x7f636c0b3330 con 0x7f636c15d3c0 2024-04-14T23:34:59.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636a7fc640 1 -- 172.21.15.47:0/1868080558 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6354003520 con 0x7f636c15d3c0 2024-04-14T23:34:59.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7ff9c2cd5640 1 -- 172.21.15.47:0/4211323112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9bc163890 msgr2=0x7ff9bc165f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7ff9c2cd5640 1 --2- 172.21.15.47:0/4211323112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9bc163890 0x7ff9bc165f90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0729d0 tx=0x7ff9b002b760 comp rx=0 tx=0).stop 2024-04-14T23:34:59.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7ff9c2cd5640 1 -- 172.21.15.47:0/4211323112 shutdown_connections 2024-04-14T23:34:59.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7ff9c2cd5640 1 --2- 172.21.15.47:0/4211323112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9bc163890 0x7ff9bc165f90 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0729d0 tx=0x7ff9b002b760 comp rx=0 tx=0).stop 2024-04-14T23:34:59.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7ff9c2cd5640 1 --2- 172.21.15.47:0/4211323112 >> v2:172.21.15.191:3300/0 conn(0x7ff9bc166b50 0x7ff9bc1664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7ff9c2cd5640 1 -- 172.21.15.47:0/4211323112 >> 172.21.15.47:0/4211323112 conn(0x7ff9bc06b200 msgr2=0x7ff9bc06b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7ff9c2cd5640 1 -- 172.21.15.47:0/4211323112 shutdown_connections 2024-04-14T23:34:59.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f69159bd640 1 --2- 172.21.15.47:0/1332586279 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69100d0300 0x7f69100ceff0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6908009e80 tx=0x7f690802beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb1c0c015043be96 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.321+0000 7f9be6164640 1 --2- 172.21.15.47:0/4255628601 >> v2:172.21.15.191:3300/0 conn(0x7f9be015bed0 0x7f9be0073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f9be6965640 1 -- 172.21.15.47:0/4255628601 >> v2:172.21.15.191:3300/0 conn(0x7f9be015bed0 msgr2=0x7f9be0073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:59.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f9be6965640 1 --2- 172.21.15.47:0/4255628601 >> v2:172.21.15.191:3300/0 conn(0x7f9be015bed0 0x7f9be0073210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f9be6965640 1 -- 172.21.15.47:0/4255628601 >> v1:172.21.15.191:6789/0 conn(0x7f9be0074620 legacy=0x7f9be00b30b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-14T23:34:59.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f9be6965640 1 -- 172.21.15.47:0/4255628601 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be00b4d00 con 0x7f9be00af860 2024-04-14T23:34:59.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f9be6164640 1 --2- 172.21.15.47:0/4255628601 >> v2:172.21.15.191:3300/0 conn(0x7f9be015bed0 0x7f9be0073210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:59.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636a7fc640 1 -- 172.21.15.47:0/1868080558 <== mon.1 v1:172.21.15.191:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1951931651 0 0) 0x7f6354003520 con 0x7f636c15d3c0 2024-04-14T23:34:59.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636a7fc640 1 -- 172.21.15.47:0/1868080558 >> v2:172.21.15.47:3300/0 conn(0x7f636c06d720 msgr2=0x7f636c06db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:59.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636a7fc640 1 --2- 172.21.15.47:0/1868080558 >> v2:172.21.15.47:3300/0 conn(0x7f636c06d720 0x7f636c06db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636a7fc640 1 -- 172.21.15.47:0/1868080558 >> v1:172.21.15.47:6789/0 conn(0x7f636c0b2260 legacy=0x7f636c140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636a7fc640 1 -- 172.21.15.47:0/1868080558 --> v1:172.21.15.191:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636c0b3610 con 0x7f636c15d3c0 2024-04-14T23:34:59.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636a7fc640 1 -- 172.21.15.47:0/1868080558 <== mon.1 v1:172.21.15.191:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f63640019f0 con 0x7f636c15d3c0 2024-04-14T23:34:59.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636a7fc640 1 -- 172.21.15.47:0/1868080558 >> v1:172.21.15.191:6789/0 conn(0x7f636c15d3c0 legacy=0x7f636c071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636a7fc640 1 --2- 172.21.15.47:0/1868080558 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63540039b0 0x7f6354003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636a7fc640 1 --2- 172.21.15.47:0/1868080558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6354004800 0x7f6354004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636a7fc640 1 --2- 172.21.15.47:0/1868080558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6354005210 0x7f635400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636a7fc640 1 -- 172.21.15.47:0/1868080558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f636c072860 con 0x7f6354005210 2024-04-14T23:34:59.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636a7fc640 1 -- 172.21.15.47:0/1868080558 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f635400c140 con 0x7f6354004800 2024-04-14T23:34:59.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636a7fc640 1 -- 172.21.15.47:0/1868080558 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f635400c340 con 0x7f63540039b0 2024-04-14T23:34:59.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7f636affd640 1 --2- 172.21.15.47:0/1868080558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6354004800 0x7f6354004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.323+0000 7f9be6965640 1 --2- 172.21.15.47:0/4255628601 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9be00af860 0x7f9be00b37c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9be0072600 tx=0x7f9bd802be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=127629284d37f3cc server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.323+0000 7f6907fff640 1 -- 172.21.15.47:0/1332586279 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690802ca50 con 0x7f69100d0300 2024-04-14T23:34:59.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.323+0000 7f6907fff640 1 -- 172.21.15.47:0/1332586279 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f690802cbf0 con 0x7f69100d0300 2024-04-14T23:34:59.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.323+0000 7f6907fff640 1 -- 172.21.15.47:0/1332586279 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69080343f0 con 0x7f69100d0300 2024-04-14T23:34:59.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.323+0000 7f636b7fe640 1 --2- 172.21.15.47:0/1868080558 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63540039b0 0x7f6354003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.323+0000 7f9be5162640 1 -- 172.21.15.47:0/4255628601 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd802c9c0 con 0x7f9be00af860 2024-04-14T23:34:59.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.323+0000 7f636bfff640 1 --2- 172.21.15.47:0/1868080558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6354005210 0x7f635400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.323+0000 7f9be5162640 1 -- 172.21.15.47:0/4255628601 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd802cb60 con 0x7f9be00af860 2024-04-14T23:34:59.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.323+0000 7f9be5162640 1 -- 172.21.15.47:0/4255628601 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd80343f0 con 0x7f9be00af860 2024-04-14T23:34:59.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.323+0000 7fd397508640 1 Processor -- start 2024-04-14T23:34:59.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.323+0000 7fada607c640 1 Processor -- start 2024-04-14T23:34:59.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.323+0000 7fd397508640 1 -- start start 2024-04-14T23:34:59.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7f636affd640 1 -- 172.21.15.47:0/1868080558 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63540039b0 msgr2=0x7f6354003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:59.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7f636affd640 1 --2- 172.21.15.47:0/1868080558 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63540039b0 0x7f6354003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7f636affd640 1 -- 172.21.15.47:0/1868080558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6354005210 msgr2=0x7f635400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:59.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7f636affd640 1 --2- 172.21.15.47:0/1868080558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6354005210 0x7f635400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7f636affd640 1 -- 172.21.15.47:0/1868080558 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636c0b3610 con 0x7f6354004800 2024-04-14T23:34:59.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7f636bfff640 1 -- 172.21.15.47:0/1868080558 reap_dead start 2024-04-14T23:34:59.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.322+0000 7fc23bc05640 1 -- start start 2024-04-14T23:34:59.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7fada607c640 1 -- start start 2024-04-14T23:34:59.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7ff9c2cd5640 1 -- 172.21.15.47:0/4211323112 wait complete. 2024-04-14T23:34:59.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7fc23bc05640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc234162740 0x7fc2340d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7fc23bc05640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc2340af510 0x7fc2340b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7fc23bc05640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc234074750 con 0x7fc234162b20 2024-04-14T23:34:59.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7fc23bc05640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc2340b0be0 con 0x7fc2340af510 2024-04-14T23:34:59.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7fc23bc05640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fc234074a30 con 0x7fc234162740 2024-04-14T23:34:59.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7f9be7166640 1 -- 172.21.15.47:0/4255628601 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9be00af860 msgr2=0x7f9be00b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7f9be7166640 1 --2- 172.21.15.47:0/4255628601 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9be00af860 0x7f9be00b37c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9be0072600 tx=0x7f9bd802be20 comp rx=0 tx=0).stop 2024-04-14T23:34:59.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7f69161be640 1 -- 172.21.15.47:0/1332586279 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69100d0300 msgr2=0x7f69100ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7f69161be640 1 --2- 172.21.15.47:0/1332586279 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69100d0300 0x7f69100ceff0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6908009e80 tx=0x7f690802beb0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fc2391a0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc2340af510 0x7fc2340b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fc2391a0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc2340af510 0x7fc2340b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36172/0 (socket says 172.21.15.47:36172) 2024-04-14T23:34:59.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fc2391a0640 1 -- 172.21.15.47:0/1838111152 learned_addr learned my addr 172.21.15.47:0/1838111152 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7f9be7166640 1 -- 172.21.15.47:0/4255628601 shutdown_connections 2024-04-14T23:34:59.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7f9be7166640 1 --2- 172.21.15.47:0/4255628601 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9be00af860 0x7f9be00b37c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7f9be7166640 1 --2- 172.21.15.47:0/4255628601 >> v2:172.21.15.191:3300/0 conn(0x7f9be015bed0 0x7f9be0073210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.324+0000 7f9be7166640 1 -- 172.21.15.47:0/4255628601 >> 172.21.15.47:0/4255628601 conn(0x7f9be00726f0 msgr2=0x7f9be0072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7f69161be640 1 -- 172.21.15.47:0/1332586279 shutdown_connections 2024-04-14T23:34:59.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7f69161be640 1 --2- 172.21.15.47:0/1332586279 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69100d0300 0x7f69100ceff0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fd397508640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39014bf50 0x7fd3900b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7f69161be640 1 -- 172.21.15.47:0/1332586279 >> 172.21.15.47:0/1332586279 conn(0x7f69100d3cf0 msgr2=0x7f69100d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fd397508640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd390163890 0x7fd390148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fc2399a1640 1 --2- 172.21.15.47:0/1838111152 >> v2:172.21.15.191:3300/0 conn(0x7fc234162740 0x7fc2340d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7f9be7166640 1 -- 172.21.15.47:0/4255628601 shutdown_connections 2024-04-14T23:34:59.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fada607c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fad980ead00 0x7fad9804fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fada607c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fad9804ffd0 0x7fad98037bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fada607c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad98038110 0x7fad980385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fada607c640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fad98054330 con 0x7fad980ead00 2024-04-14T23:34:59.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fada607c640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fad98053720 con 0x7fad9804ffd0 2024-04-14T23:34:59.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fada607c640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fad98053a00 con 0x7fad98038110 2024-04-14T23:34:59.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7f69161be640 1 -- 172.21.15.47:0/1332586279 shutdown_connections 2024-04-14T23:34:59.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fada587b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad98038110 0x7fad980385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fada587b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad98038110 0x7fad980385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58434/0 (socket says 172.21.15.47:58434) 2024-04-14T23:34:59.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fada587b640 1 -- 172.21.15.47:0/40897773 learned_addr learned my addr 172.21.15.47:0/40897773 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fc2391a0640 1 -- 172.21.15.47:0/1838111152 >> v2:172.21.15.191:3300/0 conn(0x7fc234162740 msgr2=0x7fc2340d0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:59.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fc2391a0640 1 --2- 172.21.15.47:0/1838111152 >> v2:172.21.15.191:3300/0 conn(0x7fc234162740 0x7fc2340d0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fc2391a0640 1 -- 172.21.15.47:0/1838111152 >> v1:172.21.15.191:6789/0 conn(0x7fc234162b20 legacy=0x7fc2340c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fc2391a0640 1 -- 172.21.15.47:0/1838111152 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2340b0870 con 0x7fc2340af510 2024-04-14T23:34:59.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7ff9c2cd5640 1 Processor -- start 2024-04-14T23:34:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7f636affd640 1 --2- 172.21.15.47:0/1868080558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6354004800 0x7f6354004c80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f636400c510 tx=0x7f6354005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef1f849c3ffbf082 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7f636a7fc640 1 -- 172.21.15.47:0/1868080558 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6364039070 con 0x7f6354004800 2024-04-14T23:34:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7f636a7fc640 1 -- 172.21.15.47:0/1868080558 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f636402cd80 con 0x7f6354004800 2024-04-14T23:34:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7f636a7fc640 1 -- 172.21.15.47:0/1868080558 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636400c0e0 con 0x7f6354004800 2024-04-14T23:34:59.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fada507a640 1 --2- 172.21.15.47:0/40897773 >> v2:172.21.15.47:3300/0 conn(0x7fad980ead00 0x7fad9804fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fada4879640 1 --2- 172.21.15.47:0/40897773 >> v2:172.21.15.191:3300/0 conn(0x7fad9804ffd0 0x7fad98037bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7fada587b640 1 -- 172.21.15.47:0/40897773 >> v2:172.21.15.191:3300/0 conn(0x7fad9804ffd0 msgr2=0x7fad98037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7ff9c2cd5640 1 -- start start 2024-04-14T23:34:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7f69161be640 1 -- 172.21.15.47:0/1332586279 wait complete. 2024-04-14T23:34:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7f9be7166640 1 -- 172.21.15.47:0/4255628601 wait complete. 2024-04-14T23:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fd397508640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd390166b50 0x7fd3901ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fd397508640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd390071680 con 0x7fd39014bf50 2024-04-14T23:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fd397508640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd390071500 con 0x7fd390163890 2024-04-14T23:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fd397508640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd390071800 con 0x7fd390166b50 2024-04-14T23:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fd3952a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39014bf50 0x7fd3900b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fd394aa3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd390163890 0x7fd390148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fd394aa3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd390163890 0x7fd390148320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:35672/0 (socket says 172.21.15.47:35672) 2024-04-14T23:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fd394aa3640 1 -- 172.21.15.47:0/1601970023 learned_addr learned my addr 172.21.15.47:0/1601970023 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7fd394aa3640 1 -- 172.21.15.47:0/1601970023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd390166b50 msgr2=0x7fd3901ed930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T23:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7fd394aa3640 1 --2- 172.21.15.47:0/1601970023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd390166b50 0x7fd3901ed930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7fd394aa3640 1 -- 172.21.15.47:0/1601970023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39014bf50 msgr2=0x7fd3900b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.325+0000 7fd3952a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39014bf50 0x7fd3900b21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36178/0 (socket says 172.21.15.47:36178) 2024-04-14T23:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7fd394aa3640 1 --2- 172.21.15.47:0/1601970023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39014bf50 0x7fd3900b21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7fd394aa3640 1 -- 172.21.15.47:0/1601970023 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39015b6a0 con 0x7fd390163890 2024-04-14T23:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7fd3952a4640 1 --2- 172.21.15.47:0/1601970023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39014bf50 0x7fd3900b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7fada587b640 1 --2- 172.21.15.47:0/40897773 >> v2:172.21.15.191:3300/0 conn(0x7fad9804ffd0 0x7fad98037bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7fada587b640 1 -- 172.21.15.47:0/40897773 >> v2:172.21.15.47:3300/0 conn(0x7fad980ead00 msgr2=0x7fad9804fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7fada587b640 1 --2- 172.21.15.47:0/40897773 >> v2:172.21.15.47:3300/0 conn(0x7fad980ead00 0x7fad9804fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7fada587b640 1 -- 172.21.15.47:0/40897773 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad98053ce0 con 0x7fad98038110 2024-04-14T23:34:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7fada4879640 1 --2- 172.21.15.47:0/40897773 >> v2:172.21.15.191:3300/0 conn(0x7fad9804ffd0 0x7fad98037bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:59.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7fada507a640 1 --2- 172.21.15.47:0/40897773 >> v2:172.21.15.47:3300/0 conn(0x7fad980ead00 0x7fad9804fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:59.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7f6371c84640 1 -- 172.21.15.47:0/1868080558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6354004800 msgr2=0x7f6354004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7f6371c84640 1 --2- 172.21.15.47:0/1868080558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6354004800 0x7f6354004c80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f636400c510 tx=0x7f6354005830 comp rx=0 tx=0).stop 2024-04-14T23:34:59.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7fd394aa3640 1 --2- 172.21.15.47:0/1601970023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd390163890 0x7fd390148320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd388036040 tx=0x7fd388004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.326+0000 7fc2391a0640 1 --2- 172.21.15.47:0/1838111152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2340af510 0x7fc2340b1070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc2340b1e20 tx=0x7fc23002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d089d8b8d45b68 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7f6371c84640 1 -- 172.21.15.47:0/1868080558 shutdown_connections 2024-04-14T23:34:59.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7f6371c84640 1 --2- 172.21.15.47:0/1868080558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6354004800 0x7f6354004c80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7f6371c84640 1 -- 172.21.15.47:0/1868080558 >> 172.21.15.47:0/1868080558 conn(0x7f636c0b1770 msgr2=0x7f636c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7ff9c2cd5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9bc14bf50 0x7ff9bc141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7fd385ffb640 1 -- 172.21.15.47:0/1601970023 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388043020 con 0x7fd390163890 2024-04-14T23:34:59.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7f6371c84640 1 -- 172.21.15.47:0/1868080558 shutdown_connections 2024-04-14T23:34:59.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7f9be7166640 1 Processor -- start 2024-04-14T23:34:59.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7fd385ffb640 1 -- 172.21.15.47:0/1601970023 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38803e660 con 0x7fd390163890 2024-04-14T23:34:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7f9be7166640 1 -- start start 2024-04-14T23:34:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7fd385ffb640 1 -- 172.21.15.47:0/1601970023 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38803ea30 con 0x7fd390163890 2024-04-14T23:34:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7fc23899f640 1 -- 172.21.15.47:0/1838111152 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23002ca80 con 0x7fc2340af510 2024-04-14T23:34:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7f6371c84640 1 -- 172.21.15.47:0/1868080558 wait complete. 2024-04-14T23:34:59.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7fada587b640 1 --2- 172.21.15.47:0/40897773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad98038110 0x7fad980385a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fada006a6c0 tx=0x7fada00a7000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cecccab6931482c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7fd397508640 1 -- 172.21.15.47:0/1601970023 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39015b980 con 0x7fd390163890 2024-04-14T23:34:59.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7ff9c0a71640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9bc14bf50 0x7ff9bc141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7ff9c0a71640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9bc14bf50 0x7ff9bc141160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36192/0 (socket says 172.21.15.47:36192) 2024-04-14T23:34:59.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7ff9c0a71640 1 -- 172.21.15.47:0/1858233544 learned_addr learned my addr 172.21.15.47:0/1858233544 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7fd397508640 1 -- 172.21.15.47:0/1601970023 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd39015bf40 con 0x7fd390163890 2024-04-14T23:34:59.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7ff9c2cd5640 1 --2- 172.21.15.47:0/1858233544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9bc166b50 0x7ff9bc1446d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7ff9c2cd5640 1 --2- 172.21.15.47:0/1858233544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9bc0b1730 0x7ff9bc0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7ff9bbfff640 1 --2- 172.21.15.47:0/1858233544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9bc166b50 0x7ff9bc1446d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.327+0000 7fc23899f640 1 -- 172.21.15.47:0/1838111152 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc23002cc20 con 0x7fc2340af510 2024-04-14T23:34:59.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7fc23bc05640 1 -- 172.21.15.47:0/1838111152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2340af510 msgr2=0x7fc2340b1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7ff9c2cd5640 1 -- 172.21.15.47:0/1858233544 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc071680 con 0x7ff9bc14bf50 2024-04-14T23:34:59.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7ff9c2cd5640 1 -- 172.21.15.47:0/1858233544 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc071500 con 0x7ff9bc0b1730 2024-04-14T23:34:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7ff9c2cd5640 1 -- 172.21.15.47:0/1858233544 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff9bc071800 con 0x7ff9bc166b50 2024-04-14T23:34:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7fc23899f640 1 -- 172.21.15.47:0/1838111152 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23002ca80 con 0x7fc2340af510 2024-04-14T23:34:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7f9be7166640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9be0074620 0x7f9be01f7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7fc23bc05640 1 --2- 172.21.15.47:0/1838111152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2340af510 0x7fc2340b1070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc2340b1e20 tx=0x7fc23002bee0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7f69161be640 1 Processor -- start 2024-04-14T23:34:59.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7f69161be640 1 -- start start 2024-04-14T23:34:59.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7fc23bc05640 1 -- 172.21.15.47:0/1838111152 shutdown_connections 2024-04-14T23:34:59.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7fc23bc05640 1 --2- 172.21.15.47:0/1838111152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2340af510 0x7fc2340b1070 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7fc23bc05640 1 --2- 172.21.15.47:0/1838111152 >> v2:172.21.15.191:3300/0 conn(0x7fc234162740 0x7fc2340d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7fc23bc05640 1 -- 172.21.15.47:0/1838111152 >> 172.21.15.47:0/1838111152 conn(0x7fc2340d0320 msgr2=0x7fc2340d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7f9be7166640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9be00af860 0x7f9be0153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7f9be7166640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9be015bed0 0x7f9be0153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7f6371c84640 1 Processor -- start 2024-04-14T23:34:59.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7f9be7166640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9be015c2b0 con 0x7f9be0074620 2024-04-14T23:34:59.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7fc23bc05640 1 -- 172.21.15.47:0/1838111152 shutdown_connections 2024-04-14T23:34:59.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7f6371c84640 1 -- start start 2024-04-14T23:34:59.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7f9be6164640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9be0074620 0x7f9be01f7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7f9be6965640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9be015bed0 0x7f9be0153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7f9be6965640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9be015bed0 0x7f9be0153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:35704/0 (socket says 172.21.15.47:35704) 2024-04-14T23:34:59.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7f9be6965640 1 -- 172.21.15.47:0/335353032 learned_addr learned my addr 172.21.15.47:0/335353032 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7f9be7166640 1 -- 172.21.15.47:0/335353032 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9be00b52c0 con 0x7f9be015bed0 2024-04-14T23:34:59.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7f9be7166640 1 -- 172.21.15.47:0/335353032 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f9be015c430 con 0x7f9be00af860 2024-04-14T23:34:59.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7f9be5963640 1 --2- 172.21.15.47:0/335353032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9be00af860 0x7f9be0153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7fad97fff640 1 -- 172.21.15.47:0/40897773 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada00a7ba0 con 0x7fad98038110 2024-04-14T23:34:59.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7fad97fff640 1 -- 172.21.15.47:0/40897773 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada00a7d40 con 0x7fad98038110 2024-04-14T23:34:59.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7fad97fff640 1 -- 172.21.15.47:0/40897773 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada00af640 con 0x7fad98038110 2024-04-14T23:34:59.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.328+0000 7ff9c1272640 1 --2- 172.21.15.47:0/1858233544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9bc0b1730 0x7ff9bc0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7ff9c0a71640 1 -- 172.21.15.47:0/1858233544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9bc166b50 msgr2=0x7ff9bc1446d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7ff9c0a71640 1 --2- 172.21.15.47:0/1858233544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9bc166b50 0x7ff9bc1446d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7ff9c0a71640 1 -- 172.21.15.47:0/1858233544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9bc0b1730 msgr2=0x7ff9bc0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7ff9c0a71640 1 --2- 172.21.15.47:0/1858233544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9bc0b1730 0x7ff9bc0b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7ff9c0a71640 1 -- 172.21.15.47:0/1858233544 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9bc144c10 con 0x7ff9bc14bf50 2024-04-14T23:34:59.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7ff9c0a71640 1 --2- 172.21.15.47:0/1858233544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9bc14bf50 0x7ff9bc141160 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00c8c0 tx=0x7ff9ac00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f69161be640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69100d0300 0x7f691014c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f69161be640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69100d2950 0x7f691014b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f69161be640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6910161680 0x7f691014d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f69161be640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f69100ca2b0 con 0x7f69100d0300 2024-04-14T23:34:59.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f69161be640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f69100ca130 con 0x7f69100d2950 2024-04-14T23:34:59.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f69161be640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f69100ca430 con 0x7f6910161680 2024-04-14T23:34:59.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f6371c84640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6354004800 0x7f636c15a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f9be5963640 1 -- 172.21.15.47:0/335353032 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9be015bed0 msgr2=0x7f9be0153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f6371c84640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f636c143660 0x7f636c1359f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f69159bd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6910161680 0x7f691014d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f6371c84640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f636c15bb60 0x7f636c15bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f6371c84640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f636c15d9d0 con 0x7f636c15bb60 2024-04-14T23:34:59.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f6371c84640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f636c15d850 con 0x7f6354004800 2024-04-14T23:34:59.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f6371c84640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f636c072da0 con 0x7f636c143660 2024-04-14T23:34:59.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f69159bd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6910161680 0x7f691014d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58462/0 (socket says 172.21.15.47:58462) 2024-04-14T23:34:59.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f69159bd640 1 -- 172.21.15.47:0/874537344 learned_addr learned my addr 172.21.15.47:0/874537344 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f636b7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6354004800 0x7f636c15a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f69149bb640 1 --2- 172.21.15.47:0/874537344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69100d2950 0x7f691014b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f9be5963640 1 --2- 172.21.15.47:0/335353032 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9be015bed0 0x7f9be0153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7fada607c640 1 -- 172.21.15.47:0/40897773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad98038110 msgr2=0x7fad980385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7fada607c640 1 --2- 172.21.15.47:0/40897773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad98038110 0x7fad980385a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fada006a6c0 tx=0x7fada00a7000 comp rx=0 tx=0).stop 2024-04-14T23:34:59.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f636b7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6354004800 0x7f636c15a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:35716/0 (socket says 172.21.15.47:35716) 2024-04-14T23:34:59.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7fc23bc05640 1 -- 172.21.15.47:0/1838111152 wait complete. 2024-04-14T23:34:59.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7fada607c640 1 -- 172.21.15.47:0/40897773 shutdown_connections 2024-04-14T23:34:59.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7fada607c640 1 --2- 172.21.15.47:0/40897773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad98038110 0x7fad980385a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7fada607c640 1 --2- 172.21.15.47:0/40897773 >> v2:172.21.15.191:3300/0 conn(0x7fad9804ffd0 0x7fad98037bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7fada607c640 1 --2- 172.21.15.47:0/40897773 >> v2:172.21.15.47:3300/0 conn(0x7fad980ead00 0x7fad9804fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7fada607c640 1 -- 172.21.15.47:0/40897773 >> 172.21.15.47:0/40897773 conn(0x7fad98009fb0 msgr2=0x7fad9800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f636b7fe640 1 -- 172.21.15.47:0/768400223 learned_addr learned my addr 172.21.15.47:0/768400223 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f636affd640 1 --2- 172.21.15.47:0/768400223 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f636c143660 0x7f636c1359f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f636bfff640 1 --2- 172.21.15.47:0/768400223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f636c15bb60 0x7f636c15bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f69159bd640 1 -- 172.21.15.47:0/874537344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69100d2950 msgr2=0x7f691014b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f69159bd640 1 --2- 172.21.15.47:0/874537344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69100d2950 0x7f691014b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f69159bd640 1 -- 172.21.15.47:0/874537344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69100d0300 msgr2=0x7f691014c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f69159bd640 1 --2- 172.21.15.47:0/874537344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69100d0300 0x7f691014c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f69159bd640 1 -- 172.21.15.47:0/874537344 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691014c820 con 0x7f6910161680 2024-04-14T23:34:59.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7fc23bc05640 1 Processor -- start 2024-04-14T23:34:59.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7fada607c640 1 -- 172.21.15.47:0/40897773 shutdown_connections 2024-04-14T23:34:59.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f69159bd640 1 --2- 172.21.15.47:0/874537344 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6910161680 0x7f691014d8c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f690802c4c0 tx=0x7f6908004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7ff9b97fa640 1 -- 172.21.15.47:0/1858233544 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac017070 con 0x7ff9bc14bf50 2024-04-14T23:34:59.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7ff9b97fa640 1 -- 172.21.15.47:0/1858233544 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ac005270 con 0x7ff9bc14bf50 2024-04-14T23:34:59.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7ff9b97fa640 1 -- 172.21.15.47:0/1858233544 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac00a640 con 0x7ff9bc14bf50 2024-04-14T23:34:59.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7ff9c2cd5640 1 -- 172.21.15.47:0/1858233544 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9bc15b800 con 0x7ff9bc14bf50 2024-04-14T23:34:59.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f636b7fe640 1 -- 172.21.15.47:0/768400223 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f636c143660 msgr2=0x7f636c1359f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f636b7fe640 1 --2- 172.21.15.47:0/768400223 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f636c143660 0x7f636c1359f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f636b7fe640 1 -- 172.21.15.47:0/768400223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f636c15bb60 msgr2=0x7f636c15bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f636b7fe640 1 --2- 172.21.15.47:0/768400223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f636c15bb60 0x7f636c15bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f636b7fe640 1 -- 172.21.15.47:0/768400223 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636c1599d0 con 0x7f6354004800 2024-04-14T23:34:59.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.330+0000 7f9be5963640 1 -- 172.21.15.47:0/335353032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9be0074620 msgr2=0x7f9be01f7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f9be5963640 1 --2- 172.21.15.47:0/335353032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9be0074620 0x7f9be01f7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f9be5963640 1 -- 172.21.15.47:0/335353032 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be01502f0 con 0x7f9be00af860 2024-04-14T23:34:59.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f9be6164640 1 --2- 172.21.15.47:0/335353032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9be0074620 0x7f9be01f7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:34:59.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f9be5963640 1 --2- 172.21.15.47:0/335353032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9be00af860 0x7f9be0153130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009fd0 tx=0x7f9bd000b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.329+0000 7fd37b7fe640 1 -- 172.21.15.47:0/1601970023 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd390075430 con 0x7fd390163890 2024-04-14T23:34:59.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f636b7fe640 1 --2- 172.21.15.47:0/768400223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6354004800 0x7f636c15a350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f635c001580 tx=0x7f635c001a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f6905ffb640 1 -- 172.21.15.47:0/874537344 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908043020 con 0x7f6910161680 2024-04-14T23:34:59.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f6353fff640 1 -- 172.21.15.47:0/768400223 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c00f750 con 0x7f6354004800 2024-04-14T23:34:59.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f6353fff640 1 -- 172.21.15.47:0/768400223 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f635c018070 con 0x7f6354004800 2024-04-14T23:34:59.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f6353fff640 1 -- 172.21.15.47:0/768400223 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c00faf0 con 0x7f6354004800 2024-04-14T23:34:59.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f6371c84640 1 -- 172.21.15.47:0/768400223 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f636c159cb0 con 0x7f6354004800 2024-04-14T23:34:59.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7f6371c84640 1 -- 172.21.15.47:0/768400223 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f636c15c520 con 0x7f6354004800 2024-04-14T23:34:59.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7fc23bc05640 1 -- start start 2024-04-14T23:34:59.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7fc23bc05640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc234162740 0x7fc2340c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7fc23bc05640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc234162b20 0x7fc2340b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7fc23bc05640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc234156e60 0x7fc23406e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7fd385ffb640 1 -- 172.21.15.47:0/1601970023 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd388046020 con 0x7fd390163890 2024-04-14T23:34:59.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7fada607c640 1 -- 172.21.15.47:0/40897773 wait complete. 2024-04-14T23:34:59.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.333+0000 7ff9c2cd5640 1 -- 172.21.15.47:0/1858233544 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9bc15bdc0 con 0x7ff9bc14bf50 2024-04-14T23:34:59.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7fc23bc05640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc234166530 con 0x7fc234156e60 2024-04-14T23:34:59.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7fc23bc05640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc2341666b0 con 0x7fc234162740 2024-04-14T23:34:59.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7fc23bc05640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc234166830 con 0x7fc234162b20 2024-04-14T23:34:59.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7fc2399a1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc234162740 0x7fc2340c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7fc23a1a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc234156e60 0x7fc23406e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7fc2399a1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc234162740 0x7fc2340c5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:35742/0 (socket says 172.21.15.47:35742) 2024-04-14T23:34:59.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7fc2399a1640 1 -- 172.21.15.47:0/938011835 learned_addr learned my addr 172.21.15.47:0/938011835 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7fc2391a0640 1 --2- 172.21.15.47:0/938011835 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc234162b20 0x7fc2340b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7f9bd6ffd640 1 -- 172.21.15.47:0/335353032 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0015020 con 0x7f9be00af860 2024-04-14T23:34:59.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7f9be7166640 1 -- 172.21.15.47:0/335353032 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be01505d0 con 0x7f9be00af860 2024-04-14T23:34:59.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7f9be7166640 1 -- 172.21.15.47:0/335353032 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be0150e70 con 0x7f9be00af860 2024-04-14T23:34:59.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7f9bd6ffd640 1 -- 172.21.15.47:0/335353032 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd0011830 con 0x7f9be00af860 2024-04-14T23:34:59.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7f9bd6ffd640 1 -- 172.21.15.47:0/335353032 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0011c20 con 0x7f9be00af860 2024-04-14T23:34:59.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7fada607c640 1 Processor -- start 2024-04-14T23:34:59.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7fada607c640 1 -- start start 2024-04-14T23:34:59.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.333+0000 7fada607c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad98038110 0x7fad9817c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7fada607c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad9804ffd0 0x7fad98046060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7fada607c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad980ead00 0x7fad9804dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7fada607c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fad98054940 con 0x7fad98038110 2024-04-14T23:34:59.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7fada607c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fad980547c0 con 0x7fad9804ffd0 2024-04-14T23:34:59.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7fada607c640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fad9804f550 con 0x7fad980ead00 2024-04-14T23:34:59.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7fd385ffb640 1 --2- 172.21.15.47:0/1601970023 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd37406b990 0x7fd37406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.333+0000 7fc23a1a2640 1 -- 172.21.15.47:0/938011835 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc234162b20 msgr2=0x7fc2340b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.333+0000 7fc23a1a2640 1 --2- 172.21.15.47:0/938011835 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc234162b20 0x7fc2340b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.333+0000 7fc23a1a2640 1 -- 172.21.15.47:0/938011835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc234162740 msgr2=0x7fc2340c5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.333+0000 7fc23a1a2640 1 --2- 172.21.15.47:0/938011835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc234162740 0x7fc2340c5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.333+0000 7fc23a1a2640 1 -- 172.21.15.47:0/938011835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2340b5db0 con 0x7fc234156e60 2024-04-14T23:34:59.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.333+0000 7fc23a1a2640 1 --2- 172.21.15.47:0/938011835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc234156e60 0x7fc23406e790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00c3c0 tx=0x7fc22c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7fada587b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad980ead00 0x7fad9804dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7fada587b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad980ead00 0x7fad9804dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58486/0 (socket says 172.21.15.47:58486) 2024-04-14T23:34:59.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7fada587b640 1 -- 172.21.15.47:0/450644360 learned_addr learned my addr 172.21.15.47:0/450644360 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7fada4879640 1 --2- 172.21.15.47:0/450644360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad9804ffd0 0x7fad98046060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7ff9a2ffd640 1 -- 172.21.15.47:0/1858233544 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9bc075430 con 0x7ff9bc14bf50 2024-04-14T23:34:59.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7fada587b640 1 -- 172.21.15.47:0/450644360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad9804ffd0 msgr2=0x7fad98046060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7fada587b640 1 --2- 172.21.15.47:0/450644360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad9804ffd0 0x7fad98046060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7fada587b640 1 -- 172.21.15.47:0/450644360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad98038110 msgr2=0x7fad9817c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7fada587b640 1 --2- 172.21.15.47:0/450644360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad98038110 0x7fad9817c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7fada587b640 1 -- 172.21.15.47:0/450644360 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9817cd00 con 0x7fad980ead00 2024-04-14T23:34:59.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7fada4879640 1 --2- 172.21.15.47:0/450644360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad9804ffd0 0x7fad98046060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:34:59.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f6905ffb640 1 -- 172.21.15.47:0/874537344 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f690803e450 con 0x7f6910161680 2024-04-14T23:34:59.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.331+0000 7f69161be640 1 -- 172.21.15.47:0/874537344 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691014cb00 con 0x7f6910161680 2024-04-14T23:34:59.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7f6905ffb640 1 -- 172.21.15.47:0/874537344 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690803e800 con 0x7f6910161680 2024-04-14T23:34:59.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.332+0000 7f69161be640 1 -- 172.21.15.47:0/874537344 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f691014d0c0 con 0x7f6910161680 2024-04-14T23:34:59.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.333+0000 7fd385ffb640 1 -- 172.21.15.47:0/1601970023 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd3880ad250 con 0x7fd390163890 2024-04-14T23:34:59.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.335+0000 7fd3952a4640 1 --2- 172.21.15.47:0/1601970023 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd37406b990 0x7fd37406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.335+0000 7f9bd6ffd640 1 -- 172.21.15.47:0/335353032 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9bd0018020 con 0x7f9be00af860 2024-04-14T23:34:59.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.335+0000 7f9bd6ffd640 1 --2- 172.21.15.47:0/335353032 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9bc406ba60 0x7f9bc406df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.333+0000 7f6371c84640 1 -- 172.21.15.47:0/768400223 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f634c005290 con 0x7f6354004800 2024-04-14T23:34:59.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.334+0000 7f6353fff640 1 -- 172.21.15.47:0/768400223 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f635c00fc90 con 0x7f6354004800 2024-04-14T23:34:59.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.335+0000 7f6353fff640 1 --2- 172.21.15.47:0/768400223 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f635806ba60 0x7f635806df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.335+0000 7f6353fff640 1 -- 172.21.15.47:0/768400223 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f635c08a7a0 con 0x7f6354004800 2024-04-14T23:34:59.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7fd3952a4640 1 --2- 172.21.15.47:0/1601970023 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd37406b990 0x7fd37406de50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd3901ed330 tx=0x7fd38c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.335+0000 7f6905ffb640 1 -- 172.21.15.47:0/874537344 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6908046020 con 0x7f6910161680 2024-04-14T23:34:59.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7f9bd6ffd640 1 -- 172.21.15.47:0/335353032 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9bd008a930 con 0x7f9be00af860 2024-04-14T23:34:59.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7fada587b640 1 --2- 172.21.15.47:0/450644360 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad980ead00 0x7fad9804dba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fada006a010 tx=0x7fada00744d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7f9be6164640 1 --2- 172.21.15.47:0/335353032 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9bc406ba60 0x7f9bc406df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7f9be7166640 1 -- 172.21.15.47:0/335353032 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc8005290 con 0x7f9be00af860 2024-04-14T23:34:59.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7fad95ffb640 1 -- 172.21.15.47:0/450644360 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada006e600 con 0x7fad980ead00 2024-04-14T23:34:59.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7f636affd640 1 --2- 172.21.15.47:0/768400223 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f635806ba60 0x7f635806df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7ff9b97fa640 1 -- 172.21.15.47:0/1858233544 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ff9ac01a070 con 0x7ff9bc14bf50 2024-04-14T23:34:59.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7ff9b97fa640 1 --2- 172.21.15.47:0/1858233544 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff9a806ba60 0x7ff9a806df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7f6905ffb640 1 --2- 172.21.15.47:0/874537344 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f68f406ba60 0x7f68f406df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7f6905ffb640 1 -- 172.21.15.47:0/874537344 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f69080ad410 con 0x7f6910161680 2024-04-14T23:34:59.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7f69151bc640 1 --2- 172.21.15.47:0/874537344 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f68f406ba60 0x7f68f406df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.335+0000 7f69161be640 1 -- 172.21.15.47:0/874537344 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69100753c0 con 0x7f6910161680 2024-04-14T23:34:59.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7ff9b97fa640 1 -- 172.21.15.47:0/1858233544 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff9ac08a550 con 0x7ff9bc14bf50 2024-04-14T23:34:59.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7fc22a7fc640 1 -- 172.21.15.47:0/938011835 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c0052d0 con 0x7fc234156e60 2024-04-14T23:34:59.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7fada607c640 1 -- 172.21.15.47:0/450644360 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad980445e0 con 0x7fad980ead00 2024-04-14T23:34:59.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7fad95ffb640 1 -- 172.21.15.47:0/450644360 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada006e7a0 con 0x7fad980ead00 2024-04-14T23:34:59.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7fad95ffb640 1 -- 172.21.15.47:0/450644360 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada006eb50 con 0x7fad980ead00 2024-04-14T23:34:59.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7fada607c640 1 -- 172.21.15.47:0/450644360 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fad98044ba0 con 0x7fad980ead00 2024-04-14T23:34:59.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7fc23bc05640 1 -- 172.21.15.47:0/938011835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2340c6570 con 0x7fc234156e60 2024-04-14T23:34:59.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7fc23bc05640 1 -- 172.21.15.47:0/938011835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2340b3450 con 0x7fc234156e60 2024-04-14T23:34:59.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7fc22a7fc640 1 -- 172.21.15.47:0/938011835 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc22c005470 con 0x7fc234156e60 2024-04-14T23:34:59.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.336+0000 7fc22a7fc640 1 -- 172.21.15.47:0/938011835 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c007220 con 0x7fc234156e60 2024-04-14T23:34:59.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.337+0000 7f9be6164640 1 --2- 172.21.15.47:0/335353032 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9bc406ba60 0x7f9bc406df20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00ae90 tx=0x7f9bdc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.337+0000 7ff9bbfff640 1 --2- 172.21.15.47:0/1858233544 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff9a806ba60 0x7ff9a806df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.337+0000 7f69151bc640 1 --2- 172.21.15.47:0/874537344 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f68f406ba60 0x7f68f406df20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f690c001610 tx=0x7f690c0079e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.337+0000 7f636affd640 1 --2- 172.21.15.47:0/768400223 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f635806ba60 0x7f635806df20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6364036000 tx=0x7f6364009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.338+0000 7fc23bc05640 1 -- 172.21.15.47:0/938011835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc21c005290 con 0x7fc234156e60 2024-04-14T23:34:59.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.338+0000 7ff9bbfff640 1 --2- 172.21.15.47:0/1858233544 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff9a806ba60 0x7ff9a806df20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0034000 tx=0x7ff9b0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.338+0000 7fada607c640 1 -- 172.21.15.47:0/450644360 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad80005290 con 0x7fad980ead00 2024-04-14T23:34:59.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.338+0000 7fd385ffb640 1 -- 172.21.15.47:0/1601970023 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd38804d030 con 0x7fd390163890 2024-04-14T23:34:59.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.341+0000 7ff9b97fa640 1 -- 172.21.15.47:0/1858233544 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff9ac022020 con 0x7ff9bc14bf50 2024-04-14T23:34:59.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.342+0000 7f9bd6ffd640 1 -- 172.21.15.47:0/335353032 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9bd001f020 con 0x7f9be00af860 2024-04-14T23:34:59.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.342+0000 7fc22a7fc640 1 -- 172.21.15.47:0/938011835 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc22c0073c0 con 0x7fc234156e60 2024-04-14T23:34:59.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.343+0000 7fc22a7fc640 1 --2- 172.21.15.47:0/938011835 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc21806b9e0 0x7fc21806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.343+0000 7fc22a7fc640 1 -- 172.21.15.47:0/938011835 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc22c08a4b0 con 0x7fc234156e60 2024-04-14T23:34:59.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.343+0000 7f6353fff640 1 -- 172.21.15.47:0/768400223 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f636c06e070 con 0x7f6354004800 2024-04-14T23:34:59.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.344+0000 7fc2399a1640 1 --2- 172.21.15.47:0/938011835 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc21806b9e0 0x7fc21806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.345+0000 7fc2399a1640 1 --2- 172.21.15.47:0/938011835 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc21806b9e0 0x7fc21806dea0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc224009c00 tx=0x7fc224009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.347+0000 7f6905ffb640 1 -- 172.21.15.47:0/874537344 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f690804d030 con 0x7f6910161680 2024-04-14T23:34:59.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.348+0000 7fad95ffb640 1 -- 172.21.15.47:0/450644360 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fada006ecf0 con 0x7fad980ead00 2024-04-14T23:34:59.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.349+0000 7fad95ffb640 1 --2- 172.21.15.47:0/450644360 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fad8406ba60 0x7fad8406df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.349+0000 7fad95ffb640 1 -- 172.21.15.47:0/450644360 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fada0127e80 con 0x7fad980ead00 2024-04-14T23:34:59.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.349+0000 7fada507a640 1 --2- 172.21.15.47:0/450644360 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fad8406ba60 0x7fad8406df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.350+0000 7fada507a640 1 --2- 172.21.15.47:0/450644360 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fad8406ba60 0x7fad8406df20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad9c006fd0 tx=0x7fad9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.350+0000 7fc22a7fc640 1 -- 172.21.15.47:0/938011835 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc22c0588a0 con 0x7fc234156e60 2024-04-14T23:34:59.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.351+0000 7fad95ffb640 1 -- 172.21.15.47:0/450644360 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fada00f60e0 con 0x7fad980ead00 2024-04-14T23:34:59.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.713+0000 7fba6fc84640 1 -- 172.21.15.47:0/1292437952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fba50005580 con 0x7fba68165920 2024-04-14T23:34:59.720 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-04-14T23:34:59.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.714+0000 7fba5e7fc640 1 -- 172.21.15.47:0/1292437952 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fba60059e30 con 0x7fba68165920 2024-04-14T23:34:59.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.717+0000 7fba6fc84640 1 -- 172.21.15.47:0/1292437952 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fba4c06ba90 msgr2=0x7fba4c06df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.717+0000 7fba6fc84640 1 --2- 172.21.15.47:0/1292437952 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fba4c06ba90 0x7fba4c06df50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba58006fd0 tx=0x7fba58006b40 comp rx=0 tx=0).stop 2024-04-14T23:34:59.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.717+0000 7fba6fc84640 1 -- 172.21.15.47:0/1292437952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba68165920 msgr2=0x7fba68163f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.717+0000 7fba6fc84640 1 --2- 172.21.15.47:0/1292437952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba68165920 0x7fba68163f10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fba6000eeb0 tx=0x7fba6000b480 comp rx=0 tx=0).stop 2024-04-14T23:34:59.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.718+0000 7fba6fc84640 1 -- 172.21.15.47:0/1292437952 shutdown_connections 2024-04-14T23:34:59.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.718+0000 7fba6fc84640 1 --2- 172.21.15.47:0/1292437952 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fba4c06ba90 0x7fba4c06df50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.718+0000 7fba6fc84640 1 --2- 172.21.15.47:0/1292437952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba68165920 0x7fba68163f10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.718+0000 7fba6fc84640 1 --2- 172.21.15.47:0/1292437952 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba68071c10 0x7fba681639d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.718+0000 7fba6fc84640 1 --2- 172.21.15.47:0/1292437952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba6806ccc0 0x7fba6814d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.718+0000 7fba6fc84640 1 -- 172.21.15.47:0/1292437952 >> 172.21.15.47:0/1292437952 conn(0x7fba6806b890 msgr2=0x7fba680b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.718+0000 7fba6fc84640 1 -- 172.21.15.47:0/1292437952 shutdown_connections 2024-04-14T23:34:59.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.718+0000 7fba6fc84640 1 -- 172.21.15.47:0/1292437952 wait complete. 2024-04-14T23:34:59.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-04-14T23:34:59.737 DEBUG:teuthology.parallel:result is None 2024-04-14T23:34:59.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.746+0000 7fd37b7fe640 1 -- 172.21.15.47:0/1601970023 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd390164d70 con 0x7fd390163890 2024-04-14T23:34:59.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.746+0000 7fd385ffb640 1 -- 172.21.15.47:0/1601970023 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd38807bb10 con 0x7fd390163890 2024-04-14T23:34:59.750 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-04-14T23:34:59.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.749+0000 7fd37b7fe640 1 -- 172.21.15.47:0/1601970023 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd37406b990 msgr2=0x7fd37406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.749+0000 7fd37b7fe640 1 --2- 172.21.15.47:0/1601970023 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd37406b990 0x7fd37406de50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd3901ed330 tx=0x7fd38c009040 comp rx=0 tx=0).stop 2024-04-14T23:34:59.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.749+0000 7fd37b7fe640 1 -- 172.21.15.47:0/1601970023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd390163890 msgr2=0x7fd390148320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.749+0000 7fd37b7fe640 1 --2- 172.21.15.47:0/1601970023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd390163890 0x7fd390148320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd388036040 tx=0x7fd388004a40 comp rx=0 tx=0).stop 2024-04-14T23:34:59.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.749+0000 7fd37b7fe640 1 -- 172.21.15.47:0/1601970023 shutdown_connections 2024-04-14T23:34:59.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.749+0000 7fd37b7fe640 1 --2- 172.21.15.47:0/1601970023 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd37406b990 0x7fd37406de50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.749+0000 7fd37b7fe640 1 --2- 172.21.15.47:0/1601970023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd390166b50 0x7fd3901ed930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.749+0000 7fd37b7fe640 1 --2- 172.21.15.47:0/1601970023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd390163890 0x7fd390148320 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.749+0000 7fd37b7fe640 1 --2- 172.21.15.47:0/1601970023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39014bf50 0x7fd3900b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.749+0000 7fd37b7fe640 1 -- 172.21.15.47:0/1601970023 >> 172.21.15.47:0/1601970023 conn(0x7fd39006b200 msgr2=0x7fd390165f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.749+0000 7fd37b7fe640 1 -- 172.21.15.47:0/1601970023 shutdown_connections 2024-04-14T23:34:59.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.749+0000 7fd37b7fe640 1 -- 172.21.15.47:0/1601970023 wait complete. 2024-04-14T23:34:59.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.760+0000 7f9be7166640 1 -- 172.21.15.47:0/335353032 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9bc8005580 con 0x7f9be00af860 2024-04-14T23:34:59.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-04-14T23:34:59.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.760+0000 7f6371c84640 1 -- 172.21.15.47:0/768400223 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f634c005580 con 0x7f6354004800 2024-04-14T23:34:59.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.761+0000 7f9bd6ffd640 1 -- 172.21.15.47:0/335353032 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9bd0058b90 con 0x7f9be00af860 2024-04-14T23:34:59.764 DEBUG:teuthology.parallel:result is None 2024-04-14T23:34:59.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.761+0000 7f6353fff640 1 -- 172.21.15.47:0/768400223 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f635c058b50 con 0x7f6354004800 2024-04-14T23:34:59.765 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-04-14T23:34:59.765 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-04-14T23:34:59.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.763+0000 7f9be7166640 1 -- 172.21.15.47:0/335353032 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9bc406ba60 msgr2=0x7f9bc406df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.763+0000 7f9be7166640 1 --2- 172.21.15.47:0/335353032 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9bc406ba60 0x7f9bc406df20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00ae90 tx=0x7f9bdc008040 comp rx=0 tx=0).stop 2024-04-14T23:34:59.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.763+0000 7f9be7166640 1 -- 172.21.15.47:0/335353032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9be00af860 msgr2=0x7f9be0153130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.763+0000 7f9be7166640 1 --2- 172.21.15.47:0/335353032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9be00af860 0x7f9be0153130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009fd0 tx=0x7f9bd000b870 comp rx=0 tx=0).stop 2024-04-14T23:34:59.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.763+0000 7f9be7166640 1 -- 172.21.15.47:0/335353032 shutdown_connections 2024-04-14T23:34:59.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.763+0000 7f9be7166640 1 --2- 172.21.15.47:0/335353032 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9bc406ba60 0x7f9bc406df20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.763+0000 7f9be7166640 1 --2- 172.21.15.47:0/335353032 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9be015bed0 0x7f9be0153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.763+0000 7f9be7166640 1 --2- 172.21.15.47:0/335353032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9be00af860 0x7f9be0153130 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.763+0000 7f9be7166640 1 --2- 172.21.15.47:0/335353032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9be0074620 0x7f9be01f7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.763+0000 7f9be7166640 1 -- 172.21.15.47:0/335353032 >> 172.21.15.47:0/335353032 conn(0x7f9be00726f0 msgr2=0x7f9be0072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.763+0000 7f9be7166640 1 -- 172.21.15.47:0/335353032 shutdown_connections 2024-04-14T23:34:59.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.763+0000 7f9be7166640 1 -- 172.21.15.47:0/335353032 wait complete. 2024-04-14T23:34:59.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.764+0000 7f6371c84640 1 -- 172.21.15.47:0/768400223 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f635806ba60 msgr2=0x7f635806df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.764+0000 7f6371c84640 1 --2- 172.21.15.47:0/768400223 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f635806ba60 0x7f635806df20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6364036000 tx=0x7f6364009030 comp rx=0 tx=0).stop 2024-04-14T23:34:59.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.764+0000 7f6371c84640 1 -- 172.21.15.47:0/768400223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6354004800 msgr2=0x7f636c15a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.764+0000 7f6371c84640 1 --2- 172.21.15.47:0/768400223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6354004800 0x7f636c15a350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f635c001580 tx=0x7f635c001a40 comp rx=0 tx=0).stop 2024-04-14T23:34:59.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.764+0000 7f6371c84640 1 -- 172.21.15.47:0/768400223 shutdown_connections 2024-04-14T23:34:59.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.764+0000 7f6371c84640 1 --2- 172.21.15.47:0/768400223 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f635806ba60 0x7f635806df20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.764+0000 7f6371c84640 1 --2- 172.21.15.47:0/768400223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f636c15bb60 0x7f636c15bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.764+0000 7f6371c84640 1 --2- 172.21.15.47:0/768400223 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f636c143660 0x7f636c1359f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.764+0000 7f6371c84640 1 --2- 172.21.15.47:0/768400223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6354004800 0x7f636c15a350 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.764+0000 7f6371c84640 1 -- 172.21.15.47:0/768400223 >> 172.21.15.47:0/768400223 conn(0x7f636c0b1770 msgr2=0x7f636c158fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.764+0000 7f6371c84640 1 -- 172.21.15.47:0/768400223 shutdown_connections 2024-04-14T23:34:59.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.764+0000 7f6371c84640 1 -- 172.21.15.47:0/768400223 wait complete. 2024-04-14T23:34:59.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.765+0000 7ff9a2ffd640 1 -- 172.21.15.47:0/1858233544 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff9bc0d00c0 con 0x7ff9bc14bf50 2024-04-14T23:34:59.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.765+0000 7ff9b97fa640 1 -- 172.21.15.47:0/1858233544 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff9ac0587b0 con 0x7ff9bc14bf50 2024-04-14T23:34:59.770 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-04-14T23:34:59.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.769+0000 7ff9a2ffd640 1 -- 172.21.15.47:0/1858233544 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff9a806ba60 msgr2=0x7ff9a806df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.769+0000 7ff9a2ffd640 1 --2- 172.21.15.47:0/1858233544 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff9a806ba60 0x7ff9a806df20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0034000 tx=0x7ff9b0008030 comp rx=0 tx=0).stop 2024-04-14T23:34:59.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.769+0000 7ff9a2ffd640 1 -- 172.21.15.47:0/1858233544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9bc14bf50 msgr2=0x7ff9bc141160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.769+0000 7ff9a2ffd640 1 --2- 172.21.15.47:0/1858233544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9bc14bf50 0x7ff9bc141160 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00c8c0 tx=0x7ff9ac00cd80 comp rx=0 tx=0).stop 2024-04-14T23:34:59.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.769+0000 7ff9a2ffd640 1 -- 172.21.15.47:0/1858233544 shutdown_connections 2024-04-14T23:34:59.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.769+0000 7ff9a2ffd640 1 --2- 172.21.15.47:0/1858233544 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff9a806ba60 0x7ff9a806df20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.769+0000 7ff9a2ffd640 1 --2- 172.21.15.47:0/1858233544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9bc0b1730 0x7ff9bc0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.769+0000 7ff9a2ffd640 1 --2- 172.21.15.47:0/1858233544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9bc166b50 0x7ff9bc1446d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.769+0000 7ff9a2ffd640 1 --2- 172.21.15.47:0/1858233544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9bc14bf50 0x7ff9bc141160 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.769+0000 7ff9a2ffd640 1 -- 172.21.15.47:0/1858233544 >> 172.21.15.47:0/1858233544 conn(0x7ff9bc06b200 msgr2=0x7ff9bc165f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.769+0000 7ff9a2ffd640 1 -- 172.21.15.47:0/1858233544 shutdown_connections 2024-04-14T23:34:59.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.769+0000 7ff9a2ffd640 1 -- 172.21.15.47:0/1858233544 wait complete. 2024-04-14T23:34:59.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.769+0000 7f69161be640 1 -- 172.21.15.47:0/874537344 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f69100c7150 con 0x7f6910161680 2024-04-14T23:34:59.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.770+0000 7f6905ffb640 1 -- 172.21.15.47:0/874537344 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f690807bdd0 con 0x7f6910161680 2024-04-14T23:34:59.774 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-04-14T23:34:59.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.772+0000 7f69161be640 1 -- 172.21.15.47:0/874537344 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f68f406ba60 msgr2=0x7f68f406df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.772+0000 7f69161be640 1 --2- 172.21.15.47:0/874537344 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f68f406ba60 0x7f68f406df20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f690c001610 tx=0x7f690c0079e0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.772+0000 7f69161be640 1 -- 172.21.15.47:0/874537344 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6910161680 msgr2=0x7f691014d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.772+0000 7fc23bc05640 1 -- 172.21.15.47:0/938011835 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc21c005850 con 0x7fc234156e60 2024-04-14T23:34:59.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.772+0000 7f69161be640 1 --2- 172.21.15.47:0/874537344 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6910161680 0x7f691014d8c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f690802c4c0 tx=0x7f6908004a40 comp rx=0 tx=0).stop 2024-04-14T23:34:59.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.772+0000 7f69161be640 1 -- 172.21.15.47:0/874537344 shutdown_connections 2024-04-14T23:34:59.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.772+0000 7f69161be640 1 --2- 172.21.15.47:0/874537344 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f68f406ba60 0x7f68f406df20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.772+0000 7f69161be640 1 --2- 172.21.15.47:0/874537344 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6910161680 0x7f691014d8c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.772+0000 7f69161be640 1 --2- 172.21.15.47:0/874537344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69100d2950 0x7f691014b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.772+0000 7f69161be640 1 --2- 172.21.15.47:0/874537344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69100d0300 0x7f691014c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.772+0000 7f69161be640 1 -- 172.21.15.47:0/874537344 >> 172.21.15.47:0/874537344 conn(0x7f69100d3cf0 msgr2=0x7f691015ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.772+0000 7f69161be640 1 -- 172.21.15.47:0/874537344 shutdown_connections 2024-04-14T23:34:59.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.772+0000 7f69161be640 1 -- 172.21.15.47:0/874537344 wait complete. 2024-04-14T23:34:59.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.773+0000 7fc22a7fc640 1 -- 172.21.15.47:0/938011835 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc22c05c940 con 0x7fc234156e60 2024-04-14T23:34:59.777 INFO:teuthology.orchestra.run.smithi047.stdout:55834574857 2024-04-14T23:34:59.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.773+0000 7fada607c640 1 -- 172.21.15.47:0/450644360 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fad80005850 con 0x7fad980ead00 2024-04-14T23:34:59.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.774+0000 7fad95ffb640 1 -- 172.21.15.47:0/450644360 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fada00fa180 con 0x7fad980ead00 2024-04-14T23:34:59.778 INFO:teuthology.orchestra.run.smithi047.stdout:55834574858 2024-04-14T23:34:59.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.776+0000 7fc23bc05640 1 -- 172.21.15.47:0/938011835 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc21806b9e0 msgr2=0x7fc21806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.776+0000 7fc23bc05640 1 --2- 172.21.15.47:0/938011835 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc21806b9e0 0x7fc21806dea0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc224009c00 tx=0x7fc224009190 comp rx=0 tx=0).stop 2024-04-14T23:34:59.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.776+0000 7fc23bc05640 1 -- 172.21.15.47:0/938011835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc234156e60 msgr2=0x7fc23406e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.776+0000 7fc23bc05640 1 --2- 172.21.15.47:0/938011835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc234156e60 0x7fc23406e790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00c3c0 tx=0x7fc22c00c880 comp rx=0 tx=0).stop 2024-04-14T23:34:59.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.776+0000 7fc23bc05640 1 -- 172.21.15.47:0/938011835 shutdown_connections 2024-04-14T23:34:59.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.776+0000 7fc23bc05640 1 --2- 172.21.15.47:0/938011835 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc21806b9e0 0x7fc21806dea0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.776+0000 7fc23bc05640 1 --2- 172.21.15.47:0/938011835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc234156e60 0x7fc23406e790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.776+0000 7fc23bc05640 1 --2- 172.21.15.47:0/938011835 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc234162b20 0x7fc2340b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.776+0000 7fc23bc05640 1 --2- 172.21.15.47:0/938011835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc234162740 0x7fc2340c5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.776+0000 7fc23bc05640 1 -- 172.21.15.47:0/938011835 >> 172.21.15.47:0/938011835 conn(0x7fc2340d0320 msgr2=0x7fc2340ad130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.777+0000 7fc23bc05640 1 -- 172.21.15.47:0/938011835 shutdown_connections 2024-04-14T23:34:59.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.777+0000 7fc23bc05640 1 -- 172.21.15.47:0/938011835 wait complete. 2024-04-14T23:34:59.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.777+0000 7fada607c640 1 -- 172.21.15.47:0/450644360 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fad8406ba60 msgr2=0x7fad8406df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.777+0000 7fada607c640 1 --2- 172.21.15.47:0/450644360 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fad8406ba60 0x7fad8406df20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad9c006fd0 tx=0x7fad9c008040 comp rx=0 tx=0).stop 2024-04-14T23:34:59.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.778+0000 7fada607c640 1 -- 172.21.15.47:0/450644360 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad980ead00 msgr2=0x7fad9804dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.778+0000 7fada607c640 1 --2- 172.21.15.47:0/450644360 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad980ead00 0x7fad9804dba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fada006a010 tx=0x7fada00744d0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.778+0000 7fada607c640 1 -- 172.21.15.47:0/450644360 shutdown_connections 2024-04-14T23:34:59.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.778+0000 7fada607c640 1 --2- 172.21.15.47:0/450644360 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fad8406ba60 0x7fad8406df20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.778+0000 7fada607c640 1 --2- 172.21.15.47:0/450644360 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad980ead00 0x7fad9804dba0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.778+0000 7fada607c640 1 --2- 172.21.15.47:0/450644360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad9804ffd0 0x7fad98046060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.778+0000 7fada607c640 1 --2- 172.21.15.47:0/450644360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad98038110 0x7fad9817c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.778+0000 7fada607c640 1 -- 172.21.15.47:0/450644360 >> 172.21.15.47:0/450644360 conn(0x7fad98009fb0 msgr2=0x7fad980495c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.778+0000 7fada607c640 1 -- 172.21.15.47:0/450644360 shutdown_connections 2024-04-14T23:34:59.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.778+0000 7fada607c640 1 -- 172.21.15.47:0/450644360 wait complete. 2024-04-14T23:34:59.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-04-14T23:34:59.785 DEBUG:teuthology.parallel:result is None 2024-04-14T23:34:59.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-04-14T23:34:59.788 DEBUG:teuthology.parallel:result is None 2024-04-14T23:34:59.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-04-14T23:34:59.791 DEBUG:teuthology.parallel:result is None 2024-04-14T23:34:59.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-04-14T23:34:59.792 DEBUG:teuthology.parallel:result is None 2024-04-14T23:34:59.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2024-04-14T23:34:59.796 DEBUG:teuthology.parallel:result is None 2024-04-14T23:34:59.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-04-14T23:34:59.797 DEBUG:teuthology.parallel:result is None 2024-04-14T23:34:59.797 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-14T23:34:59.797 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T23:34:59.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.934+0000 7f6ddbb15640 1 Processor -- start 2024-04-14T23:34:59.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.934+0000 7f6ddbb15640 1 -- start start 2024-04-14T23:34:59.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.935+0000 7f6ddbb15640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6dd40d1e00 0x7f6dd40d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.935+0000 7f6ddbb15640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6dd40d2740 0x7f6dd40b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.935+0000 7f6ddbb15640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dd40d1620 con 0x7f6dd415e270 2024-04-14T23:34:59.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.935+0000 7f6ddbb15640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd40d2bb0 con 0x7f6dd40d1e00 2024-04-14T23:34:59.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.935+0000 7f6ddbb15640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd40b4300 con 0x7f6dd40d2740 2024-04-14T23:34:59.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.935+0000 7f6dd90b0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6dd40d1e00 0x7f6dd40d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.935+0000 7f6dd90b0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6dd40d1e00 0x7f6dd40d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36258/0 (socket says 172.21.15.47:36258) 2024-04-14T23:34:59.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.935+0000 7f6dd90b0640 1 -- 172.21.15.47:0/149065581 learned_addr learned my addr 172.21.15.47:0/149065581 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.935+0000 7f6dda0b2640 1 --2- 172.21.15.47:0/149065581 >> v2:172.21.15.191:3300/0 conn(0x7f6dd40d2740 0x7f6dd40b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.936+0000 7f6dd90b0640 1 -- 172.21.15.47:0/149065581 >> v2:172.21.15.191:3300/0 conn(0x7f6dd40d2740 msgr2=0x7f6dd40b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:59.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.936+0000 7f6dd90b0640 1 --2- 172.21.15.47:0/149065581 >> v2:172.21.15.191:3300/0 conn(0x7f6dd40d2740 0x7f6dd40b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.936+0000 7f6dd90b0640 1 -- 172.21.15.47:0/149065581 >> v1:172.21.15.191:6789/0 conn(0x7f6dd415e270 legacy=0x7f6dd40d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:34:59.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.936+0000 7f6dd90b0640 1 -- 172.21.15.47:0/149065581 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd40b39d0 con 0x7f6dd40d1e00 2024-04-14T23:34:59.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.936+0000 7f6dd90b0640 1 --2- 172.21.15.47:0/149065581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dd40d1e00 0x7f6dd40d2200 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40ce930 tx=0x7f6dc802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be79d03264c2d6ab server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.936+0000 7f6dd88af640 1 -- 172.21.15.47:0/149065581 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8034070 con 0x7f6dd40d1e00 2024-04-14T23:34:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.937+0000 7f6dd88af640 1 -- 172.21.15.47:0/149065581 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc8030860 con 0x7f6dd40d1e00 2024-04-14T23:34:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.937+0000 7f6dd88af640 1 -- 172.21.15.47:0/149065581 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8030c30 con 0x7f6dd40d1e00 2024-04-14T23:34:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.937+0000 7f6ddbb15640 1 -- 172.21.15.47:0/149065581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dd40d1e00 msgr2=0x7f6dd40d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.937+0000 7f6ddbb15640 1 --2- 172.21.15.47:0/149065581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dd40d1e00 0x7f6dd40d2200 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40ce930 tx=0x7f6dc802b9a0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.937+0000 7f6ddbb15640 1 -- 172.21.15.47:0/149065581 shutdown_connections 2024-04-14T23:34:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.937+0000 7f6ddbb15640 1 --2- 172.21.15.47:0/149065581 >> v2:172.21.15.191:3300/0 conn(0x7f6dd40d2740 0x7f6dd40b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.937+0000 7f6ddbb15640 1 --2- 172.21.15.47:0/149065581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dd40d1e00 0x7f6dd40d2200 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.937+0000 7f6ddbb15640 1 -- 172.21.15.47:0/149065581 >> 172.21.15.47:0/149065581 conn(0x7f6dd40d3ed0 msgr2=0x7f6dd40d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:34:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.937+0000 7f6ddbb15640 1 -- 172.21.15.47:0/149065581 shutdown_connections 2024-04-14T23:34:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.937+0000 7f6ddbb15640 1 -- 172.21.15.47:0/149065581 wait complete. 2024-04-14T23:34:59.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.938+0000 7f6ddbb15640 1 Processor -- start 2024-04-14T23:34:59.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.938+0000 7f6ddbb15640 1 -- start start 2024-04-14T23:34:59.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6ddbb15640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dd40d1e00 0x7f6dd415c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6ddbb15640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd40d2740 0x7f6dd40cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6ddbb15640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dd415e270 0x7f6dd40c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6ddbb15640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd40b0c60 con 0x7f6dd415e270 2024-04-14T23:34:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6ddbb15640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd40b3f90 con 0x7f6dd40d1e00 2024-04-14T23:34:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6ddbb15640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd415e650 con 0x7f6dd40d2740 2024-04-14T23:34:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6dda0b2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dd415e270 0x7f6dd40c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6dda0b2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dd415e270 0x7f6dd40c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36270/0 (socket says 172.21.15.47:36270) 2024-04-14T23:34:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6dda0b2640 1 -- 172.21.15.47:0/976970999 learned_addr learned my addr 172.21.15.47:0/976970999 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:34:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6dd98b1640 1 --2- 172.21.15.47:0/976970999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dd40d1e00 0x7f6dd415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6dd90b0640 1 --2- 172.21.15.47:0/976970999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd40d2740 0x7f6dd40cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6dda0b2640 1 -- 172.21.15.47:0/976970999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd40d2740 msgr2=0x7f6dd40cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6dda0b2640 1 --2- 172.21.15.47:0/976970999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd40d2740 0x7f6dd40cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6dda0b2640 1 -- 172.21.15.47:0/976970999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dd40d1e00 msgr2=0x7f6dd415c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:34:59.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6dda0b2640 1 --2- 172.21.15.47:0/976970999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dd40d1e00 0x7f6dd415c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:34:59.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6dda0b2640 1 -- 172.21.15.47:0/976970999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd40cb6a0 con 0x7f6dd415e270 2024-04-14T23:34:59.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.939+0000 7f6dd98b1640 1 --2- 172.21.15.47:0/976970999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dd40d1e00 0x7f6dd415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:34:59.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.940+0000 7f6dda0b2640 1 --2- 172.21.15.47:0/976970999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dd415e270 0x7f6dd40c75e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00d830 tx=0x7f6dcc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.940+0000 7f6dd27fc640 1 -- 172.21.15.47:0/976970999 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc00b6c0 con 0x7f6dd415e270 2024-04-14T23:34:59.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.940+0000 7f6dd27fc640 1 -- 172.21.15.47:0/976970999 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dcc019070 con 0x7f6dd415e270 2024-04-14T23:34:59.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.940+0000 7f6dd27fc640 1 -- 172.21.15.47:0/976970999 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc00bac0 con 0x7f6dd415e270 2024-04-14T23:34:59.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.940+0000 7f6ddbb15640 1 -- 172.21.15.47:0/976970999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd40cb980 con 0x7f6dd415e270 2024-04-14T23:34:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.940+0000 7f6ddbb15640 1 -- 172.21.15.47:0/976970999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd415ea20 con 0x7f6dd415e270 2024-04-14T23:34:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.941+0000 7f6ddbb15640 1 -- 172.21.15.47:0/976970999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd4075430 con 0x7f6dd415e270 2024-04-14T23:34:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.941+0000 7f6dd27fc640 1 -- 172.21.15.47:0/976970999 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6dcc01e460 con 0x7f6dd415e270 2024-04-14T23:34:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.941+0000 7f6dd27fc640 1 --2- 172.21.15.47:0/976970999 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6dc006b990 0x7f6dc006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:34:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.942+0000 7f6dd27fc640 1 -- 172.21.15.47:0/976970999 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6dcc08b210 con 0x7f6dd415e270 2024-04-14T23:34:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.942+0000 7f6dd98b1640 1 --2- 172.21.15.47:0/976970999 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6dc006b990 0x7f6dc006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:34:59.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.942+0000 7f6dd98b1640 1 --2- 172.21.15.47:0/976970999 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6dc006b990 0x7f6dc006de50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40b96a0 tx=0x7f6dc4009570 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:34:59.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:34:59.946+0000 7f6dd27fc640 1 -- 172.21.15.47:0/976970999 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6dcc059ae0 con 0x7f6dd415e270 2024-04-14T23:35:00.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.125+0000 7f6ddbb15640 1 -- 172.21.15.47:0/976970999 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6dd415d770 con 0x7f6dc006b990 2024-04-14T23:35:00.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.133+0000 7f6dd27fc640 1 -- 172.21.15.47:0/976970999 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f6dc406c310 con 0x7f6dc006b990 2024-04-14T23:35:00.139 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:00.141 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-14T23:35:00.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.136+0000 7f6ddbb15640 1 -- 172.21.15.47:0/976970999 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6dc006b990 msgr2=0x7f6dc006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.136+0000 7f6ddbb15640 1 --2- 172.21.15.47:0/976970999 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6dc006b990 0x7f6dc006de50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40b96a0 tx=0x7f6dc4009570 comp rx=0 tx=0).stop 2024-04-14T23:35:00.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.136+0000 7f6ddbb15640 1 -- 172.21.15.47:0/976970999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dd415e270 msgr2=0x7f6dd40c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.136+0000 7f6ddbb15640 1 --2- 172.21.15.47:0/976970999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dd415e270 0x7f6dd40c75e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00d830 tx=0x7f6dcc00dcf0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.136+0000 7f6ddbb15640 1 -- 172.21.15.47:0/976970999 shutdown_connections 2024-04-14T23:35:00.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.136+0000 7f6ddbb15640 1 --2- 172.21.15.47:0/976970999 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6dc006b990 0x7f6dc006de50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.136+0000 7f6ddbb15640 1 --2- 172.21.15.47:0/976970999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dd415e270 0x7f6dd40c75e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.136+0000 7f6ddbb15640 1 --2- 172.21.15.47:0/976970999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd40d2740 0x7f6dd40cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.136+0000 7f6ddbb15640 1 --2- 172.21.15.47:0/976970999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dd40d1e00 0x7f6dd415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.136+0000 7f6ddbb15640 1 -- 172.21.15.47:0/976970999 >> 172.21.15.47:0/976970999 conn(0x7f6dd40d3ed0 msgr2=0x7f6dd40b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:00.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.136+0000 7f6ddbb15640 1 -- 172.21.15.47:0/976970999 shutdown_connections 2024-04-14T23:35:00.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.136+0000 7f6ddbb15640 1 -- 172.21.15.47:0/976970999 wait complete. 2024-04-14T23:35:00.150 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-14T23:34:58.362866+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236100,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738620,"statfs":{"total":773094113280,"available":772852346880,"internally_reserved":0,"allocated":3383296,"data_stored":2049160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003166"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311249+0000","last_change":"2024-04-14T23:34:37.710684+0000","last_active":"2024-04-14T23:34:46.311249+0000","last_peered":"2024-04-14T23:34:46.311249+0000","last_clean":"2024-04-14T23:34:46.311249+0000","last_became_active":"2024-04-14T23:34:37.710401+0000","last_became_peered":"2024-04-14T23:34:37.710401+0000","last_unstale":"2024-04-14T23:34:46.311249+0000","last_undegraded":"2024-04-14T23:34:46.311249+0000","last_fullsized":"2024-04-14T23:34:46.311249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:24:08.806585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718660+0000","last_change":"2024-04-14T23:34:38.716947+0000","last_active":"2024-04-14T23:34:44.718660+0000","last_peered":"2024-04-14T23:34:44.718660+0000","last_clean":"2024-04-14T23:34:44.718660+0000","last_became_active":"2024-04-14T23:34:38.716643+0000","last_became_peered":"2024-04-14T23:34:38.716643+0000","last_unstale":"2024-04-14T23:34:44.718660+0000","last_undegraded":"2024-04-14T23:34:44.718660+0000","last_fullsized":"2024-04-14T23:34:44.718660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:27:36.965696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718020+0000","last_change":"2024-04-14T23:34:43.189638+0000","last_active":"2024-04-14T23:34:44.718020+0000","last_peered":"2024-04-14T23:34:44.718020+0000","last_clean":"2024-04-14T23:34:44.718020+0000","last_became_active":"2024-04-14T23:34:43.188302+0000","last_became_peered":"2024-04-14T23:34:43.188302+0000","last_unstale":"2024-04-14T23:34:44.718020+0000","last_undegraded":"2024-04-14T23:34:44.718020+0000","last_fullsized":"2024-04-14T23:34:44.718020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:22:18.103327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718787+0000","last_change":"2024-04-14T23:34:37.707154+0000","last_active":"2024-04-14T23:34:44.718787+0000","last_peered":"2024-04-14T23:34:44.718787+0000","last_clean":"2024-04-14T23:34:44.718787+0000","last_became_active":"2024-04-14T23:34:37.706646+0000","last_became_peered":"2024-04-14T23:34:37.706646+0000","last_unstale":"2024-04-14T23:34:44.718787+0000","last_undegraded":"2024-04-14T23:34:44.718787+0000","last_fullsized":"2024-04-14T23:34:44.718787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:24:08.806585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311859+0000","last_change":"2024-04-14T23:34:38.697913+0000","last_active":"2024-04-14T23:34:46.311859+0000","last_peered":"2024-04-14T23:34:46.311859+0000","last_clean":"2024-04-14T23:34:46.311859+0000","last_became_active":"2024-04-14T23:34:38.697206+0000","last_became_peered":"2024-04-14T23:34:38.697206+0000","last_unstale":"2024-04-14T23:34:46.311859+0000","last_undegraded":"2024-04-14T23:34:46.311859+0000","last_fullsized":"2024-04-14T23:34:46.311859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:09:45.484768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719041+0000","last_change":"2024-04-14T23:34:42.733619+0000","last_active":"2024-04-14T23:34:44.719041+0000","last_peered":"2024-04-14T23:34:44.719041+0000","last_clean":"2024-04-14T23:34:44.719041+0000","last_became_active":"2024-04-14T23:34:42.733164+0000","last_became_peered":"2024-04-14T23:34:42.733164+0000","last_unstale":"2024-04-14T23:34:44.719041+0000","last_undegraded":"2024-04-14T23:34:44.719041+0000","last_fullsized":"2024-04-14T23:34:44.719041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:28:10.218625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136525+0000","last_change":"2024-04-14T23:34:37.712565+0000","last_active":"2024-04-14T23:34:45.136525+0000","last_peered":"2024-04-14T23:34:45.136525+0000","last_clean":"2024-04-14T23:34:45.136525+0000","last_became_active":"2024-04-14T23:34:37.712304+0000","last_became_peered":"2024-04-14T23:34:37.712304+0000","last_unstale":"2024-04-14T23:34:45.136525+0000","last_undegraded":"2024-04-14T23:34:45.136525+0000","last_fullsized":"2024-04-14T23:34:45.136525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:52.026945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720469+0000","last_change":"2024-04-14T23:34:38.706895+0000","last_active":"2024-04-14T23:34:44.720469+0000","last_peered":"2024-04-14T23:34:44.720469+0000","last_clean":"2024-04-14T23:34:44.720469+0000","last_became_active":"2024-04-14T23:34:38.704429+0000","last_became_peered":"2024-04-14T23:34:38.704429+0000","last_unstale":"2024-04-14T23:34:44.720469+0000","last_undegraded":"2024-04-14T23:34:44.720469+0000","last_fullsized":"2024-04-14T23:34:44.720469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:22.876283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719267+0000","last_change":"2024-04-14T23:34:42.734180+0000","last_active":"2024-04-14T23:34:44.719267+0000","last_peered":"2024-04-14T23:34:44.719267+0000","last_clean":"2024-04-14T23:34:44.719267+0000","last_became_active":"2024-04-14T23:34:42.733249+0000","last_became_peered":"2024-04-14T23:34:42.733249+0000","last_unstale":"2024-04-14T23:34:44.719267+0000","last_undegraded":"2024-04-14T23:34:44.719267+0000","last_fullsized":"2024-04-14T23:34:44.719267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:50:07.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136305+0000","last_change":"2024-04-14T23:34:37.710172+0000","last_active":"2024-04-14T23:34:45.136305+0000","last_peered":"2024-04-14T23:34:45.136305+0000","last_clean":"2024-04-14T23:34:45.136305+0000","last_became_active":"2024-04-14T23:34:37.709859+0000","last_became_peered":"2024-04-14T23:34:37.709859+0000","last_unstale":"2024-04-14T23:34:45.136305+0000","last_undegraded":"2024-04-14T23:34:45.136305+0000","last_fullsized":"2024-04-14T23:34:45.136305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:03:17.126654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719993+0000","last_change":"2024-04-14T23:34:38.703533+0000","last_active":"2024-04-14T23:34:44.719993+0000","last_peered":"2024-04-14T23:34:44.719993+0000","last_clean":"2024-04-14T23:34:44.719993+0000","last_became_active":"2024-04-14T23:34:38.703228+0000","last_became_peered":"2024-04-14T23:34:38.703228+0000","last_unstale":"2024-04-14T23:34:44.719993+0000","last_undegraded":"2024-04-14T23:34:44.719993+0000","last_fullsized":"2024-04-14T23:34:44.719993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719336+0000","last_change":"2024-04-14T23:34:42.735315+0000","last_active":"2024-04-14T23:34:44.719336+0000","last_peered":"2024-04-14T23:34:44.719336+0000","last_clean":"2024-04-14T23:34:44.719336+0000","last_became_active":"2024-04-14T23:34:42.734932+0000","last_became_peered":"2024-04-14T23:34:42.734932+0000","last_unstale":"2024-04-14T23:34:44.719336+0000","last_undegraded":"2024-04-14T23:34:44.719336+0000","last_fullsized":"2024-04-14T23:34:44.719336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:12:56.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517099+0000","last_change":"2024-04-14T23:34:38.712701+0000","last_active":"2024-04-14T23:34:46.517099+0000","last_peered":"2024-04-14T23:34:46.517099+0000","last_clean":"2024-04-14T23:34:46.517099+0000","last_became_active":"2024-04-14T23:34:38.712434+0000","last_became_peered":"2024-04-14T23:34:38.712434+0000","last_unstale":"2024-04-14T23:34:46.517099+0000","last_undegraded":"2024-04-14T23:34:46.517099+0000","last_fullsized":"2024-04-14T23:34:46.517099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:27:36.965696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136371+0000","last_change":"2024-04-14T23:34:37.713312+0000","last_active":"2024-04-14T23:34:45.136371+0000","last_peered":"2024-04-14T23:34:45.136371+0000","last_clean":"2024-04-14T23:34:45.136371+0000","last_became_active":"2024-04-14T23:34:37.713015+0000","last_became_peered":"2024-04-14T23:34:37.713015+0000","last_unstale":"2024-04-14T23:34:45.136371+0000","last_undegraded":"2024-04-14T23:34:45.136371+0000","last_fullsized":"2024-04-14T23:34:45.136371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:25.981130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720659+0000","last_change":"2024-04-14T23:34:42.734239+0000","last_active":"2024-04-14T23:34:44.720659+0000","last_peered":"2024-04-14T23:34:44.720659+0000","last_clean":"2024-04-14T23:34:44.720659+0000","last_became_active":"2024-04-14T23:34:42.733043+0000","last_became_peered":"2024-04-14T23:34:42.733043+0000","last_unstale":"2024-04-14T23:34:44.720659+0000","last_undegraded":"2024-04-14T23:34:44.720659+0000","last_fullsized":"2024-04-14T23:34:44.720659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:24:22.674500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718328+0000","last_change":"2024-04-14T23:34:38.708368+0000","last_active":"2024-04-14T23:34:44.718328+0000","last_peered":"2024-04-14T23:34:44.718328+0000","last_clean":"2024-04-14T23:34:44.718328+0000","last_became_active":"2024-04-14T23:34:38.708065+0000","last_became_peered":"2024-04-14T23:34:38.708065+0000","last_unstale":"2024-04-14T23:34:44.718328+0000","last_undegraded":"2024-04-14T23:34:44.718328+0000","last_fullsized":"2024-04-14T23:34:44.718328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:09:47.574841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318514+0000","last_change":"2024-04-14T23:34:37.707159+0000","last_active":"2024-04-14T23:34:46.318514+0000","last_peered":"2024-04-14T23:34:46.318514+0000","last_clean":"2024-04-14T23:34:46.318514+0000","last_became_active":"2024-04-14T23:34:37.706777+0000","last_became_peered":"2024-04-14T23:34:37.706777+0000","last_unstale":"2024-04-14T23:34:46.318514+0000","last_undegraded":"2024-04-14T23:34:46.318514+0000","last_fullsized":"2024-04-14T23:34:46.318514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:23.167535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719596+0000","last_change":"2024-04-14T23:34:42.734697+0000","last_active":"2024-04-14T23:34:44.719596+0000","last_peered":"2024-04-14T23:34:44.719596+0000","last_clean":"2024-04-14T23:34:44.719596+0000","last_became_active":"2024-04-14T23:34:42.732974+0000","last_became_peered":"2024-04-14T23:34:42.732974+0000","last_unstale":"2024-04-14T23:34:44.719596+0000","last_undegraded":"2024-04-14T23:34:44.719596+0000","last_fullsized":"2024-04-14T23:34:44.719596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:18:47.542320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718187+0000","last_change":"2024-04-14T23:34:38.713694+0000","last_active":"2024-04-14T23:34:44.718187+0000","last_peered":"2024-04-14T23:34:44.718187+0000","last_clean":"2024-04-14T23:34:44.718187+0000","last_became_active":"2024-04-14T23:34:38.713374+0000","last_became_peered":"2024-04-14T23:34:38.713374+0000","last_unstale":"2024-04-14T23:34:44.718187+0000","last_undegraded":"2024-04-14T23:34:44.718187+0000","last_fullsized":"2024-04-14T23:34:44.718187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:40.949590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318481+0000","last_change":"2024-04-14T23:34:37.708516+0000","last_active":"2024-04-14T23:34:46.318481+0000","last_peered":"2024-04-14T23:34:46.318481+0000","last_clean":"2024-04-14T23:34:46.318481+0000","last_became_active":"2024-04-14T23:34:37.708219+0000","last_became_peered":"2024-04-14T23:34:37.708219+0000","last_unstale":"2024-04-14T23:34:46.318481+0000","last_undegraded":"2024-04-14T23:34:46.318481+0000","last_fullsized":"2024-04-14T23:34:46.318481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:29.023280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319235+0000","last_change":"2024-04-14T23:34:43.186688+0000","last_active":"2024-04-14T23:34:46.319235+0000","last_peered":"2024-04-14T23:34:46.319235+0000","last_clean":"2024-04-14T23:34:46.319235+0000","last_became_active":"2024-04-14T23:34:43.186305+0000","last_became_peered":"2024-04-14T23:34:43.186305+0000","last_unstale":"2024-04-14T23:34:46.319235+0000","last_undegraded":"2024-04-14T23:34:46.319235+0000","last_fullsized":"2024-04-14T23:34:46.319235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:12:56.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720326+0000","last_change":"2024-04-14T23:34:38.707888+0000","last_active":"2024-04-14T23:34:44.720326+0000","last_peered":"2024-04-14T23:34:44.720326+0000","last_clean":"2024-04-14T23:34:44.720326+0000","last_became_active":"2024-04-14T23:34:38.707601+0000","last_became_peered":"2024-04-14T23:34:38.707601+0000","last_unstale":"2024-04-14T23:34:44.720326+0000","last_undegraded":"2024-04-14T23:34:44.720326+0000","last_fullsized":"2024-04-14T23:34:44.720326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:18:41.946696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.135954+0000","last_change":"2024-04-14T23:34:37.712453+0000","last_active":"2024-04-14T23:34:45.135954+0000","last_peered":"2024-04-14T23:34:45.135954+0000","last_clean":"2024-04-14T23:34:45.135954+0000","last_became_active":"2024-04-14T23:34:37.712091+0000","last_became_peered":"2024-04-14T23:34:37.712091+0000","last_unstale":"2024-04-14T23:34:45.135954+0000","last_undegraded":"2024-04-14T23:34:45.135954+0000","last_fullsized":"2024-04-14T23:34:45.135954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:23.167535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719231+0000","last_change":"2024-04-14T23:34:42.730978+0000","last_active":"2024-04-14T23:34:44.719231+0000","last_peered":"2024-04-14T23:34:44.719231+0000","last_clean":"2024-04-14T23:34:44.719231+0000","last_became_active":"2024-04-14T23:34:42.730528+0000","last_became_peered":"2024-04-14T23:34:42.730528+0000","last_unstale":"2024-04-14T23:34:44.719231+0000","last_undegraded":"2024-04-14T23:34:44.719231+0000","last_fullsized":"2024-04-14T23:34:44.719231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:22:18.658809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.312044+0000","last_change":"2024-04-14T23:34:38.705602+0000","last_active":"2024-04-14T23:34:46.312044+0000","last_peered":"2024-04-14T23:34:46.312044+0000","last_clean":"2024-04-14T23:34:46.312044+0000","last_became_active":"2024-04-14T23:34:38.705305+0000","last_became_peered":"2024-04-14T23:34:38.705305+0000","last_unstale":"2024-04-14T23:34:46.312044+0000","last_undegraded":"2024-04-14T23:34:46.312044+0000","last_fullsized":"2024-04-14T23:34:46.312044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:12.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516709+0000","last_change":"2024-04-14T23:34:37.709059+0000","last_active":"2024-04-14T23:34:46.516709+0000","last_peered":"2024-04-14T23:34:46.516709+0000","last_clean":"2024-04-14T23:34:46.516709+0000","last_became_active":"2024-04-14T23:34:37.707857+0000","last_became_peered":"2024-04-14T23:34:37.707857+0000","last_unstale":"2024-04-14T23:34:46.516709+0000","last_undegraded":"2024-04-14T23:34:46.516709+0000","last_fullsized":"2024-04-14T23:34:46.516709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:02:03.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720072+0000","last_change":"2024-04-14T23:34:43.185206+0000","last_active":"2024-04-14T23:34:44.720072+0000","last_peered":"2024-04-14T23:34:44.720072+0000","last_clean":"2024-04-14T23:34:44.720072+0000","last_became_active":"2024-04-14T23:34:43.184816+0000","last_became_peered":"2024-04-14T23:34:43.184816+0000","last_unstale":"2024-04-14T23:34:44.720072+0000","last_undegraded":"2024-04-14T23:34:44.720072+0000","last_fullsized":"2024-04-14T23:34:44.720072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:16:46.008001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718884+0000","last_change":"2024-04-14T23:34:38.712982+0000","last_active":"2024-04-14T23:34:44.718884+0000","last_peered":"2024-04-14T23:34:44.718884+0000","last_clean":"2024-04-14T23:34:44.718884+0000","last_became_active":"2024-04-14T23:34:38.712714+0000","last_became_peered":"2024-04-14T23:34:38.712714+0000","last_unstale":"2024-04-14T23:34:44.718884+0000","last_undegraded":"2024-04-14T23:34:44.718884+0000","last_fullsized":"2024-04-14T23:34:44.718884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:44.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319185+0000","last_change":"2024-04-14T23:34:37.705495+0000","last_active":"2024-04-14T23:34:46.319185+0000","last_peered":"2024-04-14T23:34:46.319185+0000","last_clean":"2024-04-14T23:34:46.319185+0000","last_became_active":"2024-04-14T23:34:37.705184+0000","last_became_peered":"2024-04-14T23:34:37.705184+0000","last_unstale":"2024-04-14T23:34:46.319185+0000","last_undegraded":"2024-04-14T23:34:46.319185+0000","last_fullsized":"2024-04-14T23:34:46.319185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:18:40.942344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.717967+0000","last_change":"2024-04-14T23:34:43.189327+0000","last_active":"2024-04-14T23:34:44.717967+0000","last_peered":"2024-04-14T23:34:44.717967+0000","last_clean":"2024-04-14T23:34:44.717967+0000","last_became_active":"2024-04-14T23:34:43.188921+0000","last_became_peered":"2024-04-14T23:34:43.188921+0000","last_unstale":"2024-04-14T23:34:44.717967+0000","last_undegraded":"2024-04-14T23:34:44.717967+0000","last_fullsized":"2024-04-14T23:34:44.717967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:57:09.514981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319131+0000","last_change":"2024-04-14T23:34:38.707155+0000","last_active":"2024-04-14T23:34:46.319131+0000","last_peered":"2024-04-14T23:34:46.319131+0000","last_clean":"2024-04-14T23:34:46.319131+0000","last_became_active":"2024-04-14T23:34:38.706626+0000","last_became_peered":"2024-04-14T23:34:38.706626+0000","last_unstale":"2024-04-14T23:34:46.319131+0000","last_undegraded":"2024-04-14T23:34:46.319131+0000","last_fullsized":"2024-04-14T23:34:46.319131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:54:47.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136672+0000","last_change":"2024-04-14T23:34:37.713324+0000","last_active":"2024-04-14T23:34:45.136672+0000","last_peered":"2024-04-14T23:34:45.136672+0000","last_clean":"2024-04-14T23:34:45.136672+0000","last_became_active":"2024-04-14T23:34:37.713052+0000","last_became_peered":"2024-04-14T23:34:37.713052+0000","last_unstale":"2024-04-14T23:34:45.136672+0000","last_undegraded":"2024-04-14T23:34:45.136672+0000","last_fullsized":"2024-04-14T23:34:45.136672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:21:25.348015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311604+0000","last_change":"2024-04-14T23:34:43.187173+0000","last_active":"2024-04-14T23:34:46.311604+0000","last_peered":"2024-04-14T23:34:46.311604+0000","last_clean":"2024-04-14T23:34:46.311604+0000","last_became_active":"2024-04-14T23:34:43.185505+0000","last_became_peered":"2024-04-14T23:34:43.185505+0000","last_unstale":"2024-04-14T23:34:46.311604+0000","last_undegraded":"2024-04-14T23:34:46.311604+0000","last_fullsized":"2024-04-14T23:34:46.311604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:28:10.218625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720108+0000","last_change":"2024-04-14T23:34:38.708136+0000","last_active":"2024-04-14T23:34:44.720108+0000","last_peered":"2024-04-14T23:34:44.720108+0000","last_clean":"2024-04-14T23:34:44.720108+0000","last_became_active":"2024-04-14T23:34:38.707860+0000","last_became_peered":"2024-04-14T23:34:38.707860+0000","last_unstale":"2024-04-14T23:34:44.720108+0000","last_undegraded":"2024-04-14T23:34:44.720108+0000","last_fullsized":"2024-04-14T23:34:44.720108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319191+0000","last_change":"2024-04-14T23:34:37.703582+0000","last_active":"2024-04-14T23:34:46.319191+0000","last_peered":"2024-04-14T23:34:46.319191+0000","last_clean":"2024-04-14T23:34:46.319191+0000","last_became_active":"2024-04-14T23:34:37.703276+0000","last_became_peered":"2024-04-14T23:34:37.703276+0000","last_unstale":"2024-04-14T23:34:46.319191+0000","last_undegraded":"2024-04-14T23:34:46.319191+0000","last_fullsized":"2024-04-14T23:34:46.319191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:03:17.126654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318955+0000","last_change":"2024-04-14T23:34:42.738584+0000","last_active":"2024-04-14T23:34:46.318955+0000","last_peered":"2024-04-14T23:34:46.318955+0000","last_clean":"2024-04-14T23:34:46.318955+0000","last_became_active":"2024-04-14T23:34:42.738098+0000","last_became_peered":"2024-04-14T23:34:42.738098+0000","last_unstale":"2024-04-14T23:34:46.318955+0000","last_undegraded":"2024-04-14T23:34:46.318955+0000","last_fullsized":"2024-04-14T23:34:46.318955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:22:18.658809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719759+0000","last_change":"2024-04-14T23:34:38.710787+0000","last_active":"2024-04-14T23:34:44.719759+0000","last_peered":"2024-04-14T23:34:44.719759+0000","last_clean":"2024-04-14T23:34:44.719759+0000","last_became_active":"2024-04-14T23:34:38.710503+0000","last_became_peered":"2024-04-14T23:34:38.710503+0000","last_unstale":"2024-04-14T23:34:44.719759+0000","last_undegraded":"2024-04-14T23:34:44.719759+0000","last_fullsized":"2024-04-14T23:34:44.719759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:24.171888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720174+0000","last_change":"2024-04-14T23:34:37.704162+0000","last_active":"2024-04-14T23:34:44.720174+0000","last_peered":"2024-04-14T23:34:44.720174+0000","last_clean":"2024-04-14T23:34:44.720174+0000","last_became_active":"2024-04-14T23:34:37.703874+0000","last_became_peered":"2024-04-14T23:34:37.703874+0000","last_unstale":"2024-04-14T23:34:44.720174+0000","last_undegraded":"2024-04-14T23:34:44.720174+0000","last_fullsized":"2024-04-14T23:34:44.720174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:18:40.942344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319100+0000","last_change":"2024-04-14T23:34:42.731843+0000","last_active":"2024-04-14T23:34:46.319100+0000","last_peered":"2024-04-14T23:34:46.319100+0000","last_clean":"2024-04-14T23:34:46.319100+0000","last_became_active":"2024-04-14T23:34:42.730913+0000","last_became_peered":"2024-04-14T23:34:42.730913+0000","last_unstale":"2024-04-14T23:34:46.319100+0000","last_undegraded":"2024-04-14T23:34:46.319100+0000","last_fullsized":"2024-04-14T23:34:46.319100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:50:07.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318803+0000","last_change":"2024-04-14T23:34:38.706592+0000","last_active":"2024-04-14T23:34:46.318803+0000","last_peered":"2024-04-14T23:34:46.318803+0000","last_clean":"2024-04-14T23:34:46.318803+0000","last_became_active":"2024-04-14T23:34:38.706299+0000","last_became_peered":"2024-04-14T23:34:38.706299+0000","last_unstale":"2024-04-14T23:34:46.318803+0000","last_undegraded":"2024-04-14T23:34:46.318803+0000","last_fullsized":"2024-04-14T23:34:46.318803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:12.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806129+0000","last_change":"2024-04-14T23:34:37.703871+0000","last_active":"2024-04-14T23:34:45.806129+0000","last_peered":"2024-04-14T23:34:45.806129+0000","last_clean":"2024-04-14T23:34:45.806129+0000","last_became_active":"2024-04-14T23:34:37.703574+0000","last_became_peered":"2024-04-14T23:34:37.703574+0000","last_unstale":"2024-04-14T23:34:45.806129+0000","last_undegraded":"2024-04-14T23:34:45.806129+0000","last_fullsized":"2024-04-14T23:34:45.806129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:51:11.382828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319327+0000","last_change":"2024-04-14T23:34:42.739072+0000","last_active":"2024-04-14T23:34:46.319327+0000","last_peered":"2024-04-14T23:34:46.319327+0000","last_clean":"2024-04-14T23:34:46.319327+0000","last_became_active":"2024-04-14T23:34:42.738587+0000","last_became_peered":"2024-04-14T23:34:42.738587+0000","last_unstale":"2024-04-14T23:34:46.319327+0000","last_undegraded":"2024-04-14T23:34:46.319327+0000","last_fullsized":"2024-04-14T23:34:46.319327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:37:34.006119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311383+0000","last_change":"2024-04-14T23:34:38.704755+0000","last_active":"2024-04-14T23:34:46.311383+0000","last_peered":"2024-04-14T23:34:46.311383+0000","last_clean":"2024-04-14T23:34:46.311383+0000","last_became_active":"2024-04-14T23:34:38.704247+0000","last_became_peered":"2024-04-14T23:34:38.704247+0000","last_unstale":"2024-04-14T23:34:46.311383+0000","last_undegraded":"2024-04-14T23:34:46.311383+0000","last_fullsized":"2024-04-14T23:34:46.311383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:48:26.290955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.135983+0000","last_change":"2024-04-14T23:34:37.712348+0000","last_active":"2024-04-14T23:34:45.135983+0000","last_peered":"2024-04-14T23:34:45.135983+0000","last_clean":"2024-04-14T23:34:45.135983+0000","last_became_active":"2024-04-14T23:34:37.712043+0000","last_became_peered":"2024-04-14T23:34:37.712043+0000","last_unstale":"2024-04-14T23:34:45.135983+0000","last_undegraded":"2024-04-14T23:34:45.135983+0000","last_fullsized":"2024-04-14T23:34:45.135983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:48:25.286602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.312031+0000","last_change":"2024-04-14T23:34:43.186651+0000","last_active":"2024-04-14T23:34:46.312031+0000","last_peered":"2024-04-14T23:34:46.312031+0000","last_clean":"2024-04-14T23:34:46.312031+0000","last_became_active":"2024-04-14T23:34:43.186282+0000","last_became_peered":"2024-04-14T23:34:43.186282+0000","last_unstale":"2024-04-14T23:34:46.312031+0000","last_undegraded":"2024-04-14T23:34:46.312031+0000","last_fullsized":"2024-04-14T23:34:46.312031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:37:34.006119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718436+0000","last_change":"2024-04-14T23:34:38.709071+0000","last_active":"2024-04-14T23:34:44.718436+0000","last_peered":"2024-04-14T23:34:44.718436+0000","last_clean":"2024-04-14T23:34:44.718436+0000","last_became_active":"2024-04-14T23:34:38.708815+0000","last_became_peered":"2024-04-14T23:34:38.708815+0000","last_unstale":"2024-04-14T23:34:44.718436+0000","last_undegraded":"2024-04-14T23:34:44.718436+0000","last_fullsized":"2024-04-14T23:34:44.718436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:12.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720070+0000","last_change":"2024-04-14T23:34:37.704931+0000","last_active":"2024-04-14T23:34:44.720070+0000","last_peered":"2024-04-14T23:34:44.720070+0000","last_clean":"2024-04-14T23:34:44.720070+0000","last_became_active":"2024-04-14T23:34:37.704607+0000","last_became_peered":"2024-04-14T23:34:37.704607+0000","last_unstale":"2024-04-14T23:34:44.720070+0000","last_undegraded":"2024-04-14T23:34:44.720070+0000","last_fullsized":"2024-04-14T23:34:44.720070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:51:11.382828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136097+0000","last_change":"2024-04-14T23:34:27.438796+0000","last_active":"2024-04-14T23:34:45.136097+0000","last_peered":"2024-04-14T23:34:45.136097+0000","last_clean":"2024-04-14T23:34:45.136097+0000","last_became_active":"2024-04-14T23:34:27.437932+0000","last_became_peered":"2024-04-14T23:34:27.437932+0000","last_unstale":"2024-04-14T23:34:45.136097+0000","last_undegraded":"2024-04-14T23:34:45.136097+0000","last_fullsized":"2024-04-14T23:34:45.136097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_clean_scrub_stamp":"2024-04-14T23:34:26.390323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:11:13.484245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517493+0000","last_change":"2024-04-14T23:34:43.188245+0000","last_active":"2024-04-14T23:34:46.517493+0000","last_peered":"2024-04-14T23:34:46.517493+0000","last_clean":"2024-04-14T23:34:46.517493+0000","last_became_active":"2024-04-14T23:34:43.187808+0000","last_became_peered":"2024-04-14T23:34:43.187808+0000","last_unstale":"2024-04-14T23:34:46.517493+0000","last_undegraded":"2024-04-14T23:34:46.517493+0000","last_fullsized":"2024-04-14T23:34:46.517493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:28.129419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136392+0000","last_change":"2024-04-14T23:34:38.711963+0000","last_active":"2024-04-14T23:34:45.136392+0000","last_peered":"2024-04-14T23:34:45.136392+0000","last_clean":"2024-04-14T23:34:45.136392+0000","last_became_active":"2024-04-14T23:34:38.710515+0000","last_became_peered":"2024-04-14T23:34:38.710515+0000","last_unstale":"2024-04-14T23:34:45.136392+0000","last_undegraded":"2024-04-14T23:34:45.136392+0000","last_fullsized":"2024-04-14T23:34:45.136392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:29:53.179819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806129+0000","last_change":"2024-04-14T23:34:37.708620+0000","last_active":"2024-04-14T23:34:45.806129+0000","last_peered":"2024-04-14T23:34:45.806129+0000","last_clean":"2024-04-14T23:34:45.806129+0000","last_became_active":"2024-04-14T23:34:37.708280+0000","last_became_peered":"2024-04-14T23:34:37.708280+0000","last_unstale":"2024-04-14T23:34:45.806129+0000","last_undegraded":"2024-04-14T23:34:45.806129+0000","last_fullsized":"2024-04-14T23:34:45.806129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:29.023280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517179+0000","last_change":"2024-04-14T23:34:43.185307+0000","last_active":"2024-04-14T23:34:46.517179+0000","last_peered":"2024-04-14T23:34:46.517179+0000","last_clean":"2024-04-14T23:34:46.517179+0000","last_became_active":"2024-04-14T23:34:43.184870+0000","last_became_peered":"2024-04-14T23:34:43.184870+0000","last_unstale":"2024-04-14T23:34:46.517179+0000","last_undegraded":"2024-04-14T23:34:46.517179+0000","last_fullsized":"2024-04-14T23:34:46.517179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:29:57.202071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720547+0000","last_change":"2024-04-14T23:34:38.714634+0000","last_active":"2024-04-14T23:34:44.720547+0000","last_peered":"2024-04-14T23:34:44.720547+0000","last_clean":"2024-04-14T23:34:44.720547+0000","last_became_active":"2024-04-14T23:34:38.714357+0000","last_became_peered":"2024-04-14T23:34:38.714357+0000","last_unstale":"2024-04-14T23:34:44.720547+0000","last_undegraded":"2024-04-14T23:34:44.720547+0000","last_fullsized":"2024-04-14T23:34:44.720547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:29:53.179819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318527+0000","last_change":"2024-04-14T23:34:37.709513+0000","last_active":"2024-04-14T23:34:46.318527+0000","last_peered":"2024-04-14T23:34:46.318527+0000","last_clean":"2024-04-14T23:34:46.318527+0000","last_became_active":"2024-04-14T23:34:37.709235+0000","last_became_peered":"2024-04-14T23:34:37.709235+0000","last_unstale":"2024-04-14T23:34:46.318527+0000","last_undegraded":"2024-04-14T23:34:46.318527+0000","last_fullsized":"2024-04-14T23:34:46.318527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:52.026945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311747+0000","last_change":"2024-04-14T23:34:42.739900+0000","last_active":"2024-04-14T23:34:46.311747+0000","last_peered":"2024-04-14T23:34:46.311747+0000","last_clean":"2024-04-14T23:34:46.311747+0000","last_became_active":"2024-04-14T23:34:42.739539+0000","last_became_peered":"2024-04-14T23:34:42.739539+0000","last_unstale":"2024-04-14T23:34:46.311747+0000","last_undegraded":"2024-04-14T23:34:46.311747+0000","last_fullsized":"2024-04-14T23:34:46.311747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:22:18.658809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136800+0000","last_change":"2024-04-14T23:34:38.716624+0000","last_active":"2024-04-14T23:34:45.136800+0000","last_peered":"2024-04-14T23:34:45.136800+0000","last_clean":"2024-04-14T23:34:45.136800+0000","last_became_active":"2024-04-14T23:34:38.716353+0000","last_became_peered":"2024-04-14T23:34:38.716353+0000","last_unstale":"2024-04-14T23:34:45.136800+0000","last_undegraded":"2024-04-14T23:34:45.136800+0000","last_fullsized":"2024-04-14T23:34:45.136800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:28:06.196373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806146+0000","last_change":"2024-04-14T23:34:37.707669+0000","last_active":"2024-04-14T23:34:45.806146+0000","last_peered":"2024-04-14T23:34:45.806146+0000","last_clean":"2024-04-14T23:34:45.806146+0000","last_became_active":"2024-04-14T23:34:37.707312+0000","last_became_peered":"2024-04-14T23:34:37.707312+0000","last_unstale":"2024-04-14T23:34:45.806146+0000","last_undegraded":"2024-04-14T23:34:45.806146+0000","last_fullsized":"2024-04-14T23:34:45.806146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:02:03.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720259+0000","last_change":"2024-04-14T23:34:43.187817+0000","last_active":"2024-04-14T23:34:44.720259+0000","last_peered":"2024-04-14T23:34:44.720259+0000","last_clean":"2024-04-14T23:34:44.720259+0000","last_became_active":"2024-04-14T23:34:43.187119+0000","last_became_peered":"2024-04-14T23:34:43.187119+0000","last_unstale":"2024-04-14T23:34:44.720259+0000","last_undegraded":"2024-04-14T23:34:44.720259+0000","last_fullsized":"2024-04-14T23:34:44.720259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:12:56.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136660+0000","last_change":"2024-04-14T23:34:38.710233+0000","last_active":"2024-04-14T23:34:45.136660+0000","last_peered":"2024-04-14T23:34:45.136660+0000","last_clean":"2024-04-14T23:34:45.136660+0000","last_became_active":"2024-04-14T23:34:38.709977+0000","last_became_peered":"2024-04-14T23:34:38.709977+0000","last_unstale":"2024-04-14T23:34:45.136660+0000","last_undegraded":"2024-04-14T23:34:45.136660+0000","last_fullsized":"2024-04-14T23:34:45.136660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:54:48.080529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720245+0000","last_change":"2024-04-14T23:34:37.705808+0000","last_active":"2024-04-14T23:34:44.720245+0000","last_peered":"2024-04-14T23:34:44.720245+0000","last_clean":"2024-04-14T23:34:44.720245+0000","last_became_active":"2024-04-14T23:34:37.705482+0000","last_became_peered":"2024-04-14T23:34:37.705482+0000","last_unstale":"2024-04-14T23:34:44.720245+0000","last_undegraded":"2024-04-14T23:34:44.720245+0000","last_fullsized":"2024-04-14T23:34:44.720245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:15:08.407528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720487+0000","last_change":"2024-04-14T23:34:42.733535+0000","last_active":"2024-04-14T23:34:44.720487+0000","last_peered":"2024-04-14T23:34:44.720487+0000","last_clean":"2024-04-14T23:34:44.720487+0000","last_became_active":"2024-04-14T23:34:42.733097+0000","last_became_peered":"2024-04-14T23:34:42.733097+0000","last_unstale":"2024-04-14T23:34:44.720487+0000","last_undegraded":"2024-04-14T23:34:44.720487+0000","last_fullsized":"2024-04-14T23:34:44.720487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:06:02.832632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136148+0000","last_change":"2024-04-14T23:34:38.709532+0000","last_active":"2024-04-14T23:34:45.136148+0000","last_peered":"2024-04-14T23:34:45.136148+0000","last_clean":"2024-04-14T23:34:45.136148+0000","last_became_active":"2024-04-14T23:34:38.709258+0000","last_became_peered":"2024-04-14T23:34:38.709258+0000","last_unstale":"2024-04-14T23:34:45.136148+0000","last_undegraded":"2024-04-14T23:34:45.136148+0000","last_fullsized":"2024-04-14T23:34:45.136148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:57:26.195919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806275+0000","last_change":"2024-04-14T23:34:37.697607+0000","last_active":"2024-04-14T23:34:45.806275+0000","last_peered":"2024-04-14T23:34:45.806275+0000","last_clean":"2024-04-14T23:34:45.806275+0000","last_became_active":"2024-04-14T23:34:37.697298+0000","last_became_peered":"2024-04-14T23:34:37.697298+0000","last_unstale":"2024-04-14T23:34:45.806275+0000","last_undegraded":"2024-04-14T23:34:45.806275+0000","last_fullsized":"2024-04-14T23:34:45.806275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:59:31.580365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311852+0000","last_change":"2024-04-14T23:34:42.735706+0000","last_active":"2024-04-14T23:34:46.311852+0000","last_peered":"2024-04-14T23:34:46.311852+0000","last_clean":"2024-04-14T23:34:46.311852+0000","last_became_active":"2024-04-14T23:34:42.735271+0000","last_became_peered":"2024-04-14T23:34:42.735271+0000","last_unstale":"2024-04-14T23:34:46.311852+0000","last_undegraded":"2024-04-14T23:34:46.311852+0000","last_fullsized":"2024-04-14T23:34:46.311852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:12:56.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517020+0000","last_change":"2024-04-14T23:34:38.713087+0000","last_active":"2024-04-14T23:34:46.517020+0000","last_peered":"2024-04-14T23:34:46.517020+0000","last_clean":"2024-04-14T23:34:46.517020+0000","last_became_active":"2024-04-14T23:34:38.712034+0000","last_became_peered":"2024-04-14T23:34:38.712034+0000","last_unstale":"2024-04-14T23:34:46.517020+0000","last_undegraded":"2024-04-14T23:34:46.517020+0000","last_fullsized":"2024-04-14T23:34:46.517020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516575+0000","last_change":"2024-04-14T23:34:37.704849+0000","last_active":"2024-04-14T23:34:46.516575+0000","last_peered":"2024-04-14T23:34:46.516575+0000","last_clean":"2024-04-14T23:34:46.516575+0000","last_became_active":"2024-04-14T23:34:37.704557+0000","last_became_peered":"2024-04-14T23:34:37.704557+0000","last_unstale":"2024-04-14T23:34:46.516575+0000","last_undegraded":"2024-04-14T23:34:46.516575+0000","last_fullsized":"2024-04-14T23:34:46.516575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:51:11.382828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718861+0000","last_change":"2024-04-14T23:34:43.189855+0000","last_active":"2024-04-14T23:34:44.718861+0000","last_peered":"2024-04-14T23:34:44.718861+0000","last_clean":"2024-04-14T23:34:44.718861+0000","last_became_active":"2024-04-14T23:34:43.187647+0000","last_became_peered":"2024-04-14T23:34:43.187647+0000","last_unstale":"2024-04-14T23:34:44.718861+0000","last_undegraded":"2024-04-14T23:34:44.718861+0000","last_fullsized":"2024-04-14T23:34:44.718861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:43:12.062252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136349+0000","last_change":"2024-04-14T23:34:38.716708+0000","last_active":"2024-04-14T23:34:45.136349+0000","last_peered":"2024-04-14T23:34:45.136349+0000","last_clean":"2024-04-14T23:34:45.136349+0000","last_became_active":"2024-04-14T23:34:38.716155+0000","last_became_peered":"2024-04-14T23:34:38.716155+0000","last_unstale":"2024-04-14T23:34:45.136349+0000","last_undegraded":"2024-04-14T23:34:45.136349+0000","last_fullsized":"2024-04-14T23:34:45.136349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:19:41.725777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720069+0000","last_change":"2024-04-14T23:34:37.708685+0000","last_active":"2024-04-14T23:34:44.720069+0000","last_peered":"2024-04-14T23:34:44.720069+0000","last_clean":"2024-04-14T23:34:44.720069+0000","last_became_active":"2024-04-14T23:34:37.708139+0000","last_became_peered":"2024-04-14T23:34:37.708139+0000","last_unstale":"2024-04-14T23:34:44.720069+0000","last_undegraded":"2024-04-14T23:34:44.720069+0000","last_fullsized":"2024-04-14T23:34:44.720069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:23.167535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718415+0000","last_change":"2024-04-14T23:34:43.185556+0000","last_active":"2024-04-14T23:34:44.718415+0000","last_peered":"2024-04-14T23:34:44.718415+0000","last_clean":"2024-04-14T23:34:44.718415+0000","last_became_active":"2024-04-14T23:34:43.185132+0000","last_became_peered":"2024-04-14T23:34:43.185132+0000","last_unstale":"2024-04-14T23:34:44.718415+0000","last_undegraded":"2024-04-14T23:34:44.718415+0000","last_fullsized":"2024-04-14T23:34:44.718415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:42:28.109020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311653+0000","last_change":"2024-04-14T23:34:38.711429+0000","last_active":"2024-04-14T23:34:46.311653+0000","last_peered":"2024-04-14T23:34:46.311653+0000","last_clean":"2024-04-14T23:34:46.311653+0000","last_became_active":"2024-04-14T23:34:38.710919+0000","last_became_peered":"2024-04-14T23:34:38.710919+0000","last_unstale":"2024-04-14T23:34:46.311653+0000","last_undegraded":"2024-04-14T23:34:46.311653+0000","last_fullsized":"2024-04-14T23:34:46.311653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:32:33.112814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311200+0000","last_change":"2024-04-14T23:34:37.712359+0000","last_active":"2024-04-14T23:34:46.311200+0000","last_peered":"2024-04-14T23:34:46.311200+0000","last_clean":"2024-04-14T23:34:46.311200+0000","last_became_active":"2024-04-14T23:34:37.711899+0000","last_became_peered":"2024-04-14T23:34:37.711899+0000","last_unstale":"2024-04-14T23:34:46.311200+0000","last_undegraded":"2024-04-14T23:34:46.311200+0000","last_fullsized":"2024-04-14T23:34:46.311200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:15:08.407528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719927+0000","last_change":"2024-04-14T23:34:43.185490+0000","last_active":"2024-04-14T23:34:44.719927+0000","last_peered":"2024-04-14T23:34:44.719927+0000","last_clean":"2024-04-14T23:34:44.719927+0000","last_became_active":"2024-04-14T23:34:43.185080+0000","last_became_peered":"2024-04-14T23:34:43.185080+0000","last_unstale":"2024-04-14T23:34:44.719927+0000","last_undegraded":"2024-04-14T23:34:44.719927+0000","last_fullsized":"2024-04-14T23:34:44.719927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:50:07.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136350+0000","last_change":"2024-04-14T23:34:38.718154+0000","last_active":"2024-04-14T23:34:45.136350+0000","last_peered":"2024-04-14T23:34:45.136350+0000","last_clean":"2024-04-14T23:34:45.136350+0000","last_became_active":"2024-04-14T23:34:38.717760+0000","last_became_peered":"2024-04-14T23:34:38.717760+0000","last_unstale":"2024-04-14T23:34:45.136350+0000","last_undegraded":"2024-04-14T23:34:45.136350+0000","last_fullsized":"2024-04-14T23:34:45.136350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:08:52.379294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:48.188845+0000","last_change":"2024-04-14T23:34:37.710678+0000","last_active":"2024-04-14T23:34:48.188845+0000","last_peered":"2024-04-14T23:34:48.188845+0000","last_clean":"2024-04-14T23:34:48.188845+0000","last_became_active":"2024-04-14T23:34:37.710377+0000","last_became_peered":"2024-04-14T23:34:37.710377+0000","last_unstale":"2024-04-14T23:34:48.188845+0000","last_undegraded":"2024-04-14T23:34:48.188845+0000","last_fullsized":"2024-04-14T23:34:48.188845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:23.167535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318875+0000","last_change":"2024-04-14T23:34:42.735072+0000","last_active":"2024-04-14T23:34:46.318875+0000","last_peered":"2024-04-14T23:34:46.318875+0000","last_clean":"2024-04-14T23:34:46.318875+0000","last_became_active":"2024-04-14T23:34:42.734693+0000","last_became_peered":"2024-04-14T23:34:42.734693+0000","last_unstale":"2024-04-14T23:34:46.318875+0000","last_undegraded":"2024-04-14T23:34:46.318875+0000","last_fullsized":"2024-04-14T23:34:46.318875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:28:10.218625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720019+0000","last_change":"2024-04-14T23:34:38.714478+0000","last_active":"2024-04-14T23:34:44.720019+0000","last_peered":"2024-04-14T23:34:44.720019+0000","last_clean":"2024-04-14T23:34:44.720019+0000","last_became_active":"2024-04-14T23:34:38.714187+0000","last_became_peered":"2024-04-14T23:34:38.714187+0000","last_unstale":"2024-04-14T23:34:44.720019+0000","last_undegraded":"2024-04-14T23:34:44.720019+0000","last_fullsized":"2024-04-14T23:34:44.720019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:26.985483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318538+0000","last_change":"2024-04-14T23:34:37.706150+0000","last_active":"2024-04-14T23:34:46.318538+0000","last_peered":"2024-04-14T23:34:46.318538+0000","last_clean":"2024-04-14T23:34:46.318538+0000","last_became_active":"2024-04-14T23:34:37.705836+0000","last_became_peered":"2024-04-14T23:34:37.705836+0000","last_unstale":"2024-04-14T23:34:46.318538+0000","last_undegraded":"2024-04-14T23:34:46.318538+0000","last_fullsized":"2024-04-14T23:34:46.318538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:02:03.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719572+0000","last_change":"2024-04-14T23:34:42.733389+0000","last_active":"2024-04-14T23:34:44.719572+0000","last_peered":"2024-04-14T23:34:44.719572+0000","last_clean":"2024-04-14T23:34:44.719572+0000","last_became_active":"2024-04-14T23:34:42.732985+0000","last_became_peered":"2024-04-14T23:34:42.732985+0000","last_unstale":"2024-04-14T23:34:44.719572+0000","last_undegraded":"2024-04-14T23:34:44.719572+0000","last_fullsized":"2024-04-14T23:34:44.719572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:37:34.006119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311955+0000","last_change":"2024-04-14T23:34:38.710119+0000","last_active":"2024-04-14T23:34:46.311955+0000","last_peered":"2024-04-14T23:34:46.311955+0000","last_clean":"2024-04-14T23:34:46.311955+0000","last_became_active":"2024-04-14T23:34:38.709833+0000","last_became_peered":"2024-04-14T23:34:38.709833+0000","last_unstale":"2024-04-14T23:34:46.311955+0000","last_undegraded":"2024-04-14T23:34:46.311955+0000","last_fullsized":"2024-04-14T23:34:46.311955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:54:47.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720394+0000","last_change":"2024-04-14T23:34:37.707534+0000","last_active":"2024-04-14T23:34:44.720394+0000","last_peered":"2024-04-14T23:34:44.720394+0000","last_clean":"2024-04-14T23:34:44.720394+0000","last_became_active":"2024-04-14T23:34:37.707213+0000","last_became_peered":"2024-04-14T23:34:37.707213+0000","last_unstale":"2024-04-14T23:34:44.720394+0000","last_undegraded":"2024-04-14T23:34:44.720394+0000","last_fullsized":"2024-04-14T23:34:44.720394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:02:03.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718138+0000","last_change":"2024-04-14T23:34:42.728861+0000","last_active":"2024-04-14T23:34:44.718138+0000","last_peered":"2024-04-14T23:34:44.718138+0000","last_clean":"2024-04-14T23:34:44.718138+0000","last_became_active":"2024-04-14T23:34:42.727257+0000","last_became_peered":"2024-04-14T23:34:42.727257+0000","last_unstale":"2024-04-14T23:34:44.718138+0000","last_undegraded":"2024-04-14T23:34:44.718138+0000","last_fullsized":"2024-04-14T23:34:44.718138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:50:08.796670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720295+0000","last_change":"2024-04-14T23:34:38.701821+0000","last_active":"2024-04-14T23:34:44.720295+0000","last_peered":"2024-04-14T23:34:44.720295+0000","last_clean":"2024-04-14T23:34:44.720295+0000","last_became_active":"2024-04-14T23:34:38.701530+0000","last_became_peered":"2024-04-14T23:34:38.701530+0000","last_unstale":"2024-04-14T23:34:44.720295+0000","last_undegraded":"2024-04-14T23:34:44.720295+0000","last_fullsized":"2024-04-14T23:34:44.720295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:34:09.647113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516783+0000","last_change":"2024-04-14T23:34:37.703952+0000","last_active":"2024-04-14T23:34:46.516783+0000","last_peered":"2024-04-14T23:34:46.516783+0000","last_clean":"2024-04-14T23:34:46.516783+0000","last_became_active":"2024-04-14T23:34:37.703622+0000","last_became_peered":"2024-04-14T23:34:37.703622+0000","last_unstale":"2024-04-14T23:34:46.516783+0000","last_undegraded":"2024-04-14T23:34:46.516783+0000","last_fullsized":"2024-04-14T23:34:46.516783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:29.023280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718062+0000","last_change":"2024-04-14T23:34:43.190499+0000","last_active":"2024-04-14T23:34:44.718062+0000","last_peered":"2024-04-14T23:34:44.718062+0000","last_clean":"2024-04-14T23:34:44.718062+0000","last_became_active":"2024-04-14T23:34:43.190120+0000","last_became_peered":"2024-04-14T23:34:43.190120+0000","last_unstale":"2024-04-14T23:34:44.718062+0000","last_undegraded":"2024-04-14T23:34:44.718062+0000","last_fullsized":"2024-04-14T23:34:44.718062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:07:43.950068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311856+0000","last_change":"2024-04-14T23:34:43.188434+0000","last_active":"2024-04-14T23:34:46.311856+0000","last_peered":"2024-04-14T23:34:46.311856+0000","last_clean":"2024-04-14T23:34:46.311856+0000","last_became_active":"2024-04-14T23:34:43.188069+0000","last_became_peered":"2024-04-14T23:34:43.188069+0000","last_unstale":"2024-04-14T23:34:46.311856+0000","last_undegraded":"2024-04-14T23:34:46.311856+0000","last_fullsized":"2024-04-14T23:34:46.311856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:50:07.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318672+0000","last_change":"2024-04-14T23:34:38.713042+0000","last_active":"2024-04-14T23:34:46.318672+0000","last_peered":"2024-04-14T23:34:46.318672+0000","last_clean":"2024-04-14T23:34:46.318672+0000","last_became_active":"2024-04-14T23:34:38.712746+0000","last_became_peered":"2024-04-14T23:34:38.712746+0000","last_unstale":"2024-04-14T23:34:46.318672+0000","last_undegraded":"2024-04-14T23:34:46.318672+0000","last_fullsized":"2024-04-14T23:34:46.318672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:27:36.965696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719390+0000","last_change":"2024-04-14T23:34:37.709449+0000","last_active":"2024-04-14T23:34:44.719390+0000","last_peered":"2024-04-14T23:34:44.719390+0000","last_clean":"2024-04-14T23:34:44.719390+0000","last_became_active":"2024-04-14T23:34:37.709153+0000","last_became_peered":"2024-04-14T23:34:37.709153+0000","last_unstale":"2024-04-14T23:34:44.719390+0000","last_undegraded":"2024-04-14T23:34:44.719390+0000","last_fullsized":"2024-04-14T23:34:44.719390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:29.023280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517519+0000","last_change":"2024-04-14T23:34:42.734788+0000","last_active":"2024-04-14T23:34:46.517519+0000","last_peered":"2024-04-14T23:34:46.517519+0000","last_clean":"2024-04-14T23:34:46.517519+0000","last_became_active":"2024-04-14T23:34:42.734397+0000","last_became_peered":"2024-04-14T23:34:42.734397+0000","last_unstale":"2024-04-14T23:34:46.517519+0000","last_undegraded":"2024-04-14T23:34:46.517519+0000","last_fullsized":"2024-04-14T23:34:46.517519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:17.874980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718120+0000","last_change":"2024-04-14T23:34:38.713504+0000","last_active":"2024-04-14T23:34:44.718120+0000","last_peered":"2024-04-14T23:34:44.718120+0000","last_clean":"2024-04-14T23:34:44.718120+0000","last_became_active":"2024-04-14T23:34:38.712325+0000","last_became_peered":"2024-04-14T23:34:38.712325+0000","last_unstale":"2024-04-14T23:34:44.718120+0000","last_undegraded":"2024-04-14T23:34:44.718120+0000","last_fullsized":"2024-04-14T23:34:44.718120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:54:47.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718225+0000","last_change":"2024-04-14T23:34:37.711477+0000","last_active":"2024-04-14T23:34:44.718225+0000","last_peered":"2024-04-14T23:34:44.718225+0000","last_clean":"2024-04-14T23:34:44.718225+0000","last_became_active":"2024-04-14T23:34:37.710472+0000","last_became_peered":"2024-04-14T23:34:37.710472+0000","last_unstale":"2024-04-14T23:34:44.718225+0000","last_undegraded":"2024-04-14T23:34:44.718225+0000","last_fullsized":"2024-04-14T23:34:44.718225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:59:31.580365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516590+0000","last_change":"2024-04-14T23:34:37.700380+0000","last_active":"2024-04-14T23:34:46.516590+0000","last_peered":"2024-04-14T23:34:46.516590+0000","last_clean":"2024-04-14T23:34:46.516590+0000","last_became_active":"2024-04-14T23:34:37.699846+0000","last_became_peered":"2024-04-14T23:34:37.699846+0000","last_unstale":"2024-04-14T23:34:46.516590+0000","last_undegraded":"2024-04-14T23:34:46.516590+0000","last_fullsized":"2024-04-14T23:34:46.516590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:18:40.942344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311821+0000","last_change":"2024-04-14T23:34:38.701104+0000","last_active":"2024-04-14T23:34:46.311821+0000","last_peered":"2024-04-14T23:34:46.311821+0000","last_clean":"2024-04-14T23:34:46.311821+0000","last_became_active":"2024-04-14T23:34:38.700816+0000","last_became_peered":"2024-04-14T23:34:38.700816+0000","last_unstale":"2024-04-14T23:34:46.311821+0000","last_undegraded":"2024-04-14T23:34:46.311821+0000","last_fullsized":"2024-04-14T23:34:46.311821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806426+0000","last_change":"2024-04-14T23:34:42.729961+0000","last_active":"2024-04-14T23:34:45.806426+0000","last_peered":"2024-04-14T23:34:45.806426+0000","last_clean":"2024-04-14T23:34:45.806426+0000","last_became_active":"2024-04-14T23:34:42.729584+0000","last_became_peered":"2024-04-14T23:34:42.729584+0000","last_unstale":"2024-04-14T23:34:45.806426+0000","last_undegraded":"2024-04-14T23:34:45.806426+0000","last_fullsized":"2024-04-14T23:34:45.806426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:32:37.135066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718411+0000","last_change":"2024-04-14T23:34:37.711324+0000","last_active":"2024-04-14T23:34:44.718411+0000","last_peered":"2024-04-14T23:34:44.718411+0000","last_clean":"2024-04-14T23:34:44.718411+0000","last_became_active":"2024-04-14T23:34:37.710354+0000","last_became_peered":"2024-04-14T23:34:37.710354+0000","last_unstale":"2024-04-14T23:34:44.718411+0000","last_undegraded":"2024-04-14T23:34:44.718411+0000","last_fullsized":"2024-04-14T23:34:44.718411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:51:11.382828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719474+0000","last_change":"2024-04-14T23:34:38.708836+0000","last_active":"2024-04-14T23:34:44.719474+0000","last_peered":"2024-04-14T23:34:44.719474+0000","last_clean":"2024-04-14T23:34:44.719474+0000","last_became_active":"2024-04-14T23:34:38.708569+0000","last_became_peered":"2024-04-14T23:34:38.708569+0000","last_unstale":"2024-04-14T23:34:44.719474+0000","last_undegraded":"2024-04-14T23:34:44.719474+0000","last_fullsized":"2024-04-14T23:34:44.719474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:53.031298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718647+0000","last_change":"2024-04-14T23:34:42.729168+0000","last_active":"2024-04-14T23:34:44.718647+0000","last_peered":"2024-04-14T23:34:44.718647+0000","last_clean":"2024-04-14T23:34:44.718647+0000","last_became_active":"2024-04-14T23:34:42.727494+0000","last_became_peered":"2024-04-14T23:34:42.727494+0000","last_unstale":"2024-04-14T23:34:44.718647+0000","last_undegraded":"2024-04-14T23:34:44.718647+0000","last_fullsized":"2024-04-14T23:34:44.718647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:25:19.108275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516920+0000","last_change":"2024-04-14T23:34:38.714071+0000","last_active":"2024-04-14T23:34:46.516920+0000","last_peered":"2024-04-14T23:34:46.516920+0000","last_clean":"2024-04-14T23:34:46.516920+0000","last_became_active":"2024-04-14T23:34:38.713792+0000","last_became_peered":"2024-04-14T23:34:38.713792+0000","last_unstale":"2024-04-14T23:34:46.516920+0000","last_undegraded":"2024-04-14T23:34:46.516920+0000","last_fullsized":"2024-04-14T23:34:46.516920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:54:47.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806380+0000","last_change":"2024-04-14T23:34:38.710636+0000","last_active":"2024-04-14T23:34:45.806380+0000","last_peered":"2024-04-14T23:34:45.806380+0000","last_clean":"2024-04-14T23:34:45.806380+0000","last_became_active":"2024-04-14T23:34:38.710137+0000","last_became_peered":"2024-04-14T23:34:38.710137+0000","last_unstale":"2024-04-14T23:34:45.806380+0000","last_undegraded":"2024-04-14T23:34:45.806380+0000","last_fullsized":"2024-04-14T23:34:45.806380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:53.031298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719973+0000","last_change":"2024-04-14T23:34:38.712090+0000","last_active":"2024-04-14T23:34:44.719973+0000","last_peered":"2024-04-14T23:34:44.719973+0000","last_clean":"2024-04-14T23:34:44.719973+0000","last_became_active":"2024-04-14T23:34:38.711774+0000","last_became_peered":"2024-04-14T23:34:38.711774+0000","last_unstale":"2024-04-14T23:34:44.719973+0000","last_undegraded":"2024-04-14T23:34:44.719973+0000","last_fullsized":"2024-04-14T23:34:44.719973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:08:52.379294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311741+0000","last_change":"2024-04-14T23:34:38.710874+0000","last_active":"2024-04-14T23:34:46.311741+0000","last_peered":"2024-04-14T23:34:46.311741+0000","last_clean":"2024-04-14T23:34:46.311741+0000","last_became_active":"2024-04-14T23:34:38.710573+0000","last_became_peered":"2024-04-14T23:34:38.710573+0000","last_unstale":"2024-04-14T23:34:46.311741+0000","last_undegraded":"2024-04-14T23:34:46.311741+0000","last_fullsized":"2024-04-14T23:34:46.311741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:40.949590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718481+0000","last_change":"2024-04-14T23:34:38.712171+0000","last_active":"2024-04-14T23:34:44.718481+0000","last_peered":"2024-04-14T23:34:44.718481+0000","last_clean":"2024-04-14T23:34:44.718481+0000","last_became_active":"2024-04-14T23:34:38.711789+0000","last_became_peered":"2024-04-14T23:34:38.711789+0000","last_unstale":"2024-04-14T23:34:44.718481+0000","last_undegraded":"2024-04-14T23:34:44.718481+0000","last_fullsized":"2024-04-14T23:34:44.718481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:32:05.285392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319127+0000","last_change":"2024-04-14T23:34:38.717810+0000","last_active":"2024-04-14T23:34:46.319127+0000","last_peered":"2024-04-14T23:34:46.319127+0000","last_clean":"2024-04-14T23:34:46.319127+0000","last_became_active":"2024-04-14T23:34:38.717398+0000","last_became_peered":"2024-04-14T23:34:38.717398+0000","last_unstale":"2024-04-14T23:34:46.319127+0000","last_undegraded":"2024-04-14T23:34:46.319127+0000","last_fullsized":"2024-04-14T23:34:46.319127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517638+0000","last_change":"2024-04-14T23:34:38.714157+0000","last_active":"2024-04-14T23:34:46.517638+0000","last_peered":"2024-04-14T23:34:46.517638+0000","last_clean":"2024-04-14T23:34:46.517638+0000","last_became_active":"2024-04-14T23:34:38.712289+0000","last_became_peered":"2024-04-14T23:34:38.712289+0000","last_unstale":"2024-04-14T23:34:46.517638+0000","last_undegraded":"2024-04-14T23:34:46.517638+0000","last_fullsized":"2024-04-14T23:34:46.517638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:44.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718791+0000","last_change":"2024-04-14T23:34:38.711729+0000","last_active":"2024-04-14T23:34:44.718791+0000","last_peered":"2024-04-14T23:34:44.718791+0000","last_clean":"2024-04-14T23:34:44.718791+0000","last_became_active":"2024-04-14T23:34:38.711429+0000","last_became_peered":"2024-04-14T23:34:38.711429+0000","last_unstale":"2024-04-14T23:34:44.718791+0000","last_undegraded":"2024-04-14T23:34:44.718791+0000","last_fullsized":"2024-04-14T23:34:44.718791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719293+0000","last_change":"2024-04-14T23:34:38.715491+0000","last_active":"2024-04-14T23:34:44.719293+0000","last_peered":"2024-04-14T23:34:44.719293+0000","last_clean":"2024-04-14T23:34:44.719293+0000","last_became_active":"2024-04-14T23:34:38.714292+0000","last_became_peered":"2024-04-14T23:34:38.714292+0000","last_unstale":"2024-04-14T23:34:44.719293+0000","last_undegraded":"2024-04-14T23:34:44.719293+0000","last_fullsized":"2024-04-14T23:34:44.719293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:09:47.574841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718114+0000","last_change":"2024-04-14T23:34:38.709908+0000","last_active":"2024-04-14T23:34:44.718114+0000","last_peered":"2024-04-14T23:34:44.718114+0000","last_clean":"2024-04-14T23:34:44.718114+0000","last_became_active":"2024-04-14T23:34:38.709563+0000","last_became_peered":"2024-04-14T23:34:38.709563+0000","last_unstale":"2024-04-14T23:34:44.718114+0000","last_undegraded":"2024-04-14T23:34:44.718114+0000","last_fullsized":"2024-04-14T23:34:44.718114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719868+0000","last_change":"2024-04-14T23:34:38.708460+0000","last_active":"2024-04-14T23:34:44.719868+0000","last_peered":"2024-04-14T23:34:44.719868+0000","last_clean":"2024-04-14T23:34:44.719868+0000","last_became_active":"2024-04-14T23:34:38.707437+0000","last_became_peered":"2024-04-14T23:34:38.707437+0000","last_unstale":"2024-04-14T23:34:44.719868+0000","last_undegraded":"2024-04-14T23:34:44.719868+0000","last_fullsized":"2024-04-14T23:34:44.719868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:57:26.195919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311644+0000","last_change":"2024-04-14T23:34:38.702841+0000","last_active":"2024-04-14T23:34:46.311644+0000","last_peered":"2024-04-14T23:34:46.311644+0000","last_clean":"2024-04-14T23:34:46.311644+0000","last_became_active":"2024-04-14T23:34:38.702527+0000","last_became_peered":"2024-04-14T23:34:38.702527+0000","last_unstale":"2024-04-14T23:34:46.311644+0000","last_undegraded":"2024-04-14T23:34:46.311644+0000","last_fullsized":"2024-04-14T23:34:46.311644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517386+0000","last_change":"2024-04-14T23:34:38.714356+0000","last_active":"2024-04-14T23:34:46.517386+0000","last_peered":"2024-04-14T23:34:46.517386+0000","last_clean":"2024-04-14T23:34:46.517386+0000","last_became_active":"2024-04-14T23:34:38.713937+0000","last_became_peered":"2024-04-14T23:34:38.713937+0000","last_unstale":"2024-04-14T23:34:46.517386+0000","last_undegraded":"2024-04-14T23:34:46.517386+0000","last_fullsized":"2024-04-14T23:34:46.517386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:40.949590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136593+0000","last_change":"2024-04-14T23:34:38.711688+0000","last_active":"2024-04-14T23:34:45.136593+0000","last_peered":"2024-04-14T23:34:45.136593+0000","last_clean":"2024-04-14T23:34:45.136593+0000","last_became_active":"2024-04-14T23:34:38.711428+0000","last_became_peered":"2024-04-14T23:34:38.711428+0000","last_unstale":"2024-04-14T23:34:45.136593+0000","last_undegraded":"2024-04-14T23:34:45.136593+0000","last_fullsized":"2024-04-14T23:34:45.136593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:13.852728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806712+0000","last_change":"2024-04-14T23:34:38.715113+0000","last_active":"2024-04-14T23:34:45.806712+0000","last_peered":"2024-04-14T23:34:45.806712+0000","last_clean":"2024-04-14T23:34:45.806712+0000","last_became_active":"2024-04-14T23:34:38.714814+0000","last_became_peered":"2024-04-14T23:34:38.714814+0000","last_unstale":"2024-04-14T23:34:45.806712+0000","last_undegraded":"2024-04-14T23:34:45.806712+0000","last_fullsized":"2024-04-14T23:34:45.806712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:03:18.131006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720712+0000","last_change":"2024-04-14T23:34:38.704287+0000","last_active":"2024-04-14T23:34:44.720712+0000","last_peered":"2024-04-14T23:34:44.720712+0000","last_clean":"2024-04-14T23:34:44.720712+0000","last_became_active":"2024-04-14T23:34:38.702165+0000","last_became_peered":"2024-04-14T23:34:38.702165+0000","last_unstale":"2024-04-14T23:34:44.720712+0000","last_undegraded":"2024-04-14T23:34:44.720712+0000","last_fullsized":"2024-04-14T23:34:44.720712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:24.107167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719179+0000","last_change":"2024-04-14T23:34:38.706857+0000","last_active":"2024-04-14T23:34:44.719179+0000","last_peered":"2024-04-14T23:34:44.719179+0000","last_clean":"2024-04-14T23:34:44.719179+0000","last_became_active":"2024-04-14T23:34:38.705253+0000","last_became_peered":"2024-04-14T23:34:38.705253+0000","last_unstale":"2024-04-14T23:34:44.719179+0000","last_undegraded":"2024-04-14T23:34:44.719179+0000","last_fullsized":"2024-04-14T23:34:44.719179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:44.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318744+0000","last_change":"2024-04-14T23:34:38.711823+0000","last_active":"2024-04-14T23:34:46.318744+0000","last_peered":"2024-04-14T23:34:46.318744+0000","last_clean":"2024-04-14T23:34:46.318744+0000","last_became_active":"2024-04-14T23:34:38.711530+0000","last_became_peered":"2024-04-14T23:34:38.711530+0000","last_unstale":"2024-04-14T23:34:46.318744+0000","last_undegraded":"2024-04-14T23:34:46.318744+0000","last_fullsized":"2024-04-14T23:34:46.318744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:40.949590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311653+0000","last_change":"2024-04-14T23:34:38.705635+0000","last_active":"2024-04-14T23:34:46.311653+0000","last_peered":"2024-04-14T23:34:46.311653+0000","last_clean":"2024-04-14T23:34:46.311653+0000","last_became_active":"2024-04-14T23:34:38.705086+0000","last_became_peered":"2024-04-14T23:34:38.705086+0000","last_unstale":"2024-04-14T23:34:46.311653+0000","last_undegraded":"2024-04-14T23:34:46.311653+0000","last_fullsized":"2024-04-14T23:34:46.311653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:15:01.190987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718240+0000","last_change":"2024-04-14T23:34:38.710758+0000","last_active":"2024-04-14T23:34:44.718240+0000","last_peered":"2024-04-14T23:34:44.718240+0000","last_clean":"2024-04-14T23:34:44.718240+0000","last_became_active":"2024-04-14T23:34:38.710484+0000","last_became_peered":"2024-04-14T23:34:38.710484+0000","last_unstale":"2024-04-14T23:34:44.718240+0000","last_undegraded":"2024-04-14T23:34:44.718240+0000","last_fullsized":"2024-04-14T23:34:44.718240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:34:09.647113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720314+0000","last_change":"2024-04-14T23:34:38.711759+0000","last_active":"2024-04-14T23:34:44.720314+0000","last_peered":"2024-04-14T23:34:44.720314+0000","last_clean":"2024-04-14T23:34:44.720314+0000","last_became_active":"2024-04-14T23:34:38.711469+0000","last_became_peered":"2024-04-14T23:34:38.711469+0000","last_unstale":"2024-04-14T23:34:44.720314+0000","last_undegraded":"2024-04-14T23:34:44.720314+0000","last_fullsized":"2024-04-14T23:34:44.720314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:03:18.131006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517344+0000","last_change":"2024-04-14T23:34:38.710480+0000","last_active":"2024-04-14T23:34:46.517344+0000","last_peered":"2024-04-14T23:34:46.517344+0000","last_clean":"2024-04-14T23:34:46.517344+0000","last_became_active":"2024-04-14T23:34:38.710218+0000","last_became_peered":"2024-04-14T23:34:38.710218+0000","last_unstale":"2024-04-14T23:34:46.517344+0000","last_undegraded":"2024-04-14T23:34:46.517344+0000","last_fullsized":"2024-04-14T23:34:46.517344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:12.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517559+0000","last_change":"2024-04-14T23:34:38.713659+0000","last_active":"2024-04-14T23:34:46.517559+0000","last_peered":"2024-04-14T23:34:46.517559+0000","last_clean":"2024-04-14T23:34:46.517559+0000","last_became_active":"2024-04-14T23:34:38.713281+0000","last_became_peered":"2024-04-14T23:34:38.713281+0000","last_unstale":"2024-04-14T23:34:46.517559+0000","last_undegraded":"2024-04-14T23:34:46.517559+0000","last_fullsized":"2024-04-14T23:34:46.517559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136762+0000","last_change":"2024-04-14T23:34:38.713274+0000","last_active":"2024-04-14T23:34:45.136762+0000","last_peered":"2024-04-14T23:34:45.136762+0000","last_clean":"2024-04-14T23:34:45.136762+0000","last_became_active":"2024-04-14T23:34:38.711274+0000","last_became_peered":"2024-04-14T23:34:38.711274+0000","last_unstale":"2024-04-14T23:34:45.136762+0000","last_undegraded":"2024-04-14T23:34:45.136762+0000","last_fullsized":"2024-04-14T23:34:45.136762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:05:58.810380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.717969+0000","last_change":"2024-04-14T23:34:38.708235+0000","last_active":"2024-04-14T23:34:44.717969+0000","last_peered":"2024-04-14T23:34:44.717969+0000","last_clean":"2024-04-14T23:34:44.717969+0000","last_became_active":"2024-04-14T23:34:38.707779+0000","last_became_peered":"2024-04-14T23:34:38.707779+0000","last_unstale":"2024-04-14T23:34:44.717969+0000","last_undegraded":"2024-04-14T23:34:44.717969+0000","last_fullsized":"2024-04-14T23:34:44.717969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:09:45.484768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136144+0000","last_change":"2024-04-14T23:34:38.713218+0000","last_active":"2024-04-14T23:34:45.136144+0000","last_peered":"2024-04-14T23:34:45.136144+0000","last_clean":"2024-04-14T23:34:45.136144+0000","last_became_active":"2024-04-14T23:34:38.712930+0000","last_became_peered":"2024-04-14T23:34:38.712930+0000","last_unstale":"2024-04-14T23:34:45.136144+0000","last_undegraded":"2024-04-14T23:34:45.136144+0000","last_fullsized":"2024-04-14T23:34:45.136144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:32:05.285392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719753+0000","last_change":"2024-04-14T23:34:38.710158+0000","last_active":"2024-04-14T23:34:44.719753+0000","last_peered":"2024-04-14T23:34:44.719753+0000","last_clean":"2024-04-14T23:34:44.719753+0000","last_became_active":"2024-04-14T23:34:38.709903+0000","last_became_peered":"2024-04-14T23:34:38.709903+0000","last_unstale":"2024-04-14T23:34:44.719753+0000","last_undegraded":"2024-04-14T23:34:44.719753+0000","last_fullsized":"2024-04-14T23:34:44.719753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:32:05.285392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136196+0000","last_change":"2024-04-14T23:34:38.710654+0000","last_active":"2024-04-14T23:34:45.136196+0000","last_peered":"2024-04-14T23:34:45.136196+0000","last_clean":"2024-04-14T23:34:45.136196+0000","last_became_active":"2024-04-14T23:34:38.710267+0000","last_became_peered":"2024-04-14T23:34:38.710267+0000","last_unstale":"2024-04-14T23:34:45.136196+0000","last_undegraded":"2024-04-14T23:34:45.136196+0000","last_fullsized":"2024-04-14T23:34:45.136196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:22.876283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720393+0000","last_change":"2024-04-14T23:34:38.715159+0000","last_active":"2024-04-14T23:34:44.720393+0000","last_peered":"2024-04-14T23:34:44.720393+0000","last_clean":"2024-04-14T23:34:44.720393+0000","last_became_active":"2024-04-14T23:34:38.714918+0000","last_became_peered":"2024-04-14T23:34:38.714918+0000","last_unstale":"2024-04-14T23:34:44.720393+0000","last_undegraded":"2024-04-14T23:34:44.720393+0000","last_fullsized":"2024-04-14T23:34:44.720393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:19:41.725777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311726+0000","last_change":"2024-04-14T23:34:38.707456+0000","last_active":"2024-04-14T23:34:46.311726+0000","last_peered":"2024-04-14T23:34:46.311726+0000","last_clean":"2024-04-14T23:34:46.311726+0000","last_became_active":"2024-04-14T23:34:38.707143+0000","last_became_peered":"2024-04-14T23:34:38.707143+0000","last_unstale":"2024-04-14T23:34:46.311726+0000","last_undegraded":"2024-04-14T23:34:46.311726+0000","last_fullsized":"2024-04-14T23:34:46.311726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:27:36.965696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319134+0000","last_change":"2024-04-14T23:34:38.714188+0000","last_active":"2024-04-14T23:34:46.319134+0000","last_peered":"2024-04-14T23:34:46.319134+0000","last_clean":"2024-04-14T23:34:46.319134+0000","last_became_active":"2024-04-14T23:34:38.713845+0000","last_became_peered":"2024-04-14T23:34:38.713845+0000","last_unstale":"2024-04-14T23:34:46.319134+0000","last_undegraded":"2024-04-14T23:34:46.319134+0000","last_fullsized":"2024-04-14T23:34:46.319134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136688+0000","last_change":"2024-04-14T23:34:38.716139+0000","last_active":"2024-04-14T23:34:45.136688+0000","last_peered":"2024-04-14T23:34:45.136688+0000","last_clean":"2024-04-14T23:34:45.136688+0000","last_became_active":"2024-04-14T23:34:38.715878+0000","last_became_peered":"2024-04-14T23:34:38.715878+0000","last_unstale":"2024-04-14T23:34:45.136688+0000","last_undegraded":"2024-04-14T23:34:45.136688+0000","last_fullsized":"2024-04-14T23:34:45.136688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:24.107167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T23:35:00.156 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T23:35:00.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.288+0000 7f3d9c1aa640 1 Processor -- start 2024-04-14T23:35:00.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.288+0000 7f3d9c1aa640 1 -- start start 2024-04-14T23:35:00.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.289+0000 7f3d9c1aa640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3d940d1e00 0x7f3d940d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.289+0000 7f3d9c1aa640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d940d1620 con 0x7f3d9415e270 2024-04-14T23:35:00.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.289+0000 7f3d9c1aa640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d940b39d0 con 0x7f3d940d2740 2024-04-14T23:35:00.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.289+0000 7f3d9c1aa640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f3d940d2b90 con 0x7f3d940d1e00 2024-04-14T23:35:00.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.289+0000 7f3d99f46640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f3d9415e270 0x7f3d940d0f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55802/0 (socket says 172.21.15.47:55802) 2024-04-14T23:35:00.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.289+0000 7f3d99f46640 1 -- 172.21.15.47:0/2230208738 learned_addr learned my addr 172.21.15.47:0/2230208738 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:00.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.289+0000 7f3d99745640 1 --2- 172.21.15.47:0/2230208738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3d940d1e00 0x7f3d940d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.289+0000 7f3d98f44640 1 -- 172.21.15.47:0/2230208738 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2349234997 0 0) 0x7f3d940d1620 con 0x7f3d9415e270 2024-04-14T23:35:00.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.289+0000 7f3d98f44640 1 -- 172.21.15.47:0/2230208738 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d7c003520 con 0x7f3d9415e270 2024-04-14T23:35:00.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d98f44640 1 -- 172.21.15.47:0/2230208738 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2472615840 0 0) 0x7f3d940b39d0 con 0x7f3d940d2740 2024-04-14T23:35:00.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d98f44640 1 -- 172.21.15.47:0/2230208738 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d940d1620 con 0x7f3d940d2740 2024-04-14T23:35:00.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d98f44640 1 -- 172.21.15.47:0/2230208738 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3886034655 0 0) 0x7f3d7c003520 con 0x7f3d9415e270 2024-04-14T23:35:00.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d98f44640 1 -- 172.21.15.47:0/2230208738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3d940d1e00 msgr2=0x7f3d940d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:00.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d98f44640 1 --2- 172.21.15.47:0/2230208738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3d940d1e00 0x7f3d940d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d98f44640 1 -- 172.21.15.47:0/2230208738 >> v1:172.21.15.191:6789/0 conn(0x7f3d940d2740 legacy=0x7f3d940b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d98f44640 1 -- 172.21.15.47:0/2230208738 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d940b3cb0 con 0x7f3d9415e270 2024-04-14T23:35:00.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d98f44640 1 -- 172.21.15.47:0/2230208738 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f3d8c001670 con 0x7f3d9415e270 2024-04-14T23:35:00.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d98f44640 1 -- 172.21.15.47:0/2230208738 >> v1:172.21.15.47:6789/0 conn(0x7f3d9415e270 legacy=0x7f3d940d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d98f44640 1 --2- 172.21.15.47:0/2230208738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3d7c003b70 0x7f3d7c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d98f44640 1 --2- 172.21.15.47:0/2230208738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d7c004800 0x7f3d7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d98f44640 1 --2- 172.21.15.47:0/2230208738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3d7c0051c0 0x7f3d7c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d98f44640 1 -- 172.21.15.47:0/2230208738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3d940d2b90 con 0x7f3d7c004800 2024-04-14T23:35:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d98f44640 1 -- 172.21.15.47:0/2230208738 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c00bf60 con 0x7f3d7c003b70 2024-04-14T23:35:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d98f44640 1 -- 172.21.15.47:0/2230208738 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7c00c160 con 0x7f3d7c0051c0 2024-04-14T23:35:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d99745640 1 --2- 172.21.15.47:0/2230208738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3d940d1e00 0x7f3d940d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d99f46640 1 --2- 172.21.15.47:0/2230208738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3d7c003b70 0x7f3d7c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d99745640 1 --2- 172.21.15.47:0/2230208738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d7c004800 0x7f3d7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d9a747640 1 --2- 172.21.15.47:0/2230208738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3d7c0051c0 0x7f3d7c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d99745640 1 -- 172.21.15.47:0/2230208738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3d7c0051c0 msgr2=0x7f3d7c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d99745640 1 --2- 172.21.15.47:0/2230208738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3d7c0051c0 0x7f3d7c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d99745640 1 -- 172.21.15.47:0/2230208738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3d7c003b70 msgr2=0x7f3d7c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d99745640 1 --2- 172.21.15.47:0/2230208738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3d7c003b70 0x7f3d7c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d99745640 1 -- 172.21.15.47:0/2230208738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c003520 con 0x7f3d7c004800 2024-04-14T23:35:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.290+0000 7f3d9a747640 1 --2- 172.21.15.47:0/2230208738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3d7c0051c0 0x7f3d7c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.291+0000 7f3d99745640 1 --2- 172.21.15.47:0/2230208738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d7c004800 0x7f3d7c004c80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3d940d4fd0 tx=0x7f3d7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ba3edf0a04a03a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:00.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.291+0000 7f3d98f44640 1 -- 172.21.15.47:0/2230208738 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d880097d0 con 0x7f3d7c004800 2024-04-14T23:35:00.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.291+0000 7f3d98f44640 1 -- 172.21.15.47:0/2230208738 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d88004030 con 0x7f3d7c004800 2024-04-14T23:35:00.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.291+0000 7f3d98f44640 1 -- 172.21.15.47:0/2230208738 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88004400 con 0x7f3d7c004800 2024-04-14T23:35:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.292+0000 7f3d9c1aa640 1 -- 172.21.15.47:0/2230208738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d7c004800 msgr2=0x7f3d7c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.292+0000 7f3d9c1aa640 1 --2- 172.21.15.47:0/2230208738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d7c004800 0x7f3d7c004c80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3d940d4fd0 tx=0x7f3d7c005830 comp rx=0 tx=0).stop 2024-04-14T23:35:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.292+0000 7f3d9a747640 1 -- 172.21.15.47:0/2230208738 reap_dead start 2024-04-14T23:35:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.292+0000 7f3d9c1aa640 1 -- 172.21.15.47:0/2230208738 shutdown_connections 2024-04-14T23:35:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.292+0000 7f3d9c1aa640 1 -- 172.21.15.47:0/2230208738 >> 172.21.15.47:0/2230208738 conn(0x7f3d940d3ed0 msgr2=0x7f3d940d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.292+0000 7f3d9c1aa640 1 -- 172.21.15.47:0/2230208738 shutdown_connections 2024-04-14T23:35:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.292+0000 7f3d9c1aa640 1 -- 172.21.15.47:0/2230208738 wait complete. 2024-04-14T23:35:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.293+0000 7f3d9c1aa640 1 Processor -- start 2024-04-14T23:35:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.293+0000 7f3d9c1aa640 1 -- start start 2024-04-14T23:35:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9c1aa640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3d7c004800 0x7f3d940b9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9c1aa640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3d9414b290 0x7f3d940cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9c1aa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d9414b710 0x7f3d940cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9c1aa640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3d940b0c60 con 0x7f3d9414b710 2024-04-14T23:35:00.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9c1aa640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3d940b4300 con 0x7f3d7c004800 2024-04-14T23:35:00.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9c1aa640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f3d9415e650 con 0x7f3d9414b290 2024-04-14T23:35:00.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9a747640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d9414b710 0x7f3d940cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9a747640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d9414b710 0x7f3d940cdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36274/0 (socket says 172.21.15.47:36274) 2024-04-14T23:35:00.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9a747640 1 -- 172.21.15.47:0/3183891953 learned_addr learned my addr 172.21.15.47:0/3183891953 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:00.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d99f46640 1 --2- 172.21.15.47:0/3183891953 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3d7c004800 0x7f3d940b9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d99745640 1 --2- 172.21.15.47:0/3183891953 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3d9414b290 0x7f3d940cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9a747640 1 -- 172.21.15.47:0/3183891953 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3d9414b290 msgr2=0x7f3d940cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9a747640 1 --2- 172.21.15.47:0/3183891953 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3d9414b290 0x7f3d940cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9a747640 1 -- 172.21.15.47:0/3183891953 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3d7c004800 msgr2=0x7f3d940b9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9a747640 1 --2- 172.21.15.47:0/3183891953 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3d7c004800 0x7f3d940b9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9a747640 1 -- 172.21.15.47:0/3183891953 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d940cc780 con 0x7f3d9414b710 2024-04-14T23:35:00.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9a747640 1 --2- 172.21.15.47:0/3183891953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d9414b710 0x7f3d940cdd20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3d84001330 tx=0x7f3d8400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:00.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d927fc640 1 -- 172.21.15.47:0/3183891953 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400ee50 con 0x7f3d9414b710 2024-04-14T23:35:00.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d927fc640 1 -- 172.21.15.47:0/3183891953 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d84003b80 con 0x7f3d9414b710 2024-04-14T23:35:00.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9c1aa640 1 -- 172.21.15.47:0/3183891953 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d940ce260 con 0x7f3d9414b710 2024-04-14T23:35:00.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d927fc640 1 -- 172.21.15.47:0/3183891953 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84006b50 con 0x7f3d9414b710 2024-04-14T23:35:00.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.294+0000 7f3d9c1aa640 1 -- 172.21.15.47:0/3183891953 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d940ccd00 con 0x7f3d9414b710 2024-04-14T23:35:00.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.295+0000 7f3d9c1aa640 1 -- 172.21.15.47:0/3183891953 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d94075430 con 0x7f3d9414b710 2024-04-14T23:35:00.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.296+0000 7f3d927fc640 1 -- 172.21.15.47:0/3183891953 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f3d84006cf0 con 0x7f3d9414b710 2024-04-14T23:35:00.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.296+0000 7f3d927fc640 1 --2- 172.21.15.47:0/3183891953 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3d8006b990 0x7f3d8006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.296+0000 7f3d927fc640 1 -- 172.21.15.47:0/3183891953 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3d8408a720 con 0x7f3d9414b710 2024-04-14T23:35:00.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.296+0000 7f3d99f46640 1 --2- 172.21.15.47:0/3183891953 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3d8006b990 0x7f3d8006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.297+0000 7f3d99f46640 1 --2- 172.21.15.47:0/3183891953 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3d8006b990 0x7f3d8006de50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c007b80 tx=0x7f3d8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:00.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.300+0000 7f3d927fc640 1 -- 172.21.15.47:0/3183891953 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3d84059080 con 0x7f3d9414b710 2024-04-14T23:35:00.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.479+0000 7f3d9c1aa640 1 -- 172.21.15.47:0/3183891953 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3d940b4f80 con 0x7f3d8006b990 2024-04-14T23:35:00.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.487+0000 7f3d927fc640 1 -- 172.21.15.47:0/3183891953 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f3d940b4f80 con 0x7f3d8006b990 2024-04-14T23:35:00.494 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:00.495 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-14T23:35:00.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.491+0000 7f3d9c1aa640 1 -- 172.21.15.47:0/3183891953 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3d8006b990 msgr2=0x7f3d8006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.491+0000 7f3d9c1aa640 1 --2- 172.21.15.47:0/3183891953 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3d8006b990 0x7f3d8006de50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c007b80 tx=0x7f3d8c009040 comp rx=0 tx=0).stop 2024-04-14T23:35:00.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.491+0000 7f3d9c1aa640 1 -- 172.21.15.47:0/3183891953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d9414b710 msgr2=0x7f3d940cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.491+0000 7f3d9c1aa640 1 --2- 172.21.15.47:0/3183891953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d9414b710 0x7f3d940cdd20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3d84001330 tx=0x7f3d8400ec00 comp rx=0 tx=0).stop 2024-04-14T23:35:00.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.491+0000 7f3d9c1aa640 1 -- 172.21.15.47:0/3183891953 shutdown_connections 2024-04-14T23:35:00.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.491+0000 7f3d9c1aa640 1 --2- 172.21.15.47:0/3183891953 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f3d8006b990 0x7f3d8006de50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.491+0000 7f3d9c1aa640 1 --2- 172.21.15.47:0/3183891953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d9414b710 0x7f3d940cdd20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.491+0000 7f3d9c1aa640 1 --2- 172.21.15.47:0/3183891953 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3d9414b290 0x7f3d940cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.491+0000 7f3d9c1aa640 1 --2- 172.21.15.47:0/3183891953 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3d7c004800 0x7f3d940b9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.491+0000 7f3d9c1aa640 1 -- 172.21.15.47:0/3183891953 >> 172.21.15.47:0/3183891953 conn(0x7f3d940d3ed0 msgr2=0x7f3d940b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:00.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.491+0000 7f3d9c1aa640 1 -- 172.21.15.47:0/3183891953 shutdown_connections 2024-04-14T23:35:00.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.491+0000 7f3d9c1aa640 1 -- 172.21.15.47:0/3183891953 wait complete. 2024-04-14T23:35:00.505 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-14T23:35:00.363586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236100,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738620,"statfs":{"total":773094113280,"available":772852346880,"internally_reserved":0,"allocated":3383296,"data_stored":2049160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003233"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311249+0000","last_change":"2024-04-14T23:34:37.710684+0000","last_active":"2024-04-14T23:34:46.311249+0000","last_peered":"2024-04-14T23:34:46.311249+0000","last_clean":"2024-04-14T23:34:46.311249+0000","last_became_active":"2024-04-14T23:34:37.710401+0000","last_became_peered":"2024-04-14T23:34:37.710401+0000","last_unstale":"2024-04-14T23:34:46.311249+0000","last_undegraded":"2024-04-14T23:34:46.311249+0000","last_fullsized":"2024-04-14T23:34:46.311249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:24:08.806585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718660+0000","last_change":"2024-04-14T23:34:38.716947+0000","last_active":"2024-04-14T23:34:44.718660+0000","last_peered":"2024-04-14T23:34:44.718660+0000","last_clean":"2024-04-14T23:34:44.718660+0000","last_became_active":"2024-04-14T23:34:38.716643+0000","last_became_peered":"2024-04-14T23:34:38.716643+0000","last_unstale":"2024-04-14T23:34:44.718660+0000","last_undegraded":"2024-04-14T23:34:44.718660+0000","last_fullsized":"2024-04-14T23:34:44.718660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:27:36.965696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718020+0000","last_change":"2024-04-14T23:34:43.189638+0000","last_active":"2024-04-14T23:34:44.718020+0000","last_peered":"2024-04-14T23:34:44.718020+0000","last_clean":"2024-04-14T23:34:44.718020+0000","last_became_active":"2024-04-14T23:34:43.188302+0000","last_became_peered":"2024-04-14T23:34:43.188302+0000","last_unstale":"2024-04-14T23:34:44.718020+0000","last_undegraded":"2024-04-14T23:34:44.718020+0000","last_fullsized":"2024-04-14T23:34:44.718020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:22:18.103327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718787+0000","last_change":"2024-04-14T23:34:37.707154+0000","last_active":"2024-04-14T23:34:44.718787+0000","last_peered":"2024-04-14T23:34:44.718787+0000","last_clean":"2024-04-14T23:34:44.718787+0000","last_became_active":"2024-04-14T23:34:37.706646+0000","last_became_peered":"2024-04-14T23:34:37.706646+0000","last_unstale":"2024-04-14T23:34:44.718787+0000","last_undegraded":"2024-04-14T23:34:44.718787+0000","last_fullsized":"2024-04-14T23:34:44.718787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:24:08.806585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311859+0000","last_change":"2024-04-14T23:34:38.697913+0000","last_active":"2024-04-14T23:34:46.311859+0000","last_peered":"2024-04-14T23:34:46.311859+0000","last_clean":"2024-04-14T23:34:46.311859+0000","last_became_active":"2024-04-14T23:34:38.697206+0000","last_became_peered":"2024-04-14T23:34:38.697206+0000","last_unstale":"2024-04-14T23:34:46.311859+0000","last_undegraded":"2024-04-14T23:34:46.311859+0000","last_fullsized":"2024-04-14T23:34:46.311859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:09:45.484768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719041+0000","last_change":"2024-04-14T23:34:42.733619+0000","last_active":"2024-04-14T23:34:44.719041+0000","last_peered":"2024-04-14T23:34:44.719041+0000","last_clean":"2024-04-14T23:34:44.719041+0000","last_became_active":"2024-04-14T23:34:42.733164+0000","last_became_peered":"2024-04-14T23:34:42.733164+0000","last_unstale":"2024-04-14T23:34:44.719041+0000","last_undegraded":"2024-04-14T23:34:44.719041+0000","last_fullsized":"2024-04-14T23:34:44.719041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:28:10.218625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136525+0000","last_change":"2024-04-14T23:34:37.712565+0000","last_active":"2024-04-14T23:34:45.136525+0000","last_peered":"2024-04-14T23:34:45.136525+0000","last_clean":"2024-04-14T23:34:45.136525+0000","last_became_active":"2024-04-14T23:34:37.712304+0000","last_became_peered":"2024-04-14T23:34:37.712304+0000","last_unstale":"2024-04-14T23:34:45.136525+0000","last_undegraded":"2024-04-14T23:34:45.136525+0000","last_fullsized":"2024-04-14T23:34:45.136525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:52.026945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720469+0000","last_change":"2024-04-14T23:34:38.706895+0000","last_active":"2024-04-14T23:34:44.720469+0000","last_peered":"2024-04-14T23:34:44.720469+0000","last_clean":"2024-04-14T23:34:44.720469+0000","last_became_active":"2024-04-14T23:34:38.704429+0000","last_became_peered":"2024-04-14T23:34:38.704429+0000","last_unstale":"2024-04-14T23:34:44.720469+0000","last_undegraded":"2024-04-14T23:34:44.720469+0000","last_fullsized":"2024-04-14T23:34:44.720469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:22.876283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719267+0000","last_change":"2024-04-14T23:34:42.734180+0000","last_active":"2024-04-14T23:34:44.719267+0000","last_peered":"2024-04-14T23:34:44.719267+0000","last_clean":"2024-04-14T23:34:44.719267+0000","last_became_active":"2024-04-14T23:34:42.733249+0000","last_became_peered":"2024-04-14T23:34:42.733249+0000","last_unstale":"2024-04-14T23:34:44.719267+0000","last_undegraded":"2024-04-14T23:34:44.719267+0000","last_fullsized":"2024-04-14T23:34:44.719267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:50:07.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136305+0000","last_change":"2024-04-14T23:34:37.710172+0000","last_active":"2024-04-14T23:34:45.136305+0000","last_peered":"2024-04-14T23:34:45.136305+0000","last_clean":"2024-04-14T23:34:45.136305+0000","last_became_active":"2024-04-14T23:34:37.709859+0000","last_became_peered":"2024-04-14T23:34:37.709859+0000","last_unstale":"2024-04-14T23:34:45.136305+0000","last_undegraded":"2024-04-14T23:34:45.136305+0000","last_fullsized":"2024-04-14T23:34:45.136305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:03:17.126654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719993+0000","last_change":"2024-04-14T23:34:38.703533+0000","last_active":"2024-04-14T23:34:44.719993+0000","last_peered":"2024-04-14T23:34:44.719993+0000","last_clean":"2024-04-14T23:34:44.719993+0000","last_became_active":"2024-04-14T23:34:38.703228+0000","last_became_peered":"2024-04-14T23:34:38.703228+0000","last_unstale":"2024-04-14T23:34:44.719993+0000","last_undegraded":"2024-04-14T23:34:44.719993+0000","last_fullsized":"2024-04-14T23:34:44.719993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719336+0000","last_change":"2024-04-14T23:34:42.735315+0000","last_active":"2024-04-14T23:34:44.719336+0000","last_peered":"2024-04-14T23:34:44.719336+0000","last_clean":"2024-04-14T23:34:44.719336+0000","last_became_active":"2024-04-14T23:34:42.734932+0000","last_became_peered":"2024-04-14T23:34:42.734932+0000","last_unstale":"2024-04-14T23:34:44.719336+0000","last_undegraded":"2024-04-14T23:34:44.719336+0000","last_fullsized":"2024-04-14T23:34:44.719336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:12:56.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517099+0000","last_change":"2024-04-14T23:34:38.712701+0000","last_active":"2024-04-14T23:34:46.517099+0000","last_peered":"2024-04-14T23:34:46.517099+0000","last_clean":"2024-04-14T23:34:46.517099+0000","last_became_active":"2024-04-14T23:34:38.712434+0000","last_became_peered":"2024-04-14T23:34:38.712434+0000","last_unstale":"2024-04-14T23:34:46.517099+0000","last_undegraded":"2024-04-14T23:34:46.517099+0000","last_fullsized":"2024-04-14T23:34:46.517099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:27:36.965696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136371+0000","last_change":"2024-04-14T23:34:37.713312+0000","last_active":"2024-04-14T23:34:45.136371+0000","last_peered":"2024-04-14T23:34:45.136371+0000","last_clean":"2024-04-14T23:34:45.136371+0000","last_became_active":"2024-04-14T23:34:37.713015+0000","last_became_peered":"2024-04-14T23:34:37.713015+0000","last_unstale":"2024-04-14T23:34:45.136371+0000","last_undegraded":"2024-04-14T23:34:45.136371+0000","last_fullsized":"2024-04-14T23:34:45.136371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:25.981130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720659+0000","last_change":"2024-04-14T23:34:42.734239+0000","last_active":"2024-04-14T23:34:44.720659+0000","last_peered":"2024-04-14T23:34:44.720659+0000","last_clean":"2024-04-14T23:34:44.720659+0000","last_became_active":"2024-04-14T23:34:42.733043+0000","last_became_peered":"2024-04-14T23:34:42.733043+0000","last_unstale":"2024-04-14T23:34:44.720659+0000","last_undegraded":"2024-04-14T23:34:44.720659+0000","last_fullsized":"2024-04-14T23:34:44.720659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:24:22.674500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718328+0000","last_change":"2024-04-14T23:34:38.708368+0000","last_active":"2024-04-14T23:34:44.718328+0000","last_peered":"2024-04-14T23:34:44.718328+0000","last_clean":"2024-04-14T23:34:44.718328+0000","last_became_active":"2024-04-14T23:34:38.708065+0000","last_became_peered":"2024-04-14T23:34:38.708065+0000","last_unstale":"2024-04-14T23:34:44.718328+0000","last_undegraded":"2024-04-14T23:34:44.718328+0000","last_fullsized":"2024-04-14T23:34:44.718328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:09:47.574841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318514+0000","last_change":"2024-04-14T23:34:37.707159+0000","last_active":"2024-04-14T23:34:46.318514+0000","last_peered":"2024-04-14T23:34:46.318514+0000","last_clean":"2024-04-14T23:34:46.318514+0000","last_became_active":"2024-04-14T23:34:37.706777+0000","last_became_peered":"2024-04-14T23:34:37.706777+0000","last_unstale":"2024-04-14T23:34:46.318514+0000","last_undegraded":"2024-04-14T23:34:46.318514+0000","last_fullsized":"2024-04-14T23:34:46.318514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:23.167535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719596+0000","last_change":"2024-04-14T23:34:42.734697+0000","last_active":"2024-04-14T23:34:44.719596+0000","last_peered":"2024-04-14T23:34:44.719596+0000","last_clean":"2024-04-14T23:34:44.719596+0000","last_became_active":"2024-04-14T23:34:42.732974+0000","last_became_peered":"2024-04-14T23:34:42.732974+0000","last_unstale":"2024-04-14T23:34:44.719596+0000","last_undegraded":"2024-04-14T23:34:44.719596+0000","last_fullsized":"2024-04-14T23:34:44.719596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:18:47.542320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718187+0000","last_change":"2024-04-14T23:34:38.713694+0000","last_active":"2024-04-14T23:34:44.718187+0000","last_peered":"2024-04-14T23:34:44.718187+0000","last_clean":"2024-04-14T23:34:44.718187+0000","last_became_active":"2024-04-14T23:34:38.713374+0000","last_became_peered":"2024-04-14T23:34:38.713374+0000","last_unstale":"2024-04-14T23:34:44.718187+0000","last_undegraded":"2024-04-14T23:34:44.718187+0000","last_fullsized":"2024-04-14T23:34:44.718187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:40.949590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318481+0000","last_change":"2024-04-14T23:34:37.708516+0000","last_active":"2024-04-14T23:34:46.318481+0000","last_peered":"2024-04-14T23:34:46.318481+0000","last_clean":"2024-04-14T23:34:46.318481+0000","last_became_active":"2024-04-14T23:34:37.708219+0000","last_became_peered":"2024-04-14T23:34:37.708219+0000","last_unstale":"2024-04-14T23:34:46.318481+0000","last_undegraded":"2024-04-14T23:34:46.318481+0000","last_fullsized":"2024-04-14T23:34:46.318481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:29.023280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319235+0000","last_change":"2024-04-14T23:34:43.186688+0000","last_active":"2024-04-14T23:34:46.319235+0000","last_peered":"2024-04-14T23:34:46.319235+0000","last_clean":"2024-04-14T23:34:46.319235+0000","last_became_active":"2024-04-14T23:34:43.186305+0000","last_became_peered":"2024-04-14T23:34:43.186305+0000","last_unstale":"2024-04-14T23:34:46.319235+0000","last_undegraded":"2024-04-14T23:34:46.319235+0000","last_fullsized":"2024-04-14T23:34:46.319235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:12:56.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720326+0000","last_change":"2024-04-14T23:34:38.707888+0000","last_active":"2024-04-14T23:34:44.720326+0000","last_peered":"2024-04-14T23:34:44.720326+0000","last_clean":"2024-04-14T23:34:44.720326+0000","last_became_active":"2024-04-14T23:34:38.707601+0000","last_became_peered":"2024-04-14T23:34:38.707601+0000","last_unstale":"2024-04-14T23:34:44.720326+0000","last_undegraded":"2024-04-14T23:34:44.720326+0000","last_fullsized":"2024-04-14T23:34:44.720326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:18:41.946696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.135954+0000","last_change":"2024-04-14T23:34:37.712453+0000","last_active":"2024-04-14T23:34:45.135954+0000","last_peered":"2024-04-14T23:34:45.135954+0000","last_clean":"2024-04-14T23:34:45.135954+0000","last_became_active":"2024-04-14T23:34:37.712091+0000","last_became_peered":"2024-04-14T23:34:37.712091+0000","last_unstale":"2024-04-14T23:34:45.135954+0000","last_undegraded":"2024-04-14T23:34:45.135954+0000","last_fullsized":"2024-04-14T23:34:45.135954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:23.167535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719231+0000","last_change":"2024-04-14T23:34:42.730978+0000","last_active":"2024-04-14T23:34:44.719231+0000","last_peered":"2024-04-14T23:34:44.719231+0000","last_clean":"2024-04-14T23:34:44.719231+0000","last_became_active":"2024-04-14T23:34:42.730528+0000","last_became_peered":"2024-04-14T23:34:42.730528+0000","last_unstale":"2024-04-14T23:34:44.719231+0000","last_undegraded":"2024-04-14T23:34:44.719231+0000","last_fullsized":"2024-04-14T23:34:44.719231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:22:18.658809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.312044+0000","last_change":"2024-04-14T23:34:38.705602+0000","last_active":"2024-04-14T23:34:46.312044+0000","last_peered":"2024-04-14T23:34:46.312044+0000","last_clean":"2024-04-14T23:34:46.312044+0000","last_became_active":"2024-04-14T23:34:38.705305+0000","last_became_peered":"2024-04-14T23:34:38.705305+0000","last_unstale":"2024-04-14T23:34:46.312044+0000","last_undegraded":"2024-04-14T23:34:46.312044+0000","last_fullsized":"2024-04-14T23:34:46.312044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:12.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516709+0000","last_change":"2024-04-14T23:34:37.709059+0000","last_active":"2024-04-14T23:34:46.516709+0000","last_peered":"2024-04-14T23:34:46.516709+0000","last_clean":"2024-04-14T23:34:46.516709+0000","last_became_active":"2024-04-14T23:34:37.707857+0000","last_became_peered":"2024-04-14T23:34:37.707857+0000","last_unstale":"2024-04-14T23:34:46.516709+0000","last_undegraded":"2024-04-14T23:34:46.516709+0000","last_fullsized":"2024-04-14T23:34:46.516709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:02:03.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720072+0000","last_change":"2024-04-14T23:34:43.185206+0000","last_active":"2024-04-14T23:34:44.720072+0000","last_peered":"2024-04-14T23:34:44.720072+0000","last_clean":"2024-04-14T23:34:44.720072+0000","last_became_active":"2024-04-14T23:34:43.184816+0000","last_became_peered":"2024-04-14T23:34:43.184816+0000","last_unstale":"2024-04-14T23:34:44.720072+0000","last_undegraded":"2024-04-14T23:34:44.720072+0000","last_fullsized":"2024-04-14T23:34:44.720072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:16:46.008001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718884+0000","last_change":"2024-04-14T23:34:38.712982+0000","last_active":"2024-04-14T23:34:44.718884+0000","last_peered":"2024-04-14T23:34:44.718884+0000","last_clean":"2024-04-14T23:34:44.718884+0000","last_became_active":"2024-04-14T23:34:38.712714+0000","last_became_peered":"2024-04-14T23:34:38.712714+0000","last_unstale":"2024-04-14T23:34:44.718884+0000","last_undegraded":"2024-04-14T23:34:44.718884+0000","last_fullsized":"2024-04-14T23:34:44.718884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:44.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319185+0000","last_change":"2024-04-14T23:34:37.705495+0000","last_active":"2024-04-14T23:34:46.319185+0000","last_peered":"2024-04-14T23:34:46.319185+0000","last_clean":"2024-04-14T23:34:46.319185+0000","last_became_active":"2024-04-14T23:34:37.705184+0000","last_became_peered":"2024-04-14T23:34:37.705184+0000","last_unstale":"2024-04-14T23:34:46.319185+0000","last_undegraded":"2024-04-14T23:34:46.319185+0000","last_fullsized":"2024-04-14T23:34:46.319185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:18:40.942344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.717967+0000","last_change":"2024-04-14T23:34:43.189327+0000","last_active":"2024-04-14T23:34:44.717967+0000","last_peered":"2024-04-14T23:34:44.717967+0000","last_clean":"2024-04-14T23:34:44.717967+0000","last_became_active":"2024-04-14T23:34:43.188921+0000","last_became_peered":"2024-04-14T23:34:43.188921+0000","last_unstale":"2024-04-14T23:34:44.717967+0000","last_undegraded":"2024-04-14T23:34:44.717967+0000","last_fullsized":"2024-04-14T23:34:44.717967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:57:09.514981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319131+0000","last_change":"2024-04-14T23:34:38.707155+0000","last_active":"2024-04-14T23:34:46.319131+0000","last_peered":"2024-04-14T23:34:46.319131+0000","last_clean":"2024-04-14T23:34:46.319131+0000","last_became_active":"2024-04-14T23:34:38.706626+0000","last_became_peered":"2024-04-14T23:34:38.706626+0000","last_unstale":"2024-04-14T23:34:46.319131+0000","last_undegraded":"2024-04-14T23:34:46.319131+0000","last_fullsized":"2024-04-14T23:34:46.319131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:54:47.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136672+0000","last_change":"2024-04-14T23:34:37.713324+0000","last_active":"2024-04-14T23:34:45.136672+0000","last_peered":"2024-04-14T23:34:45.136672+0000","last_clean":"2024-04-14T23:34:45.136672+0000","last_became_active":"2024-04-14T23:34:37.713052+0000","last_became_peered":"2024-04-14T23:34:37.713052+0000","last_unstale":"2024-04-14T23:34:45.136672+0000","last_undegraded":"2024-04-14T23:34:45.136672+0000","last_fullsized":"2024-04-14T23:34:45.136672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:21:25.348015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311604+0000","last_change":"2024-04-14T23:34:43.187173+0000","last_active":"2024-04-14T23:34:46.311604+0000","last_peered":"2024-04-14T23:34:46.311604+0000","last_clean":"2024-04-14T23:34:46.311604+0000","last_became_active":"2024-04-14T23:34:43.185505+0000","last_became_peered":"2024-04-14T23:34:43.185505+0000","last_unstale":"2024-04-14T23:34:46.311604+0000","last_undegraded":"2024-04-14T23:34:46.311604+0000","last_fullsized":"2024-04-14T23:34:46.311604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:28:10.218625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720108+0000","last_change":"2024-04-14T23:34:38.708136+0000","last_active":"2024-04-14T23:34:44.720108+0000","last_peered":"2024-04-14T23:34:44.720108+0000","last_clean":"2024-04-14T23:34:44.720108+0000","last_became_active":"2024-04-14T23:34:38.707860+0000","last_became_peered":"2024-04-14T23:34:38.707860+0000","last_unstale":"2024-04-14T23:34:44.720108+0000","last_undegraded":"2024-04-14T23:34:44.720108+0000","last_fullsized":"2024-04-14T23:34:44.720108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319191+0000","last_change":"2024-04-14T23:34:37.703582+0000","last_active":"2024-04-14T23:34:46.319191+0000","last_peered":"2024-04-14T23:34:46.319191+0000","last_clean":"2024-04-14T23:34:46.319191+0000","last_became_active":"2024-04-14T23:34:37.703276+0000","last_became_peered":"2024-04-14T23:34:37.703276+0000","last_unstale":"2024-04-14T23:34:46.319191+0000","last_undegraded":"2024-04-14T23:34:46.319191+0000","last_fullsized":"2024-04-14T23:34:46.319191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:03:17.126654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318955+0000","last_change":"2024-04-14T23:34:42.738584+0000","last_active":"2024-04-14T23:34:46.318955+0000","last_peered":"2024-04-14T23:34:46.318955+0000","last_clean":"2024-04-14T23:34:46.318955+0000","last_became_active":"2024-04-14T23:34:42.738098+0000","last_became_peered":"2024-04-14T23:34:42.738098+0000","last_unstale":"2024-04-14T23:34:46.318955+0000","last_undegraded":"2024-04-14T23:34:46.318955+0000","last_fullsized":"2024-04-14T23:34:46.318955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:22:18.658809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719759+0000","last_change":"2024-04-14T23:34:38.710787+0000","last_active":"2024-04-14T23:34:44.719759+0000","last_peered":"2024-04-14T23:34:44.719759+0000","last_clean":"2024-04-14T23:34:44.719759+0000","last_became_active":"2024-04-14T23:34:38.710503+0000","last_became_peered":"2024-04-14T23:34:38.710503+0000","last_unstale":"2024-04-14T23:34:44.719759+0000","last_undegraded":"2024-04-14T23:34:44.719759+0000","last_fullsized":"2024-04-14T23:34:44.719759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:24.171888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720174+0000","last_change":"2024-04-14T23:34:37.704162+0000","last_active":"2024-04-14T23:34:44.720174+0000","last_peered":"2024-04-14T23:34:44.720174+0000","last_clean":"2024-04-14T23:34:44.720174+0000","last_became_active":"2024-04-14T23:34:37.703874+0000","last_became_peered":"2024-04-14T23:34:37.703874+0000","last_unstale":"2024-04-14T23:34:44.720174+0000","last_undegraded":"2024-04-14T23:34:44.720174+0000","last_fullsized":"2024-04-14T23:34:44.720174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:18:40.942344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319100+0000","last_change":"2024-04-14T23:34:42.731843+0000","last_active":"2024-04-14T23:34:46.319100+0000","last_peered":"2024-04-14T23:34:46.319100+0000","last_clean":"2024-04-14T23:34:46.319100+0000","last_became_active":"2024-04-14T23:34:42.730913+0000","last_became_peered":"2024-04-14T23:34:42.730913+0000","last_unstale":"2024-04-14T23:34:46.319100+0000","last_undegraded":"2024-04-14T23:34:46.319100+0000","last_fullsized":"2024-04-14T23:34:46.319100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:50:07.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318803+0000","last_change":"2024-04-14T23:34:38.706592+0000","last_active":"2024-04-14T23:34:46.318803+0000","last_peered":"2024-04-14T23:34:46.318803+0000","last_clean":"2024-04-14T23:34:46.318803+0000","last_became_active":"2024-04-14T23:34:38.706299+0000","last_became_peered":"2024-04-14T23:34:38.706299+0000","last_unstale":"2024-04-14T23:34:46.318803+0000","last_undegraded":"2024-04-14T23:34:46.318803+0000","last_fullsized":"2024-04-14T23:34:46.318803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:12.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806129+0000","last_change":"2024-04-14T23:34:37.703871+0000","last_active":"2024-04-14T23:34:45.806129+0000","last_peered":"2024-04-14T23:34:45.806129+0000","last_clean":"2024-04-14T23:34:45.806129+0000","last_became_active":"2024-04-14T23:34:37.703574+0000","last_became_peered":"2024-04-14T23:34:37.703574+0000","last_unstale":"2024-04-14T23:34:45.806129+0000","last_undegraded":"2024-04-14T23:34:45.806129+0000","last_fullsized":"2024-04-14T23:34:45.806129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:51:11.382828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319327+0000","last_change":"2024-04-14T23:34:42.739072+0000","last_active":"2024-04-14T23:34:46.319327+0000","last_peered":"2024-04-14T23:34:46.319327+0000","last_clean":"2024-04-14T23:34:46.319327+0000","last_became_active":"2024-04-14T23:34:42.738587+0000","last_became_peered":"2024-04-14T23:34:42.738587+0000","last_unstale":"2024-04-14T23:34:46.319327+0000","last_undegraded":"2024-04-14T23:34:46.319327+0000","last_fullsized":"2024-04-14T23:34:46.319327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:37:34.006119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311383+0000","last_change":"2024-04-14T23:34:38.704755+0000","last_active":"2024-04-14T23:34:46.311383+0000","last_peered":"2024-04-14T23:34:46.311383+0000","last_clean":"2024-04-14T23:34:46.311383+0000","last_became_active":"2024-04-14T23:34:38.704247+0000","last_became_peered":"2024-04-14T23:34:38.704247+0000","last_unstale":"2024-04-14T23:34:46.311383+0000","last_undegraded":"2024-04-14T23:34:46.311383+0000","last_fullsized":"2024-04-14T23:34:46.311383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:48:26.290955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.135983+0000","last_change":"2024-04-14T23:34:37.712348+0000","last_active":"2024-04-14T23:34:45.135983+0000","last_peered":"2024-04-14T23:34:45.135983+0000","last_clean":"2024-04-14T23:34:45.135983+0000","last_became_active":"2024-04-14T23:34:37.712043+0000","last_became_peered":"2024-04-14T23:34:37.712043+0000","last_unstale":"2024-04-14T23:34:45.135983+0000","last_undegraded":"2024-04-14T23:34:45.135983+0000","last_fullsized":"2024-04-14T23:34:45.135983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:48:25.286602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.312031+0000","last_change":"2024-04-14T23:34:43.186651+0000","last_active":"2024-04-14T23:34:46.312031+0000","last_peered":"2024-04-14T23:34:46.312031+0000","last_clean":"2024-04-14T23:34:46.312031+0000","last_became_active":"2024-04-14T23:34:43.186282+0000","last_became_peered":"2024-04-14T23:34:43.186282+0000","last_unstale":"2024-04-14T23:34:46.312031+0000","last_undegraded":"2024-04-14T23:34:46.312031+0000","last_fullsized":"2024-04-14T23:34:46.312031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:37:34.006119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718436+0000","last_change":"2024-04-14T23:34:38.709071+0000","last_active":"2024-04-14T23:34:44.718436+0000","last_peered":"2024-04-14T23:34:44.718436+0000","last_clean":"2024-04-14T23:34:44.718436+0000","last_became_active":"2024-04-14T23:34:38.708815+0000","last_became_peered":"2024-04-14T23:34:38.708815+0000","last_unstale":"2024-04-14T23:34:44.718436+0000","last_undegraded":"2024-04-14T23:34:44.718436+0000","last_fullsized":"2024-04-14T23:34:44.718436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:12.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720070+0000","last_change":"2024-04-14T23:34:37.704931+0000","last_active":"2024-04-14T23:34:44.720070+0000","last_peered":"2024-04-14T23:34:44.720070+0000","last_clean":"2024-04-14T23:34:44.720070+0000","last_became_active":"2024-04-14T23:34:37.704607+0000","last_became_peered":"2024-04-14T23:34:37.704607+0000","last_unstale":"2024-04-14T23:34:44.720070+0000","last_undegraded":"2024-04-14T23:34:44.720070+0000","last_fullsized":"2024-04-14T23:34:44.720070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:51:11.382828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136097+0000","last_change":"2024-04-14T23:34:27.438796+0000","last_active":"2024-04-14T23:34:45.136097+0000","last_peered":"2024-04-14T23:34:45.136097+0000","last_clean":"2024-04-14T23:34:45.136097+0000","last_became_active":"2024-04-14T23:34:27.437932+0000","last_became_peered":"2024-04-14T23:34:27.437932+0000","last_unstale":"2024-04-14T23:34:45.136097+0000","last_undegraded":"2024-04-14T23:34:45.136097+0000","last_fullsized":"2024-04-14T23:34:45.136097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_clean_scrub_stamp":"2024-04-14T23:34:26.390323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:11:13.484245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517493+0000","last_change":"2024-04-14T23:34:43.188245+0000","last_active":"2024-04-14T23:34:46.517493+0000","last_peered":"2024-04-14T23:34:46.517493+0000","last_clean":"2024-04-14T23:34:46.517493+0000","last_became_active":"2024-04-14T23:34:43.187808+0000","last_became_peered":"2024-04-14T23:34:43.187808+0000","last_unstale":"2024-04-14T23:34:46.517493+0000","last_undegraded":"2024-04-14T23:34:46.517493+0000","last_fullsized":"2024-04-14T23:34:46.517493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:28.129419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136392+0000","last_change":"2024-04-14T23:34:38.711963+0000","last_active":"2024-04-14T23:34:45.136392+0000","last_peered":"2024-04-14T23:34:45.136392+0000","last_clean":"2024-04-14T23:34:45.136392+0000","last_became_active":"2024-04-14T23:34:38.710515+0000","last_became_peered":"2024-04-14T23:34:38.710515+0000","last_unstale":"2024-04-14T23:34:45.136392+0000","last_undegraded":"2024-04-14T23:34:45.136392+0000","last_fullsized":"2024-04-14T23:34:45.136392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:29:53.179819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806129+0000","last_change":"2024-04-14T23:34:37.708620+0000","last_active":"2024-04-14T23:34:45.806129+0000","last_peered":"2024-04-14T23:34:45.806129+0000","last_clean":"2024-04-14T23:34:45.806129+0000","last_became_active":"2024-04-14T23:34:37.708280+0000","last_became_peered":"2024-04-14T23:34:37.708280+0000","last_unstale":"2024-04-14T23:34:45.806129+0000","last_undegraded":"2024-04-14T23:34:45.806129+0000","last_fullsized":"2024-04-14T23:34:45.806129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:29.023280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517179+0000","last_change":"2024-04-14T23:34:43.185307+0000","last_active":"2024-04-14T23:34:46.517179+0000","last_peered":"2024-04-14T23:34:46.517179+0000","last_clean":"2024-04-14T23:34:46.517179+0000","last_became_active":"2024-04-14T23:34:43.184870+0000","last_became_peered":"2024-04-14T23:34:43.184870+0000","last_unstale":"2024-04-14T23:34:46.517179+0000","last_undegraded":"2024-04-14T23:34:46.517179+0000","last_fullsized":"2024-04-14T23:34:46.517179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:29:57.202071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720547+0000","last_change":"2024-04-14T23:34:38.714634+0000","last_active":"2024-04-14T23:34:44.720547+0000","last_peered":"2024-04-14T23:34:44.720547+0000","last_clean":"2024-04-14T23:34:44.720547+0000","last_became_active":"2024-04-14T23:34:38.714357+0000","last_became_peered":"2024-04-14T23:34:38.714357+0000","last_unstale":"2024-04-14T23:34:44.720547+0000","last_undegraded":"2024-04-14T23:34:44.720547+0000","last_fullsized":"2024-04-14T23:34:44.720547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:29:53.179819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318527+0000","last_change":"2024-04-14T23:34:37.709513+0000","last_active":"2024-04-14T23:34:46.318527+0000","last_peered":"2024-04-14T23:34:46.318527+0000","last_clean":"2024-04-14T23:34:46.318527+0000","last_became_active":"2024-04-14T23:34:37.709235+0000","last_became_peered":"2024-04-14T23:34:37.709235+0000","last_unstale":"2024-04-14T23:34:46.318527+0000","last_undegraded":"2024-04-14T23:34:46.318527+0000","last_fullsized":"2024-04-14T23:34:46.318527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:52.026945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311747+0000","last_change":"2024-04-14T23:34:42.739900+0000","last_active":"2024-04-14T23:34:46.311747+0000","last_peered":"2024-04-14T23:34:46.311747+0000","last_clean":"2024-04-14T23:34:46.311747+0000","last_became_active":"2024-04-14T23:34:42.739539+0000","last_became_peered":"2024-04-14T23:34:42.739539+0000","last_unstale":"2024-04-14T23:34:46.311747+0000","last_undegraded":"2024-04-14T23:34:46.311747+0000","last_fullsized":"2024-04-14T23:34:46.311747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:22:18.658809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136800+0000","last_change":"2024-04-14T23:34:38.716624+0000","last_active":"2024-04-14T23:34:45.136800+0000","last_peered":"2024-04-14T23:34:45.136800+0000","last_clean":"2024-04-14T23:34:45.136800+0000","last_became_active":"2024-04-14T23:34:38.716353+0000","last_became_peered":"2024-04-14T23:34:38.716353+0000","last_unstale":"2024-04-14T23:34:45.136800+0000","last_undegraded":"2024-04-14T23:34:45.136800+0000","last_fullsized":"2024-04-14T23:34:45.136800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:28:06.196373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806146+0000","last_change":"2024-04-14T23:34:37.707669+0000","last_active":"2024-04-14T23:34:45.806146+0000","last_peered":"2024-04-14T23:34:45.806146+0000","last_clean":"2024-04-14T23:34:45.806146+0000","last_became_active":"2024-04-14T23:34:37.707312+0000","last_became_peered":"2024-04-14T23:34:37.707312+0000","last_unstale":"2024-04-14T23:34:45.806146+0000","last_undegraded":"2024-04-14T23:34:45.806146+0000","last_fullsized":"2024-04-14T23:34:45.806146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:02:03.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720259+0000","last_change":"2024-04-14T23:34:43.187817+0000","last_active":"2024-04-14T23:34:44.720259+0000","last_peered":"2024-04-14T23:34:44.720259+0000","last_clean":"2024-04-14T23:34:44.720259+0000","last_became_active":"2024-04-14T23:34:43.187119+0000","last_became_peered":"2024-04-14T23:34:43.187119+0000","last_unstale":"2024-04-14T23:34:44.720259+0000","last_undegraded":"2024-04-14T23:34:44.720259+0000","last_fullsized":"2024-04-14T23:34:44.720259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:12:56.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136660+0000","last_change":"2024-04-14T23:34:38.710233+0000","last_active":"2024-04-14T23:34:45.136660+0000","last_peered":"2024-04-14T23:34:45.136660+0000","last_clean":"2024-04-14T23:34:45.136660+0000","last_became_active":"2024-04-14T23:34:38.709977+0000","last_became_peered":"2024-04-14T23:34:38.709977+0000","last_unstale":"2024-04-14T23:34:45.136660+0000","last_undegraded":"2024-04-14T23:34:45.136660+0000","last_fullsized":"2024-04-14T23:34:45.136660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:54:48.080529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720245+0000","last_change":"2024-04-14T23:34:37.705808+0000","last_active":"2024-04-14T23:34:44.720245+0000","last_peered":"2024-04-14T23:34:44.720245+0000","last_clean":"2024-04-14T23:34:44.720245+0000","last_became_active":"2024-04-14T23:34:37.705482+0000","last_became_peered":"2024-04-14T23:34:37.705482+0000","last_unstale":"2024-04-14T23:34:44.720245+0000","last_undegraded":"2024-04-14T23:34:44.720245+0000","last_fullsized":"2024-04-14T23:34:44.720245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:15:08.407528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720487+0000","last_change":"2024-04-14T23:34:42.733535+0000","last_active":"2024-04-14T23:34:44.720487+0000","last_peered":"2024-04-14T23:34:44.720487+0000","last_clean":"2024-04-14T23:34:44.720487+0000","last_became_active":"2024-04-14T23:34:42.733097+0000","last_became_peered":"2024-04-14T23:34:42.733097+0000","last_unstale":"2024-04-14T23:34:44.720487+0000","last_undegraded":"2024-04-14T23:34:44.720487+0000","last_fullsized":"2024-04-14T23:34:44.720487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:06:02.832632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136148+0000","last_change":"2024-04-14T23:34:38.709532+0000","last_active":"2024-04-14T23:34:45.136148+0000","last_peered":"2024-04-14T23:34:45.136148+0000","last_clean":"2024-04-14T23:34:45.136148+0000","last_became_active":"2024-04-14T23:34:38.709258+0000","last_became_peered":"2024-04-14T23:34:38.709258+0000","last_unstale":"2024-04-14T23:34:45.136148+0000","last_undegraded":"2024-04-14T23:34:45.136148+0000","last_fullsized":"2024-04-14T23:34:45.136148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:57:26.195919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806275+0000","last_change":"2024-04-14T23:34:37.697607+0000","last_active":"2024-04-14T23:34:45.806275+0000","last_peered":"2024-04-14T23:34:45.806275+0000","last_clean":"2024-04-14T23:34:45.806275+0000","last_became_active":"2024-04-14T23:34:37.697298+0000","last_became_peered":"2024-04-14T23:34:37.697298+0000","last_unstale":"2024-04-14T23:34:45.806275+0000","last_undegraded":"2024-04-14T23:34:45.806275+0000","last_fullsized":"2024-04-14T23:34:45.806275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:59:31.580365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311852+0000","last_change":"2024-04-14T23:34:42.735706+0000","last_active":"2024-04-14T23:34:46.311852+0000","last_peered":"2024-04-14T23:34:46.311852+0000","last_clean":"2024-04-14T23:34:46.311852+0000","last_became_active":"2024-04-14T23:34:42.735271+0000","last_became_peered":"2024-04-14T23:34:42.735271+0000","last_unstale":"2024-04-14T23:34:46.311852+0000","last_undegraded":"2024-04-14T23:34:46.311852+0000","last_fullsized":"2024-04-14T23:34:46.311852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:12:56.706506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517020+0000","last_change":"2024-04-14T23:34:38.713087+0000","last_active":"2024-04-14T23:34:46.517020+0000","last_peered":"2024-04-14T23:34:46.517020+0000","last_clean":"2024-04-14T23:34:46.517020+0000","last_became_active":"2024-04-14T23:34:38.712034+0000","last_became_peered":"2024-04-14T23:34:38.712034+0000","last_unstale":"2024-04-14T23:34:46.517020+0000","last_undegraded":"2024-04-14T23:34:46.517020+0000","last_fullsized":"2024-04-14T23:34:46.517020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516575+0000","last_change":"2024-04-14T23:34:37.704849+0000","last_active":"2024-04-14T23:34:46.516575+0000","last_peered":"2024-04-14T23:34:46.516575+0000","last_clean":"2024-04-14T23:34:46.516575+0000","last_became_active":"2024-04-14T23:34:37.704557+0000","last_became_peered":"2024-04-14T23:34:37.704557+0000","last_unstale":"2024-04-14T23:34:46.516575+0000","last_undegraded":"2024-04-14T23:34:46.516575+0000","last_fullsized":"2024-04-14T23:34:46.516575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:51:11.382828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718861+0000","last_change":"2024-04-14T23:34:43.189855+0000","last_active":"2024-04-14T23:34:44.718861+0000","last_peered":"2024-04-14T23:34:44.718861+0000","last_clean":"2024-04-14T23:34:44.718861+0000","last_became_active":"2024-04-14T23:34:43.187647+0000","last_became_peered":"2024-04-14T23:34:43.187647+0000","last_unstale":"2024-04-14T23:34:44.718861+0000","last_undegraded":"2024-04-14T23:34:44.718861+0000","last_fullsized":"2024-04-14T23:34:44.718861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:43:12.062252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136349+0000","last_change":"2024-04-14T23:34:38.716708+0000","last_active":"2024-04-14T23:34:45.136349+0000","last_peered":"2024-04-14T23:34:45.136349+0000","last_clean":"2024-04-14T23:34:45.136349+0000","last_became_active":"2024-04-14T23:34:38.716155+0000","last_became_peered":"2024-04-14T23:34:38.716155+0000","last_unstale":"2024-04-14T23:34:45.136349+0000","last_undegraded":"2024-04-14T23:34:45.136349+0000","last_fullsized":"2024-04-14T23:34:45.136349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:19:41.725777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720069+0000","last_change":"2024-04-14T23:34:37.708685+0000","last_active":"2024-04-14T23:34:44.720069+0000","last_peered":"2024-04-14T23:34:44.720069+0000","last_clean":"2024-04-14T23:34:44.720069+0000","last_became_active":"2024-04-14T23:34:37.708139+0000","last_became_peered":"2024-04-14T23:34:37.708139+0000","last_unstale":"2024-04-14T23:34:44.720069+0000","last_undegraded":"2024-04-14T23:34:44.720069+0000","last_fullsized":"2024-04-14T23:34:44.720069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:23.167535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718415+0000","last_change":"2024-04-14T23:34:43.185556+0000","last_active":"2024-04-14T23:34:44.718415+0000","last_peered":"2024-04-14T23:34:44.718415+0000","last_clean":"2024-04-14T23:34:44.718415+0000","last_became_active":"2024-04-14T23:34:43.185132+0000","last_became_peered":"2024-04-14T23:34:43.185132+0000","last_unstale":"2024-04-14T23:34:44.718415+0000","last_undegraded":"2024-04-14T23:34:44.718415+0000","last_fullsized":"2024-04-14T23:34:44.718415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:42:28.109020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311653+0000","last_change":"2024-04-14T23:34:38.711429+0000","last_active":"2024-04-14T23:34:46.311653+0000","last_peered":"2024-04-14T23:34:46.311653+0000","last_clean":"2024-04-14T23:34:46.311653+0000","last_became_active":"2024-04-14T23:34:38.710919+0000","last_became_peered":"2024-04-14T23:34:38.710919+0000","last_unstale":"2024-04-14T23:34:46.311653+0000","last_undegraded":"2024-04-14T23:34:46.311653+0000","last_fullsized":"2024-04-14T23:34:46.311653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:32:33.112814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311200+0000","last_change":"2024-04-14T23:34:37.712359+0000","last_active":"2024-04-14T23:34:46.311200+0000","last_peered":"2024-04-14T23:34:46.311200+0000","last_clean":"2024-04-14T23:34:46.311200+0000","last_became_active":"2024-04-14T23:34:37.711899+0000","last_became_peered":"2024-04-14T23:34:37.711899+0000","last_unstale":"2024-04-14T23:34:46.311200+0000","last_undegraded":"2024-04-14T23:34:46.311200+0000","last_fullsized":"2024-04-14T23:34:46.311200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:15:08.407528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719927+0000","last_change":"2024-04-14T23:34:43.185490+0000","last_active":"2024-04-14T23:34:44.719927+0000","last_peered":"2024-04-14T23:34:44.719927+0000","last_clean":"2024-04-14T23:34:44.719927+0000","last_became_active":"2024-04-14T23:34:43.185080+0000","last_became_peered":"2024-04-14T23:34:43.185080+0000","last_unstale":"2024-04-14T23:34:44.719927+0000","last_undegraded":"2024-04-14T23:34:44.719927+0000","last_fullsized":"2024-04-14T23:34:44.719927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:50:07.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136350+0000","last_change":"2024-04-14T23:34:38.718154+0000","last_active":"2024-04-14T23:34:45.136350+0000","last_peered":"2024-04-14T23:34:45.136350+0000","last_clean":"2024-04-14T23:34:45.136350+0000","last_became_active":"2024-04-14T23:34:38.717760+0000","last_became_peered":"2024-04-14T23:34:38.717760+0000","last_unstale":"2024-04-14T23:34:45.136350+0000","last_undegraded":"2024-04-14T23:34:45.136350+0000","last_fullsized":"2024-04-14T23:34:45.136350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:08:52.379294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:48.188845+0000","last_change":"2024-04-14T23:34:37.710678+0000","last_active":"2024-04-14T23:34:48.188845+0000","last_peered":"2024-04-14T23:34:48.188845+0000","last_clean":"2024-04-14T23:34:48.188845+0000","last_became_active":"2024-04-14T23:34:37.710377+0000","last_became_peered":"2024-04-14T23:34:37.710377+0000","last_unstale":"2024-04-14T23:34:48.188845+0000","last_undegraded":"2024-04-14T23:34:48.188845+0000","last_fullsized":"2024-04-14T23:34:48.188845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:23.167535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318875+0000","last_change":"2024-04-14T23:34:42.735072+0000","last_active":"2024-04-14T23:34:46.318875+0000","last_peered":"2024-04-14T23:34:46.318875+0000","last_clean":"2024-04-14T23:34:46.318875+0000","last_became_active":"2024-04-14T23:34:42.734693+0000","last_became_peered":"2024-04-14T23:34:42.734693+0000","last_unstale":"2024-04-14T23:34:46.318875+0000","last_undegraded":"2024-04-14T23:34:46.318875+0000","last_fullsized":"2024-04-14T23:34:46.318875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:28:10.218625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720019+0000","last_change":"2024-04-14T23:34:38.714478+0000","last_active":"2024-04-14T23:34:44.720019+0000","last_peered":"2024-04-14T23:34:44.720019+0000","last_clean":"2024-04-14T23:34:44.720019+0000","last_became_active":"2024-04-14T23:34:38.714187+0000","last_became_peered":"2024-04-14T23:34:38.714187+0000","last_unstale":"2024-04-14T23:34:44.720019+0000","last_undegraded":"2024-04-14T23:34:44.720019+0000","last_fullsized":"2024-04-14T23:34:44.720019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:38:26.985483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318538+0000","last_change":"2024-04-14T23:34:37.706150+0000","last_active":"2024-04-14T23:34:46.318538+0000","last_peered":"2024-04-14T23:34:46.318538+0000","last_clean":"2024-04-14T23:34:46.318538+0000","last_became_active":"2024-04-14T23:34:37.705836+0000","last_became_peered":"2024-04-14T23:34:37.705836+0000","last_unstale":"2024-04-14T23:34:46.318538+0000","last_undegraded":"2024-04-14T23:34:46.318538+0000","last_fullsized":"2024-04-14T23:34:46.318538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:02:03.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719572+0000","last_change":"2024-04-14T23:34:42.733389+0000","last_active":"2024-04-14T23:34:44.719572+0000","last_peered":"2024-04-14T23:34:44.719572+0000","last_clean":"2024-04-14T23:34:44.719572+0000","last_became_active":"2024-04-14T23:34:42.732985+0000","last_became_peered":"2024-04-14T23:34:42.732985+0000","last_unstale":"2024-04-14T23:34:44.719572+0000","last_undegraded":"2024-04-14T23:34:44.719572+0000","last_fullsized":"2024-04-14T23:34:44.719572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:37:34.006119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311955+0000","last_change":"2024-04-14T23:34:38.710119+0000","last_active":"2024-04-14T23:34:46.311955+0000","last_peered":"2024-04-14T23:34:46.311955+0000","last_clean":"2024-04-14T23:34:46.311955+0000","last_became_active":"2024-04-14T23:34:38.709833+0000","last_became_peered":"2024-04-14T23:34:38.709833+0000","last_unstale":"2024-04-14T23:34:46.311955+0000","last_undegraded":"2024-04-14T23:34:46.311955+0000","last_fullsized":"2024-04-14T23:34:46.311955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:54:47.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720394+0000","last_change":"2024-04-14T23:34:37.707534+0000","last_active":"2024-04-14T23:34:44.720394+0000","last_peered":"2024-04-14T23:34:44.720394+0000","last_clean":"2024-04-14T23:34:44.720394+0000","last_became_active":"2024-04-14T23:34:37.707213+0000","last_became_peered":"2024-04-14T23:34:37.707213+0000","last_unstale":"2024-04-14T23:34:44.720394+0000","last_undegraded":"2024-04-14T23:34:44.720394+0000","last_fullsized":"2024-04-14T23:34:44.720394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:02:03.235663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718138+0000","last_change":"2024-04-14T23:34:42.728861+0000","last_active":"2024-04-14T23:34:44.718138+0000","last_peered":"2024-04-14T23:34:44.718138+0000","last_clean":"2024-04-14T23:34:44.718138+0000","last_became_active":"2024-04-14T23:34:42.727257+0000","last_became_peered":"2024-04-14T23:34:42.727257+0000","last_unstale":"2024-04-14T23:34:44.718138+0000","last_undegraded":"2024-04-14T23:34:44.718138+0000","last_fullsized":"2024-04-14T23:34:44.718138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:50:08.796670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720295+0000","last_change":"2024-04-14T23:34:38.701821+0000","last_active":"2024-04-14T23:34:44.720295+0000","last_peered":"2024-04-14T23:34:44.720295+0000","last_clean":"2024-04-14T23:34:44.720295+0000","last_became_active":"2024-04-14T23:34:38.701530+0000","last_became_peered":"2024-04-14T23:34:38.701530+0000","last_unstale":"2024-04-14T23:34:44.720295+0000","last_undegraded":"2024-04-14T23:34:44.720295+0000","last_fullsized":"2024-04-14T23:34:44.720295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:34:09.647113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516783+0000","last_change":"2024-04-14T23:34:37.703952+0000","last_active":"2024-04-14T23:34:46.516783+0000","last_peered":"2024-04-14T23:34:46.516783+0000","last_clean":"2024-04-14T23:34:46.516783+0000","last_became_active":"2024-04-14T23:34:37.703622+0000","last_became_peered":"2024-04-14T23:34:37.703622+0000","last_unstale":"2024-04-14T23:34:46.516783+0000","last_undegraded":"2024-04-14T23:34:46.516783+0000","last_fullsized":"2024-04-14T23:34:46.516783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:29.023280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718062+0000","last_change":"2024-04-14T23:34:43.190499+0000","last_active":"2024-04-14T23:34:44.718062+0000","last_peered":"2024-04-14T23:34:44.718062+0000","last_clean":"2024-04-14T23:34:44.718062+0000","last_became_active":"2024-04-14T23:34:43.190120+0000","last_became_peered":"2024-04-14T23:34:43.190120+0000","last_unstale":"2024-04-14T23:34:44.718062+0000","last_undegraded":"2024-04-14T23:34:44.718062+0000","last_fullsized":"2024-04-14T23:34:44.718062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:07:43.950068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311856+0000","last_change":"2024-04-14T23:34:43.188434+0000","last_active":"2024-04-14T23:34:46.311856+0000","last_peered":"2024-04-14T23:34:46.311856+0000","last_clean":"2024-04-14T23:34:46.311856+0000","last_became_active":"2024-04-14T23:34:43.188069+0000","last_became_peered":"2024-04-14T23:34:43.188069+0000","last_unstale":"2024-04-14T23:34:46.311856+0000","last_undegraded":"2024-04-14T23:34:46.311856+0000","last_fullsized":"2024-04-14T23:34:46.311856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:50:07.095321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318672+0000","last_change":"2024-04-14T23:34:38.713042+0000","last_active":"2024-04-14T23:34:46.318672+0000","last_peered":"2024-04-14T23:34:46.318672+0000","last_clean":"2024-04-14T23:34:46.318672+0000","last_became_active":"2024-04-14T23:34:38.712746+0000","last_became_peered":"2024-04-14T23:34:38.712746+0000","last_unstale":"2024-04-14T23:34:46.318672+0000","last_undegraded":"2024-04-14T23:34:46.318672+0000","last_fullsized":"2024-04-14T23:34:46.318672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:27:36.965696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719390+0000","last_change":"2024-04-14T23:34:37.709449+0000","last_active":"2024-04-14T23:34:44.719390+0000","last_peered":"2024-04-14T23:34:44.719390+0000","last_clean":"2024-04-14T23:34:44.719390+0000","last_became_active":"2024-04-14T23:34:37.709153+0000","last_became_peered":"2024-04-14T23:34:37.709153+0000","last_unstale":"2024-04-14T23:34:44.719390+0000","last_undegraded":"2024-04-14T23:34:44.719390+0000","last_fullsized":"2024-04-14T23:34:44.719390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:53:29.023280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517519+0000","last_change":"2024-04-14T23:34:42.734788+0000","last_active":"2024-04-14T23:34:46.517519+0000","last_peered":"2024-04-14T23:34:46.517519+0000","last_clean":"2024-04-14T23:34:46.517519+0000","last_became_active":"2024-04-14T23:34:42.734397+0000","last_became_peered":"2024-04-14T23:34:42.734397+0000","last_unstale":"2024-04-14T23:34:46.517519+0000","last_undegraded":"2024-04-14T23:34:46.517519+0000","last_fullsized":"2024-04-14T23:34:46.517519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:17.874980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718120+0000","last_change":"2024-04-14T23:34:38.713504+0000","last_active":"2024-04-14T23:34:44.718120+0000","last_peered":"2024-04-14T23:34:44.718120+0000","last_clean":"2024-04-14T23:34:44.718120+0000","last_became_active":"2024-04-14T23:34:38.712325+0000","last_became_peered":"2024-04-14T23:34:38.712325+0000","last_unstale":"2024-04-14T23:34:44.718120+0000","last_undegraded":"2024-04-14T23:34:44.718120+0000","last_fullsized":"2024-04-14T23:34:44.718120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:54:47.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718225+0000","last_change":"2024-04-14T23:34:37.711477+0000","last_active":"2024-04-14T23:34:44.718225+0000","last_peered":"2024-04-14T23:34:44.718225+0000","last_clean":"2024-04-14T23:34:44.718225+0000","last_became_active":"2024-04-14T23:34:37.710472+0000","last_became_peered":"2024-04-14T23:34:37.710472+0000","last_unstale":"2024-04-14T23:34:44.718225+0000","last_undegraded":"2024-04-14T23:34:44.718225+0000","last_fullsized":"2024-04-14T23:34:44.718225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:59:31.580365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516590+0000","last_change":"2024-04-14T23:34:37.700380+0000","last_active":"2024-04-14T23:34:46.516590+0000","last_peered":"2024-04-14T23:34:46.516590+0000","last_clean":"2024-04-14T23:34:46.516590+0000","last_became_active":"2024-04-14T23:34:37.699846+0000","last_became_peered":"2024-04-14T23:34:37.699846+0000","last_unstale":"2024-04-14T23:34:46.516590+0000","last_undegraded":"2024-04-14T23:34:46.516590+0000","last_fullsized":"2024-04-14T23:34:46.516590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:18:40.942344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311821+0000","last_change":"2024-04-14T23:34:38.701104+0000","last_active":"2024-04-14T23:34:46.311821+0000","last_peered":"2024-04-14T23:34:46.311821+0000","last_clean":"2024-04-14T23:34:46.311821+0000","last_became_active":"2024-04-14T23:34:38.700816+0000","last_became_peered":"2024-04-14T23:34:38.700816+0000","last_unstale":"2024-04-14T23:34:46.311821+0000","last_undegraded":"2024-04-14T23:34:46.311821+0000","last_fullsized":"2024-04-14T23:34:46.311821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806426+0000","last_change":"2024-04-14T23:34:42.729961+0000","last_active":"2024-04-14T23:34:45.806426+0000","last_peered":"2024-04-14T23:34:45.806426+0000","last_clean":"2024-04-14T23:34:45.806426+0000","last_became_active":"2024-04-14T23:34:42.729584+0000","last_became_peered":"2024-04-14T23:34:42.729584+0000","last_unstale":"2024-04-14T23:34:45.806426+0000","last_undegraded":"2024-04-14T23:34:45.806426+0000","last_fullsized":"2024-04-14T23:34:45.806426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:32:37.135066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718411+0000","last_change":"2024-04-14T23:34:37.711324+0000","last_active":"2024-04-14T23:34:44.718411+0000","last_peered":"2024-04-14T23:34:44.718411+0000","last_clean":"2024-04-14T23:34:44.718411+0000","last_became_active":"2024-04-14T23:34:37.710354+0000","last_became_peered":"2024-04-14T23:34:37.710354+0000","last_unstale":"2024-04-14T23:34:44.718411+0000","last_undegraded":"2024-04-14T23:34:44.718411+0000","last_fullsized":"2024-04-14T23:34:44.718411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:36.679635+0000","last_clean_scrub_stamp":"2024-04-14T23:34:36.679635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:51:11.382828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719474+0000","last_change":"2024-04-14T23:34:38.708836+0000","last_active":"2024-04-14T23:34:44.719474+0000","last_peered":"2024-04-14T23:34:44.719474+0000","last_clean":"2024-04-14T23:34:44.719474+0000","last_became_active":"2024-04-14T23:34:38.708569+0000","last_became_peered":"2024-04-14T23:34:38.708569+0000","last_unstale":"2024-04-14T23:34:44.719474+0000","last_undegraded":"2024-04-14T23:34:44.719474+0000","last_fullsized":"2024-04-14T23:34:44.719474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:53.031298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718647+0000","last_change":"2024-04-14T23:34:42.729168+0000","last_active":"2024-04-14T23:34:44.718647+0000","last_peered":"2024-04-14T23:34:44.718647+0000","last_clean":"2024-04-14T23:34:44.718647+0000","last_became_active":"2024-04-14T23:34:42.727494+0000","last_became_peered":"2024-04-14T23:34:42.727494+0000","last_unstale":"2024-04-14T23:34:44.718647+0000","last_undegraded":"2024-04-14T23:34:44.718647+0000","last_fullsized":"2024-04-14T23:34:44.718647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:41.706239+0000","last_clean_scrub_stamp":"2024-04-14T23:34:41.706239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:25:19.108275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.516920+0000","last_change":"2024-04-14T23:34:38.714071+0000","last_active":"2024-04-14T23:34:46.516920+0000","last_peered":"2024-04-14T23:34:46.516920+0000","last_clean":"2024-04-14T23:34:46.516920+0000","last_became_active":"2024-04-14T23:34:38.713792+0000","last_became_peered":"2024-04-14T23:34:38.713792+0000","last_unstale":"2024-04-14T23:34:46.516920+0000","last_undegraded":"2024-04-14T23:34:46.516920+0000","last_fullsized":"2024-04-14T23:34:46.516920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:54:47.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806380+0000","last_change":"2024-04-14T23:34:38.710636+0000","last_active":"2024-04-14T23:34:45.806380+0000","last_peered":"2024-04-14T23:34:45.806380+0000","last_clean":"2024-04-14T23:34:45.806380+0000","last_became_active":"2024-04-14T23:34:38.710137+0000","last_became_peered":"2024-04-14T23:34:38.710137+0000","last_unstale":"2024-04-14T23:34:45.806380+0000","last_undegraded":"2024-04-14T23:34:45.806380+0000","last_fullsized":"2024-04-14T23:34:45.806380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:53.031298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719973+0000","last_change":"2024-04-14T23:34:38.712090+0000","last_active":"2024-04-14T23:34:44.719973+0000","last_peered":"2024-04-14T23:34:44.719973+0000","last_clean":"2024-04-14T23:34:44.719973+0000","last_became_active":"2024-04-14T23:34:38.711774+0000","last_became_peered":"2024-04-14T23:34:38.711774+0000","last_unstale":"2024-04-14T23:34:44.719973+0000","last_undegraded":"2024-04-14T23:34:44.719973+0000","last_fullsized":"2024-04-14T23:34:44.719973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:08:52.379294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311741+0000","last_change":"2024-04-14T23:34:38.710874+0000","last_active":"2024-04-14T23:34:46.311741+0000","last_peered":"2024-04-14T23:34:46.311741+0000","last_clean":"2024-04-14T23:34:46.311741+0000","last_became_active":"2024-04-14T23:34:38.710573+0000","last_became_peered":"2024-04-14T23:34:38.710573+0000","last_unstale":"2024-04-14T23:34:46.311741+0000","last_undegraded":"2024-04-14T23:34:46.311741+0000","last_fullsized":"2024-04-14T23:34:46.311741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:40.949590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718481+0000","last_change":"2024-04-14T23:34:38.712171+0000","last_active":"2024-04-14T23:34:44.718481+0000","last_peered":"2024-04-14T23:34:44.718481+0000","last_clean":"2024-04-14T23:34:44.718481+0000","last_became_active":"2024-04-14T23:34:38.711789+0000","last_became_peered":"2024-04-14T23:34:38.711789+0000","last_unstale":"2024-04-14T23:34:44.718481+0000","last_undegraded":"2024-04-14T23:34:44.718481+0000","last_fullsized":"2024-04-14T23:34:44.718481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:32:05.285392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319127+0000","last_change":"2024-04-14T23:34:38.717810+0000","last_active":"2024-04-14T23:34:46.319127+0000","last_peered":"2024-04-14T23:34:46.319127+0000","last_clean":"2024-04-14T23:34:46.319127+0000","last_became_active":"2024-04-14T23:34:38.717398+0000","last_became_peered":"2024-04-14T23:34:38.717398+0000","last_unstale":"2024-04-14T23:34:46.319127+0000","last_undegraded":"2024-04-14T23:34:46.319127+0000","last_fullsized":"2024-04-14T23:34:46.319127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517638+0000","last_change":"2024-04-14T23:34:38.714157+0000","last_active":"2024-04-14T23:34:46.517638+0000","last_peered":"2024-04-14T23:34:46.517638+0000","last_clean":"2024-04-14T23:34:46.517638+0000","last_became_active":"2024-04-14T23:34:38.712289+0000","last_became_peered":"2024-04-14T23:34:38.712289+0000","last_unstale":"2024-04-14T23:34:46.517638+0000","last_undegraded":"2024-04-14T23:34:46.517638+0000","last_fullsized":"2024-04-14T23:34:46.517638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:44.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718791+0000","last_change":"2024-04-14T23:34:38.711729+0000","last_active":"2024-04-14T23:34:44.718791+0000","last_peered":"2024-04-14T23:34:44.718791+0000","last_clean":"2024-04-14T23:34:44.718791+0000","last_became_active":"2024-04-14T23:34:38.711429+0000","last_became_peered":"2024-04-14T23:34:38.711429+0000","last_unstale":"2024-04-14T23:34:44.718791+0000","last_undegraded":"2024-04-14T23:34:44.718791+0000","last_fullsized":"2024-04-14T23:34:44.718791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719293+0000","last_change":"2024-04-14T23:34:38.715491+0000","last_active":"2024-04-14T23:34:44.719293+0000","last_peered":"2024-04-14T23:34:44.719293+0000","last_clean":"2024-04-14T23:34:44.719293+0000","last_became_active":"2024-04-14T23:34:38.714292+0000","last_became_peered":"2024-04-14T23:34:38.714292+0000","last_unstale":"2024-04-14T23:34:44.719293+0000","last_undegraded":"2024-04-14T23:34:44.719293+0000","last_fullsized":"2024-04-14T23:34:44.719293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:09:47.574841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718114+0000","last_change":"2024-04-14T23:34:38.709908+0000","last_active":"2024-04-14T23:34:44.718114+0000","last_peered":"2024-04-14T23:34:44.718114+0000","last_clean":"2024-04-14T23:34:44.718114+0000","last_became_active":"2024-04-14T23:34:38.709563+0000","last_became_peered":"2024-04-14T23:34:38.709563+0000","last_unstale":"2024-04-14T23:34:44.718114+0000","last_undegraded":"2024-04-14T23:34:44.718114+0000","last_fullsized":"2024-04-14T23:34:44.718114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719868+0000","last_change":"2024-04-14T23:34:38.708460+0000","last_active":"2024-04-14T23:34:44.719868+0000","last_peered":"2024-04-14T23:34:44.719868+0000","last_clean":"2024-04-14T23:34:44.719868+0000","last_became_active":"2024-04-14T23:34:38.707437+0000","last_became_peered":"2024-04-14T23:34:38.707437+0000","last_unstale":"2024-04-14T23:34:44.719868+0000","last_undegraded":"2024-04-14T23:34:44.719868+0000","last_fullsized":"2024-04-14T23:34:44.719868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:57:26.195919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311644+0000","last_change":"2024-04-14T23:34:38.702841+0000","last_active":"2024-04-14T23:34:46.311644+0000","last_peered":"2024-04-14T23:34:46.311644+0000","last_clean":"2024-04-14T23:34:46.311644+0000","last_became_active":"2024-04-14T23:34:38.702527+0000","last_became_peered":"2024-04-14T23:34:38.702527+0000","last_unstale":"2024-04-14T23:34:46.311644+0000","last_undegraded":"2024-04-14T23:34:46.311644+0000","last_fullsized":"2024-04-14T23:34:46.311644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:42:16.828722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517386+0000","last_change":"2024-04-14T23:34:38.714356+0000","last_active":"2024-04-14T23:34:46.517386+0000","last_peered":"2024-04-14T23:34:46.517386+0000","last_clean":"2024-04-14T23:34:46.517386+0000","last_became_active":"2024-04-14T23:34:38.713937+0000","last_became_peered":"2024-04-14T23:34:38.713937+0000","last_unstale":"2024-04-14T23:34:46.517386+0000","last_undegraded":"2024-04-14T23:34:46.517386+0000","last_fullsized":"2024-04-14T23:34:46.517386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:40.949590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136593+0000","last_change":"2024-04-14T23:34:38.711688+0000","last_active":"2024-04-14T23:34:45.136593+0000","last_peered":"2024-04-14T23:34:45.136593+0000","last_clean":"2024-04-14T23:34:45.136593+0000","last_became_active":"2024-04-14T23:34:38.711428+0000","last_became_peered":"2024-04-14T23:34:38.711428+0000","last_unstale":"2024-04-14T23:34:45.136593+0000","last_undegraded":"2024-04-14T23:34:45.136593+0000","last_fullsized":"2024-04-14T23:34:45.136593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:13.852728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.806712+0000","last_change":"2024-04-14T23:34:38.715113+0000","last_active":"2024-04-14T23:34:45.806712+0000","last_peered":"2024-04-14T23:34:45.806712+0000","last_clean":"2024-04-14T23:34:45.806712+0000","last_became_active":"2024-04-14T23:34:38.714814+0000","last_became_peered":"2024-04-14T23:34:38.714814+0000","last_unstale":"2024-04-14T23:34:45.806712+0000","last_undegraded":"2024-04-14T23:34:45.806712+0000","last_fullsized":"2024-04-14T23:34:45.806712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:03:18.131006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720712+0000","last_change":"2024-04-14T23:34:38.704287+0000","last_active":"2024-04-14T23:34:44.720712+0000","last_peered":"2024-04-14T23:34:44.720712+0000","last_clean":"2024-04-14T23:34:44.720712+0000","last_became_active":"2024-04-14T23:34:38.702165+0000","last_became_peered":"2024-04-14T23:34:38.702165+0000","last_unstale":"2024-04-14T23:34:44.720712+0000","last_undegraded":"2024-04-14T23:34:44.720712+0000","last_fullsized":"2024-04-14T23:34:44.720712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:24.107167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719179+0000","last_change":"2024-04-14T23:34:38.706857+0000","last_active":"2024-04-14T23:34:44.719179+0000","last_peered":"2024-04-14T23:34:44.719179+0000","last_clean":"2024-04-14T23:34:44.719179+0000","last_became_active":"2024-04-14T23:34:38.705253+0000","last_became_peered":"2024-04-14T23:34:38.705253+0000","last_unstale":"2024-04-14T23:34:44.719179+0000","last_undegraded":"2024-04-14T23:34:44.719179+0000","last_fullsized":"2024-04-14T23:34:44.719179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:48:44.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.318744+0000","last_change":"2024-04-14T23:34:38.711823+0000","last_active":"2024-04-14T23:34:46.318744+0000","last_peered":"2024-04-14T23:34:46.318744+0000","last_clean":"2024-04-14T23:34:46.318744+0000","last_became_active":"2024-04-14T23:34:38.711530+0000","last_became_peered":"2024-04-14T23:34:38.711530+0000","last_unstale":"2024-04-14T23:34:46.318744+0000","last_undegraded":"2024-04-14T23:34:46.318744+0000","last_fullsized":"2024-04-14T23:34:46.318744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:40.949590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311653+0000","last_change":"2024-04-14T23:34:38.705635+0000","last_active":"2024-04-14T23:34:46.311653+0000","last_peered":"2024-04-14T23:34:46.311653+0000","last_clean":"2024-04-14T23:34:46.311653+0000","last_became_active":"2024-04-14T23:34:38.705086+0000","last_became_peered":"2024-04-14T23:34:38.705086+0000","last_unstale":"2024-04-14T23:34:46.311653+0000","last_undegraded":"2024-04-14T23:34:46.311653+0000","last_fullsized":"2024-04-14T23:34:46.311653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:15:01.190987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.718240+0000","last_change":"2024-04-14T23:34:38.710758+0000","last_active":"2024-04-14T23:34:44.718240+0000","last_peered":"2024-04-14T23:34:44.718240+0000","last_clean":"2024-04-14T23:34:44.718240+0000","last_became_active":"2024-04-14T23:34:38.710484+0000","last_became_peered":"2024-04-14T23:34:38.710484+0000","last_unstale":"2024-04-14T23:34:44.718240+0000","last_undegraded":"2024-04-14T23:34:44.718240+0000","last_fullsized":"2024-04-14T23:34:44.718240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:34:09.647113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720314+0000","last_change":"2024-04-14T23:34:38.711759+0000","last_active":"2024-04-14T23:34:44.720314+0000","last_peered":"2024-04-14T23:34:44.720314+0000","last_clean":"2024-04-14T23:34:44.720314+0000","last_became_active":"2024-04-14T23:34:38.711469+0000","last_became_peered":"2024-04-14T23:34:38.711469+0000","last_unstale":"2024-04-14T23:34:44.720314+0000","last_undegraded":"2024-04-14T23:34:44.720314+0000","last_fullsized":"2024-04-14T23:34:44.720314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:03:18.131006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517344+0000","last_change":"2024-04-14T23:34:38.710480+0000","last_active":"2024-04-14T23:34:46.517344+0000","last_peered":"2024-04-14T23:34:46.517344+0000","last_clean":"2024-04-14T23:34:46.517344+0000","last_became_active":"2024-04-14T23:34:38.710218+0000","last_became_peered":"2024-04-14T23:34:38.710218+0000","last_unstale":"2024-04-14T23:34:46.517344+0000","last_undegraded":"2024-04-14T23:34:46.517344+0000","last_fullsized":"2024-04-14T23:34:46.517344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:52:12.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.517559+0000","last_change":"2024-04-14T23:34:38.713659+0000","last_active":"2024-04-14T23:34:46.517559+0000","last_peered":"2024-04-14T23:34:46.517559+0000","last_clean":"2024-04-14T23:34:46.517559+0000","last_became_active":"2024-04-14T23:34:38.713281+0000","last_became_peered":"2024-04-14T23:34:38.713281+0000","last_unstale":"2024-04-14T23:34:46.517559+0000","last_undegraded":"2024-04-14T23:34:46.517559+0000","last_fullsized":"2024-04-14T23:34:46.517559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136762+0000","last_change":"2024-04-14T23:34:38.713274+0000","last_active":"2024-04-14T23:34:45.136762+0000","last_peered":"2024-04-14T23:34:45.136762+0000","last_clean":"2024-04-14T23:34:45.136762+0000","last_became_active":"2024-04-14T23:34:38.711274+0000","last_became_peered":"2024-04-14T23:34:38.711274+0000","last_unstale":"2024-04-14T23:34:45.136762+0000","last_undegraded":"2024-04-14T23:34:45.136762+0000","last_fullsized":"2024-04-14T23:34:45.136762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:05:58.810380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.717969+0000","last_change":"2024-04-14T23:34:38.708235+0000","last_active":"2024-04-14T23:34:44.717969+0000","last_peered":"2024-04-14T23:34:44.717969+0000","last_clean":"2024-04-14T23:34:44.717969+0000","last_became_active":"2024-04-14T23:34:38.707779+0000","last_became_peered":"2024-04-14T23:34:38.707779+0000","last_unstale":"2024-04-14T23:34:44.717969+0000","last_undegraded":"2024-04-14T23:34:44.717969+0000","last_fullsized":"2024-04-14T23:34:44.717969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:09:45.484768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136144+0000","last_change":"2024-04-14T23:34:38.713218+0000","last_active":"2024-04-14T23:34:45.136144+0000","last_peered":"2024-04-14T23:34:45.136144+0000","last_clean":"2024-04-14T23:34:45.136144+0000","last_became_active":"2024-04-14T23:34:38.712930+0000","last_became_peered":"2024-04-14T23:34:38.712930+0000","last_unstale":"2024-04-14T23:34:45.136144+0000","last_undegraded":"2024-04-14T23:34:45.136144+0000","last_fullsized":"2024-04-14T23:34:45.136144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:32:05.285392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.719753+0000","last_change":"2024-04-14T23:34:38.710158+0000","last_active":"2024-04-14T23:34:44.719753+0000","last_peered":"2024-04-14T23:34:44.719753+0000","last_clean":"2024-04-14T23:34:44.719753+0000","last_became_active":"2024-04-14T23:34:38.709903+0000","last_became_peered":"2024-04-14T23:34:38.709903+0000","last_unstale":"2024-04-14T23:34:44.719753+0000","last_undegraded":"2024-04-14T23:34:44.719753+0000","last_fullsized":"2024-04-14T23:34:44.719753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:32:05.285392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136196+0000","last_change":"2024-04-14T23:34:38.710654+0000","last_active":"2024-04-14T23:34:45.136196+0000","last_peered":"2024-04-14T23:34:45.136196+0000","last_clean":"2024-04-14T23:34:45.136196+0000","last_became_active":"2024-04-14T23:34:38.710267+0000","last_became_peered":"2024-04-14T23:34:38.710267+0000","last_unstale":"2024-04-14T23:34:45.136196+0000","last_undegraded":"2024-04-14T23:34:45.136196+0000","last_fullsized":"2024-04-14T23:34:45.136196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:22.876283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:44.720393+0000","last_change":"2024-04-14T23:34:38.715159+0000","last_active":"2024-04-14T23:34:44.720393+0000","last_peered":"2024-04-14T23:34:44.720393+0000","last_clean":"2024-04-14T23:34:44.720393+0000","last_became_active":"2024-04-14T23:34:38.714918+0000","last_became_peered":"2024-04-14T23:34:38.714918+0000","last_unstale":"2024-04-14T23:34:44.720393+0000","last_undegraded":"2024-04-14T23:34:44.720393+0000","last_fullsized":"2024-04-14T23:34:44.720393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:19:41.725777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.311726+0000","last_change":"2024-04-14T23:34:38.707456+0000","last_active":"2024-04-14T23:34:46.311726+0000","last_peered":"2024-04-14T23:34:46.311726+0000","last_clean":"2024-04-14T23:34:46.311726+0000","last_became_active":"2024-04-14T23:34:38.707143+0000","last_became_peered":"2024-04-14T23:34:38.707143+0000","last_unstale":"2024-04-14T23:34:46.311726+0000","last_undegraded":"2024-04-14T23:34:46.311726+0000","last_fullsized":"2024-04-14T23:34:46.311726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:27:36.965696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:46.319134+0000","last_change":"2024-04-14T23:34:38.714188+0000","last_active":"2024-04-14T23:34:46.319134+0000","last_peered":"2024-04-14T23:34:46.319134+0000","last_clean":"2024-04-14T23:34:46.319134+0000","last_became_active":"2024-04-14T23:34:38.713845+0000","last_became_peered":"2024-04-14T23:34:38.713845+0000","last_unstale":"2024-04-14T23:34:46.319134+0000","last_undegraded":"2024-04-14T23:34:46.319134+0000","last_fullsized":"2024-04-14T23:34:46.319134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:01:32.621907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T23:34:45.136688+0000","last_change":"2024-04-14T23:34:38.716139+0000","last_active":"2024-04-14T23:34:45.136688+0000","last_peered":"2024-04-14T23:34:45.136688+0000","last_clean":"2024-04-14T23:34:45.136688+0000","last_became_active":"2024-04-14T23:34:38.715878+0000","last_became_peered":"2024-04-14T23:34:38.715878+0000","last_unstale":"2024-04-14T23:34:45.136688+0000","last_undegraded":"2024-04-14T23:34:45.136688+0000","last_fullsized":"2024-04-14T23:34:45.136688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:37.683987+0000","last_clean_scrub_stamp":"2024-04-14T23:34:37.683987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:49:24.107167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T23:35:00.509 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-14T23:35:00.509 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-14T23:35:00.509 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-14T23:35:00.510 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-14T23:35:00.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.642+0000 7f79bac29640 1 Processor -- start 2024-04-14T23:35:00.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.643+0000 7f79bac29640 1 -- start start 2024-04-14T23:35:00.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.643+0000 7f79bac29640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f79b415e270 0x7f79b40d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.643+0000 7f79bac29640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b40d1e00 0x7f79b40d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.643+0000 7f79bac29640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79b40b57a0 con 0x7f79b40d1450 2024-04-14T23:35:00.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.643+0000 7f79bac29640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f79b40b4300 con 0x7f79b415e270 2024-04-14T23:35:00.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.643+0000 7f79bac29640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f79b40b39d0 con 0x7f79b40d1e00 2024-04-14T23:35:00.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.644+0000 7f79b89c5640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f79b415e270 0x7f79b40d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.644+0000 7f79b3fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b40d1e00 0x7f79b40d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.644+0000 7f79b3fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b40d1e00 0x7f79b40d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:58522/0 (socket says 172.21.15.47:58522) 2024-04-14T23:35:00.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.644+0000 7f79b89c5640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f79b415e270 0x7f79b40d0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:35810/0 (socket says 172.21.15.47:35810) 2024-04-14T23:35:00.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.644+0000 7f79b3fff640 1 -- 172.21.15.47:0/2965683161 learned_addr learned my addr 172.21.15.47:0/2965683161 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:00.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.644+0000 7f79b89c5640 1 -- 172.21.15.47:0/2965683161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b40d1e00 msgr2=0x7f79b40d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:00.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.644+0000 7f79b89c5640 1 --2- 172.21.15.47:0/2965683161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b40d1e00 0x7f79b40d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.644+0000 7f79b89c5640 1 -- 172.21.15.47:0/2965683161 >> v1:172.21.15.191:6789/0 conn(0x7f79b40d1450 legacy=0x7f79b40ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.644+0000 7f79b89c5640 1 -- 172.21.15.47:0/2965683161 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b40b3cb0 con 0x7f79b415e270 2024-04-14T23:35:00.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.644+0000 7f79b3fff640 1 --2- 172.21.15.47:0/2965683161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b40d1e00 0x7f79b40d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.645+0000 7f79b89c5640 1 --2- 172.21.15.47:0/2965683161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79b415e270 0x7f79b40d0f10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009d90 tx=0x7f79ac02bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7827bd8111ac1fc server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.645+0000 7f79b37fe640 1 -- 172.21.15.47:0/2965683161 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ac039070 con 0x7f79b415e270 2024-04-14T23:35:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.645+0000 7f79b37fe640 1 -- 172.21.15.47:0/2965683161 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79ac02cce0 con 0x7f79b415e270 2024-04-14T23:35:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.645+0000 7f79b37fe640 1 -- 172.21.15.47:0/2965683161 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ac034660 con 0x7f79b415e270 2024-04-14T23:35:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.645+0000 7f79bac29640 1 -- 172.21.15.47:0/2965683161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79b415e270 msgr2=0x7f79b40d0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.645+0000 7f79bac29640 1 --2- 172.21.15.47:0/2965683161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79b415e270 0x7f79b40d0f10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009d90 tx=0x7f79ac02bf30 comp rx=0 tx=0).stop 2024-04-14T23:35:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.645+0000 7f79bac29640 1 -- 172.21.15.47:0/2965683161 shutdown_connections 2024-04-14T23:35:00.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.646+0000 7f79bac29640 1 --2- 172.21.15.47:0/2965683161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b40d1e00 0x7f79b40d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.646+0000 7f79bac29640 1 --2- 172.21.15.47:0/2965683161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79b415e270 0x7f79b40d0f10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.646+0000 7f79bac29640 1 -- 172.21.15.47:0/2965683161 >> 172.21.15.47:0/2965683161 conn(0x7f79b40d3ed0 msgr2=0x7f79b40d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:00.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.646+0000 7f79bac29640 1 -- 172.21.15.47:0/2965683161 shutdown_connections 2024-04-14T23:35:00.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.646+0000 7f79bac29640 1 -- 172.21.15.47:0/2965683161 wait complete. 2024-04-14T23:35:00.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.647+0000 7f79bac29640 1 Processor -- start 2024-04-14T23:35:00.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.647+0000 7f79bac29640 1 -- start start 2024-04-14T23:35:00.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.647+0000 7f79bac29640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79b40d1450 0x7f79b415fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.647+0000 7f79bac29640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79b40d1e00 0x7f79b40cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.647+0000 7f79bac29640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b415e270 0x7f79b40b95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.647+0000 7f79bac29640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f79b415e650 con 0x7f79b40d1e00 2024-04-14T23:35:00.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.647+0000 7f79bac29640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f79b40b0c60 con 0x7f79b40d1450 2024-04-14T23:35:00.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.647+0000 7f79bac29640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f79b415e7d0 con 0x7f79b415e270 2024-04-14T23:35:00.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.648+0000 7f79b3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79b40d1e00 0x7f79b40cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.648+0000 7f79b3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79b40d1e00 0x7f79b40cd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36288/0 (socket says 172.21.15.47:36288) 2024-04-14T23:35:00.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.648+0000 7f79b3fff640 1 -- 172.21.15.47:0/2949285991 learned_addr learned my addr 172.21.15.47:0/2949285991 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:00.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.648+0000 7f79b89c5640 1 --2- 172.21.15.47:0/2949285991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79b40d1450 0x7f79b415fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.648+0000 7f79b91c6640 1 --2- 172.21.15.47:0/2949285991 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b415e270 0x7f79b40b95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.648+0000 7f79b3fff640 1 -- 172.21.15.47:0/2949285991 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b415e270 msgr2=0x7f79b40b95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.648+0000 7f79b3fff640 1 --2- 172.21.15.47:0/2949285991 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b415e270 0x7f79b40b95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.648+0000 7f79b3fff640 1 -- 172.21.15.47:0/2949285991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79b40d1450 msgr2=0x7f79b415fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.648+0000 7f79b3fff640 1 --2- 172.21.15.47:0/2949285991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79b40d1450 0x7f79b415fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.648+0000 7f79b3fff640 1 -- 172.21.15.47:0/2949285991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b40b85c0 con 0x7f79b40d1e00 2024-04-14T23:35:00.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.648+0000 7f79b3fff640 1 --2- 172.21.15.47:0/2949285991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79b40d1e00 0x7f79b40cd380 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f79a400e9d0 tx=0x7f79a400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:00.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.648+0000 7f79b17fa640 1 -- 172.21.15.47:0/2949285991 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a4017070 con 0x7f79b40d1e00 2024-04-14T23:35:00.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.648+0000 7f79b17fa640 1 -- 172.21.15.47:0/2949285991 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a400ca60 con 0x7f79b40d1e00 2024-04-14T23:35:00.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.648+0000 7f79bac29640 1 -- 172.21.15.47:0/2949285991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79b4160210 con 0x7f79b40d1e00 2024-04-14T23:35:00.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.648+0000 7f79b17fa640 1 -- 172.21.15.47:0/2949285991 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a400ce10 con 0x7f79b40d1e00 2024-04-14T23:35:00.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.648+0000 7f79bac29640 1 -- 172.21.15.47:0/2949285991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79b40b8b10 con 0x7f79b40d1e00 2024-04-14T23:35:00.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.649+0000 7f79bac29640 1 -- 172.21.15.47:0/2949285991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79b4075430 con 0x7f79b40d1e00 2024-04-14T23:35:00.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.650+0000 7f79b17fa640 1 -- 172.21.15.47:0/2949285991 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f79a401a070 con 0x7f79b40d1e00 2024-04-14T23:35:00.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.650+0000 7f79b17fa640 1 --2- 172.21.15.47:0/2949285991 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f799406b990 0x7f799406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.650+0000 7f79b17fa640 1 -- 172.21.15.47:0/2949285991 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f79a408ab20 con 0x7f79b40d1e00 2024-04-14T23:35:00.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.650+0000 7f79b89c5640 1 --2- 172.21.15.47:0/2949285991 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f799406b990 0x7f799406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.651+0000 7f79b89c5640 1 --2- 172.21.15.47:0/2949285991 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f799406b990 0x7f799406de50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79ac036000 tx=0x7f79ac030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:00.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.654+0000 7f79b17fa640 1 -- 172.21.15.47:0/2949285991 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f79a40593f0 con 0x7f79b40d1e00 2024-04-14T23:35:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.871+0000 7f79bac29640 1 -- 172.21.15.47:0/2949285991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f79b40cd8c0 con 0x7f79b40d1e00 2024-04-14T23:35:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.872+0000 7f79b17fa640 1 -- 172.21.15.47:0/2949285991 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f79a4058cf0 con 0x7f79b40d1e00 2024-04-14T23:35:00.875 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:00.875 INFO:teuthology.orchestra.run.smithi047.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-14T23:35:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.874+0000 7f79bac29640 1 -- 172.21.15.47:0/2949285991 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f799406b990 msgr2=0x7f799406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.874+0000 7f79bac29640 1 --2- 172.21.15.47:0/2949285991 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f799406b990 0x7f799406de50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79ac036000 tx=0x7f79ac030000 comp rx=0 tx=0).stop 2024-04-14T23:35:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.874+0000 7f79bac29640 1 -- 172.21.15.47:0/2949285991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79b40d1e00 msgr2=0x7f79b40cd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.874+0000 7f79bac29640 1 --2- 172.21.15.47:0/2949285991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79b40d1e00 0x7f79b40cd380 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f79a400e9d0 tx=0x7f79a400ee90 comp rx=0 tx=0).stop 2024-04-14T23:35:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.874+0000 7f79bac29640 1 -- 172.21.15.47:0/2949285991 shutdown_connections 2024-04-14T23:35:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.874+0000 7f79bac29640 1 --2- 172.21.15.47:0/2949285991 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f799406b990 0x7f799406de50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.874+0000 7f79bac29640 1 --2- 172.21.15.47:0/2949285991 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b415e270 0x7f79b40b95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.874+0000 7f79bac29640 1 --2- 172.21.15.47:0/2949285991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f79b40d1e00 0x7f79b40cd380 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.874+0000 7f79bac29640 1 --2- 172.21.15.47:0/2949285991 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79b40d1450 0x7f79b415fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.874+0000 7f79bac29640 1 -- 172.21.15.47:0/2949285991 >> 172.21.15.47:0/2949285991 conn(0x7f79b40d3ed0 msgr2=0x7f79b40cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.874+0000 7f79bac29640 1 -- 172.21.15.47:0/2949285991 shutdown_connections 2024-04-14T23:35:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.874+0000 7f79bac29640 1 -- 172.21.15.47:0/2949285991 wait complete. 2024-04-14T23:35:00.887 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-14T23:35:00.888 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.986+0000 7f5bf0488640 1 Processor -- start 2024-04-14T23:35:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.986+0000 7f5bf0488640 1 -- start start 2024-04-14T23:35:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.987+0000 7f5bf0488640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5be80d1e00 0x7f5be80d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.987+0000 7f5bf0488640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5be80d1620 con 0x7f5be815e270 2024-04-14T23:35:00.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.987+0000 7f5bf0488640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5be80b39d0 con 0x7f5be80d2740 2024-04-14T23:35:00.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.987+0000 7f5bf0488640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5be80d2bb0 con 0x7f5be80d1e00 2024-04-14T23:35:00.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.987+0000 7f5beda23640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5be80d1e00 0x7f5be80d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.987+0000 7f5bee224640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5be815e270 0x7f5be80d0f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55816/0 (socket says 172.21.15.47:55816) 2024-04-14T23:35:00.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.987+0000 7f5bee224640 1 -- 172.21.15.47:0/2149053472 learned_addr learned my addr 172.21.15.47:0/2149053472 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:00.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.988+0000 7f5beda23640 1 -- 172.21.15.47:0/2149053472 >> v1:172.21.15.191:6789/0 conn(0x7f5be80d2740 legacy=0x7f5be80b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.988+0000 7f5beda23640 1 -- 172.21.15.47:0/2149053472 >> v1:172.21.15.47:6789/0 conn(0x7f5be815e270 legacy=0x7f5be80d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.988+0000 7f5bed222640 1 -- 172.21.15.47:0/2149053472 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220885563 0 0) 0x7f5be80d1620 con 0x7f5be815e270 2024-04-14T23:35:00.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.988+0000 7f5beda23640 1 -- 172.21.15.47:0/2149053472 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be80b3cb0 con 0x7f5be80d1e00 2024-04-14T23:35:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.988+0000 7f5beda23640 1 --2- 172.21.15.47:0/2149053472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be80d1e00 0x7f5be80d2200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0097a0 tx=0x7f5bdc02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce23ab35d6f9423 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.989+0000 7f5bed222640 1 -- 172.21.15.47:0/2149053472 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc02f810 con 0x7f5be80d1e00 2024-04-14T23:35:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.989+0000 7f5bed222640 1 -- 172.21.15.47:0/2149053472 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bdc02f9b0 con 0x7f5be80d1e00 2024-04-14T23:35:00.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.989+0000 7f5bed222640 1 -- 172.21.15.47:0/2149053472 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc02fd80 con 0x7f5be80d1e00 2024-04-14T23:35:00.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.989+0000 7f5bf0488640 1 -- 172.21.15.47:0/2149053472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be80d1e00 msgr2=0x7f5be80d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.989+0000 7f5bf0488640 1 --2- 172.21.15.47:0/2149053472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be80d1e00 0x7f5be80d2200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0097a0 tx=0x7f5bdc02b9f0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.989+0000 7f5bf0488640 1 -- 172.21.15.47:0/2149053472 shutdown_connections 2024-04-14T23:35:00.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.989+0000 7f5bf0488640 1 --2- 172.21.15.47:0/2149053472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be80d1e00 0x7f5be80d2200 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.989+0000 7f5bf0488640 1 -- 172.21.15.47:0/2149053472 >> 172.21.15.47:0/2149053472 conn(0x7f5be80d3ed0 msgr2=0x7f5be80d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:00.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.989+0000 7f5bf0488640 1 -- 172.21.15.47:0/2149053472 shutdown_connections 2024-04-14T23:35:00.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.989+0000 7f5bf0488640 1 -- 172.21.15.47:0/2149053472 wait complete. 2024-04-14T23:35:00.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.990+0000 7f5bf0488640 1 Processor -- start 2024-04-14T23:35:00.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.990+0000 7f5bf0488640 1 -- start start 2024-04-14T23:35:00.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.991+0000 7f5bf0488640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5be80d1e00 0x7f5be81533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.991+0000 7f5bf0488640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5be80d2740 0x7f5be80cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.991+0000 7f5bf0488640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be815e270 0x7f5be8160910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.991+0000 7f5bf0488640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5be80b0c60 con 0x7f5be815e270 2024-04-14T23:35:00.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.991+0000 7f5bf0488640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5be80b4300 con 0x7f5be80d1e00 2024-04-14T23:35:00.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.991+0000 7f5bf0488640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5be815e650 con 0x7f5be80d2740 2024-04-14T23:35:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.991+0000 7f5beea25640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be815e270 0x7f5be8160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.991+0000 7f5beea25640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be815e270 0x7f5be8160910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36300/0 (socket says 172.21.15.47:36300) 2024-04-14T23:35:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.991+0000 7f5beea25640 1 -- 172.21.15.47:0/1842753265 learned_addr learned my addr 172.21.15.47:0/1842753265 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.991+0000 7f5beda23640 1 --2- 172.21.15.47:0/1842753265 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5be80d2740 0x7f5be80cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.991+0000 7f5bee224640 1 --2- 172.21.15.47:0/1842753265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5be80d1e00 0x7f5be81533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.991+0000 7f5beea25640 1 -- 172.21.15.47:0/1842753265 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5be80d2740 msgr2=0x7f5be80cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.991+0000 7f5beea25640 1 --2- 172.21.15.47:0/1842753265 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5be80d2740 0x7f5be80cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.991+0000 7f5beea25640 1 -- 172.21.15.47:0/1842753265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5be80d1e00 msgr2=0x7f5be81533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.991+0000 7f5beea25640 1 --2- 172.21.15.47:0/1842753265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5be80d1e00 0x7f5be81533d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.991+0000 7f5beea25640 1 -- 172.21.15.47:0/1842753265 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be80b8910 con 0x7f5be815e270 2024-04-14T23:35:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.992+0000 7f5beda23640 1 --2- 172.21.15.47:0/1842753265 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5be80d2740 0x7f5be80cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.992+0000 7f5bee224640 1 --2- 172.21.15.47:0/1842753265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5be80d1e00 0x7f5be81533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.992+0000 7f5beea25640 1 --2- 172.21.15.47:0/1842753265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be815e270 0x7f5be8160910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800c7a0 tx=0x7f5bd800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.992+0000 7f5be6ffd640 1 -- 172.21.15.47:0/1842753265 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8003b70 con 0x7f5be815e270 2024-04-14T23:35:00.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.992+0000 7f5be6ffd640 1 -- 172.21.15.47:0/1842753265 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd8003d30 con 0x7f5be815e270 2024-04-14T23:35:00.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.992+0000 7f5bf0488640 1 -- 172.21.15.47:0/1842753265 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be80b9140 con 0x7f5be815e270 2024-04-14T23:35:00.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.992+0000 7f5be6ffd640 1 -- 172.21.15.47:0/1842753265 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800aa90 con 0x7f5be815e270 2024-04-14T23:35:00.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.992+0000 7f5bf0488640 1 -- 172.21.15.47:0/1842753265 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be80b8b80 con 0x7f5be815e270 2024-04-14T23:35:00.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.993+0000 7f5bf0488640 1 -- 172.21.15.47:0/1842753265 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be8075430 con 0x7f5be815e270 2024-04-14T23:35:00.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.993+0000 7f5be6ffd640 1 -- 172.21.15.47:0/1842753265 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f5bd800ac30 con 0x7f5be815e270 2024-04-14T23:35:00.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.994+0000 7f5be6ffd640 1 --2- 172.21.15.47:0/1842753265 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5bd406b990 0x7f5bd406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:00.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.994+0000 7f5be6ffd640 1 -- 172.21.15.47:0/1842753265 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5bd808aa60 con 0x7f5be815e270 2024-04-14T23:35:00.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.994+0000 7f5bee224640 1 --2- 172.21.15.47:0/1842753265 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5bd406b990 0x7f5bd406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:00.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.995+0000 7f5bee224640 1 --2- 172.21.15.47:0/1842753265 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5bd406b990 0x7f5bd406de50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5be0007fd0 tx=0x7f5be0007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:01.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:00.998+0000 7f5be6ffd640 1 -- 172.21.15.47:0/1842753265 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5bd80593c0 con 0x7f5be815e270 2024-04-14T23:35:01.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.184+0000 7f5bf0488640 1 -- 172.21.15.47:0/1842753265 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5be806d7b0 con 0x7f5be815e270 2024-04-14T23:35:01.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.185+0000 7f5be6ffd640 1 -- 172.21.15.47:0/1842753265 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7f5bd8058cc0 con 0x7f5be815e270 2024-04-14T23:35:01.188 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:01.189 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:44.714882+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:01.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.187+0000 7f5bf0488640 1 -- 172.21.15.47:0/1842753265 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5bd406b990 msgr2=0x7f5bd406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.187+0000 7f5bf0488640 1 --2- 172.21.15.47:0/1842753265 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5bd406b990 0x7f5bd406de50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5be0007fd0 tx=0x7f5be0007dc0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.187+0000 7f5bf0488640 1 -- 172.21.15.47:0/1842753265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be815e270 msgr2=0x7f5be8160910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.187+0000 7f5bf0488640 1 --2- 172.21.15.47:0/1842753265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be815e270 0x7f5be8160910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800c7a0 tx=0x7f5bd800cc60 comp rx=0 tx=0).stop 2024-04-14T23:35:01.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.188+0000 7f5bf0488640 1 -- 172.21.15.47:0/1842753265 shutdown_connections 2024-04-14T23:35:01.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.188+0000 7f5bf0488640 1 --2- 172.21.15.47:0/1842753265 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5bd406b990 0x7f5bd406de50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.188+0000 7f5bf0488640 1 --2- 172.21.15.47:0/1842753265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be815e270 0x7f5be8160910 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.188+0000 7f5bf0488640 1 --2- 172.21.15.47:0/1842753265 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5be80d2740 0x7f5be80cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.188+0000 7f5bf0488640 1 --2- 172.21.15.47:0/1842753265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5be80d1e00 0x7f5be81533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.188+0000 7f5bf0488640 1 -- 172.21.15.47:0/1842753265 >> 172.21.15.47:0/1842753265 conn(0x7f5be80d3ed0 msgr2=0x7f5be80b4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:01.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.188+0000 7f5bf0488640 1 -- 172.21.15.47:0/1842753265 shutdown_connections 2024-04-14T23:35:01.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.188+0000 7f5bf0488640 1 -- 172.21.15.47:0/1842753265 wait complete. 2024-04-14T23:35:01.201 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T23:34:36.382034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T23:34:37.023103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T23:34:40.726418+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T23:35:01.202 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:35:01.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.303+0000 7fef7999c640 1 Processor -- start 2024-04-14T23:35:01.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.304+0000 7fef7999c640 1 -- start start 2024-04-14T23:35:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.304+0000 7fef7999c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fef740c8410 0x7fef740ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.304+0000 7fef7999c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fef740cdee0 0x7fef740ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.304+0000 7fef7999c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef740d1090 con 0x7fef740d0b40 2024-04-14T23:35:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.304+0000 7fef7999c640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fef740cc3f0 con 0x7fef740c8410 2024-04-14T23:35:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.304+0000 7fef7999c640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fef740cc6d0 con 0x7fef740cdee0 2024-04-14T23:35:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.304+0000 7fef72ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fef740c8410 0x7fef740ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.304+0000 7fef72ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fef740c8410 0x7fef740ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36306/0 (socket says 172.21.15.47:36306) 2024-04-14T23:35:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.304+0000 7fef72ffd640 1 -- 172.21.15.47:0/685072444 learned_addr learned my addr 172.21.15.47:0/685072444 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.304+0000 7fef727fc640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fef740d0b40 0x7fef7406c6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55824/0 (socket says 172.21.15.47:55824) 2024-04-14T23:35:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.305+0000 7fef737fe640 1 --2- 172.21.15.47:0/685072444 >> v2:172.21.15.191:3300/0 conn(0x7fef740cdee0 0x7fef740ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.305+0000 7fef72ffd640 1 -- 172.21.15.47:0/685072444 >> v2:172.21.15.191:3300/0 conn(0x7fef740cdee0 msgr2=0x7fef740ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.305+0000 7fef72ffd640 1 --2- 172.21.15.47:0/685072444 >> v2:172.21.15.191:3300/0 conn(0x7fef740cdee0 0x7fef740ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.305+0000 7fef72ffd640 1 -- 172.21.15.47:0/685072444 >> v1:172.21.15.47:6789/0 conn(0x7fef740d0b40 legacy=0x7fef7406c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.305+0000 7fef72ffd640 1 -- 172.21.15.47:0/685072444 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef740cc9b0 con 0x7fef740c8410 2024-04-14T23:35:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.305+0000 7fef71ffb640 1 -- 172.21.15.47:0/685072444 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098356584 0 0) 0x7fef740d1090 con 0x7fef740d0b40 2024-04-14T23:35:01.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.306+0000 7fef72ffd640 1 --2- 172.21.15.47:0/685072444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef740c8410 0x7fef740ce580 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fef74072820 tx=0x7fef6c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d55c4a67e7782b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:01.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.306+0000 7fef71ffb640 1 -- 172.21.15.47:0/685072444 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c035020 con 0x7fef740c8410 2024-04-14T23:35:01.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.306+0000 7fef71ffb640 1 -- 172.21.15.47:0/685072444 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef6c031870 con 0x7fef740c8410 2024-04-14T23:35:01.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.306+0000 7fef71ffb640 1 -- 172.21.15.47:0/685072444 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c031c40 con 0x7fef740c8410 2024-04-14T23:35:01.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.306+0000 7fef7999c640 1 -- 172.21.15.47:0/685072444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef740c8410 msgr2=0x7fef740ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.306+0000 7fef7999c640 1 --2- 172.21.15.47:0/685072444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef740c8410 0x7fef740ce580 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fef74072820 tx=0x7fef6c02b910 comp rx=0 tx=0).stop 2024-04-14T23:35:01.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.306+0000 7fef7999c640 1 -- 172.21.15.47:0/685072444 shutdown_connections 2024-04-14T23:35:01.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.306+0000 7fef7999c640 1 --2- 172.21.15.47:0/685072444 >> v2:172.21.15.191:3300/0 conn(0x7fef740cdee0 0x7fef740ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.306+0000 7fef7999c640 1 --2- 172.21.15.47:0/685072444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef740c8410 0x7fef740ce580 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.306+0000 7fef7999c640 1 -- 172.21.15.47:0/685072444 >> 172.21.15.47:0/685072444 conn(0x7fef740d1d00 msgr2=0x7fef740d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:01.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.306+0000 7fef7999c640 1 -- 172.21.15.47:0/685072444 shutdown_connections 2024-04-14T23:35:01.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.306+0000 7fef7999c640 1 -- 172.21.15.47:0/685072444 wait complete. 2024-04-14T23:35:01.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.307+0000 7fef7999c640 1 Processor -- start 2024-04-14T23:35:01.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.308+0000 7fef7999c640 1 -- start start 2024-04-14T23:35:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.308+0000 7fef7999c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef740c8410 0x7fef740c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.308+0000 7fef7999c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef740cdee0 0x7fef740cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.308+0000 7fef7999c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef740d0b40 0x7fef741d4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.308+0000 7fef7999c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fef740cf6b0 con 0x7fef740d0b40 2024-04-14T23:35:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.308+0000 7fef7999c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fef740cf530 con 0x7fef740c8410 2024-04-14T23:35:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.308+0000 7fef7999c640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fef740d2820 con 0x7fef740cdee0 2024-04-14T23:35:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.308+0000 7fef737fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef740d0b40 0x7fef741d4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.308+0000 7fef737fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef740d0b40 0x7fef741d4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36310/0 (socket says 172.21.15.47:36310) 2024-04-14T23:35:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.308+0000 7fef737fe640 1 -- 172.21.15.47:0/567683475 learned_addr learned my addr 172.21.15.47:0/567683475 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.308+0000 7fef72ffd640 1 --2- 172.21.15.47:0/567683475 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef740c8410 0x7fef740c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.308+0000 7fef727fc640 1 --2- 172.21.15.47:0/567683475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef740cdee0 0x7fef740cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.309+0000 7fef737fe640 1 -- 172.21.15.47:0/567683475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef740cdee0 msgr2=0x7fef740cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.309+0000 7fef737fe640 1 --2- 172.21.15.47:0/567683475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef740cdee0 0x7fef740cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.309+0000 7fef737fe640 1 -- 172.21.15.47:0/567683475 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef740c8410 msgr2=0x7fef740c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.309+0000 7fef737fe640 1 --2- 172.21.15.47:0/567683475 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef740c8410 0x7fef740c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.309+0000 7fef737fe640 1 -- 172.21.15.47:0/567683475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef741e73f0 con 0x7fef740d0b40 2024-04-14T23:35:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.309+0000 7fef737fe640 1 --2- 172.21.15.47:0/567683475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef740d0b40 0x7fef741d4e20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fef6400cd70 tx=0x7fef6400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.309+0000 7fef6bfff640 1 -- 172.21.15.47:0/567683475 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef64003b90 con 0x7fef740d0b40 2024-04-14T23:35:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.309+0000 7fef6bfff640 1 -- 172.21.15.47:0/567683475 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef64003d30 con 0x7fef740d0b40 2024-04-14T23:35:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.309+0000 7fef7999c640 1 -- 172.21.15.47:0/567683475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef741e76d0 con 0x7fef740d0b40 2024-04-14T23:35:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.309+0000 7fef6bfff640 1 -- 172.21.15.47:0/567683475 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef64004240 con 0x7fef740d0b40 2024-04-14T23:35:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.309+0000 7fef7999c640 1 -- 172.21.15.47:0/567683475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef741e7c90 con 0x7fef740d0b40 2024-04-14T23:35:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.310+0000 7fef7999c640 1 -- 172.21.15.47:0/567683475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef740cdd00 con 0x7fef740d0b40 2024-04-14T23:35:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.310+0000 7fef6bfff640 1 -- 172.21.15.47:0/567683475 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fef640043e0 con 0x7fef740d0b40 2024-04-14T23:35:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.311+0000 7fef6bfff640 1 --2- 172.21.15.47:0/567683475 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fef5406b990 0x7fef5406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.311+0000 7fef6bfff640 1 -- 172.21.15.47:0/567683475 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fef6408b520 con 0x7fef740d0b40 2024-04-14T23:35:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.311+0000 7fef72ffd640 1 --2- 172.21.15.47:0/567683475 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fef5406b990 0x7fef5406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.311+0000 7fef72ffd640 1 --2- 172.21.15.47:0/567683475 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fef5406b990 0x7fef5406de50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fef6c036000 tx=0x7fef6c03c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:01.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.315+0000 7fef6bfff640 1 -- 172.21.15.47:0/567683475 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fef740cdd00 con 0x7fef740d0b40 2024-04-14T23:35:01.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.495+0000 7fef7999c640 1 -- 172.21.15.47:0/567683475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fef74073f50 con 0x7fef740d0b40 2024-04-14T23:35:01.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.495+0000 7fef6bfff640 1 -- 172.21.15.47:0/567683475 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fef640597a0 con 0x7fef740d0b40 2024-04-14T23:35:01.498 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:35:01.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.497+0000 7fef7999c640 1 -- 172.21.15.47:0/567683475 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fef5406b990 msgr2=0x7fef5406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.497+0000 7fef7999c640 1 --2- 172.21.15.47:0/567683475 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fef5406b990 0x7fef5406de50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fef6c036000 tx=0x7fef6c03c040 comp rx=0 tx=0).stop 2024-04-14T23:35:01.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.497+0000 7fef7999c640 1 -- 172.21.15.47:0/567683475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef740d0b40 msgr2=0x7fef741d4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.497+0000 7fef7999c640 1 --2- 172.21.15.47:0/567683475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef740d0b40 0x7fef741d4e20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fef6400cd70 tx=0x7fef6400a660 comp rx=0 tx=0).stop 2024-04-14T23:35:01.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.497+0000 7fef7999c640 1 -- 172.21.15.47:0/567683475 shutdown_connections 2024-04-14T23:35:01.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.497+0000 7fef7999c640 1 --2- 172.21.15.47:0/567683475 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fef5406b990 0x7fef5406de50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.497+0000 7fef7999c640 1 --2- 172.21.15.47:0/567683475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef740d0b40 0x7fef741d4e20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.497+0000 7fef7999c640 1 --2- 172.21.15.47:0/567683475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef740cdee0 0x7fef740cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.497+0000 7fef7999c640 1 --2- 172.21.15.47:0/567683475 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef740c8410 0x7fef740c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.497+0000 7fef7999c640 1 -- 172.21.15.47:0/567683475 >> 172.21.15.47:0/567683475 conn(0x7fef740d1d00 msgr2=0x7fef740ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:01.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.497+0000 7fef7999c640 1 -- 172.21.15.47:0/567683475 shutdown_connections 2024-04-14T23:35:01.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.497+0000 7fef7999c640 1 -- 172.21.15.47:0/567683475 wait complete. 2024-04-14T23:35:01.511 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T23:35:01.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.612+0000 7fdff898c640 1 Processor -- start 2024-04-14T23:35:01.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.612+0000 7fdff898c640 1 -- start start 2024-04-14T23:35:01.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.613+0000 7fdff898c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdff41619b0 0x7fdff40d1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.613+0000 7fdff898c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdff40b2c70 0x7fdff40d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.613+0000 7fdff898c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdff40b0c10 0x7fdff40b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.613+0000 7fdff898c640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fdff40d4cc0 con 0x7fdff40b0c10 2024-04-14T23:35:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.613+0000 7fdff898c640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fdff40d0d80 con 0x7fdff41619b0 2024-04-14T23:35:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.613+0000 7fdff898c640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fdff40d2c00 con 0x7fdff40b2c70 2024-04-14T23:35:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.613+0000 7fdff2d9d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdff40b0c10 0x7fdff40b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.613+0000 7fdff2d9d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdff40b0c10 0x7fdff40b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36318/0 (socket says 172.21.15.47:36318) 2024-04-14T23:35:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.613+0000 7fdff2d9d640 1 -- 172.21.15.47:0/2043230911 learned_addr learned my addr 172.21.15.47:0/2043230911 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.613+0000 7fdff259c640 1 --2- 172.21.15.47:0/2043230911 >> v2:172.21.15.191:3300/0 conn(0x7fdff41619b0 0x7fdff40d1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.613+0000 7fdff1d9b640 1 --2- 172.21.15.47:0/2043230911 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdff40b2c70 0x7fdff40d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.613+0000 7fdff2d9d640 1 -- 172.21.15.47:0/2043230911 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdff40b2c70 msgr2=0x7fdff40d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.613+0000 7fdff2d9d640 1 --2- 172.21.15.47:0/2043230911 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdff40b2c70 0x7fdff40d23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.613+0000 7fdff2d9d640 1 -- 172.21.15.47:0/2043230911 >> v2:172.21.15.191:3300/0 conn(0x7fdff41619b0 msgr2=0x7fdff40d1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.613+0000 7fdff2d9d640 1 --2- 172.21.15.47:0/2043230911 >> v2:172.21.15.191:3300/0 conn(0x7fdff41619b0 0x7fdff40d1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.614+0000 7fdff2d9d640 1 -- 172.21.15.47:0/2043230911 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff40d2ee0 con 0x7fdff40b0c10 2024-04-14T23:35:01.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.614+0000 7fdff2d9d640 1 --2- 172.21.15.47:0/2043230911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff40b0c10 0x7fdff40b10a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdff4068620 tx=0x7fdfe402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda7ca4c0f0923e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:01.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.614+0000 7fdff159a640 1 -- 172.21.15.47:0/2043230911 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe402c9e0 con 0x7fdff40b0c10 2024-04-14T23:35:01.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.614+0000 7fdff159a640 1 -- 172.21.15.47:0/2043230911 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe402cb80 con 0x7fdff40b0c10 2024-04-14T23:35:01.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.614+0000 7fdff159a640 1 -- 172.21.15.47:0/2043230911 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe40343f0 con 0x7fdff40b0c10 2024-04-14T23:35:01.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.615+0000 7fdff898c640 1 -- 172.21.15.47:0/2043230911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff40b0c10 msgr2=0x7fdff40b10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.615+0000 7fdff898c640 1 --2- 172.21.15.47:0/2043230911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff40b0c10 0x7fdff40b10a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdff4068620 tx=0x7fdfe402be40 comp rx=0 tx=0).stop 2024-04-14T23:35:01.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.615+0000 7fdff898c640 1 -- 172.21.15.47:0/2043230911 shutdown_connections 2024-04-14T23:35:01.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.615+0000 7fdff898c640 1 --2- 172.21.15.47:0/2043230911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff40b0c10 0x7fdff40b10a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.615+0000 7fdff898c640 1 --2- 172.21.15.47:0/2043230911 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdff40b2c70 0x7fdff40d23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.615+0000 7fdff898c640 1 --2- 172.21.15.47:0/2043230911 >> v2:172.21.15.191:3300/0 conn(0x7fdff41619b0 0x7fdff40d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.615+0000 7fdff898c640 1 -- 172.21.15.47:0/2043230911 >> 172.21.15.47:0/2043230911 conn(0x7fdff40d3f80 msgr2=0x7fdff40d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:01.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.615+0000 7fdff898c640 1 -- 172.21.15.47:0/2043230911 shutdown_connections 2024-04-14T23:35:01.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.615+0000 7fdff898c640 1 -- 172.21.15.47:0/2043230911 wait complete. 2024-04-14T23:35:01.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.616+0000 7fdff898c640 1 Processor -- start 2024-04-14T23:35:01.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.616+0000 7fdff898c640 1 -- start start 2024-04-14T23:35:01.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff898c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdff40b0c10 0x7fdff41514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff898c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdff40b2c70 0x7fdff409dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff898c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff41619b0 0x7fdff40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff898c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdff40d2900 con 0x7fdff41619b0 2024-04-14T23:35:01.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff898c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdff40d1320 con 0x7fdff40b0c10 2024-04-14T23:35:01.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff898c640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fdff40b15e0 con 0x7fdff40b2c70 2024-04-14T23:35:01.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff41619b0 0x7fdff40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff41619b0 0x7fdff40ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36320/0 (socket says 172.21.15.47:36320) 2024-04-14T23:35:01.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff2d9d640 1 -- 172.21.15.47:0/2984741308 learned_addr learned my addr 172.21.15.47:0/2984741308 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:01.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff1d9b640 1 --2- 172.21.15.47:0/2984741308 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdff40b2c70 0x7fdff409dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff259c640 1 --2- 172.21.15.47:0/2984741308 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdff40b0c10 0x7fdff41514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff2d9d640 1 -- 172.21.15.47:0/2984741308 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdff40b2c70 msgr2=0x7fdff409dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff2d9d640 1 --2- 172.21.15.47:0/2984741308 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdff40b2c70 0x7fdff409dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff2d9d640 1 -- 172.21.15.47:0/2984741308 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdff40b0c10 msgr2=0x7fdff41514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff2d9d640 1 --2- 172.21.15.47:0/2984741308 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdff40b0c10 0x7fdff41514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff2d9d640 1 -- 172.21.15.47:0/2984741308 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff40cb430 con 0x7fdff41619b0 2024-04-14T23:35:01.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.617+0000 7fdff259c640 1 --2- 172.21.15.47:0/2984741308 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdff40b0c10 0x7fdff41514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:01.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.618+0000 7fdff2d9d640 1 --2- 172.21.15.47:0/2984741308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff41619b0 0x7fdff40ccff0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009f40 tx=0x7fdfe4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:01.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.618+0000 7fdfe2ffd640 1 -- 172.21.15.47:0/2984741308 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4043020 con 0x7fdff41619b0 2024-04-14T23:35:01.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.618+0000 7fdfe2ffd640 1 -- 172.21.15.47:0/2984741308 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe403e450 con 0x7fdff41619b0 2024-04-14T23:35:01.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.618+0000 7fdff898c640 1 -- 172.21.15.47:0/2984741308 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff40cb710 con 0x7fdff41619b0 2024-04-14T23:35:01.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.618+0000 7fdfe2ffd640 1 -- 172.21.15.47:0/2984741308 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4009510 con 0x7fdff41619b0 2024-04-14T23:35:01.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.618+0000 7fdff898c640 1 -- 172.21.15.47:0/2984741308 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff409e260 con 0x7fdff41619b0 2024-04-14T23:35:01.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.619+0000 7fdff898c640 1 -- 172.21.15.47:0/2984741308 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff4073f50 con 0x7fdff41619b0 2024-04-14T23:35:01.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.619+0000 7fdfe2ffd640 1 -- 172.21.15.47:0/2984741308 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fdfe4046020 con 0x7fdff41619b0 2024-04-14T23:35:01.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.620+0000 7fdfe2ffd640 1 --2- 172.21.15.47:0/2984741308 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdfd406b9c0 0x7fdfd406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.620+0000 7fdfe2ffd640 1 -- 172.21.15.47:0/2984741308 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdfe40acfe0 con 0x7fdff41619b0 2024-04-14T23:35:01.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.620+0000 7fdff259c640 1 --2- 172.21.15.47:0/2984741308 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdfd406b9c0 0x7fdfd406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.620+0000 7fdff259c640 1 --2- 172.21.15.47:0/2984741308 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdfd406b9c0 0x7fdfd406de80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009a20 tx=0x7fdfec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:01.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.624+0000 7fdfe2ffd640 1 -- 172.21.15.47:0/2984741308 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdfe404d070 con 0x7fdff41619b0 2024-04-14T23:35:01.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.805+0000 7fdff898c640 1 -- 172.21.15.47:0/2984741308 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdff40ce340 con 0x7fdff41619b0 2024-04-14T23:35:01.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.806+0000 7fdfe2ffd640 1 -- 172.21.15.47:0/2984741308 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fdfe407b820 con 0x7fdff41619b0 2024-04-14T23:35:01.809 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:01.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.808+0000 7fdff898c640 1 -- 172.21.15.47:0/2984741308 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdfd406b9c0 msgr2=0x7fdfd406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.808+0000 7fdff898c640 1 --2- 172.21.15.47:0/2984741308 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdfd406b9c0 0x7fdfd406de80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009a20 tx=0x7fdfec008040 comp rx=0 tx=0).stop 2024-04-14T23:35:01.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.808+0000 7fdff898c640 1 -- 172.21.15.47:0/2984741308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff41619b0 msgr2=0x7fdff40ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.808+0000 7fdff898c640 1 --2- 172.21.15.47:0/2984741308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff41619b0 0x7fdff40ccff0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009f40 tx=0x7fdfe4004a40 comp rx=0 tx=0).stop 2024-04-14T23:35:01.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.808+0000 7fdff898c640 1 -- 172.21.15.47:0/2984741308 shutdown_connections 2024-04-14T23:35:01.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.808+0000 7fdff898c640 1 --2- 172.21.15.47:0/2984741308 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdfd406b9c0 0x7fdfd406de80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.808+0000 7fdff898c640 1 --2- 172.21.15.47:0/2984741308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff41619b0 0x7fdff40ccff0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.808+0000 7fdff898c640 1 --2- 172.21.15.47:0/2984741308 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdff40b2c70 0x7fdff409dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.808+0000 7fdff898c640 1 --2- 172.21.15.47:0/2984741308 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdff40b0c10 0x7fdff41514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.808+0000 7fdff898c640 1 -- 172.21.15.47:0/2984741308 >> 172.21.15.47:0/2984741308 conn(0x7fdff40d3f80 msgr2=0x7fdff40b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:01.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.808+0000 7fdff898c640 1 -- 172.21.15.47:0/2984741308 shutdown_connections 2024-04-14T23:35:01.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.808+0000 7fdff898c640 1 -- 172.21.15.47:0/2984741308 wait complete. 2024-04-14T23:35:01.822 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T23:35:01.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.923+0000 7fceeb31e640 1 Processor -- start 2024-04-14T23:35:01.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.924+0000 7fceeb31e640 1 -- start start 2024-04-14T23:35:01.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.924+0000 7fceeb31e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcee4161870 0x7fcee40ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.924+0000 7fceeb31e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee40b5590 con 0x7fcee40cf760 2024-04-14T23:35:01.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.924+0000 7fceeb31e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee40b52b0 con 0x7fcee40b4e30 2024-04-14T23:35:01.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.924+0000 7fceeb31e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fcee40cff40 con 0x7fcee4161870 2024-04-14T23:35:01.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.924+0000 7fcee98bb640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fcee40cf760 0x7fcee40c7b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55836/0 (socket says 172.21.15.47:55836) 2024-04-14T23:35:01.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.924+0000 7fcee98bb640 1 -- 172.21.15.47:0/72768638 learned_addr learned my addr 172.21.15.47:0/72768638 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:01.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.925+0000 7fcee90ba640 1 --2- 172.21.15.47:0/72768638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcee4161870 0x7fcee40ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.925+0000 7fcee3fff640 1 -- 172.21.15.47:0/72768638 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2920042356 0 0) 0x7fcee40b5590 con 0x7fcee40cf760 2024-04-14T23:35:01.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.925+0000 7fcee3fff640 1 -- 172.21.15.47:0/72768638 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcecc003520 con 0x7fcee40cf760 2024-04-14T23:35:01.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.925+0000 7fcee3fff640 1 -- 172.21.15.47:0/72768638 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088022693 0 0) 0x7fcee40b52b0 con 0x7fcee40b4e30 2024-04-14T23:35:01.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.925+0000 7fcee3fff640 1 -- 172.21.15.47:0/72768638 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcee40b5590 con 0x7fcee40b4e30 2024-04-14T23:35:01.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.925+0000 7fcee90ba640 1 -- 172.21.15.47:0/72768638 >> v1:172.21.15.191:6789/0 conn(0x7fcee40b4e30 legacy=0x7fcee40cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.925+0000 7fcee3fff640 1 -- 172.21.15.47:0/72768638 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3821388611 0 0) 0x7fcecc003520 con 0x7fcee40cf760 2024-04-14T23:35:01.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.925+0000 7fcee90ba640 1 -- 172.21.15.47:0/72768638 >> v1:172.21.15.47:6789/0 conn(0x7fcee40cf760 legacy=0x7fcee40c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.925+0000 7fcee90ba640 1 -- 172.21.15.47:0/72768638 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee40d2680 con 0x7fcee4161870 2024-04-14T23:35:01.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.926+0000 7fcee90ba640 1 --2- 172.21.15.47:0/72768638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcee4161870 0x7fcee40ceb10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0097d0 tx=0x7fcedc02b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6a5c09b1d7cccf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:01.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.926+0000 7fcee3fff640 1 -- 172.21.15.47:0/72768638 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc037070 con 0x7fcee4161870 2024-04-14T23:35:01.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.926+0000 7fcee3fff640 1 -- 172.21.15.47:0/72768638 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcedc030510 con 0x7fcee4161870 2024-04-14T23:35:01.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.926+0000 7fcee3fff640 1 -- 172.21.15.47:0/72768638 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced40019f0 con 0x7fcee4161870 2024-04-14T23:35:01.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.926+0000 7fceeb31e640 1 -- 172.21.15.47:0/72768638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcee4161870 msgr2=0x7fcee40ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.926+0000 7fceeb31e640 1 --2- 172.21.15.47:0/72768638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcee4161870 0x7fcee40ceb10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0097d0 tx=0x7fcedc02b770 comp rx=0 tx=0).stop 2024-04-14T23:35:01.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.927+0000 7fceeb31e640 1 -- 172.21.15.47:0/72768638 shutdown_connections 2024-04-14T23:35:01.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.927+0000 7fceeb31e640 1 --2- 172.21.15.47:0/72768638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcee4161870 0x7fcee40ceb10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.927+0000 7fceeb31e640 1 -- 172.21.15.47:0/72768638 >> 172.21.15.47:0/72768638 conn(0x7fcee40d3f70 msgr2=0x7fcee40d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:01.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.927+0000 7fceeb31e640 1 -- 172.21.15.47:0/72768638 shutdown_connections 2024-04-14T23:35:01.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.927+0000 7fceeb31e640 1 -- 172.21.15.47:0/72768638 wait complete. 2024-04-14T23:35:01.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.928+0000 7fceeb31e640 1 Processor -- start 2024-04-14T23:35:01.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.928+0000 7fceeb31e640 1 -- start start 2024-04-14T23:35:01.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.928+0000 7fceeb31e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcee40b4e30 0x7fcee40cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.928+0000 7fceeb31e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcee40cf760 0x7fcee414e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.928+0000 7fceeb31e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcee4161870 0x7fcee41f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fceeb31e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcee40d18e0 con 0x7fcee40cf760 2024-04-14T23:35:01.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fceeb31e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcee40d2c40 con 0x7fcee4161870 2024-04-14T23:35:01.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fceeb31e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fcee4161c50 con 0x7fcee40b4e30 2024-04-14T23:35:01.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fcee88b9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcee40cf760 0x7fcee414e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fcee88b9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcee40cf760 0x7fcee414e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36332/0 (socket says 172.21.15.47:36332) 2024-04-14T23:35:01.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fcee88b9640 1 -- 172.21.15.47:0/2971381056 learned_addr learned my addr 172.21.15.47:0/2971381056 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:01.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fcee90ba640 1 --2- 172.21.15.47:0/2971381056 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcee40b4e30 0x7fcee40cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fcee98bb640 1 --2- 172.21.15.47:0/2971381056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcee4161870 0x7fcee41f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fcee88b9640 1 -- 172.21.15.47:0/2971381056 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcee40b4e30 msgr2=0x7fcee40cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fcee88b9640 1 --2- 172.21.15.47:0/2971381056 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcee40b4e30 0x7fcee40cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fcee88b9640 1 -- 172.21.15.47:0/2971381056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcee4161870 msgr2=0x7fcee41f3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:01.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fcee88b9640 1 --2- 172.21.15.47:0/2971381056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcee4161870 0x7fcee41f3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:01.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fcee88b9640 1 -- 172.21.15.47:0/2971381056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee414e8d0 con 0x7fcee40cf760 2024-04-14T23:35:01.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fcee88b9640 1 --2- 172.21.15.47:0/2971381056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcee40cf760 0x7fcee414e390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fced800c430 tx=0x7fced800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:01.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fcee1ffb640 1 -- 172.21.15.47:0/2971381056 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced8017070 con 0x7fcee40cf760 2024-04-14T23:35:01.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fcee1ffb640 1 -- 172.21.15.47:0/2971381056 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fced80052f0 con 0x7fcee40cf760 2024-04-14T23:35:01.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fceeb31e640 1 -- 172.21.15.47:0/2971381056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee40b7e40 con 0x7fcee40cf760 2024-04-14T23:35:01.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.929+0000 7fcee1ffb640 1 -- 172.21.15.47:0/2971381056 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced8003830 con 0x7fcee40cf760 2024-04-14T23:35:01.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.930+0000 7fceeb31e640 1 -- 172.21.15.47:0/2971381056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee41f49e0 con 0x7fcee40cf760 2024-04-14T23:35:01.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.931+0000 7fceeb31e640 1 -- 172.21.15.47:0/2971381056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcee4073f50 con 0x7fcee40cf760 2024-04-14T23:35:01.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.931+0000 7fcee1ffb640 1 -- 172.21.15.47:0/2971381056 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fced801a070 con 0x7fcee40cf760 2024-04-14T23:35:01.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.931+0000 7fcee1ffb640 1 --2- 172.21.15.47:0/2971381056 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fced006b990 0x7fced006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:01.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.931+0000 7fcee1ffb640 1 -- 172.21.15.47:0/2971381056 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fced8089ed0 con 0x7fcee40cf760 2024-04-14T23:35:01.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.932+0000 7fcee90ba640 1 --2- 172.21.15.47:0/2971381056 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fced006b990 0x7fced006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:01.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.932+0000 7fcee90ba640 1 --2- 172.21.15.47:0/2971381056 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fced006b990 0x7fced006de50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcedc034000 tx=0x7fcedc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:01.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:01.936+0000 7fcee1ffb640 1 -- 172.21.15.47:0/2971381056 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fced8058150 con 0x7fcee40cf760 2024-04-14T23:35:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.115+0000 7fceeb31e640 1 -- 172.21.15.47:0/2971381056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcee40748d0 con 0x7fcee40cf760 2024-04-14T23:35:02.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.116+0000 7fcee1ffb640 1 -- 172.21.15.47:0/2971381056 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fced805c1f0 con 0x7fcee40cf760 2024-04-14T23:35:02.119 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-14T23:35:02.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.117+0000 7fceeb31e640 1 -- 172.21.15.47:0/2971381056 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fced006b990 msgr2=0x7fced006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.117+0000 7fceeb31e640 1 --2- 172.21.15.47:0/2971381056 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fced006b990 0x7fced006de50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcedc034000 tx=0x7fcedc008030 comp rx=0 tx=0).stop 2024-04-14T23:35:02.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.118+0000 7fceeb31e640 1 -- 172.21.15.47:0/2971381056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcee40cf760 msgr2=0x7fcee414e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.118+0000 7fceeb31e640 1 --2- 172.21.15.47:0/2971381056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcee40cf760 0x7fcee414e390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fced800c430 tx=0x7fced800c8f0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.118+0000 7fceeb31e640 1 -- 172.21.15.47:0/2971381056 shutdown_connections 2024-04-14T23:35:02.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.118+0000 7fceeb31e640 1 --2- 172.21.15.47:0/2971381056 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fced006b990 0x7fced006de50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.118+0000 7fceeb31e640 1 --2- 172.21.15.47:0/2971381056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcee4161870 0x7fcee41f3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.118+0000 7fceeb31e640 1 --2- 172.21.15.47:0/2971381056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcee40cf760 0x7fcee414e390 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.118+0000 7fceeb31e640 1 --2- 172.21.15.47:0/2971381056 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcee40b4e30 0x7fcee40cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.118+0000 7fceeb31e640 1 -- 172.21.15.47:0/2971381056 >> 172.21.15.47:0/2971381056 conn(0x7fcee40d3f70 msgr2=0x7fcee415f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:02.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.118+0000 7fceeb31e640 1 -- 172.21.15.47:0/2971381056 shutdown_connections 2024-04-14T23:35:02.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.118+0000 7fceeb31e640 1 -- 172.21.15.47:0/2971381056 wait complete. 2024-04-14T23:35:02.131 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T23:35:02.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.232+0000 7f7bd9b1e640 1 Processor -- start 2024-04-14T23:35:02.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.232+0000 7f7bd9b1e640 1 -- start start 2024-04-14T23:35:02.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.233+0000 7f7bd9b1e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7bd40ce700 0x7f7bd40ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.233+0000 7f7bd9b1e640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7bd40d2810 0x7f7bd40cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.233+0000 7f7bd9b1e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7bd40b0e20 0x7f7bd40d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.233+0000 7f7bd9b1e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f7bd40d12e0 con 0x7f7bd40ce700 2024-04-14T23:35:02.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.233+0000 7f7bd9b1e640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f7bd406c3b0 con 0x7f7bd40d2810 2024-04-14T23:35:02.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.233+0000 7f7bd9b1e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd40cf020 con 0x7f7bd40b0e20 2024-04-14T23:35:02.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.233+0000 7f7bd37fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7bd40ce700 0x7f7bd40ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.233+0000 7f7bd37fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7bd40ce700 0x7f7bd40ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36342/0 (socket says 172.21.15.47:36342) 2024-04-14T23:35:02.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.233+0000 7f7bd37fe640 1 -- 172.21.15.47:0/4276675452 learned_addr learned my addr 172.21.15.47:0/4276675452 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:02.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.233+0000 7f7bd2ffd640 1 --2- 172.21.15.47:0/4276675452 >> v2:172.21.15.191:3300/0 conn(0x7f7bd40d2810 0x7f7bd40cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.233+0000 7f7bd37fe640 1 -- 172.21.15.47:0/4276675452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7bd40b0e20 msgr2=0x7f7bd40d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:02.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.233+0000 7f7bd3fff640 1 --2- 172.21.15.47:0/4276675452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7bd40b0e20 0x7f7bd40d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.234+0000 7f7bd37fe640 1 --2- 172.21.15.47:0/4276675452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7bd40b0e20 0x7f7bd40d0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.234+0000 7f7bd37fe640 1 -- 172.21.15.47:0/4276675452 >> v2:172.21.15.191:3300/0 conn(0x7f7bd40d2810 msgr2=0x7f7bd40cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:02.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.234+0000 7f7bd37fe640 1 --2- 172.21.15.47:0/4276675452 >> v2:172.21.15.191:3300/0 conn(0x7f7bd40d2810 0x7f7bd40cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.234+0000 7f7bd37fe640 1 -- 172.21.15.47:0/4276675452 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd406f2c0 con 0x7f7bd40ce700 2024-04-14T23:35:02.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.234+0000 7f7bd2ffd640 1 --2- 172.21.15.47:0/4276675452 >> v2:172.21.15.191:3300/0 conn(0x7f7bd40d2810 0x7f7bd40cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:02.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.234+0000 7f7bd37fe640 1 --2- 172.21.15.47:0/4276675452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd40ce700 0x7f7bd40ceae0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4071160 tx=0x7f7bc402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca132f243ac3736 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:02.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.234+0000 7f7bd27fc640 1 -- 172.21.15.47:0/4276675452 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4035020 con 0x7f7bd40ce700 2024-04-14T23:35:02.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.234+0000 7f7bd27fc640 1 -- 172.21.15.47:0/4276675452 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc4031870 con 0x7f7bd40ce700 2024-04-14T23:35:02.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.234+0000 7f7bd27fc640 1 -- 172.21.15.47:0/4276675452 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4031c40 con 0x7f7bd40ce700 2024-04-14T23:35:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.235+0000 7f7bd9b1e640 1 -- 172.21.15.47:0/4276675452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd40ce700 msgr2=0x7f7bd40ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.235+0000 7f7bd9b1e640 1 --2- 172.21.15.47:0/4276675452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd40ce700 0x7f7bd40ceae0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4071160 tx=0x7f7bc402b910 comp rx=0 tx=0).stop 2024-04-14T23:35:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.235+0000 7f7bd9b1e640 1 -- 172.21.15.47:0/4276675452 shutdown_connections 2024-04-14T23:35:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.235+0000 7f7bd9b1e640 1 --2- 172.21.15.47:0/4276675452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7bd40b0e20 0x7f7bd40d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.235+0000 7f7bd9b1e640 1 --2- 172.21.15.47:0/4276675452 >> v2:172.21.15.191:3300/0 conn(0x7f7bd40d2810 0x7f7bd40cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.235+0000 7f7bd9b1e640 1 --2- 172.21.15.47:0/4276675452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd40ce700 0x7f7bd40ceae0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.235+0000 7f7bd9b1e640 1 -- 172.21.15.47:0/4276675452 >> 172.21.15.47:0/4276675452 conn(0x7f7bd40d1cf0 msgr2=0x7f7bd40d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.235+0000 7f7bd9b1e640 1 -- 172.21.15.47:0/4276675452 shutdown_connections 2024-04-14T23:35:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.235+0000 7f7bd9b1e640 1 -- 172.21.15.47:0/4276675452 wait complete. 2024-04-14T23:35:02.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.236+0000 7f7bd9b1e640 1 Processor -- start 2024-04-14T23:35:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.236+0000 7f7bd9b1e640 1 -- start start 2024-04-14T23:35:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd9b1e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7bd40b0e20 0x7f7bd41e77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd9b1e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd40ce700 0x7f7bd4149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd9b1e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bd40d2810 0x7f7bd40c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd9b1e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd406f5a0 con 0x7f7bd40ce700 2024-04-14T23:35:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd9b1e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd406c930 con 0x7f7bd40d2810 2024-04-14T23:35:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd9b1e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd415e600 con 0x7f7bd40b0e20 2024-04-14T23:35:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd40ce700 0x7f7bd4149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd40ce700 0x7f7bd4149fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36344/0 (socket says 172.21.15.47:36344) 2024-04-14T23:35:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd2ffd640 1 -- 172.21.15.47:0/1165680129 learned_addr learned my addr 172.21.15.47:0/1165680129 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd37fe640 1 --2- 172.21.15.47:0/1165680129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7bd40b0e20 0x7f7bd41e77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd3fff640 1 --2- 172.21.15.47:0/1165680129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bd40d2810 0x7f7bd40c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd2ffd640 1 -- 172.21.15.47:0/1165680129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7bd40b0e20 msgr2=0x7f7bd41e77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd2ffd640 1 --2- 172.21.15.47:0/1165680129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7bd40b0e20 0x7f7bd41e77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd2ffd640 1 -- 172.21.15.47:0/1165680129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bd40d2810 msgr2=0x7f7bd40c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd2ffd640 1 --2- 172.21.15.47:0/1165680129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bd40d2810 0x7f7bd40c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd2ffd640 1 -- 172.21.15.47:0/1165680129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd40c6f40 con 0x7f7bd40ce700 2024-04-14T23:35:02.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.237+0000 7f7bd37fe640 1 --2- 172.21.15.47:0/1165680129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7bd40b0e20 0x7f7bd41e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:02.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.238+0000 7f7bd2ffd640 1 --2- 172.21.15.47:0/1165680129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd40ce700 0x7f7bd4149fe0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800c7f0 tx=0x7f7bc800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:02.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.238+0000 7f7bbbfff640 1 -- 172.21.15.47:0/1165680129 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8015070 con 0x7f7bd40ce700 2024-04-14T23:35:02.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.238+0000 7f7bbbfff640 1 -- 172.21.15.47:0/1165680129 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc80079d0 con 0x7f7bd40ce700 2024-04-14T23:35:02.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.238+0000 7f7bd9b1e640 1 -- 172.21.15.47:0/1165680129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd40c7220 con 0x7f7bd40ce700 2024-04-14T23:35:02.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.238+0000 7f7bbbfff640 1 -- 172.21.15.47:0/1165680129 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8007da0 con 0x7f7bd40ce700 2024-04-14T23:35:02.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.238+0000 7f7bd9b1e640 1 -- 172.21.15.47:0/1165680129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd40c77e0 con 0x7f7bd40ce700 2024-04-14T23:35:02.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.239+0000 7f7bd9b1e640 1 -- 172.21.15.47:0/1165680129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd4073f50 con 0x7f7bd40ce700 2024-04-14T23:35:02.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.239+0000 7f7bbbfff640 1 -- 172.21.15.47:0/1165680129 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f7bc8018070 con 0x7f7bd40ce700 2024-04-14T23:35:02.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.239+0000 7f7bbbfff640 1 --2- 172.21.15.47:0/1165680129 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7bc006b990 0x7f7bc006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.240+0000 7f7bbbfff640 1 -- 172.21.15.47:0/1165680129 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7bc808ab50 con 0x7f7bd40ce700 2024-04-14T23:35:02.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.240+0000 7f7bd37fe640 1 --2- 172.21.15.47:0/1165680129 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7bc006b990 0x7f7bc006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.240+0000 7f7bd37fe640 1 --2- 172.21.15.47:0/1165680129 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7bc006b990 0x7f7bc006de50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4036000 tx=0x7f7bc4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:02.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.244+0000 7f7bbbfff640 1 -- 172.21.15.47:0/1165680129 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7bc8059380 con 0x7f7bd40ce700 2024-04-14T23:35:02.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.422+0000 7f7bd9b1e640 1 -- 172.21.15.47:0/1165680129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7bd406e1e0 con 0x7f7bd40ce700 2024-04-14T23:35:02.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.423+0000 7f7bbbfff640 1 -- 172.21.15.47:0/1165680129 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f7bc8058c80 con 0x7f7bd40ce700 2024-04-14T23:35:02.426 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:02.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.425+0000 7f7bd9b1e640 1 -- 172.21.15.47:0/1165680129 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7bc006b990 msgr2=0x7f7bc006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.425+0000 7f7bd9b1e640 1 --2- 172.21.15.47:0/1165680129 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7bc006b990 0x7f7bc006de50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4036000 tx=0x7f7bc4008030 comp rx=0 tx=0).stop 2024-04-14T23:35:02.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.425+0000 7f7bd9b1e640 1 -- 172.21.15.47:0/1165680129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd40ce700 msgr2=0x7f7bd4149fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.425+0000 7f7bd9b1e640 1 --2- 172.21.15.47:0/1165680129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd40ce700 0x7f7bd4149fe0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800c7f0 tx=0x7f7bc800cbf0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.425+0000 7f7bd9b1e640 1 -- 172.21.15.47:0/1165680129 shutdown_connections 2024-04-14T23:35:02.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.425+0000 7f7bd9b1e640 1 --2- 172.21.15.47:0/1165680129 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7bc006b990 0x7f7bc006de50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.425+0000 7f7bd9b1e640 1 --2- 172.21.15.47:0/1165680129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bd40d2810 0x7f7bd40c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.425+0000 7f7bd9b1e640 1 --2- 172.21.15.47:0/1165680129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bd40ce700 0x7f7bd4149fe0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.425+0000 7f7bd9b1e640 1 --2- 172.21.15.47:0/1165680129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7bd40b0e20 0x7f7bd41e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.425+0000 7f7bd9b1e640 1 -- 172.21.15.47:0/1165680129 >> 172.21.15.47:0/1165680129 conn(0x7f7bd40d1cf0 msgr2=0x7f7bd40afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:02.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.425+0000 7f7bd9b1e640 1 -- 172.21.15.47:0/1165680129 shutdown_connections 2024-04-14T23:35:02.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.425+0000 7f7bd9b1e640 1 -- 172.21.15.47:0/1165680129 wait complete. 2024-04-14T23:35:02.439 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T23:35:02.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.537+0000 7f005ac36640 1 Processor -- start 2024-04-14T23:35:02.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.537+0000 7f005ac36640 1 -- start start 2024-04-14T23:35:02.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.538+0000 7f005ac36640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00540d0980 0x7f00540cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.538+0000 7f005ac36640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f00540cccd0 0x7f00540cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.538+0000 7f005ac36640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00540d1040 con 0x7f005415e420 2024-04-14T23:35:02.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.538+0000 7f005ac36640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f00540cc280 con 0x7f00540cccd0 2024-04-14T23:35:02.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.538+0000 7f005ac36640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f005406d750 con 0x7f00540d0980 2024-04-14T23:35:02.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.538+0000 7f00591d3640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f00540cccd0 0x7f00540cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.538+0000 7f00589d2640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f005415e420 0x7f00540ce4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55844/0 (socket says 172.21.15.47:55844) 2024-04-14T23:35:02.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.538+0000 7f00589d2640 1 -- 172.21.15.47:0/2209928442 learned_addr learned my addr 172.21.15.47:0/2209928442 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:02.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.538+0000 7f0053fff640 1 --2- 172.21.15.47:0/2209928442 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00540d0980 0x7f00540cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.538+0000 7f00591d3640 1 -- 172.21.15.47:0/2209928442 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00540d0980 msgr2=0x7f00540cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:02.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.538+0000 7f00591d3640 1 --2- 172.21.15.47:0/2209928442 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00540d0980 0x7f00540cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.538+0000 7f00591d3640 1 -- 172.21.15.47:0/2209928442 >> v1:172.21.15.47:6789/0 conn(0x7f005415e420 legacy=0x7f00540ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.539+0000 7f00591d3640 1 -- 172.21.15.47:0/2209928442 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00540d1320 con 0x7f00540cccd0 2024-04-14T23:35:02.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.538+0000 7f00537fe640 1 -- 172.21.15.47:0/2209928442 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1678150712 0 0) 0x7f00540d1040 con 0x7f005415e420 2024-04-14T23:35:02.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.539+0000 7f00591d3640 1 --2- 172.21.15.47:0/2209928442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00540cccd0 0x7f00540cd160 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f00440097a0 tx=0x7f004402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2cc0286144f4cb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:02.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.539+0000 7f00537fe640 1 -- 172.21.15.47:0/2209928442 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0044034070 con 0x7f00540cccd0 2024-04-14T23:35:02.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.539+0000 7f00537fe640 1 -- 172.21.15.47:0/2209928442 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0044030610 con 0x7f00540cccd0 2024-04-14T23:35:02.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.539+0000 7f00537fe640 1 -- 172.21.15.47:0/2209928442 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00440309e0 con 0x7f00540cccd0 2024-04-14T23:35:02.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.540+0000 7f005ac36640 1 -- 172.21.15.47:0/2209928442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00540cccd0 msgr2=0x7f00540cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.540+0000 7f005ac36640 1 --2- 172.21.15.47:0/2209928442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00540cccd0 0x7f00540cd160 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f00440097a0 tx=0x7f004402b960 comp rx=0 tx=0).stop 2024-04-14T23:35:02.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.540+0000 7f005ac36640 1 -- 172.21.15.47:0/2209928442 shutdown_connections 2024-04-14T23:35:02.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.540+0000 7f005ac36640 1 --2- 172.21.15.47:0/2209928442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00540cccd0 0x7f00540cd160 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.540+0000 7f005ac36640 1 --2- 172.21.15.47:0/2209928442 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00540d0980 0x7f00540cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.540+0000 7f005ac36640 1 -- 172.21.15.47:0/2209928442 >> 172.21.15.47:0/2209928442 conn(0x7f00540d1c30 msgr2=0x7f00540d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:02.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.540+0000 7f005ac36640 1 -- 172.21.15.47:0/2209928442 shutdown_connections 2024-04-14T23:35:02.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.540+0000 7f005ac36640 1 -- 172.21.15.47:0/2209928442 wait complete. 2024-04-14T23:35:02.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.541+0000 7f005ac36640 1 Processor -- start 2024-04-14T23:35:02.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.541+0000 7f005ac36640 1 -- start start 2024-04-14T23:35:02.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.542+0000 7f005ac36640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00540cccd0 0x7f005406fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.542+0000 7f005ac36640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00540d0980 0x7f0054070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.542+0000 7f005ac36640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f005415e420 0x7f0054160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.542+0000 7f005ac36640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f00540cc7b0 con 0x7f00540cccd0 2024-04-14T23:35:02.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.542+0000 7f005ac36640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f00540d0de0 con 0x7f00540d0980 2024-04-14T23:35:02.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.542+0000 7f005ac36640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f005415e800 con 0x7f005415e420 2024-04-14T23:35:02.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.542+0000 7f00589d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00540cccd0 0x7f005406fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.542+0000 7f00589d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00540cccd0 0x7f005406fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36364/0 (socket says 172.21.15.47:36364) 2024-04-14T23:35:02.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.542+0000 7f00589d2640 1 -- 172.21.15.47:0/2434643576 learned_addr learned my addr 172.21.15.47:0/2434643576 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:02.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.542+0000 7f00591d3640 1 --2- 172.21.15.47:0/2434643576 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f005415e420 0x7f0054160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.542+0000 7f0053fff640 1 --2- 172.21.15.47:0/2434643576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00540d0980 0x7f0054070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.543+0000 7f00589d2640 1 -- 172.21.15.47:0/2434643576 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f005415e420 msgr2=0x7f0054160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.543+0000 7f00589d2640 1 --2- 172.21.15.47:0/2434643576 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f005415e420 0x7f0054160050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.543+0000 7f00589d2640 1 -- 172.21.15.47:0/2434643576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00540d0980 msgr2=0x7f0054070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.543+0000 7f00589d2640 1 --2- 172.21.15.47:0/2434643576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00540d0980 0x7f0054070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.543+0000 7f00589d2640 1 -- 172.21.15.47:0/2434643576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0054160cc0 con 0x7f00540cccd0 2024-04-14T23:35:02.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.543+0000 7f00589d2640 1 --2- 172.21.15.47:0/2434643576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00540cccd0 0x7f005406fb50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f004c00c7f0 tx=0x7f004c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:02.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.543+0000 7f00517fa640 1 -- 172.21.15.47:0/2434643576 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c018070 con 0x7f00540cccd0 2024-04-14T23:35:02.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.543+0000 7f00517fa640 1 -- 172.21.15.47:0/2434643576 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f004c00a640 con 0x7f00540cccd0 2024-04-14T23:35:02.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.543+0000 7f005ac36640 1 -- 172.21.15.47:0/2434643576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0054160fa0 con 0x7f00540cccd0 2024-04-14T23:35:02.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.543+0000 7f00517fa640 1 -- 172.21.15.47:0/2434643576 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c00aa30 con 0x7f00540cccd0 2024-04-14T23:35:02.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.543+0000 7f005ac36640 1 -- 172.21.15.47:0/2434643576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00540ca830 con 0x7f00540cccd0 2024-04-14T23:35:02.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.544+0000 7f005ac36640 1 -- 172.21.15.47:0/2434643576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0054075430 con 0x7f00540cccd0 2024-04-14T23:35:02.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.544+0000 7f00517fa640 1 -- 172.21.15.47:0/2434643576 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f004c01b070 con 0x7f00540cccd0 2024-04-14T23:35:02.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.545+0000 7f00517fa640 1 --2- 172.21.15.47:0/2434643576 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f004006b990 0x7f004006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.545+0000 7f00517fa640 1 -- 172.21.15.47:0/2434643576 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f004c08a110 con 0x7f00540cccd0 2024-04-14T23:35:02.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.545+0000 7f0053fff640 1 --2- 172.21.15.47:0/2434643576 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f004006b990 0x7f004006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.545+0000 7f0053fff640 1 --2- 172.21.15.47:0/2434643576 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f004006b990 0x7f004006de50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f005415dc20 tx=0x7f0048008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:02.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.549+0000 7f00517fa640 1 -- 172.21.15.47:0/2434643576 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f004c058380 con 0x7f00540cccd0 2024-04-14T23:35:02.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.769+0000 7f005ac36640 1 -- 172.21.15.47:0/2434643576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f005406c310 con 0x7f00540cccd0 2024-04-14T23:35:02.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.769+0000 7f00517fa640 1 -- 172.21.15.47:0/2434643576 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f004c05c420 con 0x7f00540cccd0 2024-04-14T23:35:02.772 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:02.773 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/416388535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":416388535},{"type":"v1","addr":"172.21.15.191:6837","nonce":416388535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/2830978927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2830978927},{"type":"v1","addr":"172.21.15.47:6833","nonce":2830978927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/4025654680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":4025654680},{"type":"v1","addr":"172.21.15.191:6836","nonce":4025654680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T23:34:38.059644+0000","modified":"2024-04-14T23:34:54.105483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/1169029730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1169029730},{"type":"v1","addr":"172.21.15.47:6835","nonce":1169029730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-14T23:35:02.773 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-04-14T23:35:02.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.771+0000 7f005ac36640 1 -- 172.21.15.47:0/2434643576 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f004006b990 msgr2=0x7f004006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.771+0000 7f005ac36640 1 --2- 172.21.15.47:0/2434643576 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f004006b990 0x7f004006de50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f005415dc20 tx=0x7f0048008040 comp rx=0 tx=0).stop 2024-04-14T23:35:02.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.771+0000 7f005ac36640 1 -- 172.21.15.47:0/2434643576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00540cccd0 msgr2=0x7f005406fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.771+0000 7f005ac36640 1 --2- 172.21.15.47:0/2434643576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00540cccd0 0x7f005406fb50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f004c00c7f0 tx=0x7f004c00ccb0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.771+0000 7f005ac36640 1 -- 172.21.15.47:0/2434643576 shutdown_connections 2024-04-14T23:35:02.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.771+0000 7f005ac36640 1 --2- 172.21.15.47:0/2434643576 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f004006b990 0x7f004006de50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.771+0000 7f005ac36640 1 --2- 172.21.15.47:0/2434643576 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f005415e420 0x7f0054160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.771+0000 7f005ac36640 1 --2- 172.21.15.47:0/2434643576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00540d0980 0x7f0054070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.771+0000 7f005ac36640 1 --2- 172.21.15.47:0/2434643576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00540cccd0 0x7f005406fb50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.771+0000 7f005ac36640 1 -- 172.21.15.47:0/2434643576 >> 172.21.15.47:0/2434643576 conn(0x7f00540d1c30 msgr2=0x7f00540cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:02.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.771+0000 7f005ac36640 1 -- 172.21.15.47:0/2434643576 shutdown_connections 2024-04-14T23:35:02.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.771+0000 7f005ac36640 1 -- 172.21.15.47:0/2434643576 wait complete. 2024-04-14T23:35:02.786 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:02.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.885+0000 7f44e1205640 1 Processor -- start 2024-04-14T23:35:02.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.885+0000 7f44e1205640 1 -- start start 2024-04-14T23:35:02.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.885+0000 7f44e1205640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f44dc0cca50 0x7f44dc0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.885+0000 7f44e1205640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44dc162b90 con 0x7f44dc0ceab0 2024-04-14T23:35:02.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.885+0000 7f44e1205640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44dc15e9a0 con 0x7f44dc0d16d0 2024-04-14T23:35:02.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.885+0000 7f44e1205640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f44dc15f5b0 con 0x7f44dc0cca50 2024-04-14T23:35:02.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.886+0000 7f44dad9d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f44dc0cca50 0x7f44dc0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.886+0000 7f44d3fff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f44dc0ceab0 0x7f44dc161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55856/0 (socket says 172.21.15.47:55856) 2024-04-14T23:35:02.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.886+0000 7f44d3fff640 1 -- 172.21.15.47:0/2573873401 learned_addr learned my addr 172.21.15.47:0/2573873401 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:02.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.886+0000 7f44dad9d640 1 -- 172.21.15.47:0/2573873401 >> v1:172.21.15.191:6789/0 conn(0x7f44dc0d16d0 legacy=0x7f44dc162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.886+0000 7f44dad9d640 1 -- 172.21.15.47:0/2573873401 >> v1:172.21.15.47:6789/0 conn(0x7f44dc0ceab0 legacy=0x7f44dc161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.886+0000 7f44dad9d640 1 -- 172.21.15.47:0/2573873401 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44dc15ec80 con 0x7f44dc0cca50 2024-04-14T23:35:02.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.887+0000 7f44dad9d640 1 --2- 172.21.15.47:0/2573873401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44dc0cca50 0x7f44dc0cce30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0097a0 tx=0x7f44cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357273c1045506c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:02.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.887+0000 7f44da59c640 1 -- 172.21.15.47:0/2573873401 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc0315a0 con 0x7f44dc0cca50 2024-04-14T23:35:02.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.887+0000 7f44da59c640 1 -- 172.21.15.47:0/2573873401 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44cc037070 con 0x7f44dc0cca50 2024-04-14T23:35:02.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.887+0000 7f44da59c640 1 -- 172.21.15.47:0/2573873401 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc031960 con 0x7f44dc0cca50 2024-04-14T23:35:02.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.887+0000 7f44e1205640 1 -- 172.21.15.47:0/2573873401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44dc0cca50 msgr2=0x7f44dc0cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.887+0000 7f44e1205640 1 --2- 172.21.15.47:0/2573873401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44dc0cca50 0x7f44dc0cce30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0097a0 tx=0x7f44cc02b840 comp rx=0 tx=0).stop 2024-04-14T23:35:02.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.887+0000 7f44e1205640 1 -- 172.21.15.47:0/2573873401 shutdown_connections 2024-04-14T23:35:02.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.887+0000 7f44e1205640 1 --2- 172.21.15.47:0/2573873401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44dc0cca50 0x7f44dc0cce30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.887+0000 7f44e1205640 1 -- 172.21.15.47:0/2573873401 >> 172.21.15.47:0/2573873401 conn(0x7f44dc0d0bb0 msgr2=0x7f44dc0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:02.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.887+0000 7f44e1205640 1 -- 172.21.15.47:0/2573873401 shutdown_connections 2024-04-14T23:35:02.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.887+0000 7f44e1205640 1 -- 172.21.15.47:0/2573873401 wait complete. 2024-04-14T23:35:02.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.889+0000 7f44e1205640 1 Processor -- start 2024-04-14T23:35:02.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.889+0000 7f44e1205640 1 -- start start 2024-04-14T23:35:02.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.889+0000 7f44e1205640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44dc0cca50 0x7f44dc161e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.889+0000 7f44e1205640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44dc0ceab0 0x7f44dc0ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.889+0000 7f44e1205640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44dc0d16d0 0x7f44dc160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.889+0000 7f44e1205640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc0cd370 con 0x7f44dc0d16d0 2024-04-14T23:35:02.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.889+0000 7f44e1205640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc15f240 con 0x7f44dc0cca50 2024-04-14T23:35:02.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.889+0000 7f44e1205640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f44dc15e660 con 0x7f44dc0ceab0 2024-04-14T23:35:02.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.889+0000 7f44db59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44dc0d16d0 0x7f44dc160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.889+0000 7f44db59e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44dc0d16d0 0x7f44dc160370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36386/0 (socket says 172.21.15.47:36386) 2024-04-14T23:35:02.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.889+0000 7f44db59e640 1 -- 172.21.15.47:0/41155283 learned_addr learned my addr 172.21.15.47:0/41155283 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:02.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.890+0000 7f44dad9d640 1 --2- 172.21.15.47:0/41155283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44dc0cca50 0x7f44dc161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.890+0000 7f44d3fff640 1 --2- 172.21.15.47:0/41155283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44dc0ceab0 0x7f44dc0ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.890+0000 7f44db59e640 1 -- 172.21.15.47:0/41155283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44dc0ceab0 msgr2=0x7f44dc0ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.890+0000 7f44db59e640 1 --2- 172.21.15.47:0/41155283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44dc0ceab0 0x7f44dc0ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.890+0000 7f44db59e640 1 -- 172.21.15.47:0/41155283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44dc0cca50 msgr2=0x7f44dc161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:02.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.890+0000 7f44db59e640 1 --2- 172.21.15.47:0/41155283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44dc0cca50 0x7f44dc161e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:02.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.890+0000 7f44db59e640 1 -- 172.21.15.47:0/41155283 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44dc160d80 con 0x7f44dc0d16d0 2024-04-14T23:35:02.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.890+0000 7f44dad9d640 1 --2- 172.21.15.47:0/41155283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44dc0cca50 0x7f44dc161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:02.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.890+0000 7f44db59e640 1 --2- 172.21.15.47:0/41155283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44dc0d16d0 0x7f44dc160370 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f44d400c6b0 tx=0x7f44d400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:02.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.890+0000 7f44d37fe640 1 -- 172.21.15.47:0/41155283 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d4003b70 con 0x7f44dc0d16d0 2024-04-14T23:35:02.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.890+0000 7f44d37fe640 1 -- 172.21.15.47:0/41155283 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44d4003d30 con 0x7f44dc0d16d0 2024-04-14T23:35:02.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.890+0000 7f44e1205640 1 -- 172.21.15.47:0/41155283 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44dc161060 con 0x7f44dc0d16d0 2024-04-14T23:35:02.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.890+0000 7f44d37fe640 1 -- 172.21.15.47:0/41155283 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d4005310 con 0x7f44dc0d16d0 2024-04-14T23:35:02.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.890+0000 7f44e1205640 1 -- 172.21.15.47:0/41155283 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44dc161900 con 0x7f44dc0d16d0 2024-04-14T23:35:02.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.891+0000 7f44e1205640 1 -- 172.21.15.47:0/41155283 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44dc0cb3c0 con 0x7f44dc0d16d0 2024-04-14T23:35:02.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.891+0000 7f44d37fe640 1 -- 172.21.15.47:0/41155283 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f44d40054b0 con 0x7f44dc0d16d0 2024-04-14T23:35:02.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.892+0000 7f44d37fe640 1 --2- 172.21.15.47:0/41155283 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f44bc06b990 0x7f44bc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:02.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.892+0000 7f44d37fe640 1 -- 172.21.15.47:0/41155283 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f44d408a9c0 con 0x7f44dc0d16d0 2024-04-14T23:35:02.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.892+0000 7f44dad9d640 1 --2- 172.21.15.47:0/41155283 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f44bc06b990 0x7f44bc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:02.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.893+0000 7f44dad9d640 1 --2- 172.21.15.47:0/41155283 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f44bc06b990 0x7f44bc06de50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f44cc036000 tx=0x7f44cc03d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:02.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:02.896+0000 7f44d37fe640 1 -- 172.21.15.47:0/41155283 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f44dc0cb3c0 con 0x7f44dc0d16d0 2024-04-14T23:35:03.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.077+0000 7f44e1205640 1 -- 172.21.15.47:0/41155283 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44dc161230 con 0x7f44dc0d16d0 2024-04-14T23:35:03.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.078+0000 7f44d37fe640 1 -- 172.21.15.47:0/41155283 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7f44d408ce20 con 0x7f44dc0d16d0 2024-04-14T23:35:03.081 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:03.081 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:44.714882+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:03.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.080+0000 7f44e1205640 1 -- 172.21.15.47:0/41155283 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f44bc06b990 msgr2=0x7f44bc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.080+0000 7f44e1205640 1 --2- 172.21.15.47:0/41155283 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f44bc06b990 0x7f44bc06de50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f44cc036000 tx=0x7f44cc03d040 comp rx=0 tx=0).stop 2024-04-14T23:35:03.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.080+0000 7f44e1205640 1 -- 172.21.15.47:0/41155283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44dc0d16d0 msgr2=0x7f44dc160370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.080+0000 7f44e1205640 1 --2- 172.21.15.47:0/41155283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44dc0d16d0 0x7f44dc160370 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f44d400c6b0 tx=0x7f44d400cb70 comp rx=0 tx=0).stop 2024-04-14T23:35:03.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.080+0000 7f44e1205640 1 -- 172.21.15.47:0/41155283 shutdown_connections 2024-04-14T23:35:03.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.080+0000 7f44e1205640 1 --2- 172.21.15.47:0/41155283 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f44bc06b990 0x7f44bc06de50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.080+0000 7f44e1205640 1 --2- 172.21.15.47:0/41155283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44dc0d16d0 0x7f44dc160370 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.080+0000 7f44e1205640 1 --2- 172.21.15.47:0/41155283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44dc0ceab0 0x7f44dc0ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.080+0000 7f44e1205640 1 --2- 172.21.15.47:0/41155283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44dc0cca50 0x7f44dc161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.080+0000 7f44e1205640 1 -- 172.21.15.47:0/41155283 >> 172.21.15.47:0/41155283 conn(0x7f44dc0d0bb0 msgr2=0x7f44dc0a1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:03.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.080+0000 7f44e1205640 1 -- 172.21.15.47:0/41155283 shutdown_connections 2024-04-14T23:35:03.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.080+0000 7f44e1205640 1 -- 172.21.15.47:0/41155283 wait complete. 2024-04-14T23:35:03.094 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T23:34:36.382034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T23:34:37.023103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T23:34:40.726418+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T23:35:03.095 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:35:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.195+0000 7fbb80571640 1 Processor -- start 2024-04-14T23:35:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.195+0000 7fbb80571640 1 -- start start 2024-04-14T23:35:03.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.196+0000 7fbb80571640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb78161870 0x7fbb780ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.196+0000 7fbb80571640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbb780b4e30 0x7fbb780cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.196+0000 7fbb80571640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb780cfa20 con 0x7fbb780cf590 2024-04-14T23:35:03.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.196+0000 7fbb80571640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbb780cff40 con 0x7fbb780b4e30 2024-04-14T23:35:03.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.196+0000 7fbb80571640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbb780b5590 con 0x7fbb78161870 2024-04-14T23:35:03.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.197+0000 7fbb7db0c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbb780b4e30 0x7fbb780cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.197+0000 7fbb7eb0e640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbb780cf590 0x7fbb780d08d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55862/0 (socket says 172.21.15.47:55862) 2024-04-14T23:35:03.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.197+0000 7fbb7db0c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbb780b4e30 0x7fbb780cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36402/0 (socket says 172.21.15.47:36402) 2024-04-14T23:35:03.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.197+0000 7fbb7eb0e640 1 -- 172.21.15.47:0/115334995 learned_addr learned my addr 172.21.15.47:0/115334995 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:03.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.197+0000 7fbb7e30d640 1 --2- 172.21.15.47:0/115334995 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb78161870 0x7fbb780ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.197+0000 7fbb7db0c640 1 -- 172.21.15.47:0/115334995 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb78161870 msgr2=0x7fbb780ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:03.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.197+0000 7fbb7db0c640 1 --2- 172.21.15.47:0/115334995 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb78161870 0x7fbb780ceb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.197+0000 7fbb7db0c640 1 -- 172.21.15.47:0/115334995 >> v1:172.21.15.47:6789/0 conn(0x7fbb780cf590 legacy=0x7fbb780d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.197+0000 7fbb7db0c640 1 -- 172.21.15.47:0/115334995 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb780b52b0 con 0x7fbb780b4e30 2024-04-14T23:35:03.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.197+0000 7fbb7d30b640 1 -- 172.21.15.47:0/115334995 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4236228705 0 0) 0x7fbb780cfa20 con 0x7fbb780cf590 2024-04-14T23:35:03.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.198+0000 7fbb7db0c640 1 --2- 172.21.15.47:0/115334995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb780b4e30 0x7fbb780cf050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbb740097a0 tx=0x7fbb7402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a821cac9648c7466 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:03.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.198+0000 7fbb7d30b640 1 -- 172.21.15.47:0/115334995 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb740315a0 con 0x7fbb780b4e30 2024-04-14T23:35:03.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.198+0000 7fbb7d30b640 1 -- 172.21.15.47:0/115334995 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb74037070 con 0x7fbb780b4e30 2024-04-14T23:35:03.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.198+0000 7fbb7d30b640 1 -- 172.21.15.47:0/115334995 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74031960 con 0x7fbb780b4e30 2024-04-14T23:35:03.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.198+0000 7fbb80571640 1 -- 172.21.15.47:0/115334995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb780b4e30 msgr2=0x7fbb780cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.198+0000 7fbb80571640 1 --2- 172.21.15.47:0/115334995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb780b4e30 0x7fbb780cf050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbb740097a0 tx=0x7fbb7402b840 comp rx=0 tx=0).stop 2024-04-14T23:35:03.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.198+0000 7fbb80571640 1 -- 172.21.15.47:0/115334995 shutdown_connections 2024-04-14T23:35:03.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.198+0000 7fbb80571640 1 --2- 172.21.15.47:0/115334995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb780b4e30 0x7fbb780cf050 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.198+0000 7fbb80571640 1 --2- 172.21.15.47:0/115334995 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb78161870 0x7fbb780ceb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.198+0000 7fbb80571640 1 -- 172.21.15.47:0/115334995 >> 172.21.15.47:0/115334995 conn(0x7fbb780d3f70 msgr2=0x7fbb780d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:03.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.198+0000 7fbb80571640 1 -- 172.21.15.47:0/115334995 shutdown_connections 2024-04-14T23:35:03.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.198+0000 7fbb80571640 1 -- 172.21.15.47:0/115334995 wait complete. 2024-04-14T23:35:03.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.200+0000 7fbb80571640 1 Processor -- start 2024-04-14T23:35:03.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.200+0000 7fbb80571640 1 -- start start 2024-04-14T23:35:03.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.200+0000 7fbb80571640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb780b4e30 0x7fbb780b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.200+0000 7fbb80571640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb780cf590 0x7fbb7815d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.200+0000 7fbb80571640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb78161870 0x7fbb781543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.200+0000 7fbb80571640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbb780d2c40 con 0x7fbb780cf590 2024-04-14T23:35:03.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.200+0000 7fbb80571640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb780d2960 con 0x7fbb780b4e30 2024-04-14T23:35:03.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.200+0000 7fbb80571640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbb78161c50 con 0x7fbb78161870 2024-04-14T23:35:03.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.200+0000 7fbb7db0c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb780cf590 0x7fbb7815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.200+0000 7fbb7db0c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb780cf590 0x7fbb7815d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36418/0 (socket says 172.21.15.47:36418) 2024-04-14T23:35:03.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.200+0000 7fbb7db0c640 1 -- 172.21.15.47:0/3272132895 learned_addr learned my addr 172.21.15.47:0/3272132895 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:03.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.200+0000 7fbb7e30d640 1 --2- 172.21.15.47:0/3272132895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb780b4e30 0x7fbb780b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.201+0000 7fbb7eb0e640 1 --2- 172.21.15.47:0/3272132895 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb78161870 0x7fbb781543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.201+0000 7fbb7db0c640 1 -- 172.21.15.47:0/3272132895 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb78161870 msgr2=0x7fbb781543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.201+0000 7fbb7db0c640 1 --2- 172.21.15.47:0/3272132895 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb78161870 0x7fbb781543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.201+0000 7fbb7db0c640 1 -- 172.21.15.47:0/3272132895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb780b4e30 msgr2=0x7fbb780b6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.201+0000 7fbb7db0c640 1 --2- 172.21.15.47:0/3272132895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb780b4e30 0x7fbb780b6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.201+0000 7fbb7db0c640 1 -- 172.21.15.47:0/3272132895 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb780b7170 con 0x7fbb780cf590 2024-04-14T23:35:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.201+0000 7fbb7eb0e640 1 --2- 172.21.15.47:0/3272132895 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb78161870 0x7fbb781543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.201+0000 7fbb7db0c640 1 --2- 172.21.15.47:0/3272132895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb780cf590 0x7fbb7815d170 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbb74034040 tx=0x7fbb740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.201+0000 7fbb6effd640 1 -- 172.21.15.47:0/3272132895 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74032630 con 0x7fbb780cf590 2024-04-14T23:35:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.201+0000 7fbb6effd640 1 -- 172.21.15.47:0/3272132895 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb740327d0 con 0x7fbb780cf590 2024-04-14T23:35:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.201+0000 7fbb6effd640 1 -- 172.21.15.47:0/3272132895 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74032bc0 con 0x7fbb780cf590 2024-04-14T23:35:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.201+0000 7fbb80571640 1 -- 172.21.15.47:0/3272132895 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb780b7450 con 0x7fbb780cf590 2024-04-14T23:35:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.201+0000 7fbb80571640 1 -- 172.21.15.47:0/3272132895 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb780b7a10 con 0x7fbb780cf590 2024-04-14T23:35:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.202+0000 7fbb80571640 1 -- 172.21.15.47:0/3272132895 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb78073f50 con 0x7fbb780cf590 2024-04-14T23:35:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.202+0000 7fbb6effd640 1 -- 172.21.15.47:0/3272132895 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fbb7404e430 con 0x7fbb780cf590 2024-04-14T23:35:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.203+0000 7fbb6effd640 1 --2- 172.21.15.47:0/3272132895 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbb5c06b990 0x7fbb5c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.203+0000 7fbb6effd640 1 -- 172.21.15.47:0/3272132895 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbb7402f030 con 0x7fbb780cf590 2024-04-14T23:35:03.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.203+0000 7fbb7e30d640 1 --2- 172.21.15.47:0/3272132895 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbb5c06b990 0x7fbb5c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.203+0000 7fbb7e30d640 1 --2- 172.21.15.47:0/3272132895 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbb5c06b990 0x7fbb5c06de50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb780b9de0 tx=0x7fbb68009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:03.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.207+0000 7fbb6effd640 1 -- 172.21.15.47:0/3272132895 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbb74040070 con 0x7fbb780cf590 2024-04-14T23:35:03.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.387+0000 7fbb80571640 1 -- 172.21.15.47:0/3272132895 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbb780caae0 con 0x7fbb780cf590 2024-04-14T23:35:03.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.388+0000 7fbb6effd640 1 -- 172.21.15.47:0/3272132895 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fbb7407b280 con 0x7fbb780cf590 2024-04-14T23:35:03.391 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:35:03.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.389+0000 7fbb80571640 1 -- 172.21.15.47:0/3272132895 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbb5c06b990 msgr2=0x7fbb5c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.389+0000 7fbb80571640 1 --2- 172.21.15.47:0/3272132895 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbb5c06b990 0x7fbb5c06de50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb780b9de0 tx=0x7fbb68009190 comp rx=0 tx=0).stop 2024-04-14T23:35:03.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.389+0000 7fbb80571640 1 -- 172.21.15.47:0/3272132895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb780cf590 msgr2=0x7fbb7815d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.389+0000 7fbb80571640 1 --2- 172.21.15.47:0/3272132895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb780cf590 0x7fbb7815d170 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbb74034040 tx=0x7fbb740046c0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.389+0000 7fbb80571640 1 -- 172.21.15.47:0/3272132895 shutdown_connections 2024-04-14T23:35:03.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.389+0000 7fbb80571640 1 --2- 172.21.15.47:0/3272132895 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbb5c06b990 0x7fbb5c06de50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.389+0000 7fbb80571640 1 --2- 172.21.15.47:0/3272132895 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb78161870 0x7fbb781543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.389+0000 7fbb80571640 1 --2- 172.21.15.47:0/3272132895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb780cf590 0x7fbb7815d170 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.389+0000 7fbb80571640 1 --2- 172.21.15.47:0/3272132895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb780b4e30 0x7fbb780b6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.390+0000 7fbb80571640 1 -- 172.21.15.47:0/3272132895 >> 172.21.15.47:0/3272132895 conn(0x7fbb780d3f70 msgr2=0x7fbb7806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:03.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.390+0000 7fbb80571640 1 -- 172.21.15.47:0/3272132895 shutdown_connections 2024-04-14T23:35:03.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.390+0000 7fbb80571640 1 -- 172.21.15.47:0/3272132895 wait complete. 2024-04-14T23:35:03.403 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T23:35:03.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.504+0000 7f98af82d640 1 Processor -- start 2024-04-14T23:35:03.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.504+0000 7f98af82d640 1 -- start start 2024-04-14T23:35:03.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.505+0000 7f98af82d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f98a80d25d0 0x7f98a80d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.505+0000 7f98af82d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f98a80b7e50 0x7f98a80b8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.505+0000 7f98af82d640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98a80d2f80 con 0x7f98a80b53c0 2024-04-14T23:35:03.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.505+0000 7f98af82d640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f98a80b6e40 con 0x7f98a80d25d0 2024-04-14T23:35:03.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.505+0000 7f98af82d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f98a80b7090 con 0x7f98a80b7e50 2024-04-14T23:35:03.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.506+0000 7f98acdc8640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f98a80d25d0 0x7f98a80d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.506+0000 7f98addca640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f98a80b7e50 0x7f98a80b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.506+0000 7f98ad5c9640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f98a80b53c0 0x7f98a80cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.47:42548/0 (socket says 172.21.15.47:42548) 2024-04-14T23:35:03.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.506+0000 7f98ad5c9640 1 -- 172.21.15.47:0/3530148415 learned_addr learned my addr 172.21.15.47:0/3530148415 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:03.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.506+0000 7f98acdc8640 1 -- 172.21.15.47:0/3530148415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f98a80b7e50 msgr2=0x7f98a80b8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:03.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.506+0000 7f98acdc8640 1 --2- 172.21.15.47:0/3530148415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f98a80b7e50 0x7f98a80b8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.506+0000 7f98acdc8640 1 -- 172.21.15.47:0/3530148415 >> v1:172.21.15.191:6789/0 conn(0x7f98a80b53c0 legacy=0x7f98a80cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.506+0000 7f98acdc8640 1 -- 172.21.15.47:0/3530148415 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a80b7370 con 0x7f98a80d25d0 2024-04-14T23:35:03.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.507+0000 7f98acdc8640 1 --2- 172.21.15.47:0/3530148415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98a80d25d0 0x7f98a80d2a40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f989c0097a0 tx=0x7f989c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a24564ea6abbc4e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:03.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.507+0000 7f98a7fff640 1 -- 172.21.15.47:0/3530148415 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c034070 con 0x7f98a80d25d0 2024-04-14T23:35:03.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.507+0000 7f98a7fff640 1 -- 172.21.15.47:0/3530148415 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f989c030610 con 0x7f98a80d25d0 2024-04-14T23:35:03.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.507+0000 7f98a7fff640 1 -- 172.21.15.47:0/3530148415 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c0309e0 con 0x7f98a80d25d0 2024-04-14T23:35:03.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.507+0000 7f98af82d640 1 -- 172.21.15.47:0/3530148415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98a80d25d0 msgr2=0x7f98a80d2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.507+0000 7f98af82d640 1 --2- 172.21.15.47:0/3530148415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98a80d25d0 0x7f98a80d2a40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f989c0097a0 tx=0x7f989c02b960 comp rx=0 tx=0).stop 2024-04-14T23:35:03.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.508+0000 7f98af82d640 1 -- 172.21.15.47:0/3530148415 shutdown_connections 2024-04-14T23:35:03.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.508+0000 7f98af82d640 1 --2- 172.21.15.47:0/3530148415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f98a80b7e50 0x7f98a80b8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.508+0000 7f98af82d640 1 --2- 172.21.15.47:0/3530148415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98a80d25d0 0x7f98a80d2a40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.508+0000 7f98af82d640 1 -- 172.21.15.47:0/3530148415 >> 172.21.15.47:0/3530148415 conn(0x7f98a809d2c0 msgr2=0x7f98a80d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:03.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.508+0000 7f98af82d640 1 -- 172.21.15.47:0/3530148415 shutdown_connections 2024-04-14T23:35:03.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.508+0000 7f98af82d640 1 -- 172.21.15.47:0/3530148415 wait complete. 2024-04-14T23:35:03.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.509+0000 7f98af82d640 1 Processor -- start 2024-04-14T23:35:03.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.509+0000 7f98af82d640 1 -- start start 2024-04-14T23:35:03.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.509+0000 7f98af82d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98a80b53c0 0x7f98a8157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.509+0000 7f98af82d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98a80b7e50 0x7f98a815dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.509+0000 7f98af82d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f98a80d25d0 0x7f98a815e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.509+0000 7f98af82d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f98a80cfd00 con 0x7f98a80b53c0 2024-04-14T23:35:03.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.509+0000 7f98af82d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f98a80b7930 con 0x7f98a80b7e50 2024-04-14T23:35:03.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.509+0000 7f98af82d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f98a80b57a0 con 0x7f98a80d25d0 2024-04-14T23:35:03.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.510+0000 7f98ad5c9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98a80b53c0 0x7f98a8157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.510+0000 7f98ad5c9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98a80b53c0 0x7f98a8157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36424/0 (socket says 172.21.15.47:36424) 2024-04-14T23:35:03.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.510+0000 7f98ad5c9640 1 -- 172.21.15.47:0/2115544596 learned_addr learned my addr 172.21.15.47:0/2115544596 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:03.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.510+0000 7f98addca640 1 --2- 172.21.15.47:0/2115544596 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f98a80d25d0 0x7f98a815e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.510+0000 7f98acdc8640 1 --2- 172.21.15.47:0/2115544596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98a80b7e50 0x7f98a815dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.510+0000 7f98ad5c9640 1 -- 172.21.15.47:0/2115544596 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f98a80d25d0 msgr2=0x7f98a815e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.510+0000 7f98ad5c9640 1 --2- 172.21.15.47:0/2115544596 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f98a80d25d0 0x7f98a815e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.510+0000 7f98ad5c9640 1 -- 172.21.15.47:0/2115544596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98a80b7e50 msgr2=0x7f98a815dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.510+0000 7f98ad5c9640 1 --2- 172.21.15.47:0/2115544596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98a80b7e50 0x7f98a815dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.510+0000 7f98ad5c9640 1 -- 172.21.15.47:0/2115544596 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a80c85d0 con 0x7f98a80b53c0 2024-04-14T23:35:03.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.510+0000 7f98ad5c9640 1 --2- 172.21.15.47:0/2115544596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98a80b53c0 0x7f98a8157a80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f98a000c430 tx=0x7f98a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:03.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.510+0000 7f98a5ffb640 1 -- 172.21.15.47:0/2115544596 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0017070 con 0x7f98a80b53c0 2024-04-14T23:35:03.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.510+0000 7f98a5ffb640 1 -- 172.21.15.47:0/2115544596 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a0005ce0 con 0x7f98a80b53c0 2024-04-14T23:35:03.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.510+0000 7f98af82d640 1 -- 172.21.15.47:0/2115544596 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a80c88b0 con 0x7f98a80b53c0 2024-04-14T23:35:03.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.510+0000 7f98a5ffb640 1 -- 172.21.15.47:0/2115544596 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0007310 con 0x7f98a80b53c0 2024-04-14T23:35:03.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.510+0000 7f98af82d640 1 -- 172.21.15.47:0/2115544596 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a80c8e70 con 0x7f98a80b53c0 2024-04-14T23:35:03.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.511+0000 7f98af82d640 1 -- 172.21.15.47:0/2115544596 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a80d3d20 con 0x7f98a80b53c0 2024-04-14T23:35:03.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.512+0000 7f98a5ffb640 1 -- 172.21.15.47:0/2115544596 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f98a001a070 con 0x7f98a80b53c0 2024-04-14T23:35:03.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.512+0000 7f98a5ffb640 1 --2- 172.21.15.47:0/2115544596 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f989406b990 0x7f989406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.512+0000 7f98a5ffb640 1 -- 172.21.15.47:0/2115544596 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f98a0089e50 con 0x7f98a80b53c0 2024-04-14T23:35:03.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.512+0000 7f98acdc8640 1 --2- 172.21.15.47:0/2115544596 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f989406b990 0x7f989406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.513+0000 7f98acdc8640 1 --2- 172.21.15.47:0/2115544596 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f989406b990 0x7f989406de50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f989c036000 tx=0x7f989c03b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:03.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.516+0000 7f98a5ffb640 1 -- 172.21.15.47:0/2115544596 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f98a80d3d20 con 0x7f98a80b53c0 2024-04-14T23:35:03.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.696+0000 7f98af82d640 1 -- 172.21.15.47:0/2115544596 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f98a80b69d0 con 0x7f98a80b53c0 2024-04-14T23:35:03.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.697+0000 7f98a5ffb640 1 -- 172.21.15.47:0/2115544596 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f98a80b69d0 con 0x7f98a80b53c0 2024-04-14T23:35:03.700 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:03.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.699+0000 7f98af82d640 1 -- 172.21.15.47:0/2115544596 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f989406b990 msgr2=0x7f989406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.699+0000 7f98af82d640 1 --2- 172.21.15.47:0/2115544596 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f989406b990 0x7f989406de50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f989c036000 tx=0x7f989c03b040 comp rx=0 tx=0).stop 2024-04-14T23:35:03.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.699+0000 7f98af82d640 1 -- 172.21.15.47:0/2115544596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98a80b53c0 msgr2=0x7f98a8157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.699+0000 7f98af82d640 1 --2- 172.21.15.47:0/2115544596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98a80b53c0 0x7f98a8157a80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f98a000c430 tx=0x7f98a000c8f0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.699+0000 7f98af82d640 1 -- 172.21.15.47:0/2115544596 shutdown_connections 2024-04-14T23:35:03.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.699+0000 7f98af82d640 1 --2- 172.21.15.47:0/2115544596 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f989406b990 0x7f989406de50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.699+0000 7f98af82d640 1 --2- 172.21.15.47:0/2115544596 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f98a80d25d0 0x7f98a815e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.699+0000 7f98af82d640 1 --2- 172.21.15.47:0/2115544596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98a80b7e50 0x7f98a815dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.699+0000 7f98af82d640 1 --2- 172.21.15.47:0/2115544596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98a80b53c0 0x7f98a8157a80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.699+0000 7f98af82d640 1 -- 172.21.15.47:0/2115544596 >> 172.21.15.47:0/2115544596 conn(0x7f98a809d2c0 msgr2=0x7f98a806c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:03.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.699+0000 7f98af82d640 1 -- 172.21.15.47:0/2115544596 shutdown_connections 2024-04-14T23:35:03.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.699+0000 7f98af82d640 1 -- 172.21.15.47:0/2115544596 wait complete. 2024-04-14T23:35:03.713 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T23:35:03.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.815+0000 7f9a1d0c8640 1 Processor -- start 2024-04-14T23:35:03.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.815+0000 7f9a1d0c8640 1 -- start start 2024-04-14T23:35:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1d0c8640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9a180ca6e0 0x7f9a180cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1d0c8640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a180cfd20 con 0x7f9a180d06c0 2024-04-14T23:35:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1d0c8640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a180c7bf0 con 0x7f9a1815e640 2024-04-14T23:35:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1d0c8640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f9a180d0000 con 0x7f9a180ca6e0 2024-04-14T23:35:03.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a16d9d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9a180d06c0 0x7f9a180d0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55780/0 (socket says 172.21.15.47:55780) 2024-04-14T23:35:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a16d9d640 1 -- 172.21.15.47:0/2109578808 learned_addr learned my addr 172.21.15.47:0/2109578808 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1759e640 1 --2- 172.21.15.47:0/2109578808 >> v2:172.21.15.191:3300/0 conn(0x7f9a180ca6e0 0x7f9a180cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1659c640 1 -- 172.21.15.47:0/2109578808 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2273645637 0 0) 0x7f9a180cfd20 con 0x7f9a180d06c0 2024-04-14T23:35:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1659c640 1 -- 172.21.15.47:0/2109578808 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a04003520 con 0x7f9a180d06c0 2024-04-14T23:35:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1659c640 1 -- 172.21.15.47:0/2109578808 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2500782826 0 0) 0x7f9a04003520 con 0x7f9a180d06c0 2024-04-14T23:35:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1659c640 1 -- 172.21.15.47:0/2109578808 >> v2:172.21.15.191:3300/0 conn(0x7f9a180ca6e0 msgr2=0x7f9a180cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1659c640 1 --2- 172.21.15.47:0/2109578808 >> v2:172.21.15.191:3300/0 conn(0x7f9a180ca6e0 0x7f9a180cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1659c640 1 -- 172.21.15.47:0/2109578808 >> v1:172.21.15.191:6789/0 conn(0x7f9a1815e640 legacy=0x7f9a180d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1659c640 1 -- 172.21.15.47:0/2109578808 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a180c7ed0 con 0x7f9a180d06c0 2024-04-14T23:35:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1659c640 1 -- 172.21.15.47:0/2109578808 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f9a08001670 con 0x7f9a180d06c0 2024-04-14T23:35:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1659c640 1 -- 172.21.15.47:0/2109578808 >> v1:172.21.15.47:6789/0 conn(0x7f9a180d06c0 legacy=0x7f9a180d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1659c640 1 --2- 172.21.15.47:0/2109578808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a040039e0 0x7f9a04003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1659c640 1 --2- 172.21.15.47:0/2109578808 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a04004800 0x7f9a04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1659c640 1 --2- 172.21.15.47:0/2109578808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a040051c0 0x7f9a0400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1659c640 1 -- 172.21.15.47:0/2109578808 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9a180d0000 con 0x7f9a040039e0 2024-04-14T23:35:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1659c640 1 -- 172.21.15.47:0/2109578808 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0400c090 con 0x7f9a040051c0 2024-04-14T23:35:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a1659c640 1 -- 172.21.15.47:0/2109578808 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f9a0400c290 con 0x7f9a04004800 2024-04-14T23:35:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.816+0000 7f9a16d9d640 1 --2- 172.21.15.47:0/2109578808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a040039e0 0x7f9a04003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.817+0000 7f9a1759e640 1 --2- 172.21.15.47:0/2109578808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a040051c0 0x7f9a0400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.817+0000 7f9a0ffff640 1 --2- 172.21.15.47:0/2109578808 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a04004800 0x7f9a04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.817+0000 7f9a16d9d640 1 -- 172.21.15.47:0/2109578808 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a04004800 msgr2=0x7f9a04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.817+0000 7f9a16d9d640 1 --2- 172.21.15.47:0/2109578808 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a04004800 0x7f9a04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.817+0000 7f9a16d9d640 1 -- 172.21.15.47:0/2109578808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a040051c0 msgr2=0x7f9a0400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.817+0000 7f9a16d9d640 1 --2- 172.21.15.47:0/2109578808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a040051c0 0x7f9a0400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.817+0000 7f9a16d9d640 1 -- 172.21.15.47:0/2109578808 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a04003520 con 0x7f9a040039e0 2024-04-14T23:35:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.817+0000 7f9a1759e640 1 --2- 172.21.15.47:0/2109578808 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a040051c0 0x7f9a0400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.817+0000 7f9a1759e640 1 -- 172.21.15.47:0/2109578808 reap_dead start 2024-04-14T23:35:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.817+0000 7f9a16d9d640 1 --2- 172.21.15.47:0/2109578808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a040039e0 0x7f9a04003e00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800c240 tx=0x7f9a04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da80e8dda0705acb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:03.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.818+0000 7f9a1659c640 1 -- 172.21.15.47:0/2109578808 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08007d10 con 0x7f9a040039e0 2024-04-14T23:35:03.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.818+0000 7f9a1659c640 1 -- 172.21.15.47:0/2109578808 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a08030070 con 0x7f9a040039e0 2024-04-14T23:35:03.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.818+0000 7f9a1659c640 1 -- 172.21.15.47:0/2109578808 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08005d90 con 0x7f9a040039e0 2024-04-14T23:35:03.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.818+0000 7f9a1d0c8640 1 -- 172.21.15.47:0/2109578808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a040039e0 msgr2=0x7f9a04003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.818+0000 7f9a1d0c8640 1 --2- 172.21.15.47:0/2109578808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a040039e0 0x7f9a04003e00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800c240 tx=0x7f9a04005830 comp rx=0 tx=0).stop 2024-04-14T23:35:03.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.818+0000 7f9a1d0c8640 1 -- 172.21.15.47:0/2109578808 shutdown_connections 2024-04-14T23:35:03.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.818+0000 7f9a1d0c8640 1 --2- 172.21.15.47:0/2109578808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a040039e0 0x7f9a04003e00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.818+0000 7f9a1d0c8640 1 -- 172.21.15.47:0/2109578808 >> 172.21.15.47:0/2109578808 conn(0x7f9a180d3f70 msgr2=0x7f9a180d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:03.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.818+0000 7f9a1d0c8640 1 -- 172.21.15.47:0/2109578808 shutdown_connections 2024-04-14T23:35:03.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.818+0000 7f9a1d0c8640 1 -- 172.21.15.47:0/2109578808 wait complete. 2024-04-14T23:35:03.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.819+0000 7f9a1d0c8640 1 Processor -- start 2024-04-14T23:35:03.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.819+0000 7f9a1d0c8640 1 -- start start 2024-04-14T23:35:03.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.820+0000 7f9a1d0c8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a040039e0 0x7f9a1809e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.820+0000 7f9a1d0c8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a18150d60 0x7f9a180a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.820+0000 7f9a1d0c8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a180a1630 0x7f9a180b8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.820+0000 7f9a1d0c8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9a180cfa80 con 0x7f9a040039e0 2024-04-14T23:35:03.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.820+0000 7f9a1d0c8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9a180cf900 con 0x7f9a18150d60 2024-04-14T23:35:03.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.820+0000 7f9a1d0c8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f9a180c8240 con 0x7f9a180a1630 2024-04-14T23:35:03.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.820+0000 7f9a16d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a040039e0 0x7f9a1809e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.820+0000 7f9a16d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a040039e0 0x7f9a1809e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44898/0 (socket says 172.21.15.47:44898) 2024-04-14T23:35:03.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.820+0000 7f9a16d9d640 1 -- 172.21.15.47:0/1294923185 learned_addr learned my addr 172.21.15.47:0/1294923185 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:03.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.820+0000 7f9a0ffff640 1 --2- 172.21.15.47:0/1294923185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a18150d60 0x7f9a180a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.821+0000 7f9a16d9d640 1 -- 172.21.15.47:0/1294923185 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a180a1630 msgr2=0x7f9a180b8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.821+0000 7f9a1759e640 1 --2- 172.21.15.47:0/1294923185 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a180a1630 0x7f9a180b8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.821+0000 7f9a16d9d640 1 --2- 172.21.15.47:0/1294923185 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a180a1630 0x7f9a180b8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.821+0000 7f9a16d9d640 1 -- 172.21.15.47:0/1294923185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a18150d60 msgr2=0x7f9a180a10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:03.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.821+0000 7f9a16d9d640 1 --2- 172.21.15.47:0/1294923185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a18150d60 0x7f9a180a10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:03.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.821+0000 7f9a16d9d640 1 -- 172.21.15.47:0/1294923185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a180a1ab0 con 0x7f9a040039e0 2024-04-14T23:35:03.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.821+0000 7f9a0ffff640 1 --2- 172.21.15.47:0/1294923185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a18150d60 0x7f9a180a10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:03.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.821+0000 7f9a16d9d640 1 --2- 172.21.15.47:0/1294923185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a040039e0 0x7f9a1809e780 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9a0802c520 tx=0x7f9a180c7dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:03.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.821+0000 7f9a0f7fe640 1 -- 172.21.15.47:0/1294923185 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08045070 con 0x7f9a040039e0 2024-04-14T23:35:03.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.821+0000 7f9a0f7fe640 1 -- 172.21.15.47:0/1294923185 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a080049f0 con 0x7f9a040039e0 2024-04-14T23:35:03.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.821+0000 7f9a1d0c8640 1 -- 172.21.15.47:0/1294923185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a181515d0 con 0x7f9a040039e0 2024-04-14T23:35:03.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.821+0000 7f9a0f7fe640 1 -- 172.21.15.47:0/1294923185 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08007d10 con 0x7f9a040039e0 2024-04-14T23:35:03.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.821+0000 7f9a1d0c8640 1 -- 172.21.15.47:0/1294923185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a18151b90 con 0x7f9a040039e0 2024-04-14T23:35:03.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.822+0000 7f9a1d0c8640 1 -- 172.21.15.47:0/1294923185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a180b9c10 con 0x7f9a040039e0 2024-04-14T23:35:03.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.822+0000 7f9a0f7fe640 1 -- 172.21.15.47:0/1294923185 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9a08007070 con 0x7f9a040039e0 2024-04-14T23:35:03.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.823+0000 7f9a0f7fe640 1 --2- 172.21.15.47:0/1294923185 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f99f806b9c0 0x7f99f806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:03.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.823+0000 7f9a0f7fe640 1 -- 172.21.15.47:0/1294923185 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9a080ab660 con 0x7f9a040039e0 2024-04-14T23:35:03.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.823+0000 7f9a0ffff640 1 --2- 172.21.15.47:0/1294923185 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f99f806b9c0 0x7f99f806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:03.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.823+0000 7f9a0ffff640 1 --2- 172.21.15.47:0/1294923185 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f99f806b9c0 0x7f99f806de80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9a00000c00 tx=0x7f9a00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:03.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:03.827+0000 7f9a0f7fe640 1 -- 172.21.15.47:0/1294923185 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9a180b9c10 con 0x7f9a040039e0 2024-04-14T23:35:04.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.007+0000 7f9a1d0c8640 1 -- 172.21.15.47:0/1294923185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9a180c85d0 con 0x7f9a040039e0 2024-04-14T23:35:04.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.007+0000 7f9a0f7fe640 1 -- 172.21.15.47:0/1294923185 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f9a080798e0 con 0x7f9a040039e0 2024-04-14T23:35:04.010 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-14T23:35:04.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.009+0000 7f9a1d0c8640 1 -- 172.21.15.47:0/1294923185 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f99f806b9c0 msgr2=0x7f99f806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.009+0000 7f9a1d0c8640 1 --2- 172.21.15.47:0/1294923185 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f99f806b9c0 0x7f99f806de80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9a00000c00 tx=0x7f9a00009040 comp rx=0 tx=0).stop 2024-04-14T23:35:04.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.009+0000 7f9a1d0c8640 1 -- 172.21.15.47:0/1294923185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a040039e0 msgr2=0x7f9a1809e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.009+0000 7f9a1d0c8640 1 --2- 172.21.15.47:0/1294923185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a040039e0 0x7f9a1809e780 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9a0802c520 tx=0x7f9a180c7dc0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.009+0000 7f9a1d0c8640 1 -- 172.21.15.47:0/1294923185 shutdown_connections 2024-04-14T23:35:04.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.009+0000 7f9a1d0c8640 1 --2- 172.21.15.47:0/1294923185 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f99f806b9c0 0x7f99f806de80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.009+0000 7f9a1d0c8640 1 --2- 172.21.15.47:0/1294923185 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a180a1630 0x7f9a180b8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.009+0000 7f9a1d0c8640 1 --2- 172.21.15.47:0/1294923185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a18150d60 0x7f9a180a10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.009+0000 7f9a1d0c8640 1 --2- 172.21.15.47:0/1294923185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a040039e0 0x7f9a1809e780 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.009+0000 7f9a1d0c8640 1 -- 172.21.15.47:0/1294923185 >> 172.21.15.47:0/1294923185 conn(0x7f9a180d3f70 msgr2=0x7f9a180c90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:04.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.009+0000 7f9a1d0c8640 1 -- 172.21.15.47:0/1294923185 shutdown_connections 2024-04-14T23:35:04.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.009+0000 7f9a1d0c8640 1 -- 172.21.15.47:0/1294923185 wait complete. 2024-04-14T23:35:04.023 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T23:35:04.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.124+0000 7f9493155640 1 Processor -- start 2024-04-14T23:35:04.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.124+0000 7f9493155640 1 -- start start 2024-04-14T23:35:04.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.125+0000 7f9493155640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f948c0aeab0 0x7f948c1690f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.125+0000 7f9493155640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f948c06f3c0 con 0x7f948c15e420 2024-04-14T23:35:04.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.125+0000 7f9493155640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f948c06c3b0 con 0x7f948c06f920 2024-04-14T23:35:04.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.125+0000 7f9493155640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f948c06cfc0 con 0x7f948c0aeab0 2024-04-14T23:35:04.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.125+0000 7f948bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f948c15e420 0x7f948c0d0b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55786/0 (socket says 172.21.15.47:55786) 2024-04-14T23:35:04.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.125+0000 7f948bfff640 1 -- 172.21.15.47:0/1767856184 learned_addr learned my addr 172.21.15.47:0/1767856184 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:04.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.125+0000 7f94916f2640 1 --2- 172.21.15.47:0/1767856184 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f948c0aeab0 0x7f948c1690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.125+0000 7f948b7fe640 1 -- 172.21.15.47:0/1767856184 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 429376625 0 0) 0x7f948c06f3c0 con 0x7f948c15e420 2024-04-14T23:35:04.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.125+0000 7f948b7fe640 1 -- 172.21.15.47:0/1767856184 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f947c003520 con 0x7f948c15e420 2024-04-14T23:35:04.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.125+0000 7f948b7fe640 1 -- 172.21.15.47:0/1767856184 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 691247811 0 0) 0x7f948c06c3b0 con 0x7f948c06f920 2024-04-14T23:35:04.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.126+0000 7f948b7fe640 1 -- 172.21.15.47:0/1767856184 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f948c06f3c0 con 0x7f948c06f920 2024-04-14T23:35:04.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.126+0000 7f94916f2640 1 -- 172.21.15.47:0/1767856184 >> v1:172.21.15.191:6789/0 conn(0x7f948c06f920 legacy=0x7f948c06fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.126+0000 7f94916f2640 1 -- 172.21.15.47:0/1767856184 >> v1:172.21.15.47:6789/0 conn(0x7f948c15e420 legacy=0x7f948c0d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.126+0000 7f948b7fe640 1 -- 172.21.15.47:0/1767856184 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 900172234 0 0) 0x7f947c003520 con 0x7f948c15e420 2024-04-14T23:35:04.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.126+0000 7f94916f2640 1 -- 172.21.15.47:0/1767856184 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c06c690 con 0x7f948c0aeab0 2024-04-14T23:35:04.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.126+0000 7f94916f2640 1 --2- 172.21.15.47:0/1767856184 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f948c0aeab0 0x7f948c1690f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9484009dc0 tx=0x7f948402bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c971e18a815870a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:04.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.126+0000 7f948b7fe640 1 -- 172.21.15.47:0/1767856184 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9484039070 con 0x7f948c0aeab0 2024-04-14T23:35:04.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.127+0000 7f948b7fe640 1 -- 172.21.15.47:0/1767856184 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f948402c910 con 0x7f948c0aeab0 2024-04-14T23:35:04.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.127+0000 7f948b7fe640 1 -- 172.21.15.47:0/1767856184 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478001670 con 0x7f948c0aeab0 2024-04-14T23:35:04.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.127+0000 7f9493155640 1 -- 172.21.15.47:0/1767856184 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f948c0aeab0 msgr2=0x7f948c1690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.127+0000 7f9493155640 1 --2- 172.21.15.47:0/1767856184 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f948c0aeab0 0x7f948c1690f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9484009dc0 tx=0x7f948402bde0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.127+0000 7f9493155640 1 -- 172.21.15.47:0/1767856184 shutdown_connections 2024-04-14T23:35:04.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.127+0000 7f9493155640 1 --2- 172.21.15.47:0/1767856184 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f948c0aeab0 0x7f948c1690f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.127+0000 7f9493155640 1 -- 172.21.15.47:0/1767856184 >> 172.21.15.47:0/1767856184 conn(0x7f948c0b37d0 msgr2=0x7f948c0b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:04.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.127+0000 7f9493155640 1 -- 172.21.15.47:0/1767856184 shutdown_connections 2024-04-14T23:35:04.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.127+0000 7f9493155640 1 -- 172.21.15.47:0/1767856184 wait complete. 2024-04-14T23:35:04.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.128+0000 7f9493155640 1 Processor -- start 2024-04-14T23:35:04.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.128+0000 7f9493155640 1 -- start start 2024-04-14T23:35:04.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.129+0000 7f9493155640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f948c06f920 0x7f948c0c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.129+0000 7f9493155640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f948c0aeab0 0x7f948c157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.129+0000 7f9493155640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f948c15e420 0x7f948c1e9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.129+0000 7f9493155640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f948c0d1210 con 0x7f948c0aeab0 2024-04-14T23:35:04.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.129+0000 7f9493155640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f948c06cc50 con 0x7f948c15e420 2024-04-14T23:35:04.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.129+0000 7f9493155640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f948c0d1390 con 0x7f948c06f920 2024-04-14T23:35:04.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.129+0000 7f948bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f948c0aeab0 0x7f948c157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.129+0000 7f948bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f948c0aeab0 0x7f948c157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44914/0 (socket says 172.21.15.47:44914) 2024-04-14T23:35:04.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.129+0000 7f948bfff640 1 -- 172.21.15.47:0/1466586936 learned_addr learned my addr 172.21.15.47:0/1466586936 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:04.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.129+0000 7f9490ef1640 1 --2- 172.21.15.47:0/1466586936 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f948c06f920 0x7f948c0c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.129+0000 7f94916f2640 1 --2- 172.21.15.47:0/1466586936 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f948c15e420 0x7f948c1e9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.130+0000 7f948bfff640 1 -- 172.21.15.47:0/1466586936 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f948c06f920 msgr2=0x7f948c0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.130+0000 7f948bfff640 1 --2- 172.21.15.47:0/1466586936 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f948c06f920 0x7f948c0c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.130+0000 7f948bfff640 1 -- 172.21.15.47:0/1466586936 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f948c15e420 msgr2=0x7f948c1e9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.130+0000 7f948bfff640 1 --2- 172.21.15.47:0/1466586936 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f948c15e420 0x7f948c1e9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.130+0000 7f948bfff640 1 -- 172.21.15.47:0/1466586936 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c0c6720 con 0x7f948c0aeab0 2024-04-14T23:35:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.130+0000 7f948bfff640 1 --2- 172.21.15.47:0/1466586936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f948c0aeab0 0x7f948c157100 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9478000fd0 tx=0x7f947800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.130+0000 7f94897fa640 1 -- 172.21.15.47:0/1466586936 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478017070 con 0x7f948c0aeab0 2024-04-14T23:35:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.130+0000 7f94897fa640 1 -- 172.21.15.47:0/1466586936 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9478005ad0 con 0x7f948c0aeab0 2024-04-14T23:35:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.130+0000 7f9493155640 1 -- 172.21.15.47:0/1466586936 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948c157640 con 0x7f948c0aeab0 2024-04-14T23:35:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.130+0000 7f94897fa640 1 -- 172.21.15.47:0/1466586936 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478007070 con 0x7f948c0aeab0 2024-04-14T23:35:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.130+0000 7f9493155640 1 -- 172.21.15.47:0/1466586936 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948c0c7a70 con 0x7f948c0aeab0 2024-04-14T23:35:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.131+0000 7f9493155640 1 -- 172.21.15.47:0/1466586936 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f948c073f50 con 0x7f948c0aeab0 2024-04-14T23:35:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.131+0000 7f94897fa640 1 -- 172.21.15.47:0/1466586936 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f947801a070 con 0x7f948c0aeab0 2024-04-14T23:35:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.132+0000 7f94897fa640 1 --2- 172.21.15.47:0/1466586936 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f947006b9c0 0x7f947006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.132+0000 7f94897fa640 1 -- 172.21.15.47:0/1466586936 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9478089f20 con 0x7f948c0aeab0 2024-04-14T23:35:04.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.132+0000 7f9490ef1640 1 --2- 172.21.15.47:0/1466586936 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f947006b9c0 0x7f947006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.132+0000 7f9490ef1640 1 --2- 172.21.15.47:0/1466586936 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f947006b9c0 0x7f947006de80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f94800011e0 tx=0x7f9480009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:04.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.136+0000 7f94897fa640 1 -- 172.21.15.47:0/1466586936 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f948c0c6720 con 0x7f948c0aeab0 2024-04-14T23:35:04.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.317+0000 7f9493155640 1 -- 172.21.15.47:0/1466586936 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f948c0cf910 con 0x7f948c0aeab0 2024-04-14T23:35:04.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.317+0000 7f94897fa640 1 -- 172.21.15.47:0/1466586936 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f94780581a0 con 0x7f948c0aeab0 2024-04-14T23:35:04.321 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:04.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.319+0000 7f9493155640 1 -- 172.21.15.47:0/1466586936 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f947006b9c0 msgr2=0x7f947006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.319+0000 7f9493155640 1 --2- 172.21.15.47:0/1466586936 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f947006b9c0 0x7f947006de80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f94800011e0 tx=0x7f9480009040 comp rx=0 tx=0).stop 2024-04-14T23:35:04.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.319+0000 7f9493155640 1 -- 172.21.15.47:0/1466586936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f948c0aeab0 msgr2=0x7f948c157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.319+0000 7f9493155640 1 --2- 172.21.15.47:0/1466586936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f948c0aeab0 0x7f948c157100 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9478000fd0 tx=0x7f947800cbe0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.319+0000 7f9493155640 1 -- 172.21.15.47:0/1466586936 shutdown_connections 2024-04-14T23:35:04.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.319+0000 7f9493155640 1 --2- 172.21.15.47:0/1466586936 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f947006b9c0 0x7f947006de80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.319+0000 7f9493155640 1 --2- 172.21.15.47:0/1466586936 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f948c15e420 0x7f948c1e9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.319+0000 7f9493155640 1 --2- 172.21.15.47:0/1466586936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f948c0aeab0 0x7f948c157100 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.319+0000 7f9493155640 1 --2- 172.21.15.47:0/1466586936 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f948c06f920 0x7f948c0c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.319+0000 7f9493155640 1 -- 172.21.15.47:0/1466586936 >> 172.21.15.47:0/1466586936 conn(0x7f948c0b37d0 msgr2=0x7f948c0aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:04.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.319+0000 7f9493155640 1 -- 172.21.15.47:0/1466586936 shutdown_connections 2024-04-14T23:35:04.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.319+0000 7f9493155640 1 -- 172.21.15.47:0/1466586936 wait complete. 2024-04-14T23:35:04.333 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T23:35:04.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.432+0000 7f382979c640 1 Processor -- start 2024-04-14T23:35:04.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.432+0000 7f382979c640 1 -- start start 2024-04-14T23:35:04.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f382979c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f38240cdcb0 0x7f38240cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f382979c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3824162d10 con 0x7f382406d0b0 2024-04-14T23:35:04.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f382979c640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38240cfed0 con 0x7f382406cc20 2024-04-14T23:35:04.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f382979c640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f38240d0170 con 0x7f38240cdcb0 2024-04-14T23:35:04.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38237fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f382406d0b0 0x7f3824162600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55794/0 (socket says 172.21.15.47:55794) 2024-04-14T23:35:04.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38237fe640 1 -- 172.21.15.47:0/2384717035 learned_addr learned my addr 172.21.15.47:0/2384717035 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:04.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f3822ffd640 1 --2- 172.21.15.47:0/2384717035 >> v2:172.21.15.191:3300/0 conn(0x7f38240cdcb0 0x7f38240cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38227fc640 1 -- 172.21.15.47:0/2384717035 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277577237 0 0) 0x7f3824162d10 con 0x7f382406d0b0 2024-04-14T23:35:04.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38227fc640 1 -- 172.21.15.47:0/2384717035 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3810003520 con 0x7f382406d0b0 2024-04-14T23:35:04.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38227fc640 1 -- 172.21.15.47:0/2384717035 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4193747156 0 0) 0x7f3810003520 con 0x7f382406d0b0 2024-04-14T23:35:04.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38227fc640 1 -- 172.21.15.47:0/2384717035 >> v2:172.21.15.191:3300/0 conn(0x7f38240cdcb0 msgr2=0x7f38240cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:04.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38227fc640 1 --2- 172.21.15.47:0/2384717035 >> v2:172.21.15.191:3300/0 conn(0x7f38240cdcb0 0x7f38240cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38227fc640 1 -- 172.21.15.47:0/2384717035 >> v1:172.21.15.191:6789/0 conn(0x7f382406cc20 legacy=0x7f3824161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38227fc640 1 -- 172.21.15.47:0/2384717035 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38240d0450 con 0x7f382406d0b0 2024-04-14T23:35:04.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38227fc640 1 -- 172.21.15.47:0/2384717035 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f381c0019f0 con 0x7f382406d0b0 2024-04-14T23:35:04.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38227fc640 1 -- 172.21.15.47:0/2384717035 >> v1:172.21.15.47:6789/0 conn(0x7f382406d0b0 legacy=0x7f3824162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38227fc640 1 --2- 172.21.15.47:0/2384717035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38100039b0 0x7f3810003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38227fc640 1 --2- 172.21.15.47:0/2384717035 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3810004800 0x7f3810004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38227fc640 1 --2- 172.21.15.47:0/2384717035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38100051c0 0x7f381000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38227fc640 1 -- 172.21.15.47:0/2384717035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f38240d0170 con 0x7f38100039b0 2024-04-14T23:35:04.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38227fc640 1 -- 172.21.15.47:0/2384717035 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f381000c060 con 0x7f38100051c0 2024-04-14T23:35:04.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38227fc640 1 -- 172.21.15.47:0/2384717035 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f381000c260 con 0x7f3810004800 2024-04-14T23:35:04.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f3822ffd640 1 --2- 172.21.15.47:0/2384717035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38100039b0 0x7f3810003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f38237fe640 1 --2- 172.21.15.47:0/2384717035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38100051c0 0x7f381000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.433+0000 7f381bfff640 1 --2- 172.21.15.47:0/2384717035 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3810004800 0x7f3810004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.434+0000 7f3822ffd640 1 -- 172.21.15.47:0/2384717035 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3810004800 msgr2=0x7f3810004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:04.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.434+0000 7f3822ffd640 1 --2- 172.21.15.47:0/2384717035 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3810004800 0x7f3810004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.434+0000 7f3822ffd640 1 -- 172.21.15.47:0/2384717035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38100051c0 msgr2=0x7f381000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:04.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.434+0000 7f3822ffd640 1 --2- 172.21.15.47:0/2384717035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38100051c0 0x7f381000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.434+0000 7f3822ffd640 1 -- 172.21.15.47:0/2384717035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3810003520 con 0x7f38100039b0 2024-04-14T23:35:04.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.434+0000 7f38237fe640 1 --2- 172.21.15.47:0/2384717035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38100051c0 0x7f381000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:04.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.434+0000 7f38237fe640 1 -- 172.21.15.47:0/2384717035 reap_dead start 2024-04-14T23:35:04.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.434+0000 7f3822ffd640 1 --2- 172.21.15.47:0/2384717035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38100039b0 0x7f3810003dd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3814009ac0 tx=0x7f3810005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc16f0119b7d6954 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:04.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.434+0000 7f38227fc640 1 -- 172.21.15.47:0/2384717035 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814039070 con 0x7f38100039b0 2024-04-14T23:35:04.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.435+0000 7f38227fc640 1 -- 172.21.15.47:0/2384717035 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f381402c6b0 con 0x7f38100039b0 2024-04-14T23:35:04.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.435+0000 7f38227fc640 1 -- 172.21.15.47:0/2384717035 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814009690 con 0x7f38100039b0 2024-04-14T23:35:04.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.435+0000 7f382979c640 1 -- 172.21.15.47:0/2384717035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38100039b0 msgr2=0x7f3810003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.435+0000 7f382979c640 1 --2- 172.21.15.47:0/2384717035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38100039b0 0x7f3810003dd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3814009ac0 tx=0x7f3810005830 comp rx=0 tx=0).stop 2024-04-14T23:35:04.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.435+0000 7f382979c640 1 -- 172.21.15.47:0/2384717035 shutdown_connections 2024-04-14T23:35:04.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.435+0000 7f382979c640 1 --2- 172.21.15.47:0/2384717035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38100039b0 0x7f3810003dd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.435+0000 7f382979c640 1 -- 172.21.15.47:0/2384717035 >> 172.21.15.47:0/2384717035 conn(0x7f38240d1c90 msgr2=0x7f38240d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:04.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.435+0000 7f382979c640 1 -- 172.21.15.47:0/2384717035 shutdown_connections 2024-04-14T23:35:04.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.435+0000 7f382979c640 1 -- 172.21.15.47:0/2384717035 wait complete. 2024-04-14T23:35:04.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.436+0000 7f382979c640 1 Processor -- start 2024-04-14T23:35:04.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.436+0000 7f382979c640 1 -- start start 2024-04-14T23:35:04.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.437+0000 7f382979c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38100039b0 0x7f382415d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.437+0000 7f382979c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f382415df60 0x7f382409c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.437+0000 7f382979c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f382409d2e0 0x7f382409d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.437+0000 7f382979c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f38240d0cf0 con 0x7f38100039b0 2024-04-14T23:35:04.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.437+0000 7f382979c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f38240d0a10 con 0x7f382415df60 2024-04-14T23:35:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.437+0000 7f382979c640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f38240ce090 con 0x7f382409d2e0 2024-04-14T23:35:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.437+0000 7f3822ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38100039b0 0x7f382415d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.437+0000 7f3822ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38100039b0 0x7f382415d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44932/0 (socket says 172.21.15.47:44932) 2024-04-14T23:35:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.437+0000 7f3822ffd640 1 -- 172.21.15.47:0/517714278 learned_addr learned my addr 172.21.15.47:0/517714278 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.437+0000 7f3822ffd640 1 -- 172.21.15.47:0/517714278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f382409d2e0 msgr2=0x7f382409d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.437+0000 7f3822ffd640 1 --2- 172.21.15.47:0/517714278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f382409d2e0 0x7f382409d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.437+0000 7f3822ffd640 1 -- 172.21.15.47:0/517714278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f382415df60 msgr2=0x7f382409c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.437+0000 7f3822ffd640 1 --2- 172.21.15.47:0/517714278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f382415df60 0x7f382409c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.437+0000 7f3822ffd640 1 -- 172.21.15.47:0/517714278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382415dc00 con 0x7f38100039b0 2024-04-14T23:35:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.438+0000 7f3822ffd640 1 --2- 172.21.15.47:0/517714278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38100039b0 0x7f382415d6c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3814037040 tx=0x7f3814004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.438+0000 7f381b7fe640 1 -- 172.21.15.47:0/517714278 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814042020 con 0x7f38100039b0 2024-04-14T23:35:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.438+0000 7f381b7fe640 1 -- 172.21.15.47:0/517714278 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f381403a040 con 0x7f38100039b0 2024-04-14T23:35:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.438+0000 7f381b7fe640 1 -- 172.21.15.47:0/517714278 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814039070 con 0x7f38100039b0 2024-04-14T23:35:04.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.438+0000 7f382979c640 1 -- 172.21.15.47:0/517714278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38240c6830 con 0x7f38100039b0 2024-04-14T23:35:04.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.438+0000 7f382979c640 1 -- 172.21.15.47:0/517714278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382409df40 con 0x7f38100039b0 2024-04-14T23:35:04.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.439+0000 7f382979c640 1 -- 172.21.15.47:0/517714278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3824075430 con 0x7f38100039b0 2024-04-14T23:35:04.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.439+0000 7f381b7fe640 1 -- 172.21.15.47:0/517714278 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f3814045020 con 0x7f38100039b0 2024-04-14T23:35:04.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.440+0000 7f381b7fe640 1 --2- 172.21.15.47:0/517714278 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f380406b990 0x7f380406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.440+0000 7f381b7fe640 1 -- 172.21.15.47:0/517714278 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f38140abe80 con 0x7f38100039b0 2024-04-14T23:35:04.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.440+0000 7f381bfff640 1 --2- 172.21.15.47:0/517714278 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f380406b990 0x7f380406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.441+0000 7f381bfff640 1 --2- 172.21.15.47:0/517714278 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f380406b990 0x7f380406de50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f380c007fd0 tx=0x7f380c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:04.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.444+0000 7f381b7fe640 1 -- 172.21.15.47:0/517714278 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f381404c070 con 0x7f38100039b0 2024-04-14T23:35:04.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.664+0000 7f382979c640 1 -- 172.21.15.47:0/517714278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38240ceea0 con 0x7f38100039b0 2024-04-14T23:35:04.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.664+0000 7f381b7fe640 1 -- 172.21.15.47:0/517714278 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f381407a750 con 0x7f38100039b0 2024-04-14T23:35:04.667 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:04.667 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/416388535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":416388535},{"type":"v1","addr":"172.21.15.191:6837","nonce":416388535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/2830978927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2830978927},{"type":"v1","addr":"172.21.15.47:6833","nonce":2830978927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/4025654680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":4025654680},{"type":"v1","addr":"172.21.15.191:6836","nonce":4025654680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T23:34:38.059644+0000","modified":"2024-04-14T23:34:54.105483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/1169029730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1169029730},{"type":"v1","addr":"172.21.15.47:6835","nonce":1169029730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-14T23:35:04.668 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-04-14T23:35:04.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.666+0000 7f382979c640 1 -- 172.21.15.47:0/517714278 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f380406b990 msgr2=0x7f380406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.666+0000 7f382979c640 1 --2- 172.21.15.47:0/517714278 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f380406b990 0x7f380406de50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f380c007fd0 tx=0x7f380c009040 comp rx=0 tx=0).stop 2024-04-14T23:35:04.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.666+0000 7f382979c640 1 -- 172.21.15.47:0/517714278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38100039b0 msgr2=0x7f382415d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.666+0000 7f382979c640 1 --2- 172.21.15.47:0/517714278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38100039b0 0x7f382415d6c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3814037040 tx=0x7f3814004730 comp rx=0 tx=0).stop 2024-04-14T23:35:04.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.666+0000 7f382979c640 1 -- 172.21.15.47:0/517714278 shutdown_connections 2024-04-14T23:35:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.666+0000 7f382979c640 1 --2- 172.21.15.47:0/517714278 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f380406b990 0x7f380406de50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.666+0000 7f382979c640 1 --2- 172.21.15.47:0/517714278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f382409d2e0 0x7f382409d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.666+0000 7f382979c640 1 --2- 172.21.15.47:0/517714278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f382415df60 0x7f382409c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.666+0000 7f382979c640 1 --2- 172.21.15.47:0/517714278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38100039b0 0x7f382415d6c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.666+0000 7f382979c640 1 -- 172.21.15.47:0/517714278 >> 172.21.15.47:0/517714278 conn(0x7f38240d1c90 msgr2=0x7f3824160e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.666+0000 7f382979c640 1 -- 172.21.15.47:0/517714278 shutdown_connections 2024-04-14T23:35:04.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.666+0000 7f382979c640 1 -- 172.21.15.47:0/517714278 wait complete. 2024-04-14T23:35:04.680 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:04.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.779+0000 7fc9672d5640 1 Processor -- start 2024-04-14T23:35:04.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.779+0000 7fc9672d5640 1 -- start start 2024-04-14T23:35:04.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc9672d5640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc9600d1e00 0x7fc9600d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc9672d5640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9600d1620 con 0x7fc96015e270 2024-04-14T23:35:04.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc9672d5640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9600b39d0 con 0x7fc9600d2740 2024-04-14T23:35:04.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc9672d5640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fc9600d2bb0 con 0x7fc9600d1e00 2024-04-14T23:35:04.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc965071640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc96015e270 0x7fc9600d0f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55806/0 (socket says 172.21.15.47:55806) 2024-04-14T23:35:04.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc965071640 1 -- 172.21.15.47:0/404541769 learned_addr learned my addr 172.21.15.47:0/404541769 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:04.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc964870640 1 --2- 172.21.15.47:0/404541769 >> v2:172.21.15.191:3300/0 conn(0x7fc9600d1e00 0x7fc9600d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc957fff640 1 -- 172.21.15.47:0/404541769 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2176085599 0 0) 0x7fc9600d1620 con 0x7fc96015e270 2024-04-14T23:35:04.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc957fff640 1 -- 172.21.15.47:0/404541769 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc94c003520 con 0x7fc96015e270 2024-04-14T23:35:04.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc957fff640 1 -- 172.21.15.47:0/404541769 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3362119062 0 0) 0x7fc94c003520 con 0x7fc96015e270 2024-04-14T23:35:04.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc957fff640 1 -- 172.21.15.47:0/404541769 >> v2:172.21.15.191:3300/0 conn(0x7fc9600d1e00 msgr2=0x7fc9600d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:04.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc957fff640 1 --2- 172.21.15.47:0/404541769 >> v2:172.21.15.191:3300/0 conn(0x7fc9600d1e00 0x7fc9600d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc957fff640 1 -- 172.21.15.47:0/404541769 >> v1:172.21.15.191:6789/0 conn(0x7fc9600d2740 legacy=0x7fc9600b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc957fff640 1 -- 172.21.15.47:0/404541769 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9600b3cb0 con 0x7fc96015e270 2024-04-14T23:35:04.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc957fff640 1 -- 172.21.15.47:0/404541769 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7fc95c001670 con 0x7fc96015e270 2024-04-14T23:35:04.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc957fff640 1 -- 172.21.15.47:0/404541769 >> v1:172.21.15.47:6789/0 conn(0x7fc96015e270 legacy=0x7fc9600d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc957fff640 1 --2- 172.21.15.47:0/404541769 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc94c0039b0 0x7fc94c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc957fff640 1 --2- 172.21.15.47:0/404541769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc94c004800 0x7fc94c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc957fff640 1 --2- 172.21.15.47:0/404541769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc94c0051c0 0x7fc94c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc957fff640 1 -- 172.21.15.47:0/404541769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc9600d2bb0 con 0x7fc94c004800 2024-04-14T23:35:04.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc957fff640 1 -- 172.21.15.47:0/404541769 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc94c00c070 con 0x7fc94c0051c0 2024-04-14T23:35:04.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc957fff640 1 -- 172.21.15.47:0/404541769 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc94c00c270 con 0x7fc94c0039b0 2024-04-14T23:35:04.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc964870640 1 --2- 172.21.15.47:0/404541769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc94c004800 0x7fc94c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.780+0000 7fc965071640 1 --2- 172.21.15.47:0/404541769 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc94c0039b0 0x7fc94c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.781+0000 7fc965872640 1 --2- 172.21.15.47:0/404541769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc94c0051c0 0x7fc94c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.781+0000 7fc964870640 1 -- 172.21.15.47:0/404541769 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc94c0039b0 msgr2=0x7fc94c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:04.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.781+0000 7fc964870640 1 --2- 172.21.15.47:0/404541769 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc94c0039b0 0x7fc94c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.781+0000 7fc964870640 1 -- 172.21.15.47:0/404541769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc94c0051c0 msgr2=0x7fc94c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:04.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.781+0000 7fc964870640 1 --2- 172.21.15.47:0/404541769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc94c0051c0 0x7fc94c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.781+0000 7fc965872640 1 -- 172.21.15.47:0/404541769 reap_dead start 2024-04-14T23:35:04.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.781+0000 7fc964870640 1 -- 172.21.15.47:0/404541769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94c003520 con 0x7fc94c004800 2024-04-14T23:35:04.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.782+0000 7fc964870640 1 --2- 172.21.15.47:0/404541769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc94c004800 0x7fc94c004c80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc950009a90 tx=0x7fc94c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96174f8850723c75 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:04.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.782+0000 7fc957fff640 1 -- 172.21.15.47:0/404541769 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950039070 con 0x7fc94c004800 2024-04-14T23:35:04.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.782+0000 7fc957fff640 1 -- 172.21.15.47:0/404541769 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc95002c680 con 0x7fc94c004800 2024-04-14T23:35:04.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.782+0000 7fc957fff640 1 -- 172.21.15.47:0/404541769 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950009690 con 0x7fc94c004800 2024-04-14T23:35:04.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.783+0000 7fc9672d5640 1 -- 172.21.15.47:0/404541769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc94c004800 msgr2=0x7fc94c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.783+0000 7fc9672d5640 1 --2- 172.21.15.47:0/404541769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc94c004800 0x7fc94c004c80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc950009a90 tx=0x7fc94c005830 comp rx=0 tx=0).stop 2024-04-14T23:35:04.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.783+0000 7fc9672d5640 1 -- 172.21.15.47:0/404541769 shutdown_connections 2024-04-14T23:35:04.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.783+0000 7fc9672d5640 1 --2- 172.21.15.47:0/404541769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc94c004800 0x7fc94c004c80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.783+0000 7fc9672d5640 1 -- 172.21.15.47:0/404541769 >> 172.21.15.47:0/404541769 conn(0x7fc9600d3ed0 msgr2=0x7fc9600d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:04.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.783+0000 7fc9672d5640 1 -- 172.21.15.47:0/404541769 shutdown_connections 2024-04-14T23:35:04.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.783+0000 7fc9672d5640 1 -- 172.21.15.47:0/404541769 wait complete. 2024-04-14T23:35:04.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.784+0000 7fc9672d5640 1 Processor -- start 2024-04-14T23:35:04.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.784+0000 7fc9672d5640 1 -- start start 2024-04-14T23:35:04.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.785+0000 7fc9672d5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc94c004800 0x7fc960160f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.785+0000 7fc9672d5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9600cdc80 0x7fc9601f3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.785+0000 7fc9672d5640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9600b6d20 0x7fc9601f7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.785+0000 7fc9672d5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc9600b0c60 con 0x7fc94c004800 2024-04-14T23:35:04.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.785+0000 7fc9672d5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc9600b4300 con 0x7fc9600cdc80 2024-04-14T23:35:04.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.785+0000 7fc9672d5640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc96015e650 con 0x7fc9600b6d20 2024-04-14T23:35:04.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.785+0000 7fc965071640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc94c004800 0x7fc960160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.785+0000 7fc965071640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc94c004800 0x7fc960160f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44950/0 (socket says 172.21.15.47:44950) 2024-04-14T23:35:04.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.785+0000 7fc965071640 1 -- 172.21.15.47:0/3783840068 learned_addr learned my addr 172.21.15.47:0/3783840068 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:04.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.785+0000 7fc964870640 1 --2- 172.21.15.47:0/3783840068 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9600cdc80 0x7fc9601f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.785+0000 7fc965872640 1 --2- 172.21.15.47:0/3783840068 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9600b6d20 0x7fc9601f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.785+0000 7fc965071640 1 -- 172.21.15.47:0/3783840068 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9600b6d20 msgr2=0x7fc9601f7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.786+0000 7fc965071640 1 --2- 172.21.15.47:0/3783840068 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9600b6d20 0x7fc9601f7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.786+0000 7fc965071640 1 -- 172.21.15.47:0/3783840068 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9600cdc80 msgr2=0x7fc9601f3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.786+0000 7fc965071640 1 --2- 172.21.15.47:0/3783840068 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9600cdc80 0x7fc9601f3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.786+0000 7fc965071640 1 -- 172.21.15.47:0/3783840068 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9601614c0 con 0x7fc94c004800 2024-04-14T23:35:04.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.786+0000 7fc965071640 1 --2- 172.21.15.47:0/3783840068 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc94c004800 0x7fc960160f80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc95c001b80 tx=0x7fc95c007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:04.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.786+0000 7fc955ffb640 1 -- 172.21.15.47:0/3783840068 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00f960 con 0x7fc94c004800 2024-04-14T23:35:04.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.786+0000 7fc955ffb640 1 -- 172.21.15.47:0/3783840068 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc95c018070 con 0x7fc94c004800 2024-04-14T23:35:04.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.786+0000 7fc9672d5640 1 -- 172.21.15.47:0/3783840068 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9601604e0 con 0x7fc94c004800 2024-04-14T23:35:04.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.786+0000 7fc955ffb640 1 -- 172.21.15.47:0/3783840068 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00fd20 con 0x7fc94c004800 2024-04-14T23:35:04.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.786+0000 7fc9672d5640 1 -- 172.21.15.47:0/3783840068 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9601f3a20 con 0x7fc94c004800 2024-04-14T23:35:04.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.787+0000 7fc9672d5640 1 -- 172.21.15.47:0/3783840068 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc960075430 con 0x7fc94c004800 2024-04-14T23:35:04.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.787+0000 7fc955ffb640 1 -- 172.21.15.47:0/3783840068 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc95c01d460 con 0x7fc94c004800 2024-04-14T23:35:04.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.788+0000 7fc955ffb640 1 --2- 172.21.15.47:0/3783840068 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc94406b990 0x7fc94406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:04.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.788+0000 7fc955ffb640 1 -- 172.21.15.47:0/3783840068 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc95c08aba0 con 0x7fc94c004800 2024-04-14T23:35:04.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.788+0000 7fc964870640 1 --2- 172.21.15.47:0/3783840068 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc94406b990 0x7fc94406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:04.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.789+0000 7fc964870640 1 --2- 172.21.15.47:0/3783840068 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc94406b990 0x7fc94406de50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc950036000 tx=0x7fc950030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:04.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.792+0000 7fc955ffb640 1 -- 172.21.15.47:0/3783840068 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc95c058e20 con 0x7fc94c004800 2024-04-14T23:35:04.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.974+0000 7fc9672d5640 1 -- 172.21.15.47:0/3783840068 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9600b9ca0 con 0x7fc94c004800 2024-04-14T23:35:04.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.975+0000 7fc955ffb640 1 -- 172.21.15.47:0/3783840068 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7fc95c08a030 con 0x7fc94c004800 2024-04-14T23:35:04.978 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:04.978 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:44.714882+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:04.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.977+0000 7fc9672d5640 1 -- 172.21.15.47:0/3783840068 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc94406b990 msgr2=0x7fc94406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.977+0000 7fc9672d5640 1 --2- 172.21.15.47:0/3783840068 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc94406b990 0x7fc94406de50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc950036000 tx=0x7fc950030000 comp rx=0 tx=0).stop 2024-04-14T23:35:04.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.977+0000 7fc9672d5640 1 -- 172.21.15.47:0/3783840068 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc94c004800 msgr2=0x7fc960160f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:04.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.977+0000 7fc9672d5640 1 --2- 172.21.15.47:0/3783840068 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc94c004800 0x7fc960160f80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc95c001b80 tx=0x7fc95c007720 comp rx=0 tx=0).stop 2024-04-14T23:35:04.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.977+0000 7fc9672d5640 1 -- 172.21.15.47:0/3783840068 shutdown_connections 2024-04-14T23:35:04.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.977+0000 7fc9672d5640 1 --2- 172.21.15.47:0/3783840068 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc94406b990 0x7fc94406de50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.977+0000 7fc9672d5640 1 --2- 172.21.15.47:0/3783840068 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9600b6d20 0x7fc9601f7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.977+0000 7fc9672d5640 1 --2- 172.21.15.47:0/3783840068 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9600cdc80 0x7fc9601f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.977+0000 7fc9672d5640 1 --2- 172.21.15.47:0/3783840068 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc94c004800 0x7fc960160f80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:04.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.977+0000 7fc9672d5640 1 -- 172.21.15.47:0/3783840068 >> 172.21.15.47:0/3783840068 conn(0x7fc9600d3ed0 msgr2=0x7fc9600b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:04.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.977+0000 7fc9672d5640 1 -- 172.21.15.47:0/3783840068 shutdown_connections 2024-04-14T23:35:04.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:04.977+0000 7fc9672d5640 1 -- 172.21.15.47:0/3783840068 wait complete. 2024-04-14T23:35:04.991 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T23:35:05.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.089+0000 7f00c4ac8640 1 Processor -- start 2024-04-14T23:35:05.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.089+0000 7f00c4ac8640 1 -- start start 2024-04-14T23:35:05.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.090+0000 7f00c4ac8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c015e270 0x7f00c00d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.090+0000 7f00c4ac8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f00c00d1450 0x7f00c00b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.090+0000 7f00c4ac8640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00c00b39d0 con 0x7f00c00d1e00 2024-04-14T23:35:05.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.090+0000 7f00c4ac8640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f00c00b4300 con 0x7f00c00d1450 2024-04-14T23:35:05.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.090+0000 7f00c4ac8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f00c00b3cb0 con 0x7f00c015e270 2024-04-14T23:35:05.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.090+0000 7f00bed9d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f00c00d1450 0x7f00c00b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.090+0000 7f00bed9d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f00c00d1450 0x7f00c00b4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44954/0 (socket says 172.21.15.47:44954) 2024-04-14T23:35:05.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.090+0000 7f00bed9d640 1 -- 172.21.15.47:0/2073860270 learned_addr learned my addr 172.21.15.47:0/2073860270 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:05.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.090+0000 7f00be59c640 1 --2- 172.21.15.47:0/2073860270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c015e270 0x7f00c00d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.091+0000 7f00bed9d640 1 -- 172.21.15.47:0/2073860270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c015e270 msgr2=0x7f00c00d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:05.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.091+0000 7f00bed9d640 1 --2- 172.21.15.47:0/2073860270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c015e270 0x7f00c00d0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.091+0000 7f00bed9d640 1 -- 172.21.15.47:0/2073860270 >> v1:172.21.15.191:6789/0 conn(0x7f00c00d1e00 legacy=0x7f00c00d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:05.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.091+0000 7f00bed9d640 1 -- 172.21.15.47:0/2073860270 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c00b3f90 con 0x7f00c00d1450 2024-04-14T23:35:05.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.091+0000 7f00bed9d640 1 --2- 172.21.15.47:0/2073860270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c00d1450 0x7f00c00b4790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009e50 tx=0x7f00b002bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b75669583b06e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:05.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.091+0000 7f00bd59a640 1 -- 172.21.15.47:0/2073860270 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b002cb90 con 0x7f00c00d1450 2024-04-14T23:35:05.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.091+0000 7f00bd59a640 1 -- 172.21.15.47:0/2073860270 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b002cd30 con 0x7f00c00d1450 2024-04-14T23:35:05.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.091+0000 7f00bd59a640 1 -- 172.21.15.47:0/2073860270 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0034610 con 0x7f00c00d1450 2024-04-14T23:35:05.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.092+0000 7f00c4ac8640 1 -- 172.21.15.47:0/2073860270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c00d1450 msgr2=0x7f00c00b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:05.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.092+0000 7f00c4ac8640 1 --2- 172.21.15.47:0/2073860270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c00d1450 0x7f00c00b4790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009e50 tx=0x7f00b002bff0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.092+0000 7f00c4ac8640 1 -- 172.21.15.47:0/2073860270 shutdown_connections 2024-04-14T23:35:05.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.092+0000 7f00c4ac8640 1 --2- 172.21.15.47:0/2073860270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c00d1450 0x7f00c00b4790 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.092+0000 7f00c4ac8640 1 --2- 172.21.15.47:0/2073860270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c015e270 0x7f00c00d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.092+0000 7f00c4ac8640 1 -- 172.21.15.47:0/2073860270 >> 172.21.15.47:0/2073860270 conn(0x7f00c00d3ed0 msgr2=0x7f00c00d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:05.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.092+0000 7f00c4ac8640 1 -- 172.21.15.47:0/2073860270 shutdown_connections 2024-04-14T23:35:05.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.092+0000 7f00c4ac8640 1 -- 172.21.15.47:0/2073860270 wait complete. 2024-04-14T23:35:05.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.093+0000 7f00c4ac8640 1 Processor -- start 2024-04-14T23:35:05.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.093+0000 7f00c4ac8640 1 -- start start 2024-04-14T23:35:05.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00c4ac8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c00d1450 0x7f00c014a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00c4ac8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c00d1e00 0x7f00c015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00c4ac8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c015e270 0x7f00c00cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00c4ac8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f00c015e7d0 con 0x7f00c00d1450 2024-04-14T23:35:05.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00c4ac8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f00c015e650 con 0x7f00c015e270 2024-04-14T23:35:05.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00c4ac8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f00c00d2910 con 0x7f00c00d1e00 2024-04-14T23:35:05.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00be59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c00d1450 0x7f00c014a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00be59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c00d1450 0x7f00c014a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44966/0 (socket says 172.21.15.47:44966) 2024-04-14T23:35:05.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00be59c640 1 -- 172.21.15.47:0/1980740337 learned_addr learned my addr 172.21.15.47:0/1980740337 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:05.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00bed9d640 1 --2- 172.21.15.47:0/1980740337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c015e270 0x7f00c00cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00bdd9b640 1 --2- 172.21.15.47:0/1980740337 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c00d1e00 0x7f00c015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00be59c640 1 -- 172.21.15.47:0/1980740337 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c00d1e00 msgr2=0x7f00c015fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:05.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00be59c640 1 --2- 172.21.15.47:0/1980740337 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c00d1e00 0x7f00c015fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00be59c640 1 -- 172.21.15.47:0/1980740337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c015e270 msgr2=0x7f00c00cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:05.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00be59c640 1 --2- 172.21.15.47:0/1980740337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c015e270 0x7f00c00cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00be59c640 1 -- 172.21.15.47:0/1980740337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c00c7850 con 0x7f00c00d1450 2024-04-14T23:35:05.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.094+0000 7f00bed9d640 1 --2- 172.21.15.47:0/1980740337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c015e270 0x7f00c00cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:05.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.095+0000 7f00be59c640 1 --2- 172.21.15.47:0/1980740337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c00d1450 0x7f00c014a1a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f00b800d620 tx=0x7f00b800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:05.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.095+0000 7f00b6ffd640 1 -- 172.21.15.47:0/1980740337 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b800b620 con 0x7f00c00d1450 2024-04-14T23:35:05.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.095+0000 7f00b6ffd640 1 -- 172.21.15.47:0/1980740337 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b8019070 con 0x7f00c00d1450 2024-04-14T23:35:05.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.095+0000 7f00c4ac8640 1 -- 172.21.15.47:0/1980740337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c00c7b30 con 0x7f00c00d1450 2024-04-14T23:35:05.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.095+0000 7f00b6ffd640 1 -- 172.21.15.47:0/1980740337 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b800ba00 con 0x7f00c00d1450 2024-04-14T23:35:05.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.095+0000 7f00c4ac8640 1 -- 172.21.15.47:0/1980740337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c00c80f0 con 0x7f00c00d1450 2024-04-14T23:35:05.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.096+0000 7f00c4ac8640 1 -- 172.21.15.47:0/1980740337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c0075430 con 0x7f00c00d1450 2024-04-14T23:35:05.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.096+0000 7f00b6ffd640 1 -- 172.21.15.47:0/1980740337 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f00b800bba0 con 0x7f00c00d1450 2024-04-14T23:35:05.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.096+0000 7f00b6ffd640 1 --2- 172.21.15.47:0/1980740337 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f00a006b990 0x7f00a006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.097+0000 7f00b6ffd640 1 -- 172.21.15.47:0/1980740337 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f00b808afc0 con 0x7f00c00d1450 2024-04-14T23:35:05.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.097+0000 7f00bdd9b640 1 --2- 172.21.15.47:0/1980740337 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f00a006b990 0x7f00a006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.097+0000 7f00bdd9b640 1 --2- 172.21.15.47:0/1980740337 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f00a006b990 0x7f00a006de50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f00c00cc310 tx=0x7f00a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:05.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.101+0000 7f00b6ffd640 1 -- 172.21.15.47:0/1980740337 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f00b8059890 con 0x7f00c00d1450 2024-04-14T23:35:05.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.319+0000 7f00c4ac8640 1 -- 172.21.15.47:0/1980740337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00c006d7b0 con 0x7f00c00d1450 2024-04-14T23:35:05.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.319+0000 7f00b6ffd640 1 -- 172.21.15.47:0/1980740337 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f00b8059190 con 0x7f00c00d1450 2024-04-14T23:35:05.322 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:05.323 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/416388535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":416388535},{"type":"v1","addr":"172.21.15.191:6837","nonce":416388535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/2830978927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2830978927},{"type":"v1","addr":"172.21.15.47:6833","nonce":2830978927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/4025654680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":4025654680},{"type":"v1","addr":"172.21.15.191:6836","nonce":4025654680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T23:34:38.059644+0000","modified":"2024-04-14T23:34:54.105483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/1169029730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1169029730},{"type":"v1","addr":"172.21.15.47:6835","nonce":1169029730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-14T23:35:05.323 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-04-14T23:35:05.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.321+0000 7f00c4ac8640 1 -- 172.21.15.47:0/1980740337 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f00a006b990 msgr2=0x7f00a006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:05.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.321+0000 7f00c4ac8640 1 --2- 172.21.15.47:0/1980740337 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f00a006b990 0x7f00a006de50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f00c00cc310 tx=0x7f00a8009040 comp rx=0 tx=0).stop 2024-04-14T23:35:05.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.321+0000 7f00c4ac8640 1 -- 172.21.15.47:0/1980740337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c00d1450 msgr2=0x7f00c014a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:05.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.321+0000 7f00c4ac8640 1 --2- 172.21.15.47:0/1980740337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c00d1450 0x7f00c014a1a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f00b800d620 tx=0x7f00b800dae0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.321+0000 7f00c4ac8640 1 -- 172.21.15.47:0/1980740337 shutdown_connections 2024-04-14T23:35:05.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.321+0000 7f00c4ac8640 1 --2- 172.21.15.47:0/1980740337 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f00a006b990 0x7f00a006de50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.321+0000 7f00c4ac8640 1 --2- 172.21.15.47:0/1980740337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00c015e270 0x7f00c00cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.321+0000 7f00c4ac8640 1 --2- 172.21.15.47:0/1980740337 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00c00d1e00 0x7f00c015fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.321+0000 7f00c4ac8640 1 --2- 172.21.15.47:0/1980740337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c00d1450 0x7f00c014a1a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.321+0000 7f00c4ac8640 1 -- 172.21.15.47:0/1980740337 >> 172.21.15.47:0/1980740337 conn(0x7f00c00d3ed0 msgr2=0x7f00c00b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:05.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.321+0000 7f00c4ac8640 1 -- 172.21.15.47:0/1980740337 shutdown_connections 2024-04-14T23:35:05.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.321+0000 7f00c4ac8640 1 -- 172.21.15.47:0/1980740337 wait complete. 2024-04-14T23:35:05.737 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-14T23:34:38.059644+0000', 'modified': '2024-04-14T23:34:54.105483+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.47:6835/1169029730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6834', 'nonce': 1169029730}, {'type': 'v1', 'addr': '172.21.15.47:6835', 'nonce': 1169029730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4287, 'qdb_cluster': [4287]} 2024-04-14T23:35:05.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-14T23:35:05.738 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-14T23:35:05.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.840+0000 7fc1e0dcc640 1 Processor -- start 2024-04-14T23:35:05.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.840+0000 7fc1e0dcc640 1 -- start start 2024-04-14T23:35:05.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.841+0000 7fc1e0dcc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1dc0cca50 0x7fc1dc0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.841+0000 7fc1e0dcc640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc1dc0d16d0 0x7fc1dc162480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.841+0000 7fc1e0dcc640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1dc15e9a0 con 0x7fc1dc0ceab0 2024-04-14T23:35:05.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.841+0000 7fc1e0dcc640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fc1dc15f5b0 con 0x7fc1dc0d16d0 2024-04-14T23:35:05.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.841+0000 7fc1e0dcc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc1dc15ec80 con 0x7fc1dc0cca50 2024-04-14T23:35:05.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.841+0000 7fc1da59c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1dc0cca50 0x7fc1dc0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.841+0000 7fc1da59c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1dc0cca50 0x7fc1dc0cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:48092/0 (socket says 172.21.15.47:48092) 2024-04-14T23:35:05.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.841+0000 7fc1da59c640 1 -- 172.21.15.47:0/1728170086 learned_addr learned my addr 172.21.15.47:0/1728170086 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:05.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.841+0000 7fc1dad9d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc1dc0d16d0 0x7fc1dc162480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.842+0000 7fc1dad9d640 1 -- 172.21.15.47:0/1728170086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1dc0cca50 msgr2=0x7fc1dc0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:05.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.842+0000 7fc1dad9d640 1 --2- 172.21.15.47:0/1728170086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1dc0cca50 0x7fc1dc0cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.842+0000 7fc1dad9d640 1 -- 172.21.15.47:0/1728170086 >> v1:172.21.15.191:6789/0 conn(0x7fc1dc0ceab0 legacy=0x7fc1dc161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:05.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.842+0000 7fc1d959a640 1 -- 172.21.15.47:0/1728170086 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2025561823 0 0) 0x7fc1dc15e9a0 con 0x7fc1dc0ceab0 2024-04-14T23:35:05.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.842+0000 7fc1dad9d640 1 -- 172.21.15.47:0/1728170086 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1dc15ef60 con 0x7fc1dc0d16d0 2024-04-14T23:35:05.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.842+0000 7fc1da59c640 1 --2- 172.21.15.47:0/1728170086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1dc0cca50 0x7fc1dc0cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:05.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.843+0000 7fc1dad9d640 1 --2- 172.21.15.47:0/1728170086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1dc0d16d0 0x7fc1dc162480 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc009d90 tx=0x7fc1cc02bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a979371804472b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:05.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.843+0000 7fc1d959a640 1 -- 172.21.15.47:0/1728170086 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc039070 con 0x7fc1dc0d16d0 2024-04-14T23:35:05.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.843+0000 7fc1d959a640 1 -- 172.21.15.47:0/1728170086 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1cc02cb30 con 0x7fc1dc0d16d0 2024-04-14T23:35:05.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.843+0000 7fc1d959a640 1 -- 172.21.15.47:0/1728170086 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc034440 con 0x7fc1dc0d16d0 2024-04-14T23:35:05.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.843+0000 7fc1e0dcc640 1 -- 172.21.15.47:0/1728170086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1dc0d16d0 msgr2=0x7fc1dc162480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:05.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.843+0000 7fc1e0dcc640 1 --2- 172.21.15.47:0/1728170086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1dc0d16d0 0x7fc1dc162480 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc009d90 tx=0x7fc1cc02bd80 comp rx=0 tx=0).stop 2024-04-14T23:35:05.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.843+0000 7fc1e0dcc640 1 -- 172.21.15.47:0/1728170086 shutdown_connections 2024-04-14T23:35:05.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.843+0000 7fc1e0dcc640 1 --2- 172.21.15.47:0/1728170086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1dc0d16d0 0x7fc1dc162480 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.843+0000 7fc1e0dcc640 1 --2- 172.21.15.47:0/1728170086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1dc0cca50 0x7fc1dc0cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.843+0000 7fc1e0dcc640 1 -- 172.21.15.47:0/1728170086 >> 172.21.15.47:0/1728170086 conn(0x7fc1dc0d0bb0 msgr2=0x7fc1dc0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:05.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.843+0000 7fc1e0dcc640 1 -- 172.21.15.47:0/1728170086 shutdown_connections 2024-04-14T23:35:05.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.843+0000 7fc1e0dcc640 1 -- 172.21.15.47:0/1728170086 wait complete. 2024-04-14T23:35:05.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.845+0000 7fc1e0dcc640 1 Processor -- start 2024-04-14T23:35:05.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.845+0000 7fc1e0dcc640 1 -- start start 2024-04-14T23:35:05.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.845+0000 7fc1e0dcc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1dc0cca50 0x7fc1dc1573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.845+0000 7fc1e0dcc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1dc0ceab0 0x7fc1dc157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.845+0000 7fc1e0dcc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0d16d0 0x7fc1dc157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.845+0000 7fc1e0dcc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc15e660 con 0x7fc1dc0d16d0 2024-04-14T23:35:05.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.845+0000 7fc1e0dcc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc0cd370 con 0x7fc1dc0cca50 2024-04-14T23:35:05.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.845+0000 7fc1e0dcc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc1dc0cb3c0 con 0x7fc1dc0ceab0 2024-04-14T23:35:05.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.846+0000 7fc1dad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0d16d0 0x7fc1dc157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.846+0000 7fc1dad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0d16d0 0x7fc1dc157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44974/0 (socket says 172.21.15.47:44974) 2024-04-14T23:35:05.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.846+0000 7fc1dad9d640 1 -- 172.21.15.47:0/3654299413 learned_addr learned my addr 172.21.15.47:0/3654299413 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:05.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.846+0000 7fc1d9d9b640 1 --2- 172.21.15.47:0/3654299413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1dc0ceab0 0x7fc1dc157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.846+0000 7fc1da59c640 1 --2- 172.21.15.47:0/3654299413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1dc0cca50 0x7fc1dc1573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.846+0000 7fc1dad9d640 1 -- 172.21.15.47:0/3654299413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1dc0ceab0 msgr2=0x7fc1dc157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:05.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.846+0000 7fc1dad9d640 1 --2- 172.21.15.47:0/3654299413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1dc0ceab0 0x7fc1dc157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.846+0000 7fc1dad9d640 1 -- 172.21.15.47:0/3654299413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1dc0cca50 msgr2=0x7fc1dc1573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:05.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.846+0000 7fc1dad9d640 1 --2- 172.21.15.47:0/3654299413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1dc0cca50 0x7fc1dc1573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.846+0000 7fc1dad9d640 1 -- 172.21.15.47:0/3654299413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1dc0c50a0 con 0x7fc1dc0d16d0 2024-04-14T23:35:05.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.846+0000 7fc1dad9d640 1 --2- 172.21.15.47:0/3654299413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0d16d0 0x7fc1dc157e90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc037040 tx=0x7fc1cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:05.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.846+0000 7fc1d2ffd640 1 -- 172.21.15.47:0/3654299413 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc039050 con 0x7fc1dc0d16d0 2024-04-14T23:35:05.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.846+0000 7fc1d2ffd640 1 -- 172.21.15.47:0/3654299413 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1cc045070 con 0x7fc1dc0d16d0 2024-04-14T23:35:05.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.846+0000 7fc1e0dcc640 1 -- 172.21.15.47:0/3654299413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1dc0c5380 con 0x7fc1dc0d16d0 2024-04-14T23:35:05.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.846+0000 7fc1d2ffd640 1 -- 172.21.15.47:0/3654299413 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc009450 con 0x7fc1dc0d16d0 2024-04-14T23:35:05.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.846+0000 7fc1e0dcc640 1 -- 172.21.15.47:0/3654299413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1dc0c5cf0 con 0x7fc1dc0d16d0 2024-04-14T23:35:05.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.848+0000 7fc1d2ffd640 1 -- 172.21.15.47:0/3654299413 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc1cc03e850 con 0x7fc1dc0d16d0 2024-04-14T23:35:05.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.848+0000 7fc1d2ffd640 1 --2- 172.21.15.47:0/3654299413 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc1bc06b990 0x7fc1bc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.848+0000 7fc1d2ffd640 1 -- 172.21.15.47:0/3654299413 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc1cc0ad940 con 0x7fc1dc0d16d0 2024-04-14T23:35:05.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.848+0000 7fc1da59c640 1 --2- 172.21.15.47:0/3654299413 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc1bc06b990 0x7fc1bc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.849+0000 7fc1da59c640 1 --2- 172.21.15.47:0/3654299413 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc1bc06b990 0x7fc1bc06de50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4009630 tx=0x7fc1d4009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:05.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.849+0000 7fc1e3bae740 1 Processor -- start 2024-04-14T23:35:05.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.849+0000 7fc1e3bae740 1 -- start start 2024-04-14T23:35:05.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.850+0000 7fc1e3bae740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e226f0 0x5643f0df5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.850+0000 7fc1e3bae740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e22ad0 0x5643f0e25480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.850+0000 7fc1e3bae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0df5bd0 0x5643f0e259c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.850+0000 7fc1e3bae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5643f0d5ef80 con 0x5643f0df5bd0 2024-04-14T23:35:05.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.850+0000 7fc1e3bae740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5643f0d079a0 con 0x5643f0e22ad0 2024-04-14T23:35:05.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.850+0000 7fc1e3bae740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x5643f0d5af30 con 0x5643f0e226f0 2024-04-14T23:35:05.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.850+0000 7fc1dad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0df5bd0 0x5643f0e259c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.850+0000 7fc1dad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0df5bd0 0x5643f0e259c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44978/0 (socket says 172.21.15.47:44978) 2024-04-14T23:35:05.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.850+0000 7fc1dad9d640 1 -- 172.21.15.47:0/1522775685 learned_addr learned my addr 172.21.15.47:0/1522775685 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:05.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.850+0000 7fc1da59c640 1 --2- 172.21.15.47:0/1522775685 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e226f0 0x5643f0df5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.850+0000 7fc1d9d9b640 1 --2- 172.21.15.47:0/1522775685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e22ad0 0x5643f0e25480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.850+0000 7fc1dad9d640 1 -- 172.21.15.47:0/1522775685 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e226f0 msgr2=0x5643f0df5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:05.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.850+0000 7fc1dad9d640 1 --2- 172.21.15.47:0/1522775685 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e226f0 0x5643f0df5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.850+0000 7fc1dad9d640 1 -- 172.21.15.47:0/1522775685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e22ad0 msgr2=0x5643f0e25480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:05.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.850+0000 7fc1dad9d640 1 --2- 172.21.15.47:0/1522775685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e22ad0 0x5643f0e25480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.850+0000 7fc1dad9d640 1 -- 172.21.15.47:0/1522775685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f0d28480 con 0x5643f0df5bd0 2024-04-14T23:35:05.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.851+0000 7fc1dad9d640 1 --2- 172.21.15.47:0/1522775685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0df5bd0 0x5643f0e259c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0abaa0 tx=0x7fc1cc07b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65ae64f3a2409b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:05.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.851+0000 7fc1bbfff640 1 -- 172.21.15.47:0/1522775685 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc08fe60 con 0x5643f0df5bd0 2024-04-14T23:35:05.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.851+0000 7fc1bbfff640 1 -- 172.21.15.47:0/1522775685 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1cc03a040 con 0x5643f0df5bd0 2024-04-14T23:35:05.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.851+0000 7fc1bbfff640 1 -- 172.21.15.47:0/1522775685 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc07fd80 con 0x5643f0df5bd0 2024-04-14T23:35:05.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.851+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1522775685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0df5bd0 msgr2=0x5643f0e259c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:05.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.851+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/1522775685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0df5bd0 0x5643f0e259c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0abaa0 tx=0x7fc1cc07b640 comp rx=0 tx=0).stop 2024-04-14T23:35:05.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.851+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1522775685 shutdown_connections 2024-04-14T23:35:05.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.851+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/1522775685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0df5bd0 0x5643f0e259c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.851+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/1522775685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e22ad0 0x5643f0e25480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.851+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/1522775685 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e226f0 0x5643f0df5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.851+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1522775685 >> 172.21.15.47:0/1522775685 conn(0x5643f0df7900 msgr2=0x5643f0e40480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:05.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.851+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1522775685 shutdown_connections 2024-04-14T23:35:05.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.851+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1522775685 wait complete. 2024-04-14T23:35:05.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.852+0000 7fc1e3bae740 1 -- start start 2024-04-14T23:35:05.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.852+0000 7fc1e3bae740 1 Processor -- start 2024-04-14T23:35:05.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1e3bae740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e226f0 0x5643f0e28c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1e3bae740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e22ad0 0x5643f0e37f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1e3bae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e202f0 0x5643f0e26470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1e3bae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5643f0d5ef80 con 0x5643f0e202f0 2024-04-14T23:35:05.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1e3bae740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5643f0d1af40 con 0x5643f0e226f0 2024-04-14T23:35:05.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1e3bae740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x5643f0df9ea0 con 0x5643f0e22ad0 2024-04-14T23:35:05.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1e3bae740 10 client.0 _ll_register_callbacks cb 0x5643f0d159a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T23:35:05.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1dad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e202f0 0x5643f0e26470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1dad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e202f0 0x5643f0e26470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44984/0 (socket says 172.21.15.47:44984) 2024-04-14T23:35:05.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1dad9d640 1 -- 172.21.15.47:0/1778914177 learned_addr learned my addr 172.21.15.47:0/1778914177 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:05.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1da59c640 1 --2- 172.21.15.47:0/1778914177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e226f0 0x5643f0e28c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1d9d9b640 1 --2- 172.21.15.47:0/1778914177 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e22ad0 0x5643f0e37f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1dad9d640 1 -- 172.21.15.47:0/1778914177 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e22ad0 msgr2=0x5643f0e37f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:05.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1dad9d640 1 --2- 172.21.15.47:0/1778914177 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e22ad0 0x5643f0e37f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1dad9d640 1 -- 172.21.15.47:0/1778914177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e226f0 msgr2=0x5643f0e28c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:05.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1dad9d640 1 --2- 172.21.15.47:0/1778914177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e226f0 0x5643f0e28c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.853+0000 7fc1dad9d640 1 -- 172.21.15.47:0/1778914177 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643f0a732d0 con 0x5643f0e202f0 2024-04-14T23:35:05.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1dad9d640 1 --2- 172.21.15.47:0/1778914177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e202f0 0x5643f0e26470 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0abb80 tx=0x7fc1cc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c655f4e151ee2d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:05.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-14T23:35:05.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1b97fa640 1 -- 172.21.15.47:0/1778914177 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc089060 con 0x5643f0e202f0 2024-04-14T23:35:05.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1b97fa640 1 -- 172.21.15.47:0/1778914177 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc1cc0820c0 con 0x5643f0e202f0 2024-04-14T23:35:05.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1778914177 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1cc03a040 con 0x5643f0e202f0 2024-04-14T23:35:05.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1b97fa640 1 -- 172.21.15.47:0/1778914177 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fc1cc08fe60 con 0x5643f0e202f0 2024-04-14T23:35:05.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1e3bae740 10 client.4839 fetch_fsmap learned FSMap version 8 2024-04-14T23:35:05.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1778914177 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5643f0b3d6b0 con 0x5643f0e202f0 2024-04-14T23:35:05.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1b97fa640 1 -- 172.21.15.47:0/1778914177 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1cc03a040 con 0x5643f0e202f0 2024-04-14T23:35:05.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1b97fa640 1 -- 172.21.15.47:0/1778914177 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fc1cc02cce0 con 0x5643f0e202f0 2024-04-14T23:35:05.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1e3bae740 10 client.4839 fetch_fsmap finished waiting for FSMap version 8 2024-04-14T23:35:05.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1e3bae740 10 client.4839 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-14T23:35:05.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1e3bae740 20 client.4839 populate_metadata read hostname 'smithi047' 2024-04-14T23:35:05.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/1778914177 >> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] conn(0x5643f0e53d60 0x5643f0e54140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1e3bae740 4 client.4839 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T23:35:05.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1778914177 --> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643f0d6c4c0 con 0x5643f0e53d60 2024-04-14T23:35:05.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.854+0000 7fc1da59c640 1 --2- 172.21.15.47:0/1778914177 >> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] conn(0x5643f0e53d60 0x5643f0e54140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.855+0000 7fc1b97fa640 10 client.4839 ms_handle_connect on v2:172.21.15.47:6834/1169029730 2024-04-14T23:35:05.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.855+0000 7fc1da59c640 1 --2- 172.21.15.47:0/1778914177 >> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] conn(0x5643f0e53d60 0x5643f0e54140 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8a28a92ebe90841 server_cookie=b38b7d92c7974ada in_seq=0 out_seq=0 2024-04-14T23:35:05.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.855+0000 7fc1b97fa640 1 -- 172.21.15.47:0/1778914177 <== mds.0 v2:172.21.15.47:6834/1169029730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5643f0d6c4c0 con 0x5643f0e53d60 2024-04-14T23:35:05.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.855+0000 7fc1b97fa640 10 client.4839 handle_command_reply: tid=0 2024-04-14T23:35:05.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.855+0000 7fc1e3bae740 1 client.4839 shutdown 2024-04-14T23:35:05.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.855+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1778914177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e202f0 msgr2=0x5643f0e26470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:05.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.855+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/1778914177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e202f0 0x5643f0e26470 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0abb80 tx=0x7fc1cc009750 comp rx=0 tx=0).stop 2024-04-14T23:35:05.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.855+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1778914177 shutdown_connections 2024-04-14T23:35:05.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.855+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/1778914177 >> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] conn(0x5643f0e53d60 0x5643f0e54140 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.855+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/1778914177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e202f0 0x5643f0e26470 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.855+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/1778914177 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e22ad0 0x5643f0e37f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.855+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/1778914177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e226f0 0x5643f0e28c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.855+0000 7fc1b97fa640 0 client.4839 ms_handle_reset on v2:172.21.15.47:6834/1169029730 2024-04-14T23:35:05.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.855+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1778914177 >> 172.21.15.47:0/1778914177 conn(0x5643f0df5bd0 msgr2=0x5643f0e25470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:05.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.855+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1778914177 shutdown_connections 2024-04-14T23:35:05.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.855+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1778914177 wait complete. 2024-04-14T23:35:05.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.856+0000 7fc1e3bae740 20 client.4839 trim_cache size 0 max 16384 2024-04-14T23:35:05.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.874+0000 7fc1e3bae740 1 Processor -- start 2024-04-14T23:35:05.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.874+0000 7fc1e3bae740 1 -- start start 2024-04-14T23:35:05.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.874+0000 7fc1e3bae740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e202f0 0x5643f0e63d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1e3bae740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e226f0 0x5643f0e64270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1e3bae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e22ad0 0x5643f0e1f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1e3bae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc200a10 con 0x5643f0e22ad0 2024-04-14T23:35:05.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1e3bae740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc0c7350 con 0x5643f0e202f0 2024-04-14T23:35:05.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1e3bae740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc1dc2003c0 con 0x5643f0e226f0 2024-04-14T23:35:05.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1dad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e22ad0 0x5643f0e1f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1dad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e22ad0 0x5643f0e1f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44996/0 (socket says 172.21.15.47:44996) 2024-04-14T23:35:05.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1dad9d640 1 -- 172.21.15.47:0/624752090 learned_addr learned my addr 172.21.15.47:0/624752090 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:05.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1dad9d640 1 -- 172.21.15.47:0/624752090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e226f0 msgr2=0x5643f0e64270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:05.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1dad9d640 1 --2- 172.21.15.47:0/624752090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e226f0 0x5643f0e64270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1dad9d640 1 -- 172.21.15.47:0/624752090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e202f0 msgr2=0x5643f0e63d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:05.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1dad9d640 1 --2- 172.21.15.47:0/624752090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e202f0 0x5643f0e63d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1dad9d640 1 -- 172.21.15.47:0/624752090 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f0df4e60 con 0x5643f0e22ad0 2024-04-14T23:35:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1dad9d640 1 --2- 172.21.15.47:0/624752090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e22ad0 0x5643f0e1f7d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc07bc70 tx=0x7fc1cc091040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1ddeb009982605 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1bb7fe640 1 -- 172.21.15.47:0/624752090 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc077f80 con 0x5643f0e22ad0 2024-04-14T23:35:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1bb7fe640 1 -- 172.21.15.47:0/624752090 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1cc0820c0 con 0x5643f0e22ad0 2024-04-14T23:35:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.875+0000 7fc1bb7fe640 1 -- 172.21.15.47:0/624752090 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc084120 con 0x5643f0e22ad0 2024-04-14T23:35:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.876+0000 7fc1e3bae740 1 -- 172.21.15.47:0/624752090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e22ad0 msgr2=0x5643f0e1f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.876+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/624752090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e22ad0 0x5643f0e1f7d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc07bc70 tx=0x7fc1cc091040 comp rx=0 tx=0).stop 2024-04-14T23:35:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.876+0000 7fc1e3bae740 1 -- 172.21.15.47:0/624752090 shutdown_connections 2024-04-14T23:35:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.876+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/624752090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e22ad0 0x5643f0e1f7d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.876+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/624752090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e226f0 0x5643f0e64270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.876+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/624752090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e202f0 0x5643f0e63d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.876+0000 7fc1e3bae740 1 -- 172.21.15.47:0/624752090 >> 172.21.15.47:0/624752090 conn(0x5643f0df5bd0 msgr2=0x5643f0e275f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:05.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.876+0000 7fc1e3bae740 1 -- 172.21.15.47:0/624752090 shutdown_connections 2024-04-14T23:35:05.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.876+0000 7fc1e3bae740 1 -- 172.21.15.47:0/624752090 wait complete. 2024-04-14T23:35:05.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.876+0000 7fc1e3bae740 1 -- start start 2024-04-14T23:35:05.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.876+0000 7fc1e3bae740 1 Processor -- start 2024-04-14T23:35:05.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.877+0000 7fc1e3bae740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e202f0 0x5643f0e37c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.877+0000 7fc1e3bae740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e226f0 0x5643f0ea3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.877+0000 7fc1e3bae740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e22ad0 0x5643f0e4ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.877+0000 7fc1e3bae740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5643f0d5ef80 con 0x5643f0e202f0 2024-04-14T23:35:05.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.877+0000 7fc1e3bae740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5643f0d1af40 con 0x5643f0e226f0 2024-04-14T23:35:05.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.877+0000 7fc1e3bae740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x5643f0e37440 con 0x5643f0e22ad0 2024-04-14T23:35:05.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.877+0000 7fc1e3bae740 10 client.0 _ll_register_callbacks cb 0x7fc1cc092070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T23:35:05.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.877+0000 7fc1da59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e202f0 0x5643f0e37c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.877+0000 7fc1da59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e202f0 0x5643f0e37c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45008/0 (socket says 172.21.15.47:45008) 2024-04-14T23:35:05.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.877+0000 7fc1da59c640 1 -- 172.21.15.47:0/1455985082 learned_addr learned my addr 172.21.15.47:0/1455985082 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:05.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.877+0000 7fc1d9d9b640 1 --2- 172.21.15.47:0/1455985082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e226f0 0x5643f0ea3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.877+0000 7fc1dad9d640 1 --2- 172.21.15.47:0/1455985082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e22ad0 0x5643f0e4ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1da59c640 1 -- 172.21.15.47:0/1455985082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e22ad0 msgr2=0x5643f0e4ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:05.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1da59c640 1 --2- 172.21.15.47:0/1455985082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e22ad0 0x5643f0e4ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1da59c640 1 -- 172.21.15.47:0/1455985082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e226f0 msgr2=0x5643f0ea3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:05.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1da59c640 1 --2- 172.21.15.47:0/1455985082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e226f0 0x5643f0ea3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1da59c640 1 -- 172.21.15.47:0/1455985082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643f0ebad80 con 0x5643f0e202f0 2024-04-14T23:35:05.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1dad9d640 1 --2- 172.21.15.47:0/1455985082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e22ad0 0x5643f0e4ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:05.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1da59c640 1 --2- 172.21.15.47:0/1455985082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e202f0 0x5643f0e37c40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x5643f0e29350 tx=0x7fc1d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498527b1e3cee177 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:05.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-14T23:35:05.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1b97fa640 1 -- 172.21.15.47:0/1455985082 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4014c70 con 0x5643f0e202f0 2024-04-14T23:35:05.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1455985082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1cc0820c0 con 0x5643f0e202f0 2024-04-14T23:35:05.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1b97fa640 1 -- 172.21.15.47:0/1455985082 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc1d402b2c0 con 0x5643f0e202f0 2024-04-14T23:35:05.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1b97fa640 1 -- 172.21.15.47:0/1455985082 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fc1d403a050 con 0x5643f0e202f0 2024-04-14T23:35:05.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1e3bae740 10 client.4845 fetch_fsmap learned FSMap version 8 2024-04-14T23:35:05.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1455985082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5643f0e39940 con 0x5643f0e202f0 2024-04-14T23:35:05.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1b97fa640 1 -- 172.21.15.47:0/1455985082 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1cc0820c0 con 0x5643f0e202f0 2024-04-14T23:35:05.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1b97fa640 1 -- 172.21.15.47:0/1455985082 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fc1d403d020 con 0x5643f0e202f0 2024-04-14T23:35:05.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1e3bae740 10 client.4845 fetch_fsmap finished waiting for FSMap version 8 2024-04-14T23:35:05.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1e3bae740 10 client.4845 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-14T23:35:05.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1e3bae740 20 client.4845 populate_metadata read hostname 'smithi047' 2024-04-14T23:35:05.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/1455985082 >> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] conn(0x5643f0ebdf30 0x5643f0e35e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:05.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1e3bae740 4 client.4845 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-14T23:35:05.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.878+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1455985082 --> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] -- command(tid 0: {"prefix": "status"}) -- 0x5643f0d66810 con 0x5643f0ebdf30 2024-04-14T23:35:05.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1d9d9b640 1 --2- 172.21.15.47:0/1455985082 >> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] conn(0x5643f0ebdf30 0x5643f0e35e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:05.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1b97fa640 10 client.4845 ms_handle_connect on v2:172.21.15.47:6834/1169029730 2024-04-14T23:35:05.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1d9d9b640 1 --2- 172.21.15.47:0/1455985082 >> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] conn(0x5643f0ebdf30 0x5643f0e35e10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc6378005b2cc6ab server_cookie=983a2b0dc4db03bd in_seq=0 out_seq=0 2024-04-14T23:35:05.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1b97fa640 1 -- 172.21.15.47:0/1455985082 <== mds.0 v2:172.21.15.47:6834/1169029730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5643f0d66810 con 0x5643f0ebdf30 2024-04-14T23:35:05.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1b97fa640 10 client.4845 handle_command_reply: tid=0 2024-04-14T23:35:05.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1e3bae740 1 client.4845 shutdown 2024-04-14T23:35:05.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1455985082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e202f0 msgr2=0x5643f0e37c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:05.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/1455985082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e202f0 0x5643f0e37c40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x5643f0e29350 tx=0x7fc1d40046c0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1455985082 shutdown_connections 2024-04-14T23:35:05.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/1455985082 >> [v2:172.21.15.47:6834/1169029730,v1:172.21.15.47:6835/1169029730] conn(0x5643f0ebdf30 0x5643f0e35e10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/1455985082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5643f0e22ad0 0x5643f0e4ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/1455985082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5643f0e226f0 0x5643f0ea3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1e3bae740 1 --2- 172.21.15.47:0/1455985082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643f0e202f0 0x5643f0e37c40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1b97fa640 0 client.4845 ms_handle_reset on v2:172.21.15.47:6834/1169029730 2024-04-14T23:35:05.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1455985082 >> 172.21.15.47:0/1455985082 conn(0x5643f0df5bd0 msgr2=0x5643f0e275f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:05.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1455985082 shutdown_connections 2024-04-14T23:35:05.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1e3bae740 1 -- 172.21.15.47:0/1455985082 wait complete. 2024-04-14T23:35:05.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.879+0000 7fc1e3bae740 20 client.4845 trim_cache size 0 max 16384 2024-04-14T23:35:05.890 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-14T23:35:05.890 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "4f54965e-64cf-4502-8b02-6c5af72b63aa", 2024-04-14T23:35:05.890 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-04-14T23:35:05.890 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4287, 2024-04-14T23:35:05.890 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-04-14T23:35:05.890 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-04-14T23:35:05.891 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-04-14T23:35:05.891 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 27.178950104999998, 2024-04-14T23:35:05.891 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 8, 2024-04-14T23:35:05.891 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 25, 2024-04-14T23:35:05.891 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 25, 2024-04-14T23:35:05.891 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 34.001015017 2024-04-14T23:35:05.891 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-14T23:35:05.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.880+0000 7fc1e0dcc640 1 -- 172.21.15.47:0/3654299413 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc1bc06b990 msgr2=0x7fc1bc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:05.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.880+0000 7fc1e0dcc640 1 --2- 172.21.15.47:0/3654299413 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc1bc06b990 0x7fc1bc06de50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4009630 tx=0x7fc1d4009240 comp rx=0 tx=0).stop 2024-04-14T23:35:05.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.880+0000 7fc1e0dcc640 1 -- 172.21.15.47:0/3654299413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0d16d0 msgr2=0x7fc1dc157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:05.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.880+0000 7fc1e0dcc640 1 --2- 172.21.15.47:0/3654299413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0d16d0 0x7fc1dc157e90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc037040 tx=0x7fc1cc004a40 comp rx=0 tx=0).stop 2024-04-14T23:35:05.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.880+0000 7fc1e0dcc640 1 -- 172.21.15.47:0/3654299413 shutdown_connections 2024-04-14T23:35:05.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.880+0000 7fc1e0dcc640 1 --2- 172.21.15.47:0/3654299413 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc1bc06b990 0x7fc1bc06de50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.880+0000 7fc1e0dcc640 1 --2- 172.21.15.47:0/3654299413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1dc0d16d0 0x7fc1dc157e90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.880+0000 7fc1e0dcc640 1 --2- 172.21.15.47:0/3654299413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1dc0ceab0 0x7fc1dc157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.880+0000 7fc1e0dcc640 1 --2- 172.21.15.47:0/3654299413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1dc0cca50 0x7fc1dc1573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:05.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.880+0000 7fc1e0dcc640 1 -- 172.21.15.47:0/3654299413 >> 172.21.15.47:0/3654299413 conn(0x7fc1dc0d0bb0 msgr2=0x7fc1dc09ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:05.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.880+0000 7fc1e0dcc640 1 -- 172.21.15.47:0/3654299413 shutdown_connections 2024-04-14T23:35:05.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:05.880+0000 7fc1e0dcc640 1 -- 172.21.15.47:0/3654299413 wait complete. 2024-04-14T23:35:05.894 INFO:teuthology.run_tasks:Running task sequential... 2024-04-14T23:35:05.905 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-14T23:35:05.905 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-14T23:35:05.905 INFO:teuthology.task.print:Enabling mgr modules 2024-04-14T23:35:05.905 INFO:teuthology.run_tasks:Running task kclient... 2024-04-14T23:35:05.924 INFO:tasks.kclient:Mounting kernel clients... 2024-04-14T23:35:05.925 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-14T23:35:05.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:05.925 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-14T23:35:05.939 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-14T23:35:05.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:05.940 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-14T23:35:06.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:06.007 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-04-14T23:35:06.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:06.109 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-14T23:35:06.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:06.123 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-04-14T23:35:06.193 INFO:teuthology.orchestra.run.smithi047.stderr:Cannot find device "ceph-brx" 2024-04-14T23:35:06.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:35:06.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:06.195 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2024-04-14T23:35:06.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:06.214 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link delete ceph-brx 2024-04-14T23:35:06.287 INFO:teuthology.orchestra.run.smithi191.stderr:Cannot find device "ceph-brx" 2024-04-14T23:35:06.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:35:06.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:06.289 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2024-04-14T23:35:06.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:06.347 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link delete ceph-brx 2024-04-14T23:35:06.418 INFO:teuthology.orchestra.run.smithi191.stderr:Cannot find device "ceph-brx" 2024-04-14T23:35:06.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:35:06.420 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-14T23:35:06.420 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-14T23:35:06.420 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-14T23:35:06.420 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-14T23:35:06.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.519+0000 7f31ec06d640 1 Processor -- start 2024-04-14T23:35:06.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.519+0000 7f31ec06d640 1 -- start start 2024-04-14T23:35:06.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.520+0000 7f31ec06d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31e406e340 0x7f31e40cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:06.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.520+0000 7f31ec06d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f31e415bcc0 0x7f31e4071a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:06.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.520+0000 7f31ec06d640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e415c370 con 0x7f31e40cff70 2024-04-14T23:35:06.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.520+0000 7f31ec06d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f31e415c130 con 0x7f31e406e340 2024-04-14T23:35:06.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.520+0000 7f31ec06d640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f31e415ead0 con 0x7f31e415bcc0 2024-04-14T23:35:06.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.520+0000 7f31e9e09640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31e406e340 0x7f31e40cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:06.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.520+0000 7f31e9e09640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31e406e340 0x7f31e40cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45022/0 (socket says 172.21.15.47:45022) 2024-04-14T23:35:06.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.520+0000 7f31e9e09640 1 -- 172.21.15.47:0/3910794105 learned_addr learned my addr 172.21.15.47:0/3910794105 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:06.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.520+0000 7f31ea60a640 1 --2- 172.21.15.47:0/3910794105 >> v2:172.21.15.191:3300/0 conn(0x7f31e415bcc0 0x7f31e4071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:06.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.520+0000 7f31e9e09640 1 -- 172.21.15.47:0/3910794105 >> v2:172.21.15.191:3300/0 conn(0x7f31e415bcc0 msgr2=0x7f31e4071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:06.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.520+0000 7f31e9e09640 1 --2- 172.21.15.47:0/3910794105 >> v2:172.21.15.191:3300/0 conn(0x7f31e415bcc0 0x7f31e4071a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:06.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.520+0000 7f31e9e09640 1 -- 172.21.15.47:0/3910794105 >> v1:172.21.15.191:6789/0 conn(0x7f31e40cff70 legacy=0x7f31e415b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:06.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.520+0000 7f31e9e09640 1 -- 172.21.15.47:0/3910794105 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e415edb0 con 0x7f31e406e340 2024-04-14T23:35:06.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.520+0000 7f31ea60a640 1 --2- 172.21.15.47:0/3910794105 >> v2:172.21.15.191:3300/0 conn(0x7f31e415bcc0 0x7f31e4071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:06.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.521+0000 7f31e9e09640 1 --2- 172.21.15.47:0/3910794105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31e406e340 0x7f31e40cfa30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f31e40cf980 tx=0x7f31dc02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86496662609e139d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:06.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.521+0000 7f31e8e07640 1 -- 172.21.15.47:0/3910794105 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc03b070 con 0x7f31e406e340 2024-04-14T23:35:06.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.521+0000 7f31e8e07640 1 -- 172.21.15.47:0/3910794105 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc036440 con 0x7f31e406e340 2024-04-14T23:35:06.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.521+0000 7f31e8e07640 1 -- 172.21.15.47:0/3910794105 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc036810 con 0x7f31e406e340 2024-04-14T23:35:06.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.522+0000 7f31ec06d640 1 -- 172.21.15.47:0/3910794105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31e406e340 msgr2=0x7f31e40cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:06.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.522+0000 7f31ec06d640 1 --2- 172.21.15.47:0/3910794105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31e406e340 0x7f31e40cfa30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f31e40cf980 tx=0x7f31dc02e0e0 comp rx=0 tx=0).stop 2024-04-14T23:35:06.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.522+0000 7f31ec06d640 1 -- 172.21.15.47:0/3910794105 shutdown_connections 2024-04-14T23:35:06.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.522+0000 7f31ec06d640 1 --2- 172.21.15.47:0/3910794105 >> v2:172.21.15.191:3300/0 conn(0x7f31e415bcc0 0x7f31e4071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:06.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.522+0000 7f31ec06d640 1 --2- 172.21.15.47:0/3910794105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31e406e340 0x7f31e40cfa30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:06.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.522+0000 7f31ec06d640 1 -- 172.21.15.47:0/3910794105 >> 172.21.15.47:0/3910794105 conn(0x7f31e406b200 msgr2=0x7f31e406b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:06.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.522+0000 7f31ec06d640 1 -- 172.21.15.47:0/3910794105 shutdown_connections 2024-04-14T23:35:06.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.522+0000 7f31ec06d640 1 -- 172.21.15.47:0/3910794105 wait complete. 2024-04-14T23:35:06.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.523+0000 7f31ec06d640 1 Processor -- start 2024-04-14T23:35:06.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.523+0000 7f31ec06d640 1 -- start start 2024-04-14T23:35:06.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31ec06d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e406e340 0x7f31e41482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31ec06d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e40cff70 0x7f31e40c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31ec06d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31e415bcc0 0x7f31e40c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31ec06d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f31e415f890 con 0x7f31e415bcc0 2024-04-14T23:35:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31ec06d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f31e406e720 con 0x7f31e40cff70 2024-04-14T23:35:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31ec06d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f31e4071f80 con 0x7f31e406e340 2024-04-14T23:35:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31ea60a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31e415bcc0 0x7f31e40c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31ea60a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31e415bcc0 0x7f31e40c4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45036/0 (socket says 172.21.15.47:45036) 2024-04-14T23:35:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31ea60a640 1 -- 172.21.15.47:0/3043281289 learned_addr learned my addr 172.21.15.47:0/3043281289 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31e9608640 1 --2- 172.21.15.47:0/3043281289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e40cff70 0x7f31e40c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31e9e09640 1 --2- 172.21.15.47:0/3043281289 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e406e340 0x7f31e41482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31ea60a640 1 -- 172.21.15.47:0/3043281289 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e406e340 msgr2=0x7f31e41482d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31ea60a640 1 --2- 172.21.15.47:0/3043281289 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e406e340 0x7f31e41482d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31ea60a640 1 -- 172.21.15.47:0/3043281289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e40cff70 msgr2=0x7f31e40c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31ea60a640 1 --2- 172.21.15.47:0/3043281289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e40cff70 0x7f31e40c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31ea60a640 1 -- 172.21.15.47:0/3043281289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e40ae520 con 0x7f31e415bcc0 2024-04-14T23:35:06.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.524+0000 7f31e9e09640 1 --2- 172.21.15.47:0/3043281289 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e406e340 0x7f31e41482d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:06.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.525+0000 7f31ea60a640 1 --2- 172.21.15.47:0/3043281289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31e415bcc0 0x7f31e40c4f20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f31d4007df0 tx=0x7f31d400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:06.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.525+0000 7f31e27fc640 1 -- 172.21.15.47:0/3043281289 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d401a070 con 0x7f31e415bcc0 2024-04-14T23:35:06.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.525+0000 7f31e27fc640 1 -- 172.21.15.47:0/3043281289 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d4003990 con 0x7f31e415bcc0 2024-04-14T23:35:06.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.525+0000 7f31ec06d640 1 -- 172.21.15.47:0/3043281289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e40ae800 con 0x7f31e415bcc0 2024-04-14T23:35:06.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.525+0000 7f31e27fc640 1 -- 172.21.15.47:0/3043281289 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4003d80 con 0x7f31e415bcc0 2024-04-14T23:35:06.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.525+0000 7f31ec06d640 1 -- 172.21.15.47:0/3043281289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e40aedc0 con 0x7f31e415bcc0 2024-04-14T23:35:06.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.526+0000 7f31ec06d640 1 -- 172.21.15.47:0/3043281289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e4075430 con 0x7f31e415bcc0 2024-04-14T23:35:06.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.526+0000 7f31e27fc640 1 -- 172.21.15.47:0/3043281289 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f31d401d070 con 0x7f31e415bcc0 2024-04-14T23:35:06.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.526+0000 7f31e27fc640 1 --2- 172.21.15.47:0/3043281289 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f31d006b990 0x7f31d006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:06.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.527+0000 7f31e27fc640 1 -- 172.21.15.47:0/3043281289 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f31d408ada0 con 0x7f31e415bcc0 2024-04-14T23:35:06.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.527+0000 7f31e9e09640 1 --2- 172.21.15.47:0/3043281289 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f31d006b990 0x7f31d006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:06.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.527+0000 7f31e9e09640 1 --2- 172.21.15.47:0/3043281289 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f31d006b990 0x7f31d006de50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f31dc038000 tx=0x7f31dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:06.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.531+0000 7f31e27fc640 1 -- 172.21.15.47:0/3043281289 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f31d4010070 con 0x7f31e415bcc0 2024-04-14T23:35:06.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.752+0000 7f31ec06d640 1 -- 172.21.15.47:0/3043281289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f31e4071820 con 0x7f31e415bcc0 2024-04-14T23:35:06.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.752+0000 7f31e27fc640 1 -- 172.21.15.47:0/3043281289 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f31d4059020 con 0x7f31e415bcc0 2024-04-14T23:35:06.755 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-14T23:35:06.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.754+0000 7f31ec06d640 1 -- 172.21.15.47:0/3043281289 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f31d006b990 msgr2=0x7f31d006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:06.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.754+0000 7f31ec06d640 1 --2- 172.21.15.47:0/3043281289 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f31d006b990 0x7f31d006de50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f31dc038000 tx=0x7f31dc008040 comp rx=0 tx=0).stop 2024-04-14T23:35:06.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.754+0000 7f31ec06d640 1 -- 172.21.15.47:0/3043281289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31e415bcc0 msgr2=0x7f31e40c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:06.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.754+0000 7f31ec06d640 1 --2- 172.21.15.47:0/3043281289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31e415bcc0 0x7f31e40c4f20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f31d4007df0 tx=0x7f31d400d4a0 comp rx=0 tx=0).stop 2024-04-14T23:35:06.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.754+0000 7f31ec06d640 1 -- 172.21.15.47:0/3043281289 shutdown_connections 2024-04-14T23:35:06.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.754+0000 7f31ec06d640 1 --2- 172.21.15.47:0/3043281289 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f31d006b990 0x7f31d006de50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:06.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.754+0000 7f31ec06d640 1 --2- 172.21.15.47:0/3043281289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31e415bcc0 0x7f31e40c4f20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:06.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.754+0000 7f31ec06d640 1 --2- 172.21.15.47:0/3043281289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31e40cff70 0x7f31e40c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:06.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.754+0000 7f31ec06d640 1 --2- 172.21.15.47:0/3043281289 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31e406e340 0x7f31e41482d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:06.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.754+0000 7f31ec06d640 1 -- 172.21.15.47:0/3043281289 >> 172.21.15.47:0/3043281289 conn(0x7f31e406b200 msgr2=0x7f31e40723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:06.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.754+0000 7f31ec06d640 1 -- 172.21.15.47:0/3043281289 shutdown_connections 2024-04-14T23:35:06.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06.754+0000 7f31ec06d640 1 -- 172.21.15.47:0/3043281289 wait complete. 2024-04-14T23:35:06.768 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-14T23:35:06.768 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-14T23:35:06.768 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-04-14T23:35:06.768 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-14T23:35:06.768 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-14T23:35:06.768 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-14T23:35:06.768 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-14T23:35:06.768 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-14T23:35:06.768 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-14T23:35:06.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:06.769 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-04-14T23:35:06.783 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T23:35:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T23:35:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T23:35:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-04-14T23:35:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:06.783 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:35:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:06.783 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-04-14T23:35:06.783 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:35:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-04-14T23:35:06.784 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-14T23:35:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-04-14T23:35:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-14T23:35:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42704sec preferred_lft 42704sec 2024-04-14T23:35:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-04-14T23:35:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:06.784 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:35:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:06.784 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-04-14T23:35:06.785 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-14T23:35:06.785 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:06.785 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-14T23:35:06.785 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-04-14T23:35:06.785 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-04-14T23:35:06.785 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-04-14T23:35:06.785 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-14T23:35:06.785 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-14T23:35:06.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:06.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:06.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:06.930 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-14T23:35:06.954 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-04-14T23:35:06.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:06.956 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-04-14T23:35:07.011 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-04-14T23:35:07.011 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-14T23:35:07.011 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-14T23:35:07.011 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-14T23:35:07.011 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-14T23:35:07.012 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:07.012 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-14T23:35:07.012 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-14T23:35:07.012 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-14T23:35:07.012 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-14T23:35:07.012 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-14T23:35:07.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:07.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:07.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:07.148 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-14T23:35:07.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:07.163 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-04-14T23:35:07.218 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:07.218 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-14T23:35:07.219 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-14T23:35:07.219 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-14T23:35:07.219 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-14T23:35:07.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:07.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:07.340 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-14T23:35:07.340 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:07.340 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-14T23:35:07.340 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-14T23:35:07.340 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-14T23:35:07.340 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-14T23:35:07.340 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-14T23:35:07.340 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-14T23:35:07.340 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-14T23:35:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:07.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:07.465 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:07.465 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-14T23:35:07.465 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-04-14T23:35:07.465 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-04-14T23:35:07.465 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-14T23:35:07.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:07.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:07.546 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T23:35:07.547 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-14T23:35:07.561 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-14T23:35:07.561 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T23:35:07.561 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-14T23:35:07.616 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-14T23:35:07.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:07.616 DEBUG:teuthology.orchestra.run.smithi047:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-14T23:35:07.700 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-14T23:35:07.700 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-14T23:35:07.700 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-04-14T23:35:07.810 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-14T23:35:07.810 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-14T23:35:07.810 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-04-14T23:35:07.810 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.191:3300,172.21.15.191:3301" 2024-04-14T23:35:07.810 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-14T23:35:07.815 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-14T23:35:07.815 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-14T23:35:07.815 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-04-14T23:35:07.815 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.191:3300,172.21.15.191:3301" 2024-04-14T23:35:07.815 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-14T23:35:07.815 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.47:6789,172.21.15.191:6789,172.21.15.191:6790" 2024-04-14T23:35:07.815 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.47:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2024-04-14T23:35:07.815 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=4f54965e-64cf-4502-8b02-6c5af72b63aa" will pass to kernel 2024-04-14T23:35:07.816 INFO:teuthology.orchestra.run.smithi047.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-14T23:35:07.816 INFO:teuthology.orchestra.run.smithi047.stdout: You just mounted a file system that supports labels which does not 2024-04-14T23:35:07.816 INFO:teuthology.orchestra.run.smithi047.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-14T23:35:07.816 INFO:teuthology.orchestra.run.smithi047.stdout: applications will generate AVC messages and not be allowed access to 2024-04-14T23:35:07.816 INFO:teuthology.orchestra.run.smithi047.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-14T23:35:07.817 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-14T23:35:07.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:07.818 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-14T23:35:07.850 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T23:35:07.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T23:35:07.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:07.947 INFO:teuthology.orchestra.run.smithi047.stdout:client4726 2024-04-14T23:35:07.947 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:35:07.947 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:07.962 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T23:35:08.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T23:35:08.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:08.056 INFO:teuthology.orchestra.run.smithi047.stdout:client4726 2024-04-14T23:35:08.057 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T23:35:08.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T23:35:08.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:08.111 INFO:teuthology.orchestra.run.smithi047.stdout:client4726 2024-04-14T23:35:08.112 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4f54965e-64cf-4502-8b02-6c5af72b63aa.client4726/status') 2024-04-14T23:35:08.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:08.172 INFO:teuthology.orchestra.run.smithi047.stdout:instance: client.4726 (3)172.21.15.47:0/3679345482 2024-04-14T23:35:08.172 INFO:teuthology.orchestra.run.smithi047.stdout:blocklisted: false 2024-04-14T23:35:08.172 INFO:teuthology.orchestra.run.smithi047.stderr:0+1 records in 2024-04-14T23:35:08.172 INFO:teuthology.orchestra.run.smithi047.stderr:0+1 records out 2024-04-14T23:35:08.173 INFO:teuthology.orchestra.run.smithi047.stderr:70 bytes copied, 2.2993e-05 s, 3.0 MB/s 2024-04-14T23:35:08.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:08.179 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-14T23:35:08.179 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-14T23:35:08.179 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-14T23:35:08.180 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-14T23:35:08.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.277+0000 7fa21920f640 1 Processor -- start 2024-04-14T23:35:08.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.277+0000 7fa21920f640 1 -- start start 2024-04-14T23:35:08.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.278+0000 7fa21920f640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa2140cdce0 0x7fa214168fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:08.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.278+0000 7fa21920f640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2140cf2d0 con 0x7fa2140d0980 2024-04-14T23:35:08.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.278+0000 7fa21920f640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2140d1040 con 0x7fa21415e420 2024-04-14T23:35:08.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.278+0000 7fa21920f640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fa2140d0e10 con 0x7fa2140cdce0 2024-04-14T23:35:08.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.278+0000 7fa21259c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa2140d0980 0x7fa2140cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55820/0 (socket says 172.21.15.47:55820) 2024-04-14T23:35:08.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.278+0000 7fa21259c640 1 -- 172.21.15.47:0/3041857526 learned_addr learned my addr 172.21.15.47:0/3041857526 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:08.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa21359e640 1 --2- 172.21.15.47:0/3041857526 >> v2:172.21.15.191:3300/0 conn(0x7fa2140cdce0 0x7fa214168fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa211d9b640 1 -- 172.21.15.47:0/3041857526 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 150008574 0 0) 0x7fa2140cf2d0 con 0x7fa2140d0980 2024-04-14T23:35:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa211d9b640 1 -- 172.21.15.47:0/3041857526 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1fc003520 con 0x7fa2140d0980 2024-04-14T23:35:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa211d9b640 1 -- 172.21.15.47:0/3041857526 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2517127421 0 0) 0x7fa1fc003520 con 0x7fa2140d0980 2024-04-14T23:35:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa211d9b640 1 -- 172.21.15.47:0/3041857526 >> v2:172.21.15.191:3300/0 conn(0x7fa2140cdce0 msgr2=0x7fa214168fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa211d9b640 1 --2- 172.21.15.47:0/3041857526 >> v2:172.21.15.191:3300/0 conn(0x7fa2140cdce0 0x7fa214168fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa211d9b640 1 -- 172.21.15.47:0/3041857526 >> v1:172.21.15.191:6789/0 conn(0x7fa21415e420 legacy=0x7fa2140ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa211d9b640 1 -- 172.21.15.47:0/3041857526 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2140d1320 con 0x7fa2140d0980 2024-04-14T23:35:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa211d9b640 1 -- 172.21.15.47:0/3041857526 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7fa208001670 con 0x7fa2140d0980 2024-04-14T23:35:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa211d9b640 1 -- 172.21.15.47:0/3041857526 >> v1:172.21.15.47:6789/0 conn(0x7fa2140d0980 legacy=0x7fa2140cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa211d9b640 1 --2- 172.21.15.47:0/3041857526 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1fc0039b0 0x7fa1fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa211d9b640 1 --2- 172.21.15.47:0/3041857526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1fc0043b0 0x7fa1fc004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa211d9b640 1 --2- 172.21.15.47:0/3041857526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1fc005080 0x7fa1fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa211d9b640 1 -- 172.21.15.47:0/3041857526 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc00bf00 con 0x7fa1fc0039b0 2024-04-14T23:35:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa211d9b640 1 -- 172.21.15.47:0/3041857526 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc00c0b0 con 0x7fa1fc005080 2024-04-14T23:35:08.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa211d9b640 1 -- 172.21.15.47:0/3041857526 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa1fc00c2b0 con 0x7fa1fc0043b0 2024-04-14T23:35:08.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa212d9d640 1 --2- 172.21.15.47:0/3041857526 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1fc0039b0 0x7fa1fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:08.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa21259c640 1 --2- 172.21.15.47:0/3041857526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1fc0043b0 0x7fa1fc004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:08.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa21359e640 1 --2- 172.21.15.47:0/3041857526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1fc005080 0x7fa1fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:08.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa212d9d640 1 -- 172.21.15.47:0/3041857526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1fc0043b0 msgr2=0x7fa1fc004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:08.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa212d9d640 1 --2- 172.21.15.47:0/3041857526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1fc0043b0 0x7fa1fc004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:08.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa212d9d640 1 -- 172.21.15.47:0/3041857526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1fc005080 msgr2=0x7fa1fc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:08.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa212d9d640 1 --2- 172.21.15.47:0/3041857526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1fc005080 0x7fa1fc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:08.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa212d9d640 1 -- 172.21.15.47:0/3041857526 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc003520 con 0x7fa1fc0039b0 2024-04-14T23:35:08.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa21359e640 1 --2- 172.21.15.47:0/3041857526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1fc005080 0x7fa1fc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:08.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.279+0000 7fa21359e640 1 -- 172.21.15.47:0/3041857526 reap_dead start 2024-04-14T23:35:08.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.280+0000 7fa212d9d640 1 --2- 172.21.15.47:0/3041857526 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1fc0039b0 0x7fa1fc003d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa204001860 tx=0x7fa1fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7570c8c2a98a16e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:08.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.280+0000 7fa211d9b640 1 -- 172.21.15.47:0/3041857526 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204038070 con 0x7fa1fc0039b0 2024-04-14T23:35:08.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.280+0000 7fa211d9b640 1 -- 172.21.15.47:0/3041857526 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa204033410 con 0x7fa1fc0039b0 2024-04-14T23:35:08.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.280+0000 7fa211d9b640 1 -- 172.21.15.47:0/3041857526 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204001430 con 0x7fa1fc0039b0 2024-04-14T23:35:08.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.281+0000 7fa21920f640 1 -- 172.21.15.47:0/3041857526 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1fc0039b0 msgr2=0x7fa1fc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:08.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.281+0000 7fa21920f640 1 --2- 172.21.15.47:0/3041857526 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1fc0039b0 0x7fa1fc003d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa204001860 tx=0x7fa1fc005830 comp rx=0 tx=0).stop 2024-04-14T23:35:08.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.281+0000 7fa21920f640 1 -- 172.21.15.47:0/3041857526 shutdown_connections 2024-04-14T23:35:08.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.281+0000 7fa21920f640 1 --2- 172.21.15.47:0/3041857526 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1fc0039b0 0x7fa1fc003d90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:08.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.281+0000 7fa21920f640 1 -- 172.21.15.47:0/3041857526 >> 172.21.15.47:0/3041857526 conn(0x7fa2140d1c30 msgr2=0x7fa2140d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:08.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.281+0000 7fa21920f640 1 -- 172.21.15.47:0/3041857526 shutdown_connections 2024-04-14T23:35:08.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.281+0000 7fa21920f640 1 -- 172.21.15.47:0/3041857526 wait complete. 2024-04-14T23:35:08.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.282+0000 7fa21920f640 1 Processor -- start 2024-04-14T23:35:08.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.282+0000 7fa21920f640 1 -- start start 2024-04-14T23:35:08.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.283+0000 7fa21920f640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1fc0039b0 0x7fa214154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:08.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.283+0000 7fa21920f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa21414f580 0x7fa2140cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:08.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.283+0000 7fa21920f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2140cb8c0 0x7fa214152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:08.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.283+0000 7fa21920f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa2140cc7b0 con 0x7fa21414f580 2024-04-14T23:35:08.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.283+0000 7fa21920f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa2140cc280 con 0x7fa2140cb8c0 2024-04-14T23:35:08.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.283+0000 7fa21920f640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa21415e800 con 0x7fa1fc0039b0 2024-04-14T23:35:08.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.283+0000 7fa21259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa21414f580 0x7fa2140cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:08.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.283+0000 7fa21259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa21414f580 0x7fa2140cb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45054/0 (socket says 172.21.15.47:45054) 2024-04-14T23:35:08.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.283+0000 7fa21259c640 1 -- 172.21.15.47:0/3683749231 learned_addr learned my addr 172.21.15.47:0/3683749231 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:08.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.284+0000 7fa21359e640 1 --2- 172.21.15.47:0/3683749231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2140cb8c0 0x7fa214152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:08.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.284+0000 7fa212d9d640 1 --2- 172.21.15.47:0/3683749231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1fc0039b0 0x7fa214154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:08.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.284+0000 7fa21259c640 1 -- 172.21.15.47:0/3683749231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1fc0039b0 msgr2=0x7fa214154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:08.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.284+0000 7fa21259c640 1 --2- 172.21.15.47:0/3683749231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1fc0039b0 0x7fa214154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:08.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.284+0000 7fa21259c640 1 -- 172.21.15.47:0/3683749231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2140cb8c0 msgr2=0x7fa214152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:08.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.284+0000 7fa21259c640 1 --2- 172.21.15.47:0/3683749231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2140cb8c0 0x7fa214152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:08.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.284+0000 7fa21259c640 1 -- 172.21.15.47:0/3683749231 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2140c9a90 con 0x7fa21414f580 2024-04-14T23:35:08.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.284+0000 7fa21359e640 1 --2- 172.21.15.47:0/3683749231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2140cb8c0 0x7fa214152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:08.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.284+0000 7fa21259c640 1 --2- 172.21.15.47:0/3683749231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa21414f580 0x7fa2140cb380 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa208007320 tx=0x7fa2080077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:08.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.284+0000 7fa1fb7fe640 1 -- 172.21.15.47:0/3683749231 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20801a070 con 0x7fa21414f580 2024-04-14T23:35:08.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.284+0000 7fa1fb7fe640 1 -- 172.21.15.47:0/3683749231 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa20800f9a0 con 0x7fa21414f580 2024-04-14T23:35:08.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.284+0000 7fa21920f640 1 -- 172.21.15.47:0/3683749231 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2140c9d70 con 0x7fa21414f580 2024-04-14T23:35:08.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.284+0000 7fa1fb7fe640 1 -- 172.21.15.47:0/3683749231 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20800fd90 con 0x7fa21414f580 2024-04-14T23:35:08.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.284+0000 7fa21920f640 1 -- 172.21.15.47:0/3683749231 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa214151580 con 0x7fa21414f580 2024-04-14T23:35:08.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.285+0000 7fa21920f640 1 -- 172.21.15.47:0/3683749231 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa214075430 con 0x7fa21414f580 2024-04-14T23:35:08.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.285+0000 7fa1fb7fe640 1 -- 172.21.15.47:0/3683749231 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fa20801d070 con 0x7fa21414f580 2024-04-14T23:35:08.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.286+0000 7fa1fb7fe640 1 --2- 172.21.15.47:0/3683749231 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa20006b990 0x7fa20006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:08.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.286+0000 7fa1fb7fe640 1 -- 172.21.15.47:0/3683749231 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa20808a5c0 con 0x7fa21414f580 2024-04-14T23:35:08.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.286+0000 7fa212d9d640 1 --2- 172.21.15.47:0/3683749231 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa20006b990 0x7fa20006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:08.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.286+0000 7fa212d9d640 1 --2- 172.21.15.47:0/3683749231 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa20006b990 0x7fa20006de50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa204035000 tx=0x7fa204009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:08.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.290+0000 7fa1fb7fe640 1 -- 172.21.15.47:0/3683749231 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa208058e90 con 0x7fa21414f580 2024-04-14T23:35:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.511+0000 7fa21920f640 1 -- 172.21.15.47:0/3683749231 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa214070aa0 con 0x7fa21414f580 2024-04-14T23:35:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.511+0000 7fa1fb7fe640 1 -- 172.21.15.47:0/3683749231 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fa208058790 con 0x7fa21414f580 2024-04-14T23:35:08.514 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-14T23:35:08.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.513+0000 7fa21920f640 1 -- 172.21.15.47:0/3683749231 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa20006b990 msgr2=0x7fa20006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:08.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.513+0000 7fa21920f640 1 --2- 172.21.15.47:0/3683749231 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa20006b990 0x7fa20006de50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa204035000 tx=0x7fa204009030 comp rx=0 tx=0).stop 2024-04-14T23:35:08.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.513+0000 7fa21920f640 1 -- 172.21.15.47:0/3683749231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa21414f580 msgr2=0x7fa2140cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:08.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.513+0000 7fa21920f640 1 --2- 172.21.15.47:0/3683749231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa21414f580 0x7fa2140cb380 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa208007320 tx=0x7fa2080077e0 comp rx=0 tx=0).stop 2024-04-14T23:35:08.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.513+0000 7fa21920f640 1 -- 172.21.15.47:0/3683749231 shutdown_connections 2024-04-14T23:35:08.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.513+0000 7fa21920f640 1 --2- 172.21.15.47:0/3683749231 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa20006b990 0x7fa20006de50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:08.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.513+0000 7fa21920f640 1 --2- 172.21.15.47:0/3683749231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2140cb8c0 0x7fa214152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:08.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.513+0000 7fa21920f640 1 --2- 172.21.15.47:0/3683749231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa21414f580 0x7fa2140cb380 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:08.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.513+0000 7fa21920f640 1 --2- 172.21.15.47:0/3683749231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1fc0039b0 0x7fa214154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:08.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.513+0000 7fa21920f640 1 -- 172.21.15.47:0/3683749231 >> 172.21.15.47:0/3683749231 conn(0x7fa2140d1c30 msgr2=0x7fa21415d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:08.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.513+0000 7fa21920f640 1 -- 172.21.15.47:0/3683749231 shutdown_connections 2024-04-14T23:35:08.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08.513+0000 7fa21920f640 1 -- 172.21.15.47:0/3683749231 wait complete. 2024-04-14T23:35:08.527 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-14T23:35:08.527 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-14T23:35:08.527 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-04-14T23:35:08.527 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-14T23:35:08.527 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-14T23:35:08.528 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-14T23:35:08.528 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-14T23:35:08.528 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-14T23:35:08.528 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-14T23:35:08.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:08.528 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-04-14T23:35:08.546 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T23:35:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T23:35:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T23:35:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-04-14T23:35:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:08.546 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:35:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-04-14T23:35:08.546 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:35:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-04-14T23:35:08.547 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-14T23:35:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-04-14T23:35:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-14T23:35:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42702sec preferred_lft 42702sec 2024-04-14T23:35:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-04-14T23:35:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:08.547 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:35:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-04-14T23:35:08.547 INFO:teuthology.orchestra.run.smithi047.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-14T23:35:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 82:cf:01:ef:df:83 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-14T23:35:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::88f0:ccff:fece:938d/64 scope link 2024-04-14T23:35:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:08.548 INFO:teuthology.orchestra.run.smithi047.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-14T23:35:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 82:cf:01:ef:df:83 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-14T23:35:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::80cf:1ff:feef:df83/64 scope link tentative 2024-04-14T23:35:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:08.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:08.548 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-14T23:35:08.611 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-04-14T23:35:08.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:08.613 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-04-14T23:35:08.668 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-04-14T23:35:08.668 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-14T23:35:08.668 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-14T23:35:08.668 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-14T23:35:08.668 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-14T23:35:08.669 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:08.669 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-14T23:35:08.669 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-14T23:35:08.669 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-14T23:35:08.669 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-14T23:35:08.669 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-14T23:35:08.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:08.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:08.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:08.805 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-14T23:35:08.820 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-14T23:35:08.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:08.820 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-04-14T23:35:08.874 INFO:teuthology.orchestra.run.smithi047.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-14T23:35:08.874 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:08.875 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-14T23:35:08.875 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-14T23:35:08.875 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-14T23:35:08.875 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-14T23:35:08.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:08.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:08.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:08.997 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-14T23:35:09.023 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T23:35:09.023 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T23:35:09.023 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T23:35:09.023 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:09.023 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-04-14T23:35:09.023 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:09.023 INFO:teuthology.orchestra.run.smithi047.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-14T23:35:09.024 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 46:1e:06:1e:4c:c9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-14T23:35:09.024 INFO:teuthology.orchestra.run.smithi047.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-14T23:35:09.024 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:09.024 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::441e:6ff:fe1e:4cc9/64 scope link tentative 2024-04-14T23:35:09.024 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:09.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:09.025 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-14T23:35:09.091 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T23:35:09.091 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T23:35:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T23:35:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-04-14T23:35:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:09.092 INFO:teuthology.orchestra.run.smithi047.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-14T23:35:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 46:1e:06:1e:4c:c9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-14T23:35:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-14T23:35:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::441e:6ff:fe1e:4cc9/64 scope link 2024-04-14T23:35:09.092 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:09.093 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-14T23:35:09.093 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:09.094 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-14T23:35:09.094 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-14T23:35:09.094 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-14T23:35:09.094 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-14T23:35:09.094 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-14T23:35:09.094 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-14T23:35:09.094 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-14T23:35:09.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:09.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:09.259 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:09.259 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-14T23:35:09.259 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.1 up 2024-04-14T23:35:09.259 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.1 master ceph-brx 2024-04-14T23:35:09.259 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-14T23:35:09.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:09.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:09.340 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T23:35:09.340 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-14T23:35:09.366 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-14T23:35:09.366 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T23:35:09.367 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-14T23:35:09.421 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-14T23:35:09.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:09.421 DEBUG:teuthology.orchestra.run.smithi047:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-14T23:35:09.505 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-14T23:35:09.506 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-14T23:35:09.506 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-04-14T23:35:09.514 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-14T23:35:09.514 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-14T23:35:09.514 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-04-14T23:35:09.514 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.191:3300,172.21.15.191:3301" 2024-04-14T23:35:09.514 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-14T23:35:09.518 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-14T23:35:09.518 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-14T23:35:09.518 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-04-14T23:35:09.519 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.191:3300,172.21.15.191:3301" 2024-04-14T23:35:09.519 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-14T23:35:09.519 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.47:6789,172.21.15.191:6789,172.21.15.191:6790" 2024-04-14T23:35:09.519 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.47:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2024-04-14T23:35:09.519 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=4f54965e-64cf-4502-8b02-6c5af72b63aa" will pass to kernel 2024-04-14T23:35:09.519 INFO:teuthology.orchestra.run.smithi047.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-14T23:35:09.519 INFO:teuthology.orchestra.run.smithi047.stdout: You just mounted a file system that supports labels which does not 2024-04-14T23:35:09.519 INFO:teuthology.orchestra.run.smithi047.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-14T23:35:09.519 INFO:teuthology.orchestra.run.smithi047.stdout: applications will generate AVC messages and not be allowed access to 2024-04-14T23:35:09.520 INFO:teuthology.orchestra.run.smithi047.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-14T23:35:09.521 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-14T23:35:09.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:09.521 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-14T23:35:09.547 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T23:35:09.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T23:35:09.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:09.643 INFO:teuthology.orchestra.run.smithi047.stdout:client4735 2024-04-14T23:35:09.643 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:35:09.643 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:09.658 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T23:35:09.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T23:35:09.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:09.755 INFO:teuthology.orchestra.run.smithi047.stdout:client4735 2024-04-14T23:35:09.755 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T23:35:09.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T23:35:09.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:09.810 INFO:teuthology.orchestra.run.smithi047.stdout:client4735 2024-04-14T23:35:09.811 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4f54965e-64cf-4502-8b02-6c5af72b63aa.client4735/status') 2024-04-14T23:35:09.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:09.872 INFO:teuthology.orchestra.run.smithi047.stdout:instance: client.4735 (3)172.21.15.47:0/2811301943 2024-04-14T23:35:09.872 INFO:teuthology.orchestra.run.smithi047.stdout:blocklisted: false 2024-04-14T23:35:09.872 INFO:teuthology.orchestra.run.smithi047.stderr:0+1 records in 2024-04-14T23:35:09.872 INFO:teuthology.orchestra.run.smithi047.stderr:0+1 records out 2024-04-14T23:35:09.872 INFO:teuthology.orchestra.run.smithi047.stderr:70 bytes copied, 2.0683e-05 s, 3.4 MB/s 2024-04-14T23:35:09.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:09.879 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-14T23:35:09.879 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-14T23:35:09.879 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-14T23:35:09.879 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-14T23:35:09.921 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T23:35:09.925 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T23:35:09.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.978+0000 7f39794c8640 1 Processor -- start 2024-04-14T23:35:09.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.978+0000 7f39794c8640 1 -- start start 2024-04-14T23:35:09.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.979+0000 7f39794c8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f39740d07e0 0x7f3974160100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.979+0000 7f39794c8640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f3974160640 0x7f39740ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.979+0000 7f39794c8640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3974160ab0 con 0x7f39740d1c60 2024-04-14T23:35:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.979+0000 7f39794c8640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f39740d0c50 con 0x7f39740d07e0 2024-04-14T23:35:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.979+0000 7f39794c8640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f39740cfa20 con 0x7f3974160640 2024-04-14T23:35:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.979+0000 7f39727fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f39740d07e0 0x7f3974160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.979+0000 7f39727fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f39740d07e0 0x7f3974160100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45056/0 (socket says 172.21.15.47:45056) 2024-04-14T23:35:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.979+0000 7f3972ffd640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f39740d1c60 0x7f39740d2040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55826/0 (socket says 172.21.15.47:55826) 2024-04-14T23:35:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.979+0000 7f39727fc640 1 -- 172.21.15.47:0/1427119804 learned_addr learned my addr 172.21.15.47:0/1427119804 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.979+0000 7f39737fe640 1 --2- 172.21.15.47:0/1427119804 >> v2:172.21.15.191:3300/0 conn(0x7f3974160640 0x7f39740ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.979+0000 7f39727fc640 1 -- 172.21.15.47:0/1427119804 >> v2:172.21.15.191:3300/0 conn(0x7f3974160640 msgr2=0x7f39740ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.979+0000 7f39727fc640 1 --2- 172.21.15.47:0/1427119804 >> v2:172.21.15.191:3300/0 conn(0x7f3974160640 0x7f39740ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.979+0000 7f39727fc640 1 -- 172.21.15.47:0/1427119804 >> v1:172.21.15.47:6789/0 conn(0x7f39740d1c60 legacy=0x7f39740d2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.979+0000 7f3971ffb640 1 -- 172.21.15.47:0/1427119804 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3259726213 0 0) 0x7f3974160ab0 con 0x7f39740d1c60 2024-04-14T23:35:09.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.979+0000 7f39727fc640 1 -- 172.21.15.47:0/1427119804 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39740cfd00 con 0x7f39740d07e0 2024-04-14T23:35:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.980+0000 7f39737fe640 1 --2- 172.21.15.47:0/1427119804 >> v2:172.21.15.191:3300/0 conn(0x7f3974160640 0x7f39740ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.980+0000 7f39727fc640 1 --2- 172.21.15.47:0/1427119804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39740d07e0 0x7f3974160100 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f39740d1a00 tx=0x7f395c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af36260bdb21e462 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.980+0000 7f3971ffb640 1 -- 172.21.15.47:0/1427119804 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c034070 con 0x7f39740d07e0 2024-04-14T23:35:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.980+0000 7f3971ffb640 1 -- 172.21.15.47:0/1427119804 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f395c030860 con 0x7f39740d07e0 2024-04-14T23:35:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.980+0000 7f3971ffb640 1 -- 172.21.15.47:0/1427119804 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c030c30 con 0x7f39740d07e0 2024-04-14T23:35:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.981+0000 7f39794c8640 1 -- 172.21.15.47:0/1427119804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39740d07e0 msgr2=0x7f3974160100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.981+0000 7f39794c8640 1 --2- 172.21.15.47:0/1427119804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39740d07e0 0x7f3974160100 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f39740d1a00 tx=0x7f395c02b9a0 comp rx=0 tx=0).stop 2024-04-14T23:35:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.981+0000 7f39794c8640 1 -- 172.21.15.47:0/1427119804 shutdown_connections 2024-04-14T23:35:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.981+0000 7f39794c8640 1 --2- 172.21.15.47:0/1427119804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39740d07e0 0x7f3974160100 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.981+0000 7f39794c8640 1 --2- 172.21.15.47:0/1427119804 >> v2:172.21.15.191:3300/0 conn(0x7f3974160640 0x7f39740ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.981+0000 7f39794c8640 1 -- 172.21.15.47:0/1427119804 >> 172.21.15.47:0/1427119804 conn(0x7f397409aa30 msgr2=0x7f397409ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.981+0000 7f39794c8640 1 -- 172.21.15.47:0/1427119804 shutdown_connections 2024-04-14T23:35:09.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.981+0000 7f39794c8640 1 -- 172.21.15.47:0/1427119804 wait complete. 2024-04-14T23:35:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.982+0000 7f39794c8640 1 Processor -- start 2024-04-14T23:35:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.982+0000 7f39794c8640 1 -- start start 2024-04-14T23:35:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f39794c8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39740d07e0 0x7f397415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f39794c8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39740d1c60 0x7f39741f1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:09.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f39794c8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3974160640 0x7f39740c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f39794c8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f39740cee30 con 0x7f3974160640 2024-04-14T23:35:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f39794c8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f39740d02c0 con 0x7f39740d07e0 2024-04-14T23:35:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f39794c8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f39740cefb0 con 0x7f39740d1c60 2024-04-14T23:35:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f39737fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3974160640 0x7f39740c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f39737fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3974160640 0x7f39740c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45070/0 (socket says 172.21.15.47:45070) 2024-04-14T23:35:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f39737fe640 1 -- 172.21.15.47:0/1575948399 learned_addr learned my addr 172.21.15.47:0/1575948399 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f3972ffd640 1 --2- 172.21.15.47:0/1575948399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39740d07e0 0x7f397415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:09.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f39727fc640 1 --2- 172.21.15.47:0/1575948399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39740d1c60 0x7f39741f1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f39737fe640 1 -- 172.21.15.47:0/1575948399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39740d1c60 msgr2=0x7f39741f1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f39737fe640 1 --2- 172.21.15.47:0/1575948399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39740d1c60 0x7f39741f1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f39737fe640 1 -- 172.21.15.47:0/1575948399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39740d07e0 msgr2=0x7f397415b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f39737fe640 1 --2- 172.21.15.47:0/1575948399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39740d07e0 0x7f397415b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f39737fe640 1 -- 172.21.15.47:0/1575948399 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39740b4960 con 0x7f3974160640 2024-04-14T23:35:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.983+0000 7f39727fc640 1 --2- 172.21.15.47:0/1575948399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39740d1c60 0x7f39741f1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.984+0000 7f39737fe640 1 --2- 172.21.15.47:0/1575948399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3974160640 0x7f39740c97b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3964007df0 tx=0x7f396400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.984+0000 7f396b7fe640 1 -- 172.21.15.47:0/1575948399 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396401a070 con 0x7f3974160640 2024-04-14T23:35:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.984+0000 7f396b7fe640 1 -- 172.21.15.47:0/1575948399 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3964003990 con 0x7f3974160640 2024-04-14T23:35:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.984+0000 7f39794c8640 1 -- 172.21.15.47:0/1575948399 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39740b4c40 con 0x7f3974160640 2024-04-14T23:35:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.984+0000 7f396b7fe640 1 -- 172.21.15.47:0/1575948399 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3964003d80 con 0x7f3974160640 2024-04-14T23:35:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.984+0000 7f39794c8640 1 -- 172.21.15.47:0/1575948399 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39740b5200 con 0x7f3974160640 2024-04-14T23:35:09.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.985+0000 7f39794c8640 1 -- 172.21.15.47:0/1575948399 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3974075430 con 0x7f3974160640 2024-04-14T23:35:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.985+0000 7f396b7fe640 1 -- 172.21.15.47:0/1575948399 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f396401d070 con 0x7f3974160640 2024-04-14T23:35:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.986+0000 7f396b7fe640 1 --2- 172.21.15.47:0/1575948399 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f395406b9c0 0x7f395406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.986+0000 7f396b7fe640 1 -- 172.21.15.47:0/1575948399 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f396408ad20 con 0x7f3974160640 2024-04-14T23:35:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.986+0000 7f3972ffd640 1 --2- 172.21.15.47:0/1575948399 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f395406b9c0 0x7f395406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:09.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.987+0000 7f3972ffd640 1 --2- 172.21.15.47:0/1575948399 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f395406b9c0 0x7f395406de80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f396c000f60 tx=0x7f396c007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:09.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:09.990+0000 7f396b7fe640 1 -- 172.21.15.47:0/1575948399 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3964010070 con 0x7f3974160640 2024-04-14T23:35:10.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:10.209+0000 7f39794c8640 1 -- 172.21.15.47:0/1575948399 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f397409b650 con 0x7f3974160640 2024-04-14T23:35:10.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:10.210+0000 7f396b7fe640 1 -- 172.21.15.47:0/1575948399 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f3964058fa0 con 0x7f3974160640 2024-04-14T23:35:10.213 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-14T23:35:10.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:10.212+0000 7f39794c8640 1 -- 172.21.15.47:0/1575948399 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f395406b9c0 msgr2=0x7f395406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:10.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:10.212+0000 7f39794c8640 1 --2- 172.21.15.47:0/1575948399 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f395406b9c0 0x7f395406de80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f396c000f60 tx=0x7f396c007d50 comp rx=0 tx=0).stop 2024-04-14T23:35:10.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:10.212+0000 7f39794c8640 1 -- 172.21.15.47:0/1575948399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3974160640 msgr2=0x7f39740c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:10.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:10.212+0000 7f39794c8640 1 --2- 172.21.15.47:0/1575948399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3974160640 0x7f39740c97b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3964007df0 tx=0x7f396400d4a0 comp rx=0 tx=0).stop 2024-04-14T23:35:10.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:10.212+0000 7f39794c8640 1 -- 172.21.15.47:0/1575948399 shutdown_connections 2024-04-14T23:35:10.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:10.212+0000 7f39794c8640 1 --2- 172.21.15.47:0/1575948399 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f395406b9c0 0x7f395406de80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:10.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:10.212+0000 7f39794c8640 1 --2- 172.21.15.47:0/1575948399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3974160640 0x7f39740c97b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:10.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:10.212+0000 7f39794c8640 1 --2- 172.21.15.47:0/1575948399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39740d1c60 0x7f39741f1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:10.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:10.212+0000 7f39794c8640 1 --2- 172.21.15.47:0/1575948399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39740d07e0 0x7f397415b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:10.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:10.212+0000 7f39794c8640 1 -- 172.21.15.47:0/1575948399 >> 172.21.15.47:0/1575948399 conn(0x7f397409aa30 msgr2=0x7f397409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:10.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:10.212+0000 7f39794c8640 1 -- 172.21.15.47:0/1575948399 shutdown_connections 2024-04-14T23:35:10.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:10.212+0000 7f39794c8640 1 -- 172.21.15.47:0/1575948399 wait complete. 2024-04-14T23:35:10.226 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-14T23:35:10.226 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-14T23:35:10.226 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi191.front.sepia.ceph.com 2024-04-14T23:35:10.226 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-14T23:35:10.226 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-14T23:35:10.226 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-14T23:35:10.226 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-14T23:35:10.226 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-14T23:35:10.226 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-14T23:35:10.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:10.227 DEBUG:teuthology.orchestra.run.smithi191:> ip addr 2024-04-14T23:35:10.245 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T23:35:10.245 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T23:35:10.245 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T23:35:10.245 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:10.245 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2024-04-14T23:35:10.245 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:10.245 INFO:teuthology.orchestra.run.smithi191.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:35:10.245 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f6 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:10.246 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f0 2024-04-14T23:35:10.246 INFO:teuthology.orchestra.run.smithi191.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:35:10.246 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f7 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:10.246 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f1 2024-04-14T23:35:10.246 INFO:teuthology.orchestra.run.smithi191.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:35:10.246 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:10 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:10.246 INFO:teuthology.orchestra.run.smithi191.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-14T23:35:10.246 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:11 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:10.246 INFO:teuthology.orchestra.run.smithi191.stdout: inet 172.21.15.191/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-14T23:35:10.246 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft 42702sec preferred_lft 42702sec 2024-04-14T23:35:10.247 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::ec4:7aff:fe88:7211/64 scope link 2024-04-14T23:35:10.247 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:10.247 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-14T23:35:10.247 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:10.247 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-04-14T23:35:10.247 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add name ceph-brx type bridge 2024-04-14T23:35:10.247 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip addr flush dev ceph-brx 2024-04-14T23:35:10.247 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set ceph-brx up 2024-04-14T23:35:10.247 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-14T23:35:10.247 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-04-14T23:35:10.342 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:10.443 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:10.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:10.449 DEBUG:teuthology.orchestra.run.smithi191:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-14T23:35:10.476 INFO:teuthology.orchestra.run.smithi191.stdout:1 2024-04-14T23:35:10.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:10.478 DEBUG:teuthology.orchestra.run.smithi191:> route 2024-04-14T23:35:10.541 INFO:teuthology.orchestra.run.smithi191.stdout:Kernel IP routing table 2024-04-14T23:35:10.541 INFO:teuthology.orchestra.run.smithi191.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-14T23:35:10.541 INFO:teuthology.orchestra.run.smithi191.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-14T23:35:10.541 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-14T23:35:10.541 INFO:teuthology.orchestra.run.smithi191.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-14T23:35:10.541 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:10.541 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-04-14T23:35:10.542 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-14T23:35:10.542 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-14T23:35:10.542 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-14T23:35:10.542 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-04-14T23:35:10.630 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:10.861 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:10.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:10.867 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2024-04-14T23:35:10.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:10.882 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list-id 2024-04-14T23:35:10.938 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:10.939 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-04-14T23:35:10.939 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-14T23:35:10.939 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-14T23:35:10.939 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-04-14T23:35:11.026 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:11.055 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:11.061 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-14T23:35:11.061 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:11.061 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-04-14T23:35:11.061 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-14T23:35:11.061 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-14T23:35:11.061 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-14T23:35:11.062 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-14T23:35:11.062 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-14T23:35:11.062 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-04-14T23:35:11.109 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:11.188 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:11.194 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:11.194 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-04-14T23:35:11.195 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set brx.0 up 2024-04-14T23:35:11.195 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set dev brx.0 master ceph-brx 2024-04-14T23:35:11.195 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-04-14T23:35:11.242 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:11.270 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:11.276 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T23:35:11.276 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-14T23:35:11.290 INFO:teuthology.orchestra.run.smithi191.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-14T23:35:11.290 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T23:35:11.290 DEBUG:teuthology.orchestra.run.smithi191:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-14T23:35:11.344 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-14T23:35:11.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:11.345 DEBUG:teuthology.orchestra.run.smithi191:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-14T23:35:11.429 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-14T23:35:11.429 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-14T23:35:11.429 INFO:teuthology.orchestra.run.smithi191.stdout:invalid new device string format 2024-04-14T23:35:11.542 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-14T23:35:11.542 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-14T23:35:11.542 INFO:teuthology.orchestra.run.smithi191.stdout:invalid new device string format 2024-04-14T23:35:11.542 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.191:3300,172.21.15.191:3301" 2024-04-14T23:35:11.542 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-14T23:35:11.561 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-14T23:35:11.561 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-14T23:35:11.561 INFO:teuthology.orchestra.run.smithi191.stdout:invalid new device string format 2024-04-14T23:35:11.561 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.191:3300,172.21.15.191:3301" 2024-04-14T23:35:11.561 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-14T23:35:11.561 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.47:6789,172.21.15.191:6789,172.21.15.191:6790" 2024-04-14T23:35:11.561 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.47:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2024-04-14T23:35:11.561 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=4f54965e-64cf-4502-8b02-6c5af72b63aa" will pass to kernel 2024-04-14T23:35:11.562 INFO:teuthology.orchestra.run.smithi191.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-14T23:35:11.562 INFO:teuthology.orchestra.run.smithi191.stdout: You just mounted a file system that supports labels which does not 2024-04-14T23:35:11.562 INFO:teuthology.orchestra.run.smithi191.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-14T23:35:11.562 INFO:teuthology.orchestra.run.smithi191.stdout: applications will generate AVC messages and not be allowed access to 2024-04-14T23:35:11.562 INFO:teuthology.orchestra.run.smithi191.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-14T23:35:11.563 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-14T23:35:11.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:11.563 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-14T23:35:11.591 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T23:35:11.679 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T23:35:11.681 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:11.686 INFO:teuthology.orchestra.run.smithi191.stdout:client4869 2024-04-14T23:35:11.686 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:35:11.686 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:11.702 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T23:35:11.790 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T23:35:11.791 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:11.797 INFO:teuthology.orchestra.run.smithi191.stdout:client4869 2024-04-14T23:35:11.797 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T23:35:11.845 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T23:35:11.847 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:11.852 INFO:teuthology.orchestra.run.smithi191.stdout:client4869 2024-04-14T23:35:11.853 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4f54965e-64cf-4502-8b02-6c5af72b63aa.client4869/status') 2024-04-14T23:35:11.901 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:11.913 INFO:teuthology.orchestra.run.smithi191.stdout:instance: client.4869 (3)172.21.15.191:0/644812968 2024-04-14T23:35:11.913 INFO:teuthology.orchestra.run.smithi191.stdout:blocklisted: false 2024-04-14T23:35:11.914 INFO:teuthology.orchestra.run.smithi191.stderr:0+1 records in 2024-04-14T23:35:11.914 INFO:teuthology.orchestra.run.smithi191.stderr:0+1 records out 2024-04-14T23:35:11.914 INFO:teuthology.orchestra.run.smithi191.stderr:70 bytes copied, 2.1038e-05 s, 3.3 MB/s 2024-04-14T23:35:11.914 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:11.920 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-14T23:35:11.920 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-14T23:35:11.921 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-14T23:35:11.921 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-14T23:35:12.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.033+0000 7f06892de640 1 Processor -- start 2024-04-14T23:35:12.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.033+0000 7f06892de640 1 -- start start 2024-04-14T23:35:12.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.034+0000 7f06892de640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f068406cc20 0x7f068406d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:12.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.034+0000 7f06892de640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06840cfed0 con 0x7f06840cc2e0 2024-04-14T23:35:12.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.034+0000 7f06892de640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06840d0170 con 0x7f06840cdcb0 2024-04-14T23:35:12.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.034+0000 7f06892de640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f06840cf630 con 0x7f068406cc20 2024-04-14T23:35:12.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.034+0000 7f06837fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f06840cc2e0 0x7f06840cc6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55842/0 (socket says 172.21.15.47:55842) 2024-04-14T23:35:12.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.034+0000 7f06837fe640 1 -- 172.21.15.47:0/2408566081 learned_addr learned my addr 172.21.15.47:0/2408566081 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:12.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.034+0000 7f0681ffb640 1 -- 172.21.15.47:0/2408566081 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 318232793 0 0) 0x7f06840cfed0 con 0x7f06840cc2e0 2024-04-14T23:35:12.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.034+0000 7f0681ffb640 1 -- 172.21.15.47:0/2408566081 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0670003520 con 0x7f06840cc2e0 2024-04-14T23:35:12.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.034+0000 7f06827fc640 1 --2- 172.21.15.47:0/2408566081 >> v2:172.21.15.191:3300/0 conn(0x7f068406cc20 0x7f068406d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0681ffb640 1 -- 172.21.15.47:0/2408566081 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 780807220 0 0) 0x7f0670003520 con 0x7f06840cc2e0 2024-04-14T23:35:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0681ffb640 1 -- 172.21.15.47:0/2408566081 >> v2:172.21.15.191:3300/0 conn(0x7f068406cc20 msgr2=0x7f068406d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0681ffb640 1 --2- 172.21.15.47:0/2408566081 >> v2:172.21.15.191:3300/0 conn(0x7f068406cc20 0x7f068406d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0681ffb640 1 -- 172.21.15.47:0/2408566081 >> v1:172.21.15.191:6789/0 conn(0x7f06840cdcb0 legacy=0x7f06840cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0681ffb640 1 -- 172.21.15.47:0/2408566081 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06840d0450 con 0x7f06840cc2e0 2024-04-14T23:35:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0681ffb640 1 -- 172.21.15.47:0/2408566081 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f06740019f0 con 0x7f06840cc2e0 2024-04-14T23:35:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0681ffb640 1 -- 172.21.15.47:0/2408566081 >> v1:172.21.15.47:6789/0 conn(0x7f06840cc2e0 legacy=0x7f06840cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0681ffb640 1 --2- 172.21.15.47:0/2408566081 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06700039b0 0x7f0670003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0681ffb640 1 --2- 172.21.15.47:0/2408566081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0670004800 0x7f0670004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0681ffb640 1 --2- 172.21.15.47:0/2408566081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06700051c0 0x7f067000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0681ffb640 1 -- 172.21.15.47:0/2408566081 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f067000c030 con 0x7f06700051c0 2024-04-14T23:35:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0681ffb640 1 -- 172.21.15.47:0/2408566081 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f067000c1e0 con 0x7f0670004800 2024-04-14T23:35:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0681ffb640 1 -- 172.21.15.47:0/2408566081 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f067000c3e0 con 0x7f06700039b0 2024-04-14T23:35:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0682ffd640 1 --2- 172.21.15.47:0/2408566081 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06700039b0 0x7f0670003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f06827fc640 1 --2- 172.21.15.47:0/2408566081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0670004800 0x7f0670004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f06837fe640 1 --2- 172.21.15.47:0/2408566081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06700051c0 0x7f067000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0682ffd640 1 -- 172.21.15.47:0/2408566081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0670004800 msgr2=0x7f0670004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0682ffd640 1 --2- 172.21.15.47:0/2408566081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0670004800 0x7f0670004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0682ffd640 1 -- 172.21.15.47:0/2408566081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06700051c0 msgr2=0x7f067000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0682ffd640 1 --2- 172.21.15.47:0/2408566081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06700051c0 0x7f067000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f0682ffd640 1 -- 172.21.15.47:0/2408566081 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0670003520 con 0x7f06700039b0 2024-04-14T23:35:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f06837fe640 1 --2- 172.21.15.47:0/2408566081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06700051c0 0x7f067000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.035+0000 7f06837fe640 1 -- 172.21.15.47:0/2408566081 reap_dead start 2024-04-14T23:35:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.036+0000 7f0682ffd640 1 --2- 172.21.15.47:0/2408566081 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06700039b0 0x7f0670003dd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f067c001750 tx=0x7f0670005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db47a0cf8a021be5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.036+0000 7f0681ffb640 1 -- 172.21.15.47:0/2408566081 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c001370 con 0x7f06700039b0 2024-04-14T23:35:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.036+0000 7f0681ffb640 1 -- 172.21.15.47:0/2408566081 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c0052d0 con 0x7f06700039b0 2024-04-14T23:35:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.036+0000 7f0681ffb640 1 -- 172.21.15.47:0/2408566081 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c003830 con 0x7f06700039b0 2024-04-14T23:35:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.037+0000 7f06892de640 1 -- 172.21.15.47:0/2408566081 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06700039b0 msgr2=0x7f0670003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:12.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.037+0000 7f06892de640 1 --2- 172.21.15.47:0/2408566081 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06700039b0 0x7f0670003dd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f067c001750 tx=0x7f0670005830 comp rx=0 tx=0).stop 2024-04-14T23:35:12.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.037+0000 7f06892de640 1 -- 172.21.15.47:0/2408566081 shutdown_connections 2024-04-14T23:35:12.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.037+0000 7f06892de640 1 --2- 172.21.15.47:0/2408566081 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06700039b0 0x7f0670003dd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:12.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.037+0000 7f06892de640 1 -- 172.21.15.47:0/2408566081 >> 172.21.15.47:0/2408566081 conn(0x7f06840d1c90 msgr2=0x7f06840d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:12.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.037+0000 7f06892de640 1 -- 172.21.15.47:0/2408566081 shutdown_connections 2024-04-14T23:35:12.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.037+0000 7f06892de640 1 -- 172.21.15.47:0/2408566081 wait complete. 2024-04-14T23:35:12.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.038+0000 7f06892de640 1 Processor -- start 2024-04-14T23:35:12.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.038+0000 7f06892de640 1 -- start start 2024-04-14T23:35:12.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06892de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06700039b0 0x7f0684159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06892de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f068415a4a0 0x7f0684158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06892de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0684158650 0x7f06840c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06892de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f06840d0cf0 con 0x7f0684158650 2024-04-14T23:35:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06892de640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f06840d0a10 con 0x7f06700039b0 2024-04-14T23:35:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06892de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f06840ce090 con 0x7f068415a4a0 2024-04-14T23:35:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06837fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0684158650 0x7f06840c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06837fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0684158650 0x7f06840c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45084/0 (socket says 172.21.15.47:45084) 2024-04-14T23:35:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06837fe640 1 -- 172.21.15.47:0/535258748 learned_addr learned my addr 172.21.15.47:0/535258748 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f0682ffd640 1 --2- 172.21.15.47:0/535258748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06700039b0 0x7f0684159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06827fc640 1 --2- 172.21.15.47:0/535258748 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f068415a4a0 0x7f0684158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06837fe640 1 -- 172.21.15.47:0/535258748 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f068415a4a0 msgr2=0x7f0684158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06837fe640 1 --2- 172.21.15.47:0/535258748 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f068415a4a0 0x7f0684158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06837fe640 1 -- 172.21.15.47:0/535258748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06700039b0 msgr2=0x7f0684159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06837fe640 1 --2- 172.21.15.47:0/535258748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06700039b0 0x7f0684159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06837fe640 1 -- 172.21.15.47:0/535258748 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06840c9640 con 0x7f0684158650 2024-04-14T23:35:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06827fc640 1 --2- 172.21.15.47:0/535258748 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f068415a4a0 0x7f0684158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.039+0000 7f06837fe640 1 --2- 172.21.15.47:0/535258748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0684158650 0x7f06840c9b20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0684161e30 tx=0x7f0674007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.040+0000 7f067b7fe640 1 -- 172.21.15.47:0/535258748 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067400a4a0 con 0x7f0684158650 2024-04-14T23:35:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.040+0000 7f067b7fe640 1 -- 172.21.15.47:0/535258748 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0674019070 con 0x7f0684158650 2024-04-14T23:35:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.040+0000 7f06892de640 1 -- 172.21.15.47:0/535258748 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0684158ad0 con 0x7f0684158650 2024-04-14T23:35:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.040+0000 7f067b7fe640 1 -- 172.21.15.47:0/535258748 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674013630 con 0x7f0684158650 2024-04-14T23:35:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.040+0000 7f06892de640 1 -- 172.21.15.47:0/535258748 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f068415ad90 con 0x7f0684158650 2024-04-14T23:35:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.041+0000 7f06892de640 1 -- 172.21.15.47:0/535258748 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06840c9810 con 0x7f0684158650 2024-04-14T23:35:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.041+0000 7f067b7fe640 1 -- 172.21.15.47:0/535258748 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f06740137d0 con 0x7f0684158650 2024-04-14T23:35:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.042+0000 7f067b7fe640 1 --2- 172.21.15.47:0/535258748 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f066406b9c0 0x7f066406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.042+0000 7f067b7fe640 1 -- 172.21.15.47:0/535258748 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f067408b050 con 0x7f0684158650 2024-04-14T23:35:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.042+0000 7f0682ffd640 1 --2- 172.21.15.47:0/535258748 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f066406b9c0 0x7f066406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:12.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.043+0000 7f0682ffd640 1 --2- 172.21.15.47:0/535258748 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f066406b9c0 0x7f066406de80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f067c033000 tx=0x7f067c009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:12.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.046+0000 7f067b7fe640 1 -- 172.21.15.47:0/535258748 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0674059880 con 0x7f0684158650 2024-04-14T23:35:12.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.265+0000 7f06892de640 1 -- 172.21.15.47:0/535258748 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0684075430 con 0x7f0684158650 2024-04-14T23:35:12.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.265+0000 7f067b7fe640 1 -- 172.21.15.47:0/535258748 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f0674059180 con 0x7f0684158650 2024-04-14T23:35:12.269 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-14T23:35:12.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.267+0000 7f06892de640 1 -- 172.21.15.47:0/535258748 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f066406b9c0 msgr2=0x7f066406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:12.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.267+0000 7f06892de640 1 --2- 172.21.15.47:0/535258748 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f066406b9c0 0x7f066406de80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f067c033000 tx=0x7f067c009030 comp rx=0 tx=0).stop 2024-04-14T23:35:12.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.267+0000 7f06892de640 1 -- 172.21.15.47:0/535258748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0684158650 msgr2=0x7f06840c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:12.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.267+0000 7f06892de640 1 --2- 172.21.15.47:0/535258748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0684158650 0x7f06840c9b20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0684161e30 tx=0x7f0674007430 comp rx=0 tx=0).stop 2024-04-14T23:35:12.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.267+0000 7f06892de640 1 -- 172.21.15.47:0/535258748 shutdown_connections 2024-04-14T23:35:12.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.267+0000 7f06892de640 1 --2- 172.21.15.47:0/535258748 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f066406b9c0 0x7f066406de80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:12.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.267+0000 7f06892de640 1 --2- 172.21.15.47:0/535258748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0684158650 0x7f06840c9b20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:12.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.267+0000 7f06892de640 1 --2- 172.21.15.47:0/535258748 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f068415a4a0 0x7f0684158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:12.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.267+0000 7f06892de640 1 --2- 172.21.15.47:0/535258748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06700039b0 0x7f0684159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:12.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.267+0000 7f06892de640 1 -- 172.21.15.47:0/535258748 >> 172.21.15.47:0/535258748 conn(0x7f06840d1c90 msgr2=0x7f068406c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:12.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.267+0000 7f06892de640 1 -- 172.21.15.47:0/535258748 shutdown_connections 2024-04-14T23:35:12.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:12.267+0000 7f06892de640 1 -- 172.21.15.47:0/535258748 wait complete. 2024-04-14T23:35:12.281 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-14T23:35:12.281 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-14T23:35:12.281 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi191.front.sepia.ceph.com 2024-04-14T23:35:12.281 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-14T23:35:12.281 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-14T23:35:12.281 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-14T23:35:12.281 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-14T23:35:12.281 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-14T23:35:12.281 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-14T23:35:12.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:12.282 DEBUG:teuthology.orchestra.run.smithi191:> ip addr 2024-04-14T23:35:12.298 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T23:35:12.298 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T23:35:12.298 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T23:35:12.298 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:12.298 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2024-04-14T23:35:12.298 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:12.299 INFO:teuthology.orchestra.run.smithi191.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:35:12.299 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f6 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:12.299 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f0 2024-04-14T23:35:12.299 INFO:teuthology.orchestra.run.smithi191.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:35:12.299 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f7 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:12.299 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f1 2024-04-14T23:35:12.299 INFO:teuthology.orchestra.run.smithi191.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:35:12.299 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:10 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:12.299 INFO:teuthology.orchestra.run.smithi191.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-14T23:35:12.299 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:11 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:12.299 INFO:teuthology.orchestra.run.smithi191.stdout: inet 172.21.15.191/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-14T23:35:12.299 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft 42700sec preferred_lft 42700sec 2024-04-14T23:35:12.299 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::ec4:7aff:fe88:7211/64 scope link 2024-04-14T23:35:12.299 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:12.299 INFO:teuthology.orchestra.run.smithi191.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-14T23:35:12.300 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether ca:6d:fd:5a:7e:4d brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:12.300 INFO:teuthology.orchestra.run.smithi191.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-14T23:35:12.300 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:12.300 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::b8b7:86ff:fe16:57b0/64 scope link 2024-04-14T23:35:12.300 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:12.300 INFO:teuthology.orchestra.run.smithi191.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-14T23:35:12.300 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether ca:6d:fd:5a:7e:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-14T23:35:12.300 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::c86d:fdff:fe5a:7e4d/64 scope link tentative 2024-04-14T23:35:12.300 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:12.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:12.300 DEBUG:teuthology.orchestra.run.smithi191:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-14T23:35:12.366 INFO:teuthology.orchestra.run.smithi191.stdout:1 2024-04-14T23:35:12.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:12.367 DEBUG:teuthology.orchestra.run.smithi191:> route 2024-04-14T23:35:12.424 INFO:teuthology.orchestra.run.smithi191.stdout:Kernel IP routing table 2024-04-14T23:35:12.424 INFO:teuthology.orchestra.run.smithi191.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-14T23:35:12.424 INFO:teuthology.orchestra.run.smithi191.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-14T23:35:12.424 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-14T23:35:12.425 INFO:teuthology.orchestra.run.smithi191.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-14T23:35:12.425 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:12.425 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-04-14T23:35:12.425 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-14T23:35:12.425 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-14T23:35:12.425 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-14T23:35:12.425 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-04-14T23:35:12.516 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:12.559 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:12.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:12.565 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2024-04-14T23:35:12.579 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-14T23:35:12.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:12.580 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list-id 2024-04-14T23:35:12.634 INFO:teuthology.orchestra.run.smithi191.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-14T23:35:12.635 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:12.635 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-04-14T23:35:12.635 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-14T23:35:12.635 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-14T23:35:12.635 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-04-14T23:35:12.722 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:12.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:12.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:12.756 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-14T23:35:12.782 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T23:35:12.782 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T23:35:12.782 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T23:35:12.783 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:12.783 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2024-04-14T23:35:12.783 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:12.783 INFO:teuthology.orchestra.run.smithi191.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-14T23:35:12.783 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether c2:e6:6f:e2:96:18 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-14T23:35:12.783 INFO:teuthology.orchestra.run.smithi191.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-14T23:35:12.783 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:12.783 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::c0e6:6fff:fee2:9618/64 scope link 2024-04-14T23:35:12.783 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:12.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:12.784 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-14T23:35:12.851 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T23:35:12.852 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T23:35:12.852 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T23:35:12.852 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:12.852 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2024-04-14T23:35:12.852 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:12.852 INFO:teuthology.orchestra.run.smithi191.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-14T23:35:12.852 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether c2:e6:6f:e2:96:18 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-14T23:35:12.852 INFO:teuthology.orchestra.run.smithi191.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-14T23:35:12.852 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:12.852 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::c0e6:6fff:fee2:9618/64 scope link 2024-04-14T23:35:12.852 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:12.853 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-14T23:35:12.854 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:12.854 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-04-14T23:35:12.854 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-14T23:35:12.854 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-14T23:35:12.854 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-14T23:35:12.854 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-14T23:35:12.854 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-14T23:35:12.854 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-04-14T23:35:12.942 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:13.012 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:13.018 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:13.018 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2024-04-14T23:35:13.018 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set brx.1 up 2024-04-14T23:35:13.018 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set dev brx.1 master ceph-brx 2024-04-14T23:35:13.018 DEBUG:teuthology.orchestra.run.smithi191:> ') 2024-04-14T23:35:13.066 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:13.094 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:13.101 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T23:35:13.101 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-14T23:35:13.115 INFO:teuthology.orchestra.run.smithi191.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-14T23:35:13.115 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T23:35:13.116 DEBUG:teuthology.orchestra.run.smithi191:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-14T23:35:13.170 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-14T23:35:13.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:13.170 DEBUG:teuthology.orchestra.run.smithi191:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-14T23:35:13.254 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-14T23:35:13.255 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-14T23:35:13.255 INFO:teuthology.orchestra.run.smithi191.stdout:invalid new device string format 2024-04-14T23:35:13.263 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-14T23:35:13.263 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-14T23:35:13.263 INFO:teuthology.orchestra.run.smithi191.stdout:invalid new device string format 2024-04-14T23:35:13.263 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.191:3300,172.21.15.191:3301" 2024-04-14T23:35:13.263 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-14T23:35:13.268 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-14T23:35:13.268 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-14T23:35:13.268 INFO:teuthology.orchestra.run.smithi191.stdout:invalid new device string format 2024-04-14T23:35:13.268 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.191:3300,172.21.15.191:3301" 2024-04-14T23:35:13.269 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-14T23:35:13.269 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.47:6789,172.21.15.191:6789,172.21.15.191:6790" 2024-04-14T23:35:13.269 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.47:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2024-04-14T23:35:13.269 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=4f54965e-64cf-4502-8b02-6c5af72b63aa" will pass to kernel 2024-04-14T23:35:13.269 INFO:teuthology.orchestra.run.smithi191.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-14T23:35:13.269 INFO:teuthology.orchestra.run.smithi191.stdout: You just mounted a file system that supports labels which does not 2024-04-14T23:35:13.269 INFO:teuthology.orchestra.run.smithi191.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-14T23:35:13.270 INFO:teuthology.orchestra.run.smithi191.stdout: applications will generate AVC messages and not be allowed access to 2024-04-14T23:35:13.270 INFO:teuthology.orchestra.run.smithi191.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-14T23:35:13.271 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-14T23:35:13.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:13.271 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-14T23:35:13.297 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T23:35:13.386 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T23:35:13.388 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:13.394 INFO:teuthology.orchestra.run.smithi191.stdout:client4753 2024-04-14T23:35:13.394 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:35:13.394 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:13.409 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T23:35:13.496 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T23:35:13.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:13.504 INFO:teuthology.orchestra.run.smithi191.stdout:client4753 2024-04-14T23:35:13.504 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T23:35:13.552 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T23:35:13.553 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:13.559 INFO:teuthology.orchestra.run.smithi191.stdout:client4753 2024-04-14T23:35:13.559 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4f54965e-64cf-4502-8b02-6c5af72b63aa.client4753/status') 2024-04-14T23:35:13.607 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:13.620 INFO:teuthology.orchestra.run.smithi191.stdout:instance: client.4753 (3)192.168.0.2:0/3401051483 2024-04-14T23:35:13.620 INFO:teuthology.orchestra.run.smithi191.stdout:blocklisted: false 2024-04-14T23:35:13.620 INFO:teuthology.orchestra.run.smithi191.stderr:0+1 records in 2024-04-14T23:35:13.620 INFO:teuthology.orchestra.run.smithi191.stderr:0+1 records out 2024-04-14T23:35:13.620 INFO:teuthology.orchestra.run.smithi191.stderr:69 bytes copied, 3.7972e-05 s, 1.8 MB/s 2024-04-14T23:35:13.620 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-14T23:35:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:13.627 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-14T23:35:13.643 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:13.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.753+0000 7f4637098640 1 Processor -- start 2024-04-14T23:35:13.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.753+0000 7f4637098640 1 -- start start 2024-04-14T23:35:13.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.754+0000 7f4637098640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f463015e270 0x7f46300d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.754+0000 7f4637098640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46300d1e00 0x7f46300d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.754+0000 7f4637098640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f46300d1450 0x7f46300d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.754+0000 7f4637098640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f46300b4300 con 0x7f463015e270 2024-04-14T23:35:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.754+0000 7f4637098640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f46300b39d0 con 0x7f46300d1450 2024-04-14T23:35:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.754+0000 7f4637098640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f46300b3cb0 con 0x7f46300d1e00 2024-04-14T23:35:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.754+0000 7f4634e34640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f463015e270 0x7f46300d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.754+0000 7f4634e34640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f463015e270 0x7f46300d0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36078/0 (socket says 172.21.15.47:36078) 2024-04-14T23:35:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.754+0000 7f4634e34640 1 -- 172.21.15.47:0/1924977667 learned_addr learned my addr 172.21.15.47:0/1924977667 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.755+0000 7f462ffff640 1 --2- 172.21.15.47:0/1924977667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46300d1e00 0x7f46300d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.755+0000 7f4635635640 1 --2- 172.21.15.47:0/1924977667 >> v2:172.21.15.191:3300/0 conn(0x7f46300d1450 0x7f46300d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.755+0000 7f4634e34640 1 -- 172.21.15.47:0/1924977667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46300d1e00 msgr2=0x7f46300d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.755+0000 7f4634e34640 1 --2- 172.21.15.47:0/1924977667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46300d1e00 0x7f46300d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.755+0000 7f4634e34640 1 -- 172.21.15.47:0/1924977667 >> v2:172.21.15.191:3300/0 conn(0x7f46300d1450 msgr2=0x7f46300d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:13.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.755+0000 7f4634e34640 1 --2- 172.21.15.47:0/1924977667 >> v2:172.21.15.191:3300/0 conn(0x7f46300d1450 0x7f46300d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:13.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.755+0000 7f4634e34640 1 -- 172.21.15.47:0/1924977667 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46300b3f90 con 0x7f463015e270 2024-04-14T23:35:13.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.755+0000 7f462ffff640 1 --2- 172.21.15.47:0/1924977667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46300d1e00 0x7f46300d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:13.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.755+0000 7f4635635640 1 --2- 172.21.15.47:0/1924977667 >> v2:172.21.15.191:3300/0 conn(0x7f46300d1450 0x7f46300d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:13.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.755+0000 7f4634e34640 1 --2- 172.21.15.47:0/1924977667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f463015e270 0x7f46300d0f10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f463008e3e0 tx=0x7f462802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f288ee5cad920727 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:13.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.756+0000 7f462f7fe640 1 -- 172.21.15.47:0/1924977667 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462802cb00 con 0x7f463015e270 2024-04-14T23:35:13.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.756+0000 7f462f7fe640 1 -- 172.21.15.47:0/1924977667 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f462802cca0 con 0x7f463015e270 2024-04-14T23:35:13.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.756+0000 7f462f7fe640 1 -- 172.21.15.47:0/1924977667 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4628034610 con 0x7f463015e270 2024-04-14T23:35:13.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.756+0000 7f4637098640 1 -- 172.21.15.47:0/1924977667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f463015e270 msgr2=0x7f46300d0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:13.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.756+0000 7f4637098640 1 --2- 172.21.15.47:0/1924977667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f463015e270 0x7f46300d0f10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f463008e3e0 tx=0x7f462802bf60 comp rx=0 tx=0).stop 2024-04-14T23:35:13.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.756+0000 7f4637098640 1 -- 172.21.15.47:0/1924977667 shutdown_connections 2024-04-14T23:35:13.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.756+0000 7f4637098640 1 --2- 172.21.15.47:0/1924977667 >> v2:172.21.15.191:3300/0 conn(0x7f46300d1450 0x7f46300d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:13.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.756+0000 7f4637098640 1 --2- 172.21.15.47:0/1924977667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46300d1e00 0x7f46300d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:13.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.756+0000 7f4637098640 1 --2- 172.21.15.47:0/1924977667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f463015e270 0x7f46300d0f10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:13.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.756+0000 7f4637098640 1 -- 172.21.15.47:0/1924977667 >> 172.21.15.47:0/1924977667 conn(0x7f46300d3ed0 msgr2=0x7f46300d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:13.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.756+0000 7f4637098640 1 -- 172.21.15.47:0/1924977667 shutdown_connections 2024-04-14T23:35:13.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.756+0000 7f4637098640 1 -- 172.21.15.47:0/1924977667 wait complete. 2024-04-14T23:35:13.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.757+0000 7f4637098640 1 Processor -- start 2024-04-14T23:35:13.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.757+0000 7f4637098640 1 -- start start 2024-04-14T23:35:13.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.758+0000 7f4637098640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46300d1450 0x7f46300cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:13.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.758+0000 7f4637098640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46300d1e00 0x7f46300cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:13.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.758+0000 7f4637098640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f463015e270 0x7f46300b91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:13.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.758+0000 7f4637098640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f463015e7d0 con 0x7f46300d1e00 2024-04-14T23:35:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.758+0000 7f4637098640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f463015e650 con 0x7f46300d1450 2024-04-14T23:35:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.758+0000 7f4637098640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f46300ce9e0 con 0x7f463015e270 2024-04-14T23:35:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.758+0000 7f462ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46300d1e00 0x7f46300cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.759+0000 7f4634e34640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46300d1450 0x7f46300cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.759+0000 7f462ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46300d1e00 0x7f46300cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36088/0 (socket says 172.21.15.47:36088) 2024-04-14T23:35:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.759+0000 7f462ffff640 1 -- 172.21.15.47:0/5457035 learned_addr learned my addr 172.21.15.47:0/5457035 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.759+0000 7f4635635640 1 --2- 172.21.15.47:0/5457035 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f463015e270 0x7f46300b91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.759+0000 7f462ffff640 1 -- 172.21.15.47:0/5457035 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f463015e270 msgr2=0x7f46300b91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.759+0000 7f462ffff640 1 --2- 172.21.15.47:0/5457035 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f463015e270 0x7f46300b91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.759+0000 7f462ffff640 1 -- 172.21.15.47:0/5457035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46300d1450 msgr2=0x7f46300cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.759+0000 7f462ffff640 1 --2- 172.21.15.47:0/5457035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46300d1450 0x7f46300cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.759+0000 7f462ffff640 1 -- 172.21.15.47:0/5457035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46300cb580 con 0x7f46300d1e00 2024-04-14T23:35:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.759+0000 7f4634e34640 1 --2- 172.21.15.47:0/5457035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46300d1450 0x7f46300cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.759+0000 7f462ffff640 1 --2- 172.21.15.47:0/5457035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46300d1e00 0x7f46300cd1c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f462400c7f0 tx=0x7f462400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.759+0000 7f462d7fa640 1 -- 172.21.15.47:0/5457035 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624015070 con 0x7f46300d1e00 2024-04-14T23:35:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.759+0000 7f462d7fa640 1 -- 172.21.15.47:0/5457035 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4624007a30 con 0x7f46300d1e00 2024-04-14T23:35:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.759+0000 7f4637098640 1 -- 172.21.15.47:0/5457035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46300cb860 con 0x7f46300d1e00 2024-04-14T23:35:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.759+0000 7f462d7fa640 1 -- 172.21.15.47:0/5457035 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624007e00 con 0x7f46300d1e00 2024-04-14T23:35:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.759+0000 7f4637098640 1 -- 172.21.15.47:0/5457035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46300cbe20 con 0x7f46300d1e00 2024-04-14T23:35:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.760+0000 7f4637098640 1 -- 172.21.15.47:0/5457035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4630075430 con 0x7f46300d1e00 2024-04-14T23:35:13.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.761+0000 7f462d7fa640 1 -- 172.21.15.47:0/5457035 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4624018070 con 0x7f46300d1e00 2024-04-14T23:35:13.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.761+0000 7f462d7fa640 1 --2- 172.21.15.47:0/5457035 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f461c06b990 0x7f461c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:13.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.761+0000 7f462d7fa640 1 -- 172.21.15.47:0/5457035 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f462408ab60 con 0x7f46300d1e00 2024-04-14T23:35:13.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.761+0000 7f4634e34640 1 --2- 172.21.15.47:0/5457035 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f461c06b990 0x7f461c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:13.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.762+0000 7f4634e34640 1 --2- 172.21.15.47:0/5457035 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f461c06b990 0x7f461c06de50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4628035000 tx=0x7f4628030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.765+0000 7f462d7fa640 1 -- 172.21.15.47:0/5457035 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4624058d40 con 0x7f46300d1e00 2024-04-14T23:35:13.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.950+0000 7f4637098640 1 -- 172.21.15.47:0/5457035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46300d3470 con 0x7f46300d1e00 2024-04-14T23:35:13.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.951+0000 7f462d7fa640 1 -- 172.21.15.47:0/5457035 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7f462405cde0 con 0x7f46300d1e00 2024-04-14T23:35:13.955 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:13.955 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:44.714882+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:13.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.953+0000 7f4637098640 1 -- 172.21.15.47:0/5457035 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f461c06b990 msgr2=0x7f461c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.953+0000 7f4637098640 1 --2- 172.21.15.47:0/5457035 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f461c06b990 0x7f461c06de50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4628035000 tx=0x7f4628030000 comp rx=0 tx=0).stop 2024-04-14T23:35:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.953+0000 7f4637098640 1 -- 172.21.15.47:0/5457035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46300d1e00 msgr2=0x7f46300cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.953+0000 7f4637098640 1 --2- 172.21.15.47:0/5457035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46300d1e00 0x7f46300cd1c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f462400c7f0 tx=0x7f462400cbf0 comp rx=0 tx=0).stop 2024-04-14T23:35:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.953+0000 7f4637098640 1 -- 172.21.15.47:0/5457035 shutdown_connections 2024-04-14T23:35:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.953+0000 7f4637098640 1 --2- 172.21.15.47:0/5457035 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f461c06b990 0x7f461c06de50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.953+0000 7f4637098640 1 --2- 172.21.15.47:0/5457035 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f463015e270 0x7f46300b91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.953+0000 7f4637098640 1 --2- 172.21.15.47:0/5457035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46300d1e00 0x7f46300cd1c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.953+0000 7f4637098640 1 --2- 172.21.15.47:0/5457035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46300d1450 0x7f46300cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.953+0000 7f4637098640 1 -- 172.21.15.47:0/5457035 >> 172.21.15.47:0/5457035 conn(0x7f46300d3ed0 msgr2=0x7f46300b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.953+0000 7f4637098640 1 -- 172.21.15.47:0/5457035 shutdown_connections 2024-04-14T23:35:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:13.953+0000 7f4637098640 1 -- 172.21.15.47:0/5457035 wait complete. 2024-04-14T23:35:13.967 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T23:34:36.382034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T23:34:37.023103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T23:34:40.726418+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T23:35:13.968 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:35:14.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.069+0000 7f29e8784640 1 Processor -- start 2024-04-14T23:35:14.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.069+0000 7f29e8784640 1 -- start start 2024-04-14T23:35:14.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.070+0000 7f29e8784640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f29e006ddb0 0x7f29e0070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.070+0000 7f29e8784640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f29e0071230 0x7f29e00b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.070+0000 7f29e8784640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29e006e370 con 0x7f29e0151510 2024-04-14T23:35:14.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.070+0000 7f29e8784640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f29e00b30c0 con 0x7f29e006ddb0 2024-04-14T23:35:14.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.070+0000 7f29e8784640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f29e006e650 con 0x7f29e0071230 2024-04-14T23:35:14.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.070+0000 7f29e5d1f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f29e006ddb0 0x7f29e0070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.070+0000 7f29e5d1f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f29e006ddb0 0x7f29e0070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36102/0 (socket says 172.21.15.47:36102) 2024-04-14T23:35:14.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.070+0000 7f29e5d1f640 1 -- 172.21.15.47:0/2209426121 learned_addr learned my addr 172.21.15.47:0/2209426121 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:14.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.070+0000 7f29e6d21640 1 --2- 172.21.15.47:0/2209426121 >> v2:172.21.15.191:3300/0 conn(0x7f29e0071230 0x7f29e00b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.070+0000 7f29e5d1f640 1 -- 172.21.15.47:0/2209426121 >> v2:172.21.15.191:3300/0 conn(0x7f29e0071230 msgr2=0x7f29e00b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:14.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.070+0000 7f29e5d1f640 1 --2- 172.21.15.47:0/2209426121 >> v2:172.21.15.191:3300/0 conn(0x7f29e0071230 0x7f29e00b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.070+0000 7f29e5d1f640 1 -- 172.21.15.47:0/2209426121 >> v1:172.21.15.191:6789/0 conn(0x7f29e0151510 legacy=0x7f29e00cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.070+0000 7f29e5d1f640 1 -- 172.21.15.47:0/2209426121 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e00b2a70 con 0x7f29e006ddb0 2024-04-14T23:35:14.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.070+0000 7f29e6d21640 1 --2- 172.21.15.47:0/2209426121 >> v2:172.21.15.191:3300/0 conn(0x7f29e0071230 0x7f29e00b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.071+0000 7f29e5d1f640 1 --2- 172.21.15.47:0/2209426121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e006ddb0 0x7f29e0070cf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f29e00731a0 tx=0x7f29d402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a1429cc3b403b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.071+0000 7f29e551e640 1 -- 172.21.15.47:0/2209426121 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4034070 con 0x7f29e006ddb0 2024-04-14T23:35:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.071+0000 7f29e551e640 1 -- 172.21.15.47:0/2209426121 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d4030860 con 0x7f29e006ddb0 2024-04-14T23:35:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.071+0000 7f29e551e640 1 -- 172.21.15.47:0/2209426121 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4030c30 con 0x7f29e006ddb0 2024-04-14T23:35:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.072+0000 7f29e8784640 1 -- 172.21.15.47:0/2209426121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e006ddb0 msgr2=0x7f29e0070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.072+0000 7f29e8784640 1 --2- 172.21.15.47:0/2209426121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e006ddb0 0x7f29e0070cf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f29e00731a0 tx=0x7f29d402b9a0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.072+0000 7f29e8784640 1 -- 172.21.15.47:0/2209426121 shutdown_connections 2024-04-14T23:35:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.072+0000 7f29e8784640 1 --2- 172.21.15.47:0/2209426121 >> v2:172.21.15.191:3300/0 conn(0x7f29e0071230 0x7f29e00b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.072+0000 7f29e8784640 1 --2- 172.21.15.47:0/2209426121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e006ddb0 0x7f29e0070cf0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.072+0000 7f29e8784640 1 -- 172.21.15.47:0/2209426121 >> 172.21.15.47:0/2209426121 conn(0x7f29e006b3e0 msgr2=0x7f29e006b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.072+0000 7f29e8784640 1 -- 172.21.15.47:0/2209426121 shutdown_connections 2024-04-14T23:35:14.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.072+0000 7f29e8784640 1 -- 172.21.15.47:0/2209426121 wait complete. 2024-04-14T23:35:14.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.073+0000 7f29e8784640 1 Processor -- start 2024-04-14T23:35:14.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.073+0000 7f29e8784640 1 -- start start 2024-04-14T23:35:14.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e8784640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29e006ddb0 0x7f29e014a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e8784640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e0071230 0x7f29e00b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e8784640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29e0151510 0x7f29e013c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e8784640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f29e00b3c10 con 0x7f29e0071230 2024-04-14T23:35:14.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e8784640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f29e00b3a90 con 0x7f29e006ddb0 2024-04-14T23:35:14.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e8784640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f29e00b3d90 con 0x7f29e0151510 2024-04-14T23:35:14.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e5d1f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e0071230 0x7f29e00b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e5d1f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e0071230 0x7f29e00b19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36106/0 (socket says 172.21.15.47:36106) 2024-04-14T23:35:14.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e5d1f640 1 -- 172.21.15.47:0/4060924883 learned_addr learned my addr 172.21.15.47:0/4060924883 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:14.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e6520640 1 --2- 172.21.15.47:0/4060924883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29e006ddb0 0x7f29e014a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e6d21640 1 --2- 172.21.15.47:0/4060924883 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29e0151510 0x7f29e013c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e5d1f640 1 -- 172.21.15.47:0/4060924883 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29e0151510 msgr2=0x7f29e013c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e5d1f640 1 --2- 172.21.15.47:0/4060924883 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29e0151510 0x7f29e013c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e5d1f640 1 -- 172.21.15.47:0/4060924883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29e006ddb0 msgr2=0x7f29e014a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e5d1f640 1 --2- 172.21.15.47:0/4060924883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29e006ddb0 0x7f29e014a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e5d1f640 1 -- 172.21.15.47:0/4060924883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e0156640 con 0x7f29e0071230 2024-04-14T23:35:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e5d1f640 1 --2- 172.21.15.47:0/4060924883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e0071230 0x7f29e00b19c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f29d4000c00 tx=0x7f29d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29deffd640 1 -- 172.21.15.47:0/4060924883 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4048070 con 0x7f29e0071230 2024-04-14T23:35:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29deffd640 1 -- 172.21.15.47:0/4060924883 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d4030660 con 0x7f29e0071230 2024-04-14T23:35:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29e8784640 1 -- 172.21.15.47:0/4060924883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e0156920 con 0x7f29e0071230 2024-04-14T23:35:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.074+0000 7f29deffd640 1 -- 172.21.15.47:0/4060924883 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4034040 con 0x7f29e0071230 2024-04-14T23:35:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.075+0000 7f29e8784640 1 -- 172.21.15.47:0/4060924883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e0156ee0 con 0x7f29e0071230 2024-04-14T23:35:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.076+0000 7f29e8784640 1 -- 172.21.15.47:0/4060924883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e0073f50 con 0x7f29e0071230 2024-04-14T23:35:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.076+0000 7f29deffd640 1 -- 172.21.15.47:0/4060924883 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f29d404b070 con 0x7f29e0071230 2024-04-14T23:35:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.076+0000 7f29deffd640 1 --2- 172.21.15.47:0/4060924883 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f29cc06b990 0x7f29cc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.076+0000 7f29deffd640 1 -- 172.21.15.47:0/4060924883 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f29d40ace20 con 0x7f29e0071230 2024-04-14T23:35:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.076+0000 7f29e6520640 1 --2- 172.21.15.47:0/4060924883 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f29cc06b990 0x7f29cc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.077+0000 7f29e6520640 1 --2- 172.21.15.47:0/4060924883 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f29cc06b990 0x7f29cc06de50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f29e01f59c0 tx=0x7f29d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:14.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.081+0000 7f29deffd640 1 -- 172.21.15.47:0/4060924883 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f29d407b1c0 con 0x7f29e0071230 2024-04-14T23:35:14.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.260+0000 7f29e8784640 1 -- 172.21.15.47:0/4060924883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f29e00cbf60 con 0x7f29e0071230 2024-04-14T23:35:14.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.261+0000 7f29deffd640 1 -- 172.21.15.47:0/4060924883 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f29d407f260 con 0x7f29e0071230 2024-04-14T23:35:14.264 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:35:14.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.263+0000 7f29e8784640 1 -- 172.21.15.47:0/4060924883 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f29cc06b990 msgr2=0x7f29cc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.263+0000 7f29e8784640 1 --2- 172.21.15.47:0/4060924883 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f29cc06b990 0x7f29cc06de50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f29e01f59c0 tx=0x7f29d8009040 comp rx=0 tx=0).stop 2024-04-14T23:35:14.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.263+0000 7f29e8784640 1 -- 172.21.15.47:0/4060924883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e0071230 msgr2=0x7f29e00b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.263+0000 7f29e8784640 1 --2- 172.21.15.47:0/4060924883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e0071230 0x7f29e00b19c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f29d4000c00 tx=0x7f29d4004730 comp rx=0 tx=0).stop 2024-04-14T23:35:14.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.263+0000 7f29e8784640 1 -- 172.21.15.47:0/4060924883 shutdown_connections 2024-04-14T23:35:14.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.263+0000 7f29e8784640 1 --2- 172.21.15.47:0/4060924883 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f29cc06b990 0x7f29cc06de50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.263+0000 7f29e8784640 1 --2- 172.21.15.47:0/4060924883 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29e0151510 0x7f29e013c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.263+0000 7f29e8784640 1 --2- 172.21.15.47:0/4060924883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f29e0071230 0x7f29e00b19c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.263+0000 7f29e8784640 1 --2- 172.21.15.47:0/4060924883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f29e006ddb0 0x7f29e014a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.263+0000 7f29e8784640 1 -- 172.21.15.47:0/4060924883 >> 172.21.15.47:0/4060924883 conn(0x7f29e006b3e0 msgr2=0x7f29e006b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:14.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.263+0000 7f29e8784640 1 -- 172.21.15.47:0/4060924883 shutdown_connections 2024-04-14T23:35:14.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.263+0000 7f29e8784640 1 -- 172.21.15.47:0/4060924883 wait complete. 2024-04-14T23:35:14.277 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T23:35:14.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.378+0000 7f11c8869640 1 Processor -- start 2024-04-14T23:35:14.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.378+0000 7f11c8869640 1 -- start start 2024-04-14T23:35:14.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.379+0000 7f11c8869640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11c406ed00 0x7f11c40cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.379+0000 7f11c8869640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c40cda70 con 0x7f11c415bd80 2024-04-14T23:35:14.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.379+0000 7f11c8869640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c40cdd50 con 0x7f11c40730d0 2024-04-14T23:35:14.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.379+0000 7f11c8869640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f11c40ce030 con 0x7f11c406ed00 2024-04-14T23:35:14.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.379+0000 7f11c259c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f11c415bd80 0x7f11c406e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60004/0 (socket says 172.21.15.47:60004) 2024-04-14T23:35:14.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.379+0000 7f11c259c640 1 -- 172.21.15.47:0/3667904503 learned_addr learned my addr 172.21.15.47:0/3667904503 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:14.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.379+0000 7f11c1d9b640 1 --2- 172.21.15.47:0/3667904503 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11c406ed00 0x7f11c40cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.379+0000 7f11c159a640 1 -- 172.21.15.47:0/3667904503 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 868635067 0 0) 0x7f11c40cda70 con 0x7f11c415bd80 2024-04-14T23:35:14.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.379+0000 7f11c159a640 1 -- 172.21.15.47:0/3667904503 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11ac003520 con 0x7f11c415bd80 2024-04-14T23:35:14.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.379+0000 7f11c159a640 1 -- 172.21.15.47:0/3667904503 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4165224304 0 0) 0x7f11ac003520 con 0x7f11c415bd80 2024-04-14T23:35:14.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.379+0000 7f11c1d9b640 1 -- 172.21.15.47:0/3667904503 >> v1:172.21.15.191:6789/0 conn(0x7f11c40730d0 legacy=0x7f11c415ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.380+0000 7f11c1d9b640 1 -- 172.21.15.47:0/3667904503 >> v1:172.21.15.47:6789/0 conn(0x7f11c415bd80 legacy=0x7f11c406e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.380+0000 7f11c1d9b640 1 -- 172.21.15.47:0/3667904503 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c415fa80 con 0x7f11c406ed00 2024-04-14T23:35:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.380+0000 7f11c1d9b640 1 --2- 172.21.15.47:0/3667904503 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11c406ed00 0x7f11c40cf850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11b80097d0 tx=0x7f11b802b5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea49c8627ae2166e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.380+0000 7f11c159a640 1 -- 172.21.15.47:0/3667904503 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8037070 con 0x7f11c406ed00 2024-04-14T23:35:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.381+0000 7f11c159a640 1 -- 172.21.15.47:0/3667904503 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b8030510 con 0x7f11c406ed00 2024-04-14T23:35:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.381+0000 7f11c159a640 1 -- 172.21.15.47:0/3667904503 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b4001670 con 0x7f11c406ed00 2024-04-14T23:35:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.381+0000 7f11c8869640 1 -- 172.21.15.47:0/3667904503 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11c406ed00 msgr2=0x7f11c40cf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.381+0000 7f11c8869640 1 --2- 172.21.15.47:0/3667904503 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11c406ed00 0x7f11c40cf850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11b80097d0 tx=0x7f11b802b5d0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.381+0000 7f11c8869640 1 -- 172.21.15.47:0/3667904503 shutdown_connections 2024-04-14T23:35:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.381+0000 7f11c8869640 1 --2- 172.21.15.47:0/3667904503 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11c406ed00 0x7f11c40cf850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.381+0000 7f11c8869640 1 -- 172.21.15.47:0/3667904503 >> 172.21.15.47:0/3667904503 conn(0x7f11c40b1e00 msgr2=0x7f11c40b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.381+0000 7f11c8869640 1 -- 172.21.15.47:0/3667904503 shutdown_connections 2024-04-14T23:35:14.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.381+0000 7f11c8869640 1 -- 172.21.15.47:0/3667904503 wait complete. 2024-04-14T23:35:14.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.382+0000 7f11c8869640 1 Processor -- start 2024-04-14T23:35:14.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.382+0000 7f11c8869640 1 -- start start 2024-04-14T23:35:14.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.383+0000 7f11c8869640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11c406ed00 0x7f11c41568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.383+0000 7f11c8869640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11c40730d0 0x7f11c41e61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.383+0000 7f11c8869640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11c415bd80 0x7f11c414cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.383+0000 7f11c8869640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f11c40cd850 con 0x7f11c40730d0 2024-04-14T23:35:14.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.383+0000 7f11c8869640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f11c40cd6d0 con 0x7f11c415bd80 2024-04-14T23:35:14.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.383+0000 7f11c8869640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f11c41606b0 con 0x7f11c406ed00 2024-04-14T23:35:14.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.383+0000 7f11c1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11c40730d0 0x7f11c41e61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.383+0000 7f11c1d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11c40730d0 0x7f11c41e61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36116/0 (socket says 172.21.15.47:36116) 2024-04-14T23:35:14.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.383+0000 7f11c1d9b640 1 -- 172.21.15.47:0/598425420 learned_addr learned my addr 172.21.15.47:0/598425420 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:14.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.383+0000 7f11c2d9d640 1 --2- 172.21.15.47:0/598425420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11c415bd80 0x7f11c414cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.384+0000 7f11c259c640 1 --2- 172.21.15.47:0/598425420 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11c406ed00 0x7f11c41568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.384+0000 7f11c1d9b640 1 -- 172.21.15.47:0/598425420 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11c406ed00 msgr2=0x7f11c41568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.384+0000 7f11c1d9b640 1 --2- 172.21.15.47:0/598425420 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11c406ed00 0x7f11c41568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.384+0000 7f11c1d9b640 1 -- 172.21.15.47:0/598425420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11c415bd80 msgr2=0x7f11c414cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.384+0000 7f11c1d9b640 1 --2- 172.21.15.47:0/598425420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11c415bd80 0x7f11c414cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.384+0000 7f11c1d9b640 1 -- 172.21.15.47:0/598425420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c41e7160 con 0x7f11c40730d0 2024-04-14T23:35:14.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.384+0000 7f11c1d9b640 1 --2- 172.21.15.47:0/598425420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11c40730d0 0x7f11c41e61e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f11b802b610 tx=0x7f11b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:14.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.384+0000 7f11b2ffd640 1 -- 172.21.15.47:0/598425420 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8042020 con 0x7f11c40730d0 2024-04-14T23:35:14.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.384+0000 7f11b2ffd640 1 -- 172.21.15.47:0/598425420 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b80044c0 con 0x7f11c40730d0 2024-04-14T23:35:14.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.384+0000 7f11b2ffd640 1 -- 172.21.15.47:0/598425420 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8037040 con 0x7f11c40730d0 2024-04-14T23:35:14.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.384+0000 7f11c8869640 1 -- 172.21.15.47:0/598425420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c41e6c00 con 0x7f11c40730d0 2024-04-14T23:35:14.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.384+0000 7f11c8869640 1 -- 172.21.15.47:0/598425420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c415dcf0 con 0x7f11c40730d0 2024-04-14T23:35:14.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.385+0000 7f11c8869640 1 -- 172.21.15.47:0/598425420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c4073f50 con 0x7f11c40730d0 2024-04-14T23:35:14.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.386+0000 7f11b2ffd640 1 -- 172.21.15.47:0/598425420 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f11b8045020 con 0x7f11c40730d0 2024-04-14T23:35:14.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.386+0000 7f11b2ffd640 1 --2- 172.21.15.47:0/598425420 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f11a406b990 0x7f11a406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.386+0000 7f11b2ffd640 1 -- 172.21.15.47:0/598425420 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f11b80ac8c0 con 0x7f11c40730d0 2024-04-14T23:35:14.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.386+0000 7f11c259c640 1 --2- 172.21.15.47:0/598425420 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f11a406b990 0x7f11a406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.387+0000 7f11c259c640 1 --2- 172.21.15.47:0/598425420 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f11a406b990 0x7f11a406de50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f11b40011e0 tx=0x7f11b4001ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.390+0000 7f11b2ffd640 1 -- 172.21.15.47:0/598425420 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f11b804c030 con 0x7f11c40730d0 2024-04-14T23:35:14.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.569+0000 7f11c8869640 1 -- 172.21.15.47:0/598425420 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f11c406f5e0 con 0x7f11c40730d0 2024-04-14T23:35:14.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.570+0000 7f11b2ffd640 1 -- 172.21.15.47:0/598425420 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f11c41e6c00 con 0x7f11c40730d0 2024-04-14T23:35:14.573 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:14.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.571+0000 7f11c8869640 1 -- 172.21.15.47:0/598425420 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f11a406b990 msgr2=0x7f11a406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.571+0000 7f11c8869640 1 --2- 172.21.15.47:0/598425420 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f11a406b990 0x7f11a406de50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f11b40011e0 tx=0x7f11b4001ba0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.571+0000 7f11c8869640 1 -- 172.21.15.47:0/598425420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11c40730d0 msgr2=0x7f11c41e61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.571+0000 7f11c8869640 1 --2- 172.21.15.47:0/598425420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11c40730d0 0x7f11c41e61e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f11b802b610 tx=0x7f11b80046c0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.571+0000 7f11c8869640 1 -- 172.21.15.47:0/598425420 shutdown_connections 2024-04-14T23:35:14.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.571+0000 7f11c8869640 1 --2- 172.21.15.47:0/598425420 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f11a406b990 0x7f11a406de50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.571+0000 7f11c8869640 1 --2- 172.21.15.47:0/598425420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11c415bd80 0x7f11c414cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.571+0000 7f11c8869640 1 --2- 172.21.15.47:0/598425420 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11c40730d0 0x7f11c41e61e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.571+0000 7f11c8869640 1 --2- 172.21.15.47:0/598425420 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11c406ed00 0x7f11c41568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.571+0000 7f11c8869640 1 -- 172.21.15.47:0/598425420 >> 172.21.15.47:0/598425420 conn(0x7f11c40b1e00 msgr2=0x7f11c406e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:14.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.571+0000 7f11c8869640 1 -- 172.21.15.47:0/598425420 shutdown_connections 2024-04-14T23:35:14.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.571+0000 7f11c8869640 1 -- 172.21.15.47:0/598425420 wait complete. 2024-04-14T23:35:14.585 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T23:35:14.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.687+0000 7fc3e54de640 1 Processor -- start 2024-04-14T23:35:14.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.687+0000 7fc3e54de640 1 -- start start 2024-04-14T23:35:14.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3e54de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3e0144da0 0x7fc3e00700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3e54de640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc3e0145180 0x7fc3e006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3e54de640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e015fb30 con 0x7fc3e006b740 2024-04-14T23:35:14.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3e54de640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fc3e0160440 con 0x7fc3e0145180 2024-04-14T23:35:14.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3e54de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e00cfd10 con 0x7fc3e0144da0 2024-04-14T23:35:14.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3df7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc3e006b740 0x7fc3e0071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60010/0 (socket says 172.21.15.47:60010) 2024-04-14T23:35:14.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3df7fe640 1 -- 172.21.15.47:0/2129631400 learned_addr learned my addr 172.21.15.47:0/2129631400 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3d7fff640 1 --2- 172.21.15.47:0/2129631400 >> v2:172.21.15.191:3300/0 conn(0x7fc3e0145180 0x7fc3e006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3deffd640 1 --2- 172.21.15.47:0/2129631400 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3e0144da0 0x7fc3e00700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3de7fc640 1 -- 172.21.15.47:0/2129631400 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437351698 0 0) 0x7fc3e015fb30 con 0x7fc3e006b740 2024-04-14T23:35:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3de7fc640 1 -- 172.21.15.47:0/2129631400 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3cc003520 con 0x7fc3e006b740 2024-04-14T23:35:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3de7fc640 1 -- 172.21.15.47:0/2129631400 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2256004408 0 0) 0x7fc3cc003520 con 0x7fc3e006b740 2024-04-14T23:35:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3de7fc640 1 -- 172.21.15.47:0/2129631400 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3e0144da0 msgr2=0x7fc3e00700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3de7fc640 1 --2- 172.21.15.47:0/2129631400 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3e0144da0 0x7fc3e00700c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3de7fc640 1 -- 172.21.15.47:0/2129631400 >> v2:172.21.15.191:3300/0 conn(0x7fc3e0145180 msgr2=0x7fc3e006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3de7fc640 1 --2- 172.21.15.47:0/2129631400 >> v2:172.21.15.191:3300/0 conn(0x7fc3e0145180 0x7fc3e006b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3de7fc640 1 -- 172.21.15.47:0/2129631400 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e00706c0 con 0x7fc3e006b740 2024-04-14T23:35:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.688+0000 7fc3de7fc640 1 -- 172.21.15.47:0/2129631400 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7fc3d80019f0 con 0x7fc3e006b740 2024-04-14T23:35:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.689+0000 7fc3de7fc640 1 -- 172.21.15.47:0/2129631400 >> v1:172.21.15.47:6789/0 conn(0x7fc3e006b740 legacy=0x7fc3e0071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.689+0000 7fc3de7fc640 1 --2- 172.21.15.47:0/2129631400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3cc0039b0 0x7fc3cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.689+0000 7fc3de7fc640 1 --2- 172.21.15.47:0/2129631400 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3cc004800 0x7fc3cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.689+0000 7fc3de7fc640 1 --2- 172.21.15.47:0/2129631400 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3e0144da0 0x7fc3cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.689+0000 7fc3de7fc640 1 -- 172.21.15.47:0/2129631400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e0160440 con 0x7fc3cc0039b0 2024-04-14T23:35:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.689+0000 7fc3de7fc640 1 -- 172.21.15.47:0/2129631400 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e00cfd10 con 0x7fc3cc004800 2024-04-14T23:35:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.689+0000 7fc3de7fc640 1 -- 172.21.15.47:0/2129631400 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc3cc00b9c0 con 0x7fc3e0144da0 2024-04-14T23:35:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.689+0000 7fc3deffd640 1 --2- 172.21.15.47:0/2129631400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3cc0039b0 0x7fc3cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.689+0000 7fc3d7fff640 1 --2- 172.21.15.47:0/2129631400 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3cc004800 0x7fc3cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.689+0000 7fc3df7fe640 1 --2- 172.21.15.47:0/2129631400 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3e0144da0 0x7fc3cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.689+0000 7fc3deffd640 1 -- 172.21.15.47:0/2129631400 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3e0144da0 msgr2=0x7fc3cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.689+0000 7fc3deffd640 1 --2- 172.21.15.47:0/2129631400 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3e0144da0 0x7fc3cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.689+0000 7fc3deffd640 1 -- 172.21.15.47:0/2129631400 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3cc004800 msgr2=0x7fc3cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.689+0000 7fc3deffd640 1 --2- 172.21.15.47:0/2129631400 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3cc004800 0x7fc3cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.689+0000 7fc3deffd640 1 -- 172.21.15.47:0/2129631400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3cc003520 con 0x7fc3cc0039b0 2024-04-14T23:35:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.689+0000 7fc3d7fff640 1 --2- 172.21.15.47:0/2129631400 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3cc004800 0x7fc3cc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.690+0000 7fc3deffd640 1 --2- 172.21.15.47:0/2129631400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3cc0039b0 0x7fc3cc003dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009ac0 tx=0x7fc3cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60f49da333994b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.690+0000 7fc3de7fc640 1 -- 172.21.15.47:0/2129631400 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0039070 con 0x7fc3cc0039b0 2024-04-14T23:35:14.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.690+0000 7fc3de7fc640 1 -- 172.21.15.47:0/2129631400 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d002c6b0 con 0x7fc3cc0039b0 2024-04-14T23:35:14.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.690+0000 7fc3de7fc640 1 -- 172.21.15.47:0/2129631400 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0009690 con 0x7fc3cc0039b0 2024-04-14T23:35:14.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.690+0000 7fc3e54de640 1 -- 172.21.15.47:0/2129631400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3cc0039b0 msgr2=0x7fc3cc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.690+0000 7fc3e54de640 1 --2- 172.21.15.47:0/2129631400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3cc0039b0 0x7fc3cc003dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009ac0 tx=0x7fc3cc005830 comp rx=0 tx=0).stop 2024-04-14T23:35:14.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.690+0000 7fc3df7fe640 1 -- 172.21.15.47:0/2129631400 reap_dead start 2024-04-14T23:35:14.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.690+0000 7fc3e54de640 1 -- 172.21.15.47:0/2129631400 shutdown_connections 2024-04-14T23:35:14.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.690+0000 7fc3e54de640 1 -- 172.21.15.47:0/2129631400 >> 172.21.15.47:0/2129631400 conn(0x7fc3e00cd670 msgr2=0x7fc3e00cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:14.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.690+0000 7fc3e54de640 1 -- 172.21.15.47:0/2129631400 shutdown_connections 2024-04-14T23:35:14.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.690+0000 7fc3e54de640 1 -- 172.21.15.47:0/2129631400 wait complete. 2024-04-14T23:35:14.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.692+0000 7fc3e54de640 1 Processor -- start 2024-04-14T23:35:14.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.692+0000 7fc3e54de640 1 -- start start 2024-04-14T23:35:14.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.692+0000 7fc3e54de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3cc0039b0 0x7fc3e0140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.692+0000 7fc3e54de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3e00c5af0 0x7fc3e00ced00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.692+0000 7fc3e54de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3e00c5f50 0x7fc3e00cf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.692+0000 7fc3e54de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01455c0 con 0x7fc3cc0039b0 2024-04-14T23:35:14.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.692+0000 7fc3e54de640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01600d0 con 0x7fc3e00c5f50 2024-04-14T23:35:14.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.692+0000 7fc3e54de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e0145a00 con 0x7fc3e00c5af0 2024-04-14T23:35:14.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.692+0000 7fc3deffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3cc0039b0 0x7fc3e0140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.692+0000 7fc3deffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3cc0039b0 0x7fc3e0140580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36122/0 (socket says 172.21.15.47:36122) 2024-04-14T23:35:14.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.692+0000 7fc3deffd640 1 -- 172.21.15.47:0/3382684410 learned_addr learned my addr 172.21.15.47:0/3382684410 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:14.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.693+0000 7fc3d7fff640 1 --2- 172.21.15.47:0/3382684410 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3e00c5af0 0x7fc3e00ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.693+0000 7fc3df7fe640 1 --2- 172.21.15.47:0/3382684410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3e00c5f50 0x7fc3e00cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.693+0000 7fc3deffd640 1 -- 172.21.15.47:0/3382684410 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3e00c5af0 msgr2=0x7fc3e00ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.693+0000 7fc3deffd640 1 --2- 172.21.15.47:0/3382684410 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3e00c5af0 0x7fc3e00ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.693+0000 7fc3deffd640 1 -- 172.21.15.47:0/3382684410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3e00c5f50 msgr2=0x7fc3e00cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.693+0000 7fc3deffd640 1 --2- 172.21.15.47:0/3382684410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3e00c5f50 0x7fc3e00cf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.693+0000 7fc3deffd640 1 -- 172.21.15.47:0/3382684410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e01f3570 con 0x7fc3cc0039b0 2024-04-14T23:35:14.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.693+0000 7fc3df7fe640 1 --2- 172.21.15.47:0/3382684410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3e00c5f50 0x7fc3e00cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:14.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.693+0000 7fc3deffd640 1 --2- 172.21.15.47:0/3382684410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3cc0039b0 0x7fc3e0140580 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0037040 tx=0x7fc3d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:14.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.693+0000 7fc3d77fe640 1 -- 172.21.15.47:0/3382684410 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0042020 con 0x7fc3cc0039b0 2024-04-14T23:35:14.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.693+0000 7fc3d77fe640 1 -- 172.21.15.47:0/3382684410 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d003a040 con 0x7fc3cc0039b0 2024-04-14T23:35:14.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.693+0000 7fc3e54de640 1 -- 172.21.15.47:0/3382684410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e01f3850 con 0x7fc3cc0039b0 2024-04-14T23:35:14.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.693+0000 7fc3d77fe640 1 -- 172.21.15.47:0/3382684410 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0039070 con 0x7fc3cc0039b0 2024-04-14T23:35:14.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.693+0000 7fc3e54de640 1 -- 172.21.15.47:0/3382684410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e01f3e10 con 0x7fc3cc0039b0 2024-04-14T23:35:14.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.694+0000 7fc3e54de640 1 -- 172.21.15.47:0/3382684410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e00ce1d0 con 0x7fc3cc0039b0 2024-04-14T23:35:14.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.694+0000 7fc3d77fe640 1 -- 172.21.15.47:0/3382684410 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc3d0045020 con 0x7fc3cc0039b0 2024-04-14T23:35:14.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.695+0000 7fc3d77fe640 1 --2- 172.21.15.47:0/3382684410 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc3c006b990 0x7fc3c006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:14.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.695+0000 7fc3d77fe640 1 -- 172.21.15.47:0/3382684410 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc3d00abff0 con 0x7fc3cc0039b0 2024-04-14T23:35:14.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.695+0000 7fc3d7fff640 1 --2- 172.21.15.47:0/3382684410 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc3c006b990 0x7fc3c006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:14.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.696+0000 7fc3d7fff640 1 --2- 172.21.15.47:0/3382684410 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc3c006b990 0x7fc3c006de50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00b1f10 tx=0x7fc3c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:14.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.699+0000 7fc3d77fe640 1 -- 172.21.15.47:0/3382684410 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc3d004c070 con 0x7fc3cc0039b0 2024-04-14T23:35:14.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.881+0000 7fc3e54de640 1 -- 172.21.15.47:0/3382684410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc3e0068cc0 con 0x7fc3cc0039b0 2024-04-14T23:35:14.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.882+0000 7fc3d77fe640 1 -- 172.21.15.47:0/3382684410 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fc3e0068cc0 con 0x7fc3cc0039b0 2024-04-14T23:35:14.885 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-14T23:35:14.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.884+0000 7fc3e54de640 1 -- 172.21.15.47:0/3382684410 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc3c006b990 msgr2=0x7fc3c006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.884+0000 7fc3e54de640 1 --2- 172.21.15.47:0/3382684410 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc3c006b990 0x7fc3c006de50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00b1f10 tx=0x7fc3c8008040 comp rx=0 tx=0).stop 2024-04-14T23:35:14.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.884+0000 7fc3e54de640 1 -- 172.21.15.47:0/3382684410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3cc0039b0 msgr2=0x7fc3e0140580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:14.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.884+0000 7fc3e54de640 1 --2- 172.21.15.47:0/3382684410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3cc0039b0 0x7fc3e0140580 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0037040 tx=0x7fc3d0004730 comp rx=0 tx=0).stop 2024-04-14T23:35:14.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.884+0000 7fc3e54de640 1 -- 172.21.15.47:0/3382684410 shutdown_connections 2024-04-14T23:35:14.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.884+0000 7fc3e54de640 1 --2- 172.21.15.47:0/3382684410 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc3c006b990 0x7fc3c006de50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.884+0000 7fc3e54de640 1 --2- 172.21.15.47:0/3382684410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3e00c5f50 0x7fc3e00cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.884+0000 7fc3e54de640 1 --2- 172.21.15.47:0/3382684410 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3e00c5af0 0x7fc3e00ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.884+0000 7fc3e54de640 1 --2- 172.21.15.47:0/3382684410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3cc0039b0 0x7fc3e0140580 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:14.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.884+0000 7fc3e54de640 1 -- 172.21.15.47:0/3382684410 >> 172.21.15.47:0/3382684410 conn(0x7fc3e00cd670 msgr2=0x7fc3e0072680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:14.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.884+0000 7fc3e54de640 1 -- 172.21.15.47:0/3382684410 shutdown_connections 2024-04-14T23:35:14.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.884+0000 7fc3e54de640 1 -- 172.21.15.47:0/3382684410 wait complete. 2024-04-14T23:35:14.898 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T23:35:15.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.999+0000 7f155f636640 1 Processor -- start 2024-04-14T23:35:15.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:14.999+0000 7f155f636640 1 -- start start 2024-04-14T23:35:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.000+0000 7f155f636640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1558144700 0x7f15580b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.000+0000 7f155f636640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f155815f5e0 0x7f15580b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.000+0000 7f155f636640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f155806e6f0 0x7f155806eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.000+0000 7f155f636640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f155806f080 con 0x7f1558144700 2024-04-14T23:35:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.000+0000 7f155f636640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f1558144ae0 con 0x7f155815f5e0 2024-04-14T23:35:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.000+0000 7f155f636640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f15580b3ff0 con 0x7f155806e6f0 2024-04-14T23:35:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.000+0000 7f155d3d2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1558144700 0x7f15580b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.000+0000 7f155d3d2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1558144700 0x7f15580b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36126/0 (socket says 172.21.15.47:36126) 2024-04-14T23:35:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.000+0000 7f155d3d2640 1 -- 172.21.15.47:0/296651294 learned_addr learned my addr 172.21.15.47:0/296651294 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.000+0000 7f155cbd1640 1 --2- 172.21.15.47:0/296651294 >> v2:172.21.15.191:3300/0 conn(0x7f155815f5e0 0x7f15580b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.000+0000 7f155dbd3640 1 --2- 172.21.15.47:0/296651294 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f155806e6f0 0x7f155806eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.001+0000 7f155d3d2640 1 -- 172.21.15.47:0/296651294 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f155806e6f0 msgr2=0x7f155806eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.001+0000 7f155d3d2640 1 --2- 172.21.15.47:0/296651294 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f155806e6f0 0x7f155806eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.001+0000 7f155d3d2640 1 -- 172.21.15.47:0/296651294 >> v2:172.21.15.191:3300/0 conn(0x7f155815f5e0 msgr2=0x7f15580b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.001+0000 7f155d3d2640 1 --2- 172.21.15.47:0/296651294 >> v2:172.21.15.191:3300/0 conn(0x7f155815f5e0 0x7f15580b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.001+0000 7f155d3d2640 1 -- 172.21.15.47:0/296651294 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15580b33e0 con 0x7f1558144700 2024-04-14T23:35:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.001+0000 7f155cbd1640 1 --2- 172.21.15.47:0/296651294 >> v2:172.21.15.191:3300/0 conn(0x7f155815f5e0 0x7f15580b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.001+0000 7f155d3d2640 1 --2- 172.21.15.47:0/296651294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1558144700 0x7f15580b4480 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f15580504a0 tx=0x7f155002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97014e11515775f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:15.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.002+0000 7f154ffff640 1 -- 172.21.15.47:0/296651294 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1550035020 con 0x7f1558144700 2024-04-14T23:35:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.002+0000 7f154ffff640 1 -- 172.21.15.47:0/296651294 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1550031870 con 0x7f1558144700 2024-04-14T23:35:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.002+0000 7f154ffff640 1 -- 172.21.15.47:0/296651294 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1550031c40 con 0x7f1558144700 2024-04-14T23:35:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.002+0000 7f155f636640 1 -- 172.21.15.47:0/296651294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1558144700 msgr2=0x7f15580b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.002+0000 7f155f636640 1 --2- 172.21.15.47:0/296651294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1558144700 0x7f15580b4480 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f15580504a0 tx=0x7f155002b910 comp rx=0 tx=0).stop 2024-04-14T23:35:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.002+0000 7f155f636640 1 -- 172.21.15.47:0/296651294 shutdown_connections 2024-04-14T23:35:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.002+0000 7f155f636640 1 --2- 172.21.15.47:0/296651294 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f155806e6f0 0x7f155806eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.002+0000 7f155f636640 1 --2- 172.21.15.47:0/296651294 >> v2:172.21.15.191:3300/0 conn(0x7f155815f5e0 0x7f15580b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.002+0000 7f155f636640 1 --2- 172.21.15.47:0/296651294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1558144700 0x7f15580b4480 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.002+0000 7f155f636640 1 -- 172.21.15.47:0/296651294 >> 172.21.15.47:0/296651294 conn(0x7f15580b1770 msgr2=0x7f15580b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.002+0000 7f155f636640 1 -- 172.21.15.47:0/296651294 shutdown_connections 2024-04-14T23:35:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.002+0000 7f155f636640 1 -- 172.21.15.47:0/296651294 wait complete. 2024-04-14T23:35:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.003+0000 7f155f636640 1 Processor -- start 2024-04-14T23:35:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.003+0000 7f155f636640 1 -- start start 2024-04-14T23:35:15.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.004+0000 7f155f636640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f155806e6f0 0x7f15581408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.004+0000 7f155f636640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1558144700 0x7f15581422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.004+0000 7f155f636640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f155815f5e0 0x7f1558142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.004+0000 7f155f636640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f15580b3c80 con 0x7f155815f5e0 2024-04-14T23:35:15.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.004+0000 7f155f636640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f15580b39a0 con 0x7f155806e6f0 2024-04-14T23:35:15.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.004+0000 7f155f636640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f15580b49c0 con 0x7f1558144700 2024-04-14T23:35:15.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.004+0000 7f155dbd3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f155815f5e0 0x7f1558142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.004+0000 7f155dbd3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f155815f5e0 0x7f1558142800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36132/0 (socket says 172.21.15.47:36132) 2024-04-14T23:35:15.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.004+0000 7f155dbd3640 1 -- 172.21.15.47:0/1727472180 learned_addr learned my addr 172.21.15.47:0/1727472180 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:15.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.004+0000 7f155cbd1640 1 --2- 172.21.15.47:0/1727472180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1558144700 0x7f15581422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.004+0000 7f155d3d2640 1 --2- 172.21.15.47:0/1727472180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f155806e6f0 0x7f15581408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.005+0000 7f155dbd3640 1 -- 172.21.15.47:0/1727472180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1558144700 msgr2=0x7f15581422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.005+0000 7f155dbd3640 1 --2- 172.21.15.47:0/1727472180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1558144700 0x7f15581422c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.005+0000 7f155dbd3640 1 -- 172.21.15.47:0/1727472180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f155806e6f0 msgr2=0x7f15581408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.005+0000 7f155dbd3640 1 --2- 172.21.15.47:0/1727472180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f155806e6f0 0x7f15581408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.005+0000 7f155dbd3640 1 -- 172.21.15.47:0/1727472180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15581f5080 con 0x7f155815f5e0 2024-04-14T23:35:15.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.005+0000 7f155dbd3640 1 --2- 172.21.15.47:0/1727472180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f155815f5e0 0x7f1558142800 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1554007ed0 tx=0x7f15540106c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:15.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.005+0000 7f154dffb640 1 -- 172.21.15.47:0/1727472180 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1554018070 con 0x7f155815f5e0 2024-04-14T23:35:15.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.005+0000 7f154dffb640 1 -- 172.21.15.47:0/1727472180 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15540138a0 con 0x7f155815f5e0 2024-04-14T23:35:15.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.005+0000 7f155f636640 1 -- 172.21.15.47:0/1727472180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15581f4da0 con 0x7f155815f5e0 2024-04-14T23:35:15.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.005+0000 7f154dffb640 1 -- 172.21.15.47:0/1727472180 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1554013c90 con 0x7f155815f5e0 2024-04-14T23:35:15.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.005+0000 7f155f636640 1 -- 172.21.15.47:0/1727472180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f155814c7f0 con 0x7f155815f5e0 2024-04-14T23:35:15.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.006+0000 7f155f636640 1 -- 172.21.15.47:0/1727472180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f155815a760 con 0x7f155815f5e0 2024-04-14T23:35:15.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.007+0000 7f154dffb640 1 -- 172.21.15.47:0/1727472180 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f155401b070 con 0x7f155815f5e0 2024-04-14T23:35:15.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.007+0000 7f154dffb640 1 --2- 172.21.15.47:0/1727472180 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f153c06b990 0x7f153c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.007+0000 7f154dffb640 1 -- 172.21.15.47:0/1727472180 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f155408da30 con 0x7f155815f5e0 2024-04-14T23:35:15.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.007+0000 7f155d3d2640 1 --2- 172.21.15.47:0/1727472180 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f153c06b990 0x7f153c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.008+0000 7f155d3d2640 1 --2- 172.21.15.47:0/1727472180 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f153c06b990 0x7f153c06de50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1550036000 tx=0x7f155003c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:15.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.012+0000 7f154dffb640 1 -- 172.21.15.47:0/1727472180 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f155405bd40 con 0x7f155815f5e0 2024-04-14T23:35:15.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.195+0000 7f155f636640 1 -- 172.21.15.47:0/1727472180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1558073f50 con 0x7f155815f5e0 2024-04-14T23:35:15.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.195+0000 7f154dffb640 1 -- 172.21.15.47:0/1727472180 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f155405fde0 con 0x7f155815f5e0 2024-04-14T23:35:15.199 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:15.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.197+0000 7f155f636640 1 -- 172.21.15.47:0/1727472180 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f153c06b990 msgr2=0x7f153c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.197+0000 7f155f636640 1 --2- 172.21.15.47:0/1727472180 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f153c06b990 0x7f153c06de50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1550036000 tx=0x7f155003c040 comp rx=0 tx=0).stop 2024-04-14T23:35:15.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.197+0000 7f155f636640 1 -- 172.21.15.47:0/1727472180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f155815f5e0 msgr2=0x7f1558142800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.197+0000 7f155f636640 1 --2- 172.21.15.47:0/1727472180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f155815f5e0 0x7f1558142800 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1554007ed0 tx=0x7f15540106c0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.197+0000 7f155f636640 1 -- 172.21.15.47:0/1727472180 shutdown_connections 2024-04-14T23:35:15.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.197+0000 7f155f636640 1 --2- 172.21.15.47:0/1727472180 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f153c06b990 0x7f153c06de50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.197+0000 7f155f636640 1 --2- 172.21.15.47:0/1727472180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f155815f5e0 0x7f1558142800 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.197+0000 7f155f636640 1 --2- 172.21.15.47:0/1727472180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1558144700 0x7f15581422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.197+0000 7f155f636640 1 --2- 172.21.15.47:0/1727472180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f155806e6f0 0x7f15581408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.197+0000 7f155f636640 1 -- 172.21.15.47:0/1727472180 >> 172.21.15.47:0/1727472180 conn(0x7f15580b1770 msgr2=0x7f15580cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:15.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.197+0000 7f155f636640 1 -- 172.21.15.47:0/1727472180 shutdown_connections 2024-04-14T23:35:15.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.197+0000 7f155f636640 1 -- 172.21.15.47:0/1727472180 wait complete. 2024-04-14T23:35:15.212 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:15.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.310+0000 7f8474c88640 1 Processor -- start 2024-04-14T23:35:15.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.310+0000 7f8474c88640 1 -- start start 2024-04-14T23:35:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.311+0000 7f8474c88640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f84700cca50 0x7f84700cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.311+0000 7f8474c88640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f84700ceab0 0x7f8470161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.311+0000 7f8474c88640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f847015e9a0 con 0x7f84700d16d0 2024-04-14T23:35:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.311+0000 7f8474c88640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f847015f5b0 con 0x7f84700cca50 2024-04-14T23:35:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.311+0000 7f8474c88640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f847015ec80 con 0x7f84700ceab0 2024-04-14T23:35:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.311+0000 7f846e59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f84700cca50 0x7f84700cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.311+0000 7f846e59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f84700cca50 0x7f84700cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36144/0 (socket says 172.21.15.47:36144) 2024-04-14T23:35:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.311+0000 7f846e59c640 1 -- 172.21.15.47:0/379240333 learned_addr learned my addr 172.21.15.47:0/379240333 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.311+0000 7f846e59c640 1 -- 172.21.15.47:0/379240333 >> v2:172.21.15.191:3300/0 conn(0x7f84700ceab0 msgr2=0x7f8470161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:15.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.311+0000 7f846e59c640 1 --2- 172.21.15.47:0/379240333 >> v2:172.21.15.191:3300/0 conn(0x7f84700ceab0 0x7f8470161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.311+0000 7f846e59c640 1 -- 172.21.15.47:0/379240333 >> v1:172.21.15.191:6789/0 conn(0x7f84700d16d0 legacy=0x7f84701622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.311+0000 7f846e59c640 1 -- 172.21.15.47:0/379240333 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847015ef60 con 0x7f84700cca50 2024-04-14T23:35:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.312+0000 7f846e59c640 1 --2- 172.21.15.47:0/379240333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700cca50 0x7f84700cce30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8470073e60 tx=0x7f846002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e659acbef9556aa1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.312+0000 7f846dd9b640 1 -- 172.21.15.47:0/379240333 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460038070 con 0x7f84700cca50 2024-04-14T23:35:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.312+0000 7f846dd9b640 1 -- 172.21.15.47:0/379240333 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f846002f050 con 0x7f84700cca50 2024-04-14T23:35:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.312+0000 7f846dd9b640 1 -- 172.21.15.47:0/379240333 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460031970 con 0x7f84700cca50 2024-04-14T23:35:15.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.312+0000 7f8474c88640 1 -- 172.21.15.47:0/379240333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700cca50 msgr2=0x7f84700cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.312+0000 7f8474c88640 1 --2- 172.21.15.47:0/379240333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700cca50 0x7f84700cce30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8470073e60 tx=0x7f846002b7f0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.312+0000 7f8474c88640 1 -- 172.21.15.47:0/379240333 shutdown_connections 2024-04-14T23:35:15.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.312+0000 7f8474c88640 1 --2- 172.21.15.47:0/379240333 >> v2:172.21.15.191:3300/0 conn(0x7f84700ceab0 0x7f8470161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.312+0000 7f8474c88640 1 --2- 172.21.15.47:0/379240333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700cca50 0x7f84700cce30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.313+0000 7f8474c88640 1 -- 172.21.15.47:0/379240333 >> 172.21.15.47:0/379240333 conn(0x7f84700d0bb0 msgr2=0x7f84700d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:15.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.313+0000 7f8474c88640 1 -- 172.21.15.47:0/379240333 shutdown_connections 2024-04-14T23:35:15.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.313+0000 7f8474c88640 1 -- 172.21.15.47:0/379240333 wait complete. 2024-04-14T23:35:15.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.314+0000 7f8474c88640 1 Processor -- start 2024-04-14T23:35:15.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.314+0000 7f8474c88640 1 -- start start 2024-04-14T23:35:15.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.314+0000 7f8474c88640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84700cca50 0x7f84700ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.314+0000 7f8474c88640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700ceab0 0x7f84701599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.314+0000 7f8474c88640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84700d16d0 0x7f84700b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.314+0000 7f8474c88640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f847015e660 con 0x7f84700ceab0 2024-04-14T23:35:15.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f8474c88640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f84700cd370 con 0x7f84700cca50 2024-04-14T23:35:15.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f8474c88640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f84700cb3c0 con 0x7f84700d16d0 2024-04-14T23:35:15.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f8467fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700ceab0 0x7f84701599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f8467fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700ceab0 0x7f84701599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36148/0 (socket says 172.21.15.47:36148) 2024-04-14T23:35:15.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f8467fff640 1 -- 172.21.15.47:0/537324827 learned_addr learned my addr 172.21.15.47:0/537324827 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:15.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f846ed9d640 1 --2- 172.21.15.47:0/537324827 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84700d16d0 0x7f84700b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f846e59c640 1 --2- 172.21.15.47:0/537324827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84700cca50 0x7f84700ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f8467fff640 1 -- 172.21.15.47:0/537324827 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84700d16d0 msgr2=0x7f84700b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f8467fff640 1 --2- 172.21.15.47:0/537324827 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84700d16d0 0x7f84700b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f8467fff640 1 -- 172.21.15.47:0/537324827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84700cca50 msgr2=0x7f84700ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f8467fff640 1 --2- 172.21.15.47:0/537324827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84700cca50 0x7f84700ca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f8467fff640 1 -- 172.21.15.47:0/537324827 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84700b1c30 con 0x7f84700ceab0 2024-04-14T23:35:15.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f846e59c640 1 --2- 172.21.15.47:0/537324827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84700cca50 0x7f84700ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:15.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f8467fff640 1 --2- 172.21.15.47:0/537324827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700ceab0 0x7f84701599d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f845800b480 tx=0x7f845800b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:15.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f8466ffd640 1 -- 172.21.15.47:0/537324827 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458014070 con 0x7f84700ceab0 2024-04-14T23:35:15.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f8466ffd640 1 -- 172.21.15.47:0/537324827 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8458010610 con 0x7f84700ceab0 2024-04-14T23:35:15.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f8474c88640 1 -- 172.21.15.47:0/537324827 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84700b1f10 con 0x7f84700ceab0 2024-04-14T23:35:15.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f8466ffd640 1 -- 172.21.15.47:0/537324827 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458010a00 con 0x7f84700ceab0 2024-04-14T23:35:15.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.315+0000 7f8474c88640 1 -- 172.21.15.47:0/537324827 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84700b24d0 con 0x7f84700ceab0 2024-04-14T23:35:15.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.316+0000 7f8474c88640 1 -- 172.21.15.47:0/537324827 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8470072f30 con 0x7f84700ceab0 2024-04-14T23:35:15.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.317+0000 7f8466ffd640 1 -- 172.21.15.47:0/537324827 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f8458017070 con 0x7f84700ceab0 2024-04-14T23:35:15.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.317+0000 7f8466ffd640 1 --2- 172.21.15.47:0/537324827 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f845006b990 0x7f845006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.317+0000 7f8466ffd640 1 -- 172.21.15.47:0/537324827 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f845808a5d0 con 0x7f84700ceab0 2024-04-14T23:35:15.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.317+0000 7f846e59c640 1 --2- 172.21.15.47:0/537324827 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f845006b990 0x7f845006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.318+0000 7f846e59c640 1 --2- 172.21.15.47:0/537324827 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f845006b990 0x7f845006de50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8460035000 tx=0x7f8460008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:15.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.321+0000 7f8466ffd640 1 -- 172.21.15.47:0/537324827 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8458058f30 con 0x7f84700ceab0 2024-04-14T23:35:15.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.502+0000 7f8474c88640 1 -- 172.21.15.47:0/537324827 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84700b2970 con 0x7f84700ceab0 2024-04-14T23:35:15.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.504+0000 7f8466ffd640 1 -- 172.21.15.47:0/537324827 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7f8458087860 con 0x7f84700ceab0 2024-04-14T23:35:15.507 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:15.507 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:44.714882+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:15.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.506+0000 7f8474c88640 1 -- 172.21.15.47:0/537324827 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f845006b990 msgr2=0x7f845006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.506+0000 7f8474c88640 1 --2- 172.21.15.47:0/537324827 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f845006b990 0x7f845006de50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8460035000 tx=0x7f8460008030 comp rx=0 tx=0).stop 2024-04-14T23:35:15.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.506+0000 7f8474c88640 1 -- 172.21.15.47:0/537324827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700ceab0 msgr2=0x7f84701599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.506+0000 7f8474c88640 1 --2- 172.21.15.47:0/537324827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700ceab0 0x7f84701599d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f845800b480 tx=0x7f845800b940 comp rx=0 tx=0).stop 2024-04-14T23:35:15.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.506+0000 7f8474c88640 1 -- 172.21.15.47:0/537324827 shutdown_connections 2024-04-14T23:35:15.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.506+0000 7f8474c88640 1 --2- 172.21.15.47:0/537324827 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f845006b990 0x7f845006de50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.506+0000 7f8474c88640 1 --2- 172.21.15.47:0/537324827 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f84700d16d0 0x7f84700b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.506+0000 7f8474c88640 1 --2- 172.21.15.47:0/537324827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700ceab0 0x7f84701599d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.506+0000 7f8474c88640 1 --2- 172.21.15.47:0/537324827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84700cca50 0x7f84700ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.506+0000 7f8474c88640 1 -- 172.21.15.47:0/537324827 >> 172.21.15.47:0/537324827 conn(0x7f84700d0bb0 msgr2=0x7f847015c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:15.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.506+0000 7f8474c88640 1 -- 172.21.15.47:0/537324827 shutdown_connections 2024-04-14T23:35:15.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.506+0000 7f8474c88640 1 -- 172.21.15.47:0/537324827 wait complete. 2024-04-14T23:35:15.520 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T23:34:36.382034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T23:34:37.023103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T23:34:40.726418+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T23:35:15.520 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:35:15.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.622+0000 7f6f40199640 1 Processor -- start 2024-04-14T23:35:15.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.622+0000 7f6f40199640 1 -- start start 2024-04-14T23:35:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.623+0000 7f6f40199640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6f38155310 0x7f6f3806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.623+0000 7f6f40199640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6f380d0070 0x7f6f3815e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.623+0000 7f6f40199640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f380cc150 con 0x7f6f3806b740 2024-04-14T23:35:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.623+0000 7f6f40199640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6f3806bbb0 con 0x7f6f380d0070 2024-04-14T23:35:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.623+0000 7f6f40199640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f6f380ce500 con 0x7f6f38155310 2024-04-14T23:35:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.623+0000 7f6f3e736640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6f380d0070 0x7f6f3815e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.623+0000 7f6f3e736640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6f380d0070 0x7f6f3815e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36156/0 (socket says 172.21.15.47:36156) 2024-04-14T23:35:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.623+0000 7f6f3e736640 1 -- 172.21.15.47:0/845033116 learned_addr learned my addr 172.21.15.47:0/845033116 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.623+0000 7f6f3df35640 1 --2- 172.21.15.47:0/845033116 >> v2:172.21.15.191:3300/0 conn(0x7f6f38155310 0x7f6f3806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.623+0000 7f6f3e736640 1 -- 172.21.15.47:0/845033116 >> v2:172.21.15.191:3300/0 conn(0x7f6f38155310 msgr2=0x7f6f3806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.623+0000 7f6f3e736640 1 --2- 172.21.15.47:0/845033116 >> v2:172.21.15.191:3300/0 conn(0x7f6f38155310 0x7f6f3806b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.623+0000 7f6f3e736640 1 -- 172.21.15.47:0/845033116 >> v1:172.21.15.191:6789/0 conn(0x7f6f3806b740 legacy=0x7f6f380cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:15.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.623+0000 7f6f3e736640 1 -- 172.21.15.47:0/845033116 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f38161d70 con 0x7f6f380d0070 2024-04-14T23:35:15.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.624+0000 7f6f3e736640 1 --2- 172.21.15.47:0/845033116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f380d0070 0x7f6f3815e6e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6f38071230 tx=0x7f6f3002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4759f09ca620f286 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:15.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.624+0000 7f6f3cf33640 1 -- 172.21.15.47:0/845033116 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3002ca80 con 0x7f6f380d0070 2024-04-14T23:35:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.624+0000 7f6f3cf33640 1 -- 172.21.15.47:0/845033116 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3002cc20 con 0x7f6f380d0070 2024-04-14T23:35:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.624+0000 7f6f3cf33640 1 -- 172.21.15.47:0/845033116 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f300343f0 con 0x7f6f380d0070 2024-04-14T23:35:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.624+0000 7f6f40199640 1 -- 172.21.15.47:0/845033116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f380d0070 msgr2=0x7f6f3815e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.624+0000 7f6f40199640 1 --2- 172.21.15.47:0/845033116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f380d0070 0x7f6f3815e6e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6f38071230 tx=0x7f6f3002bee0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.624+0000 7f6f40199640 1 -- 172.21.15.47:0/845033116 shutdown_connections 2024-04-14T23:35:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.624+0000 7f6f40199640 1 --2- 172.21.15.47:0/845033116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f380d0070 0x7f6f3815e6e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.624+0000 7f6f40199640 1 --2- 172.21.15.47:0/845033116 >> v2:172.21.15.191:3300/0 conn(0x7f6f38155310 0x7f6f3806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.624+0000 7f6f40199640 1 -- 172.21.15.47:0/845033116 >> 172.21.15.47:0/845033116 conn(0x7f6f380cd670 msgr2=0x7f6f380cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.625+0000 7f6f40199640 1 -- 172.21.15.47:0/845033116 shutdown_connections 2024-04-14T23:35:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.625+0000 7f6f40199640 1 -- 172.21.15.47:0/845033116 wait complete. 2024-04-14T23:35:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.626+0000 7f6f40199640 1 Processor -- start 2024-04-14T23:35:15.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.626+0000 7f6f40199640 1 -- start start 2024-04-14T23:35:15.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.626+0000 7f6f40199640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f3806b740 0x7f6f3814fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.626+0000 7f6f40199640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f380d0070 0x7f6f380b69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.626+0000 7f6f40199640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6f38155310 0x7f6f3814e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.626+0000 7f6f40199640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6f381626a0 con 0x7f6f3806b740 2024-04-14T23:35:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.626+0000 7f6f40199640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6f380d0540 con 0x7f6f380d0070 2024-04-14T23:35:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.626+0000 7f6f40199640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6f38162330 con 0x7f6f38155310 2024-04-14T23:35:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.626+0000 7f6f3df35640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f3806b740 0x7f6f3814fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.627+0000 7f6f3df35640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f3806b740 0x7f6f3814fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36168/0 (socket says 172.21.15.47:36168) 2024-04-14T23:35:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.627+0000 7f6f3df35640 1 -- 172.21.15.47:0/3417539049 learned_addr learned my addr 172.21.15.47:0/3417539049 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.627+0000 7f6f3d734640 1 --2- 172.21.15.47:0/3417539049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f380d0070 0x7f6f380b69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.627+0000 7f6f3e736640 1 --2- 172.21.15.47:0/3417539049 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6f38155310 0x7f6f3814e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.627+0000 7f6f3df35640 1 -- 172.21.15.47:0/3417539049 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6f38155310 msgr2=0x7f6f3814e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.627+0000 7f6f3df35640 1 --2- 172.21.15.47:0/3417539049 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6f38155310 0x7f6f3814e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.627+0000 7f6f3df35640 1 -- 172.21.15.47:0/3417539049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f380d0070 msgr2=0x7f6f380b69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.627+0000 7f6f3df35640 1 --2- 172.21.15.47:0/3417539049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f380d0070 0x7f6f380b69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.627+0000 7f6f3df35640 1 -- 172.21.15.47:0/3417539049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f38156a20 con 0x7f6f3806b740 2024-04-14T23:35:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.627+0000 7f6f3df35640 1 --2- 172.21.15.47:0/3417539049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f3806b740 0x7f6f3814fc00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400c7f0 tx=0x7f6f3400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:15.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.627+0000 7f6f2e7fc640 1 -- 172.21.15.47:0/3417539049 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34015070 con 0x7f6f3806b740 2024-04-14T23:35:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.627+0000 7f6f2e7fc640 1 -- 172.21.15.47:0/3417539049 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f34004220 con 0x7f6f3806b740 2024-04-14T23:35:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.627+0000 7f6f40199640 1 -- 172.21.15.47:0/3417539049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f38150300 con 0x7f6f3806b740 2024-04-14T23:35:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.627+0000 7f6f2e7fc640 1 -- 172.21.15.47:0/3417539049 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34007620 con 0x7f6f3806b740 2024-04-14T23:35:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.627+0000 7f6f40199640 1 -- 172.21.15.47:0/3417539049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f38156fa0 con 0x7f6f3806b740 2024-04-14T23:35:15.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.628+0000 7f6f40199640 1 -- 172.21.15.47:0/3417539049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f381571a0 con 0x7f6f3806b740 2024-04-14T23:35:15.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.629+0000 7f6f2e7fc640 1 -- 172.21.15.47:0/3417539049 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6f340079d0 con 0x7f6f3806b740 2024-04-14T23:35:15.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.629+0000 7f6f2e7fc640 1 --2- 172.21.15.47:0/3417539049 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6f1c06b990 0x7f6f1c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.629+0000 7f6f2e7fc640 1 -- 172.21.15.47:0/3417539049 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6f3408ae00 con 0x7f6f3806b740 2024-04-14T23:35:15.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.629+0000 7f6f3d734640 1 --2- 172.21.15.47:0/3417539049 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6f1c06b990 0x7f6f1c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.630+0000 7f6f3d734640 1 --2- 172.21.15.47:0/3417539049 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6f1c06b990 0x7f6f1c06de50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6f38161470 tx=0x7f6f28009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:15.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.633+0000 7f6f2e7fc640 1 -- 172.21.15.47:0/3417539049 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6f381571a0 con 0x7f6f3806b740 2024-04-14T23:35:15.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.813+0000 7f6f40199640 1 -- 172.21.15.47:0/3417539049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6f380cfa00 con 0x7f6f3806b740 2024-04-14T23:35:15.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.813+0000 7f6f2e7fc640 1 -- 172.21.15.47:0/3417539049 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f6f34059080 con 0x7f6f3806b740 2024-04-14T23:35:15.817 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:35:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.815+0000 7f6f40199640 1 -- 172.21.15.47:0/3417539049 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6f1c06b990 msgr2=0x7f6f1c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.815+0000 7f6f40199640 1 --2- 172.21.15.47:0/3417539049 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6f1c06b990 0x7f6f1c06de50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6f38161470 tx=0x7f6f28009060 comp rx=0 tx=0).stop 2024-04-14T23:35:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.815+0000 7f6f40199640 1 -- 172.21.15.47:0/3417539049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f3806b740 msgr2=0x7f6f3814fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.815+0000 7f6f40199640 1 --2- 172.21.15.47:0/3417539049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f3806b740 0x7f6f3814fc00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400c7f0 tx=0x7f6f3400ccb0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.815+0000 7f6f40199640 1 -- 172.21.15.47:0/3417539049 shutdown_connections 2024-04-14T23:35:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.815+0000 7f6f40199640 1 --2- 172.21.15.47:0/3417539049 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6f1c06b990 0x7f6f1c06de50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.815+0000 7f6f40199640 1 --2- 172.21.15.47:0/3417539049 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6f38155310 0x7f6f3814e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.815+0000 7f6f40199640 1 --2- 172.21.15.47:0/3417539049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f380d0070 0x7f6f380b69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.815+0000 7f6f40199640 1 --2- 172.21.15.47:0/3417539049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f3806b740 0x7f6f3814fc00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.815+0000 7f6f40199640 1 -- 172.21.15.47:0/3417539049 >> 172.21.15.47:0/3417539049 conn(0x7f6f380cd670 msgr2=0x7f6f380b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.815+0000 7f6f40199640 1 -- 172.21.15.47:0/3417539049 shutdown_connections 2024-04-14T23:35:15.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.815+0000 7f6f40199640 1 -- 172.21.15.47:0/3417539049 wait complete. 2024-04-14T23:35:15.829 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T23:35:15.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.931+0000 7fb5c46c4640 1 Processor -- start 2024-04-14T23:35:15.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.931+0000 7fb5c46c4640 1 -- start start 2024-04-14T23:35:15.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.932+0000 7fb5c46c4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb5bc15f5e0 0x7fb5bc0b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.932+0000 7fb5c46c4640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb5bc06e6f0 0x7fb5bc06eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.932+0000 7fb5c46c4640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5bc06f040 con 0x7fb5bc144700 2024-04-14T23:35:15.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.932+0000 7fb5c46c4640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb5bc144ae0 con 0x7fb5bc15f5e0 2024-04-14T23:35:15.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.932+0000 7fb5c46c4640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fb5bc0b3ff0 con 0x7fb5bc06e6f0 2024-04-14T23:35:15.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.932+0000 7fb5c1c5f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb5bc15f5e0 0x7fb5bc0b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.932+0000 7fb5c1c5f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb5bc15f5e0 0x7fb5bc0b2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36176/0 (socket says 172.21.15.47:36176) 2024-04-14T23:35:15.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.932+0000 7fb5c1c5f640 1 -- 172.21.15.47:0/4042201565 learned_addr learned my addr 172.21.15.47:0/4042201565 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:15.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.932+0000 7fb5c2c61640 1 --2- 172.21.15.47:0/4042201565 >> v2:172.21.15.191:3300/0 conn(0x7fb5bc06e6f0 0x7fb5bc06eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.932+0000 7fb5c1c5f640 1 -- 172.21.15.47:0/4042201565 >> v2:172.21.15.191:3300/0 conn(0x7fb5bc06e6f0 msgr2=0x7fb5bc06eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:15.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.932+0000 7fb5c1c5f640 1 --2- 172.21.15.47:0/4042201565 >> v2:172.21.15.191:3300/0 conn(0x7fb5bc06e6f0 0x7fb5bc06eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.932+0000 7fb5c1c5f640 1 -- 172.21.15.47:0/4042201565 >> v1:172.21.15.191:6789/0 conn(0x7fb5bc144700 legacy=0x7fb5bc0b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:15.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.932+0000 7fb5c1c5f640 1 -- 172.21.15.47:0/4042201565 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5bc0b33e0 con 0x7fb5bc15f5e0 2024-04-14T23:35:15.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.933+0000 7fb5c1c5f640 1 --2- 172.21.15.47:0/4042201565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc15f5e0 0x7fb5bc0b2a70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0af690 tx=0x7fb5ac02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad172528e0cf929 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:15.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.933+0000 7fb5c145e640 1 -- 172.21.15.47:0/4042201565 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac03b070 con 0x7fb5bc15f5e0 2024-04-14T23:35:15.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.933+0000 7fb5c145e640 1 -- 172.21.15.47:0/4042201565 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5ac036440 con 0x7fb5bc15f5e0 2024-04-14T23:35:15.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.933+0000 7fb5c145e640 1 -- 172.21.15.47:0/4042201565 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac036810 con 0x7fb5bc15f5e0 2024-04-14T23:35:15.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.934+0000 7fb5c46c4640 1 -- 172.21.15.47:0/4042201565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc15f5e0 msgr2=0x7fb5bc0b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.934+0000 7fb5c46c4640 1 --2- 172.21.15.47:0/4042201565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc15f5e0 0x7fb5bc0b2a70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0af690 tx=0x7fb5ac02e0e0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.934+0000 7fb5c46c4640 1 -- 172.21.15.47:0/4042201565 shutdown_connections 2024-04-14T23:35:15.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.934+0000 7fb5c46c4640 1 --2- 172.21.15.47:0/4042201565 >> v2:172.21.15.191:3300/0 conn(0x7fb5bc06e6f0 0x7fb5bc06eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.934+0000 7fb5c46c4640 1 --2- 172.21.15.47:0/4042201565 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc15f5e0 0x7fb5bc0b2a70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.934+0000 7fb5c46c4640 1 -- 172.21.15.47:0/4042201565 >> 172.21.15.47:0/4042201565 conn(0x7fb5bc0b1770 msgr2=0x7fb5bc0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:15.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.934+0000 7fb5c46c4640 1 -- 172.21.15.47:0/4042201565 shutdown_connections 2024-04-14T23:35:15.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.934+0000 7fb5c46c4640 1 -- 172.21.15.47:0/4042201565 wait complete. 2024-04-14T23:35:15.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.935+0000 7fb5c46c4640 1 Processor -- start 2024-04-14T23:35:15.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.935+0000 7fb5c46c4640 1 -- start start 2024-04-14T23:35:15.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c46c4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc06e6f0 0x7fb5bc0aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c46c4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5bc144700 0x7fb5bc159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c46c4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5bc15f5e0 0x7fb5bc15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c46c4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc0b3c80 con 0x7fb5bc06e6f0 2024-04-14T23:35:15.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c46c4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc0b39a0 con 0x7fb5bc15f5e0 2024-04-14T23:35:15.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c46c4640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb5bc0b2fb0 con 0x7fb5bc144700 2024-04-14T23:35:15.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c2460640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc06e6f0 0x7fb5bc0aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c2460640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc06e6f0 0x7fb5bc0aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36180/0 (socket says 172.21.15.47:36180) 2024-04-14T23:35:15.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c2460640 1 -- 172.21.15.47:0/2836005650 learned_addr learned my addr 172.21.15.47:0/2836005650 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:15.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c2c61640 1 --2- 172.21.15.47:0/2836005650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5bc15f5e0 0x7fb5bc15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c1c5f640 1 --2- 172.21.15.47:0/2836005650 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5bc144700 0x7fb5bc159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c2460640 1 -- 172.21.15.47:0/2836005650 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5bc144700 msgr2=0x7fb5bc159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c2460640 1 --2- 172.21.15.47:0/2836005650 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5bc144700 0x7fb5bc159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c2460640 1 -- 172.21.15.47:0/2836005650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5bc15f5e0 msgr2=0x7fb5bc15a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c2460640 1 --2- 172.21.15.47:0/2836005650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5bc15f5e0 0x7fb5bc15a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c2460640 1 -- 172.21.15.47:0/2836005650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5bc0af150 con 0x7fb5bc06e6f0 2024-04-14T23:35:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c2c61640 1 --2- 172.21.15.47:0/2836005650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5bc15f5e0 0x7fb5bc15a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.936+0000 7fb5c2460640 1 --2- 172.21.15.47:0/2836005650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc06e6f0 0x7fb5bc0aec10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c430 tx=0x7fb5b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.937+0000 7fb5b2ffd640 1 -- 172.21.15.47:0/2836005650 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8011790 con 0x7fb5bc06e6f0 2024-04-14T23:35:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.937+0000 7fb5b2ffd640 1 -- 172.21.15.47:0/2836005650 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b8017070 con 0x7fb5bc06e6f0 2024-04-14T23:35:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.937+0000 7fb5b2ffd640 1 -- 172.21.15.47:0/2836005650 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8011bb0 con 0x7fb5bc06e6f0 2024-04-14T23:35:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.937+0000 7fb5c46c4640 1 -- 172.21.15.47:0/2836005650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5bc15d5e0 con 0x7fb5bc06e6f0 2024-04-14T23:35:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.937+0000 7fb5c46c4640 1 -- 172.21.15.47:0/2836005650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5bc15dba0 con 0x7fb5bc06e6f0 2024-04-14T23:35:15.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.938+0000 7fb5c46c4640 1 -- 172.21.15.47:0/2836005650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5bc073f50 con 0x7fb5bc06e6f0 2024-04-14T23:35:15.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.938+0000 7fb5b2ffd640 1 -- 172.21.15.47:0/2836005650 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb5b801c460 con 0x7fb5bc06e6f0 2024-04-14T23:35:15.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.938+0000 7fb5b2ffd640 1 --2- 172.21.15.47:0/2836005650 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb5a006b990 0x7fb5a006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:15.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.938+0000 7fb5b2ffd640 1 -- 172.21.15.47:0/2836005650 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb5b808a960 con 0x7fb5bc06e6f0 2024-04-14T23:35:15.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.939+0000 7fb5c1c5f640 1 --2- 172.21.15.47:0/2836005650 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb5a006b990 0x7fb5a006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:15.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.939+0000 7fb5c1c5f640 1 --2- 172.21.15.47:0/2836005650 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb5a006b990 0x7fb5a006de50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac038000 tx=0x7fb5ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:15.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:15.943+0000 7fb5b2ffd640 1 -- 172.21.15.47:0/2836005650 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb5b80592c0 con 0x7fb5bc06e6f0 2024-04-14T23:35:16.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.122+0000 7fb5c46c4640 1 -- 172.21.15.47:0/2836005650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb5bc15ae50 con 0x7fb5bc06e6f0 2024-04-14T23:35:16.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.123+0000 7fb5b2ffd640 1 -- 172.21.15.47:0/2836005650 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fb5b8058bc0 con 0x7fb5bc06e6f0 2024-04-14T23:35:16.126 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:16.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.125+0000 7fb5c46c4640 1 -- 172.21.15.47:0/2836005650 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb5a006b990 msgr2=0x7fb5a006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.125+0000 7fb5c46c4640 1 --2- 172.21.15.47:0/2836005650 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb5a006b990 0x7fb5a006de50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac038000 tx=0x7fb5ac008040 comp rx=0 tx=0).stop 2024-04-14T23:35:16.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.125+0000 7fb5c46c4640 1 -- 172.21.15.47:0/2836005650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc06e6f0 msgr2=0x7fb5bc0aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.125+0000 7fb5c46c4640 1 --2- 172.21.15.47:0/2836005650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc06e6f0 0x7fb5bc0aec10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c430 tx=0x7fb5b800c8f0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.125+0000 7fb5c46c4640 1 -- 172.21.15.47:0/2836005650 shutdown_connections 2024-04-14T23:35:16.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.125+0000 7fb5c46c4640 1 --2- 172.21.15.47:0/2836005650 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb5a006b990 0x7fb5a006de50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.125+0000 7fb5c46c4640 1 --2- 172.21.15.47:0/2836005650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5bc15f5e0 0x7fb5bc15a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.125+0000 7fb5c46c4640 1 --2- 172.21.15.47:0/2836005650 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5bc144700 0x7fb5bc159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.125+0000 7fb5c46c4640 1 --2- 172.21.15.47:0/2836005650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5bc06e6f0 0x7fb5bc0aec10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.125+0000 7fb5c46c4640 1 -- 172.21.15.47:0/2836005650 >> 172.21.15.47:0/2836005650 conn(0x7fb5bc0b1770 msgr2=0x7fb5bc0b0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:16.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.125+0000 7fb5c46c4640 1 -- 172.21.15.47:0/2836005650 shutdown_connections 2024-04-14T23:35:16.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.125+0000 7fb5c46c4640 1 -- 172.21.15.47:0/2836005650 wait complete. 2024-04-14T23:35:16.139 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T23:35:16.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.240+0000 7fb00d6de640 1 Processor -- start 2024-04-14T23:35:16.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.240+0000 7fb00d6de640 1 -- start start 2024-04-14T23:35:16.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.241+0000 7fb00d6de640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb0080b23c0 0x7fb0080b2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.241+0000 7fb00d6de640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0080cf550 con 0x7fb0080d00a0 2024-04-14T23:35:16.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.241+0000 7fb00d6de640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0080cef90 con 0x7fb00815c100 2024-04-14T23:35:16.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.241+0000 7fb00d6de640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fb0080ced30 con 0x7fb0080b23c0 2024-04-14T23:35:16.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.241+0000 7fb0077fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb0080d00a0 0x7fb0080d0480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60012/0 (socket says 172.21.15.47:60012) 2024-04-14T23:35:16.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.241+0000 7fb0077fe640 1 -- 172.21.15.47:0/2355601776 learned_addr learned my addr 172.21.15.47:0/2355601776 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:16.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.241+0000 7fb0067fc640 1 --2- 172.21.15.47:0/2355601776 >> v2:172.21.15.191:3300/0 conn(0x7fb0080b23c0 0x7fb0080b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.241+0000 7fb005ffb640 1 -- 172.21.15.47:0/2355601776 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 616682836 0 0) 0x7fb0080cf550 con 0x7fb0080d00a0 2024-04-14T23:35:16.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb005ffb640 1 -- 172.21.15.47:0/2355601776 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faff4003520 con 0x7fb0080d00a0 2024-04-14T23:35:16.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb005ffb640 1 -- 172.21.15.47:0/2355601776 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3196556967 0 0) 0x7faff4003520 con 0x7fb0080d00a0 2024-04-14T23:35:16.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb005ffb640 1 -- 172.21.15.47:0/2355601776 >> v2:172.21.15.191:3300/0 conn(0x7fb0080b23c0 msgr2=0x7fb0080b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:16.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb005ffb640 1 --2- 172.21.15.47:0/2355601776 >> v2:172.21.15.191:3300/0 conn(0x7fb0080b23c0 0x7fb0080b2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb005ffb640 1 -- 172.21.15.47:0/2355601776 >> v1:172.21.15.191:6789/0 conn(0x7fb00815c100 legacy=0x7fb0080ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb005ffb640 1 -- 172.21.15.47:0/2355601776 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0080cf270 con 0x7fb0080d00a0 2024-04-14T23:35:16.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb005ffb640 1 -- 172.21.15.47:0/2355601776 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7fb000001670 con 0x7fb0080d00a0 2024-04-14T23:35:16.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb005ffb640 1 -- 172.21.15.47:0/2355601776 >> v1:172.21.15.47:6789/0 conn(0x7fb0080d00a0 legacy=0x7fb0080d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb005ffb640 1 --2- 172.21.15.47:0/2355601776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faff40039b0 0x7faff4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb005ffb640 1 --2- 172.21.15.47:0/2355601776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faff4004800 0x7faff4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb005ffb640 1 --2- 172.21.15.47:0/2355601776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faff40051c0 0x7faff400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb005ffb640 1 -- 172.21.15.47:0/2355601776 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb0080ced30 con 0x7faff4004800 2024-04-14T23:35:16.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb005ffb640 1 -- 172.21.15.47:0/2355601776 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faff400c060 con 0x7faff40051c0 2024-04-14T23:35:16.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb005ffb640 1 -- 172.21.15.47:0/2355601776 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7faff400c260 con 0x7faff40039b0 2024-04-14T23:35:16.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb0067fc640 1 --2- 172.21.15.47:0/2355601776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faff4004800 0x7faff4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb006ffd640 1 --2- 172.21.15.47:0/2355601776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faff40039b0 0x7faff4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb0077fe640 1 --2- 172.21.15.47:0/2355601776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faff40051c0 0x7faff400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb0067fc640 1 -- 172.21.15.47:0/2355601776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faff40039b0 msgr2=0x7faff4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:16.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb0067fc640 1 --2- 172.21.15.47:0/2355601776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faff40039b0 0x7faff4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb0067fc640 1 -- 172.21.15.47:0/2355601776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faff40051c0 msgr2=0x7faff400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:16.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb0067fc640 1 --2- 172.21.15.47:0/2355601776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faff40051c0 0x7faff400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb0077fe640 1 -- 172.21.15.47:0/2355601776 reap_dead start 2024-04-14T23:35:16.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.242+0000 7fb0067fc640 1 -- 172.21.15.47:0/2355601776 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff4003520 con 0x7faff4004800 2024-04-14T23:35:16.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.243+0000 7fb0067fc640 1 --2- 172.21.15.47:0/2355601776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faff4004800 0x7faff4004c80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faff0009ac0 tx=0x7faff4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a704b4a5afda247 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:16.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.243+0000 7fb005ffb640 1 -- 172.21.15.47:0/2355601776 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0039070 con 0x7faff4004800 2024-04-14T23:35:16.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.243+0000 7fb005ffb640 1 -- 172.21.15.47:0/2355601776 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff002c6b0 con 0x7faff4004800 2024-04-14T23:35:16.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.243+0000 7fb005ffb640 1 -- 172.21.15.47:0/2355601776 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0009690 con 0x7faff4004800 2024-04-14T23:35:16.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.244+0000 7fb00d6de640 1 -- 172.21.15.47:0/2355601776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faff4004800 msgr2=0x7faff4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.244+0000 7fb00d6de640 1 --2- 172.21.15.47:0/2355601776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faff4004800 0x7faff4004c80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faff0009ac0 tx=0x7faff4005830 comp rx=0 tx=0).stop 2024-04-14T23:35:16.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.244+0000 7fb00d6de640 1 -- 172.21.15.47:0/2355601776 shutdown_connections 2024-04-14T23:35:16.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.244+0000 7fb00d6de640 1 --2- 172.21.15.47:0/2355601776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faff4004800 0x7faff4004c80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.244+0000 7fb00d6de640 1 -- 172.21.15.47:0/2355601776 >> 172.21.15.47:0/2355601776 conn(0x7fb00809aa30 msgr2=0x7fb00809ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:16.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.244+0000 7fb00d6de640 1 -- 172.21.15.47:0/2355601776 shutdown_connections 2024-04-14T23:35:16.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.244+0000 7fb00d6de640 1 -- 172.21.15.47:0/2355601776 wait complete. 2024-04-14T23:35:16.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.245+0000 7fb00d6de640 1 Processor -- start 2024-04-14T23:35:16.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.245+0000 7fb00d6de640 1 -- start start 2024-04-14T23:35:16.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fb00d6de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faff4004800 0x7fb0081592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fb00d6de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0080b16a0 0x7fb0080b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fb00d6de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0080b75b0 0x7fb008159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fb00d6de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb0080cfa10 con 0x7fb0080b75b0 2024-04-14T23:35:16.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fb00d6de640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb0080b1ea0 con 0x7fb0080b16a0 2024-04-14T23:35:16.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fb00d6de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb0080cfb90 con 0x7faff4004800 2024-04-14T23:35:16.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fb0077fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0080b75b0 0x7fb008159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fb0077fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0080b75b0 0x7fb008159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36194/0 (socket says 172.21.15.47:36194) 2024-04-14T23:35:16.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fb0077fe640 1 -- 172.21.15.47:0/3497038049 learned_addr learned my addr 172.21.15.47:0/3497038049 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:16.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fb0077fe640 1 -- 172.21.15.47:0/3497038049 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faff4004800 msgr2=0x7fb0081592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fb0077fe640 1 --2- 172.21.15.47:0/3497038049 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faff4004800 0x7fb0081592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fb0077fe640 1 -- 172.21.15.47:0/3497038049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0080b16a0 msgr2=0x7fb0080b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fb0077fe640 1 --2- 172.21.15.47:0/3497038049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0080b16a0 0x7fb0080b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fb0077fe640 1 -- 172.21.15.47:0/3497038049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0080b0380 con 0x7fb0080b75b0 2024-04-14T23:35:16.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fb0077fe640 1 --2- 172.21.15.47:0/3497038049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0080b75b0 0x7fb008159cc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb00815fac0 tx=0x7fb000007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:16.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fafff7fe640 1 -- 172.21.15.47:0/3497038049 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00001a070 con 0x7fb0080b75b0 2024-04-14T23:35:16.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fafff7fe640 1 -- 172.21.15.47:0/3497038049 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb000001620 con 0x7fb0080b75b0 2024-04-14T23:35:16.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fb00d6de640 1 -- 172.21.15.47:0/3497038049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0080b0600 con 0x7fb0080b75b0 2024-04-14T23:35:16.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.246+0000 7fafff7fe640 1 -- 172.21.15.47:0/3497038049 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00000fa80 con 0x7fb0080b75b0 2024-04-14T23:35:16.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.247+0000 7fb00d6de640 1 -- 172.21.15.47:0/3497038049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0080b0bc0 con 0x7fb0080b75b0 2024-04-14T23:35:16.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.247+0000 7fb00d6de640 1 -- 172.21.15.47:0/3497038049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0080681f0 con 0x7fb0080b75b0 2024-04-14T23:35:16.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.248+0000 7fafff7fe640 1 -- 172.21.15.47:0/3497038049 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb00001d070 con 0x7fb0080b75b0 2024-04-14T23:35:16.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.248+0000 7fafff7fe640 1 --2- 172.21.15.47:0/3497038049 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fafe806b990 0x7fafe806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.248+0000 7fafff7fe640 1 -- 172.21.15.47:0/3497038049 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb00008a050 con 0x7fb0080b75b0 2024-04-14T23:35:16.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.248+0000 7fb006ffd640 1 --2- 172.21.15.47:0/3497038049 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fafe806b990 0x7fafe806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.249+0000 7fb006ffd640 1 --2- 172.21.15.47:0/3497038049 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fafe806b990 0x7fafe806de50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faff8000f80 tx=0x7faff8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:16.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.253+0000 7fafff7fe640 1 -- 172.21.15.47:0/3497038049 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb0080b0380 con 0x7fb0080b75b0 2024-04-14T23:35:16.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.431+0000 7fb00d6de640 1 -- 172.21.15.47:0/3497038049 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb008070be0 con 0x7fb0080b75b0 2024-04-14T23:35:16.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.431+0000 7fafff7fe640 1 -- 172.21.15.47:0/3497038049 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fb000058920 con 0x7fb0080b75b0 2024-04-14T23:35:16.434 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-14T23:35:16.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.433+0000 7fb00d6de640 1 -- 172.21.15.47:0/3497038049 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fafe806b990 msgr2=0x7fafe806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.433+0000 7fb00d6de640 1 --2- 172.21.15.47:0/3497038049 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fafe806b990 0x7fafe806de50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faff8000f80 tx=0x7faff8009040 comp rx=0 tx=0).stop 2024-04-14T23:35:16.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.433+0000 7fb00d6de640 1 -- 172.21.15.47:0/3497038049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0080b75b0 msgr2=0x7fb008159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.433+0000 7fb00d6de640 1 --2- 172.21.15.47:0/3497038049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0080b75b0 0x7fb008159cc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb00815fac0 tx=0x7fb000007720 comp rx=0 tx=0).stop 2024-04-14T23:35:16.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.433+0000 7fb00d6de640 1 -- 172.21.15.47:0/3497038049 shutdown_connections 2024-04-14T23:35:16.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.433+0000 7fb00d6de640 1 --2- 172.21.15.47:0/3497038049 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fafe806b990 0x7fafe806de50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.433+0000 7fb00d6de640 1 --2- 172.21.15.47:0/3497038049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0080b75b0 0x7fb008159cc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.433+0000 7fb00d6de640 1 --2- 172.21.15.47:0/3497038049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0080b16a0 0x7fb0080b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.433+0000 7fb00d6de640 1 --2- 172.21.15.47:0/3497038049 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faff4004800 0x7fb0081592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.433+0000 7fb00d6de640 1 -- 172.21.15.47:0/3497038049 >> 172.21.15.47:0/3497038049 conn(0x7fb00809aa30 msgr2=0x7fb00809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:16.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.433+0000 7fb00d6de640 1 -- 172.21.15.47:0/3497038049 shutdown_connections 2024-04-14T23:35:16.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.433+0000 7fb00d6de640 1 -- 172.21.15.47:0/3497038049 wait complete. 2024-04-14T23:35:16.447 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T23:35:16.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.548+0000 7f656691e640 1 Processor -- start 2024-04-14T23:35:16.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.548+0000 7f656691e640 1 -- start start 2024-04-14T23:35:16.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.549+0000 7f656691e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f656015fc60 0x7f65601600c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.549+0000 7f656691e640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f65600702b0 0x7f6560070720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.549+0000 7f656691e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65600cfc30 con 0x7f656015bfb0 2024-04-14T23:35:16.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.549+0000 7f656691e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6560160600 con 0x7f656015fc60 2024-04-14T23:35:16.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.549+0000 7f656691e640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f65600cff10 con 0x7f65600702b0 2024-04-14T23:35:16.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.549+0000 7f655f7fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f656015fc60 0x7f65601600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.549+0000 7f655f7fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f656015fc60 0x7f65601600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36198/0 (socket says 172.21.15.47:36198) 2024-04-14T23:35:16.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.549+0000 7f655f7fe640 1 -- 172.21.15.47:0/2632378920 learned_addr learned my addr 172.21.15.47:0/2632378920 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:16.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.549+0000 7f6564ebb640 1 --2- 172.21.15.47:0/2632378920 >> v2:172.21.15.191:3300/0 conn(0x7f65600702b0 0x7f6560070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.549+0000 7f655f7fe640 1 -- 172.21.15.47:0/2632378920 >> v2:172.21.15.191:3300/0 conn(0x7f65600702b0 msgr2=0x7f6560070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:16.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.549+0000 7f655f7fe640 1 --2- 172.21.15.47:0/2632378920 >> v2:172.21.15.191:3300/0 conn(0x7f65600702b0 0x7f6560070720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.549+0000 7f655f7fe640 1 -- 172.21.15.47:0/2632378920 >> v1:172.21.15.191:6789/0 conn(0x7f656015bfb0 legacy=0x7f65600cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.549+0000 7f655f7fe640 1 -- 172.21.15.47:0/2632378920 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65600d01f0 con 0x7f656015fc60 2024-04-14T23:35:16.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.550+0000 7f655f7fe640 1 --2- 172.21.15.47:0/2632378920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f656015fc60 0x7f65601600c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6560071af0 tx=0x7f655002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecefd95bb9926c1f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:16.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.550+0000 7f655effd640 1 -- 172.21.15.47:0/2632378920 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6550034070 con 0x7f656015fc60 2024-04-14T23:35:16.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.550+0000 7f655effd640 1 -- 172.21.15.47:0/2632378920 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6550030860 con 0x7f656015fc60 2024-04-14T23:35:16.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.550+0000 7f655effd640 1 -- 172.21.15.47:0/2632378920 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6550030c30 con 0x7f656015fc60 2024-04-14T23:35:16.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.551+0000 7f656691e640 1 -- 172.21.15.47:0/2632378920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f656015fc60 msgr2=0x7f65601600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.551+0000 7f656691e640 1 --2- 172.21.15.47:0/2632378920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f656015fc60 0x7f65601600c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6560071af0 tx=0x7f655002b9a0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.551+0000 7f656691e640 1 -- 172.21.15.47:0/2632378920 shutdown_connections 2024-04-14T23:35:16.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.551+0000 7f656691e640 1 --2- 172.21.15.47:0/2632378920 >> v2:172.21.15.191:3300/0 conn(0x7f65600702b0 0x7f6560070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.551+0000 7f656691e640 1 --2- 172.21.15.47:0/2632378920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f656015fc60 0x7f65601600c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.551+0000 7f656691e640 1 -- 172.21.15.47:0/2632378920 >> 172.21.15.47:0/2632378920 conn(0x7f65600b37d0 msgr2=0x7f65600b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:16.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.551+0000 7f656691e640 1 -- 172.21.15.47:0/2632378920 shutdown_connections 2024-04-14T23:35:16.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.551+0000 7f656691e640 1 -- 172.21.15.47:0/2632378920 wait complete. 2024-04-14T23:35:16.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.552+0000 7f656691e640 1 Processor -- start 2024-04-14T23:35:16.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.552+0000 7f656691e640 1 -- start start 2024-04-14T23:35:16.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f656691e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f65600702b0 0x7f656015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f656691e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f656015bfb0 0x7f65601e73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f656691e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f656015fc60 0x7f65600c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f656691e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f65600d0cd0 con 0x7f656015fc60 2024-04-14T23:35:16.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f656691e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f65600d07b0 con 0x7f656015bfb0 2024-04-14T23:35:16.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f656691e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f65600cdb60 con 0x7f65600702b0 2024-04-14T23:35:16.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f6564ebb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f656015fc60 0x7f65600c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f6564ebb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f656015fc60 0x7f65600c72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36214/0 (socket says 172.21.15.47:36214) 2024-04-14T23:35:16.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f6564ebb640 1 -- 172.21.15.47:0/3691948798 learned_addr learned my addr 172.21.15.47:0/3691948798 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:16.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f655ffff640 1 --2- 172.21.15.47:0/3691948798 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f65600702b0 0x7f656015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f655f7fe640 1 --2- 172.21.15.47:0/3691948798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f656015bfb0 0x7f65601e73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f6564ebb640 1 -- 172.21.15.47:0/3691948798 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f65600702b0 msgr2=0x7f656015a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f6564ebb640 1 --2- 172.21.15.47:0/3691948798 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f65600702b0 0x7f656015a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f6564ebb640 1 -- 172.21.15.47:0/3691948798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f656015bfb0 msgr2=0x7f65601e73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f6564ebb640 1 --2- 172.21.15.47:0/3691948798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f656015bfb0 0x7f65601e73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f6564ebb640 1 -- 172.21.15.47:0/3691948798 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65601e6390 con 0x7f656015fc60 2024-04-14T23:35:16.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f6564ebb640 1 --2- 172.21.15.47:0/3691948798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f656015fc60 0x7f65600c72f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6558007e60 tx=0x7f655800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:16.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f655cff9640 1 -- 172.21.15.47:0/3691948798 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558014420 con 0x7f656015fc60 2024-04-14T23:35:16.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f655cff9640 1 -- 172.21.15.47:0/3691948798 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6558019070 con 0x7f656015fc60 2024-04-14T23:35:16.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f656691e640 1 -- 172.21.15.47:0/3691948798 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f656015a820 con 0x7f656015fc60 2024-04-14T23:35:16.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f655cff9640 1 -- 172.21.15.47:0/3691948798 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558014820 con 0x7f656015fc60 2024-04-14T23:35:16.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.553+0000 7f656691e640 1 -- 172.21.15.47:0/3691948798 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65601e68f0 con 0x7f656015fc60 2024-04-14T23:35:16.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.554+0000 7f656691e640 1 -- 172.21.15.47:0/3691948798 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6560073f50 con 0x7f656015fc60 2024-04-14T23:35:16.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.555+0000 7f655cff9640 1 -- 172.21.15.47:0/3691948798 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f65580149c0 con 0x7f656015fc60 2024-04-14T23:35:16.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.555+0000 7f655cff9640 1 --2- 172.21.15.47:0/3691948798 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f654c06b990 0x7f654c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.555+0000 7f655cff9640 1 -- 172.21.15.47:0/3691948798 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f655808b3d0 con 0x7f656015fc60 2024-04-14T23:35:16.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.555+0000 7f655ffff640 1 --2- 172.21.15.47:0/3691948798 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f654c06b990 0x7f654c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.556+0000 7f655ffff640 1 --2- 172.21.15.47:0/3691948798 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f654c06b990 0x7f654c06de50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6554007fd0 tx=0x7f6554009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:16.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.559+0000 7f655cff9640 1 -- 172.21.15.47:0/3691948798 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f65601e6390 con 0x7f656015fc60 2024-04-14T23:35:16.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.739+0000 7f656691e640 1 -- 172.21.15.47:0/3691948798 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f65600c5290 con 0x7f656015fc60 2024-04-14T23:35:16.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.739+0000 7f655cff9640 1 -- 172.21.15.47:0/3691948798 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f6558059ca0 con 0x7f656015fc60 2024-04-14T23:35:16.743 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.741+0000 7f656691e640 1 -- 172.21.15.47:0/3691948798 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f654c06b990 msgr2=0x7f654c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.741+0000 7f656691e640 1 --2- 172.21.15.47:0/3691948798 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f654c06b990 0x7f654c06de50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6554007fd0 tx=0x7f6554009040 comp rx=0 tx=0).stop 2024-04-14T23:35:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.741+0000 7f656691e640 1 -- 172.21.15.47:0/3691948798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f656015fc60 msgr2=0x7f65600c72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.741+0000 7f656691e640 1 --2- 172.21.15.47:0/3691948798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f656015fc60 0x7f65600c72f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6558007e60 tx=0x7f655800e4b0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.741+0000 7f656691e640 1 -- 172.21.15.47:0/3691948798 shutdown_connections 2024-04-14T23:35:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.741+0000 7f656691e640 1 --2- 172.21.15.47:0/3691948798 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f654c06b990 0x7f654c06de50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.741+0000 7f656691e640 1 --2- 172.21.15.47:0/3691948798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f656015fc60 0x7f65600c72f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.741+0000 7f656691e640 1 --2- 172.21.15.47:0/3691948798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f656015bfb0 0x7f65601e73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.741+0000 7f656691e640 1 --2- 172.21.15.47:0/3691948798 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f65600702b0 0x7f656015a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.741+0000 7f656691e640 1 -- 172.21.15.47:0/3691948798 >> 172.21.15.47:0/3691948798 conn(0x7f65600b37d0 msgr2=0x7f65600b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:16.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.741+0000 7f656691e640 1 -- 172.21.15.47:0/3691948798 shutdown_connections 2024-04-14T23:35:16.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.741+0000 7f656691e640 1 -- 172.21.15.47:0/3691948798 wait complete. 2024-04-14T23:35:16.756 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:16.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.856+0000 7fe3af2de640 1 Processor -- start 2024-04-14T23:35:16.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.856+0000 7fe3af2de640 1 -- start start 2024-04-14T23:35:16.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.857+0000 7fe3af2de640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe3a80d1e00 0x7fe3a80d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.857+0000 7fe3af2de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3a80d2740 0x7fe3a80b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.857+0000 7fe3af2de640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a80d1620 con 0x7fe3a815e270 2024-04-14T23:35:16.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.857+0000 7fe3af2de640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fe3a80b4300 con 0x7fe3a80d1e00 2024-04-14T23:35:16.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.857+0000 7fe3af2de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a80d2b80 con 0x7fe3a80d2740 2024-04-14T23:35:16.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.857+0000 7fe3ad07a640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe3a815e270 0x7fe3a80d0f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60020/0 (socket says 172.21.15.47:60020) 2024-04-14T23:35:16.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.857+0000 7fe3ad07a640 1 -- 172.21.15.47:0/715112844 learned_addr learned my addr 172.21.15.47:0/715112844 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:16.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3a7fff640 1 -- 172.21.15.47:0/715112844 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3227880651 0 0) 0x7fe3a80d1620 con 0x7fe3a815e270 2024-04-14T23:35:16.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3a7fff640 1 -- 172.21.15.47:0/715112844 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe390003520 con 0x7fe3a815e270 2024-04-14T23:35:16.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3ad87b640 1 --2- 172.21.15.47:0/715112844 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3a80d2740 0x7fe3a80b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3ac879640 1 --2- 172.21.15.47:0/715112844 >> v2:172.21.15.191:3300/0 conn(0x7fe3a80d1e00 0x7fe3a80d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3a7fff640 1 -- 172.21.15.47:0/715112844 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 972992865 0 0) 0x7fe390003520 con 0x7fe3a815e270 2024-04-14T23:35:16.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3a7fff640 1 -- 172.21.15.47:0/715112844 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3a80d2740 msgr2=0x7fe3a80b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:16.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3a7fff640 1 --2- 172.21.15.47:0/715112844 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3a80d2740 0x7fe3a80b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3a7fff640 1 -- 172.21.15.47:0/715112844 >> v2:172.21.15.191:3300/0 conn(0x7fe3a80d1e00 msgr2=0x7fe3a80d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:16.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3a7fff640 1 --2- 172.21.15.47:0/715112844 >> v2:172.21.15.191:3300/0 conn(0x7fe3a80d1e00 0x7fe3a80d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3a7fff640 1 -- 172.21.15.47:0/715112844 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a80b39d0 con 0x7fe3a815e270 2024-04-14T23:35:16.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3a7fff640 1 -- 172.21.15.47:0/715112844 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7fe3a0001670 con 0x7fe3a815e270 2024-04-14T23:35:16.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3ac879640 1 --2- 172.21.15.47:0/715112844 >> v2:172.21.15.191:3300/0 conn(0x7fe3a80d1e00 0x7fe3a80d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:16.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3a7fff640 1 -- 172.21.15.47:0/715112844 >> v1:172.21.15.47:6789/0 conn(0x7fe3a815e270 legacy=0x7fe3a80d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3a7fff640 1 --2- 172.21.15.47:0/715112844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3900039b0 0x7fe390003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3a7fff640 1 --2- 172.21.15.47:0/715112844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe390004800 0x7fe390004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3a7fff640 1 --2- 172.21.15.47:0/715112844 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3a80d2740 0x7fe3900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3a7fff640 1 -- 172.21.15.47:0/715112844 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a80b4300 con 0x7fe390004800 2024-04-14T23:35:16.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3a7fff640 1 -- 172.21.15.47:0/715112844 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a80d2b80 con 0x7fe3900039b0 2024-04-14T23:35:16.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3a7fff640 1 -- 172.21.15.47:0/715112844 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe39000ba70 con 0x7fe3a80d2740 2024-04-14T23:35:16.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3ac879640 1 --2- 172.21.15.47:0/715112844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe390004800 0x7fe390004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3ad07a640 1 --2- 172.21.15.47:0/715112844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3900039b0 0x7fe390003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3ad87b640 1 --2- 172.21.15.47:0/715112844 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3a80d2740 0x7fe3900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3ac879640 1 -- 172.21.15.47:0/715112844 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3a80d2740 msgr2=0x7fe3900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:16.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3ac879640 1 --2- 172.21.15.47:0/715112844 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3a80d2740 0x7fe3900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3ac879640 1 -- 172.21.15.47:0/715112844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3900039b0 msgr2=0x7fe390003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:16.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3ac879640 1 --2- 172.21.15.47:0/715112844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3900039b0 0x7fe390003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.858+0000 7fe3ac879640 1 -- 172.21.15.47:0/715112844 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe390003520 con 0x7fe390004800 2024-04-14T23:35:16.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.859+0000 7fe3ac879640 1 --2- 172.21.15.47:0/715112844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe390004800 0x7fe390004c80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe3a808e1c0 tx=0x7fe390005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ee3b1b4d1e88a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:16.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.859+0000 7fe3a7fff640 1 -- 172.21.15.47:0/715112844 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c034070 con 0x7fe390004800 2024-04-14T23:35:16.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.859+0000 7fe3a7fff640 1 -- 172.21.15.47:0/715112844 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39c030680 con 0x7fe390004800 2024-04-14T23:35:16.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.859+0000 7fe3a7fff640 1 -- 172.21.15.47:0/715112844 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00f040 con 0x7fe390004800 2024-04-14T23:35:16.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.860+0000 7fe3af2de640 1 -- 172.21.15.47:0/715112844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe390004800 msgr2=0x7fe390004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.860+0000 7fe3af2de640 1 --2- 172.21.15.47:0/715112844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe390004800 0x7fe390004c80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe3a808e1c0 tx=0x7fe390005830 comp rx=0 tx=0).stop 2024-04-14T23:35:16.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.860+0000 7fe3ad87b640 1 -- 172.21.15.47:0/715112844 reap_dead start 2024-04-14T23:35:16.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.860+0000 7fe3af2de640 1 -- 172.21.15.47:0/715112844 shutdown_connections 2024-04-14T23:35:16.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.860+0000 7fe3af2de640 1 -- 172.21.15.47:0/715112844 >> 172.21.15.47:0/715112844 conn(0x7fe3a80d3ed0 msgr2=0x7fe3a80d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:16.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.860+0000 7fe3af2de640 1 -- 172.21.15.47:0/715112844 shutdown_connections 2024-04-14T23:35:16.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.860+0000 7fe3af2de640 1 -- 172.21.15.47:0/715112844 wait complete. 2024-04-14T23:35:16.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.861+0000 7fe3af2de640 1 Processor -- start 2024-04-14T23:35:16.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.861+0000 7fe3af2de640 1 -- start start 2024-04-14T23:35:16.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3af2de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe390004800 0x7fe3a80b8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3af2de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a80b7ac0 0x7fe3a81f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3af2de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3a8160b70 0x7fe3a8160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3af2de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a80b0c60 con 0x7fe3a80b7ac0 2024-04-14T23:35:16.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3af2de640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a80b3f90 con 0x7fe390004800 2024-04-14T23:35:16.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3af2de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a815e650 con 0x7fe3a8160b70 2024-04-14T23:35:16.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3ac879640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a80b7ac0 0x7fe3a81f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3ac879640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a80b7ac0 0x7fe3a81f3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36228/0 (socket says 172.21.15.47:36228) 2024-04-14T23:35:16.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3ac879640 1 -- 172.21.15.47:0/2305446853 learned_addr learned my addr 172.21.15.47:0/2305446853 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:16.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3ad07a640 1 --2- 172.21.15.47:0/2305446853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe390004800 0x7fe3a80b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3ad87b640 1 --2- 172.21.15.47:0/2305446853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3a8160b70 0x7fe3a8160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3ac879640 1 -- 172.21.15.47:0/2305446853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3a8160b70 msgr2=0x7fe3a8160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3ac879640 1 --2- 172.21.15.47:0/2305446853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3a8160b70 0x7fe3a8160ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3ac879640 1 -- 172.21.15.47:0/2305446853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe390004800 msgr2=0x7fe3a80b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:16.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3ac879640 1 --2- 172.21.15.47:0/2305446853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe390004800 0x7fe3a80b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:16.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3ac879640 1 -- 172.21.15.47:0/2305446853 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a80b8cc0 con 0x7fe3a80b7ac0 2024-04-14T23:35:16.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3ad07a640 1 --2- 172.21.15.47:0/2305446853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe390004800 0x7fe3a80b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:16.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.862+0000 7fe3ac879640 1 --2- 172.21.15.47:0/2305446853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a80b7ac0 0x7fe3a81f3420 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe39c000c00 tx=0x7fe39c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:16.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.863+0000 7fe3a5ffb640 1 -- 172.21.15.47:0/2305446853 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c034040 con 0x7fe3a80b7ac0 2024-04-14T23:35:16.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.863+0000 7fe3a5ffb640 1 -- 172.21.15.47:0/2305446853 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39c00f000 con 0x7fe3a80b7ac0 2024-04-14T23:35:16.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.863+0000 7fe3af2de640 1 -- 172.21.15.47:0/2305446853 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a80b8fa0 con 0x7fe3a80b7ac0 2024-04-14T23:35:16.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.863+0000 7fe3a5ffb640 1 -- 172.21.15.47:0/2305446853 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c03a9a0 con 0x7fe3a80b7ac0 2024-04-14T23:35:16.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.863+0000 7fe3af2de640 1 -- 172.21.15.47:0/2305446853 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a80b9560 con 0x7fe3a80b7ac0 2024-04-14T23:35:16.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.864+0000 7fe3af2de640 1 -- 172.21.15.47:0/2305446853 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3a8075430 con 0x7fe3a80b7ac0 2024-04-14T23:35:16.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.864+0000 7fe3a5ffb640 1 -- 172.21.15.47:0/2305446853 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe39c037070 con 0x7fe3a80b7ac0 2024-04-14T23:35:16.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.865+0000 7fe3a5ffb640 1 --2- 172.21.15.47:0/2305446853 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe39406b9c0 0x7fe39406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:16.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.865+0000 7fe3a5ffb640 1 -- 172.21.15.47:0/2305446853 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe39c0acaa0 con 0x7fe3a80b7ac0 2024-04-14T23:35:16.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.865+0000 7fe3ad07a640 1 --2- 172.21.15.47:0/2305446853 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe39406b9c0 0x7fe39406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:16.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.866+0000 7fe3ad07a640 1 --2- 172.21.15.47:0/2305446853 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe39406b9c0 0x7fe39406de80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0000fb0 tx=0x7fe3a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:16.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:16.869+0000 7fe3a5ffb640 1 -- 172.21.15.47:0/2305446853 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe39c07b400 con 0x7fe3a80b7ac0 2024-04-14T23:35:17.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.054+0000 7fe3af2de640 1 -- 172.21.15.47:0/2305446853 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3a80b7f40 con 0x7fe3a80b7ac0 2024-04-14T23:35:17.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.055+0000 7fe3a5ffb640 1 -- 172.21.15.47:0/2305446853 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7fe39c07ad00 con 0x7fe3a80b7ac0 2024-04-14T23:35:17.058 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:17.059 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:44.714882+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:17.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.057+0000 7fe3af2de640 1 -- 172.21.15.47:0/2305446853 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe39406b9c0 msgr2=0x7fe39406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.057+0000 7fe3af2de640 1 --2- 172.21.15.47:0/2305446853 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe39406b9c0 0x7fe39406de80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0000fb0 tx=0x7fe3a0009040 comp rx=0 tx=0).stop 2024-04-14T23:35:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.057+0000 7fe3af2de640 1 -- 172.21.15.47:0/2305446853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a80b7ac0 msgr2=0x7fe3a81f3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.057+0000 7fe3af2de640 1 --2- 172.21.15.47:0/2305446853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a80b7ac0 0x7fe3a81f3420 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe39c000c00 tx=0x7fe39c004730 comp rx=0 tx=0).stop 2024-04-14T23:35:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.057+0000 7fe3af2de640 1 -- 172.21.15.47:0/2305446853 shutdown_connections 2024-04-14T23:35:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.057+0000 7fe3af2de640 1 --2- 172.21.15.47:0/2305446853 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe39406b9c0 0x7fe39406de80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.057+0000 7fe3af2de640 1 --2- 172.21.15.47:0/2305446853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3a8160b70 0x7fe3a8160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.057+0000 7fe3af2de640 1 --2- 172.21.15.47:0/2305446853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a80b7ac0 0x7fe3a81f3420 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.057+0000 7fe3af2de640 1 --2- 172.21.15.47:0/2305446853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe390004800 0x7fe3a80b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.057+0000 7fe3af2de640 1 -- 172.21.15.47:0/2305446853 >> 172.21.15.47:0/2305446853 conn(0x7fe3a80d3ed0 msgr2=0x7fe3a80cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.057+0000 7fe3af2de640 1 -- 172.21.15.47:0/2305446853 shutdown_connections 2024-04-14T23:35:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.057+0000 7fe3af2de640 1 -- 172.21.15.47:0/2305446853 wait complete. 2024-04-14T23:35:17.071 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T23:34:36.382034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T23:34:37.023103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T23:34:40.726418+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T23:35:17.072 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:35:17.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.174+0000 7f2d19a69640 1 Processor -- start 2024-04-14T23:35:17.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.174+0000 7f2d19a69640 1 -- start start 2024-04-14T23:35:17.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.174+0000 7f2d19a69640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d14073590 0x7f2d140b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.174+0000 7f2d19a69640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2d140b1590 0x7f2d140ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.175+0000 7f2d19a69640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d140d0a10 con 0x7f2d1415e2e0 2024-04-14T23:35:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.175+0000 7f2d19a69640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f2d140b19c0 con 0x7f2d140b1590 2024-04-14T23:35:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.175+0000 7f2d19a69640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f2d140d0cf0 con 0x7f2d14073590 2024-04-14T23:35:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.175+0000 7f2d137fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f2d1415e2e0 0x7f2d140cffe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60036/0 (socket says 172.21.15.47:60036) 2024-04-14T23:35:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.175+0000 7f2d137fe640 1 -- 172.21.15.47:0/3278104587 learned_addr learned my addr 172.21.15.47:0/3278104587 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.175+0000 7f2d13fff640 1 --2- 172.21.15.47:0/3278104587 >> v2:172.21.15.191:3300/0 conn(0x7f2d140b1590 0x7f2d140ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.175+0000 7f2d12ffd640 1 --2- 172.21.15.47:0/3278104587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d14073590 0x7f2d140b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.175+0000 7f2d127fc640 1 -- 172.21.15.47:0/3278104587 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2239477189 0 0) 0x7f2d140d0a10 con 0x7f2d1415e2e0 2024-04-14T23:35:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.175+0000 7f2d127fc640 1 -- 172.21.15.47:0/3278104587 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cfc003520 con 0x7f2d1415e2e0 2024-04-14T23:35:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.175+0000 7f2d127fc640 1 -- 172.21.15.47:0/3278104587 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 633044600 0 0) 0x7f2cfc003520 con 0x7f2d1415e2e0 2024-04-14T23:35:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.175+0000 7f2d13fff640 1 -- 172.21.15.47:0/3278104587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d14073590 msgr2=0x7f2d140b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.175+0000 7f2d13fff640 1 --2- 172.21.15.47:0/3278104587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d14073590 0x7f2d140b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.175+0000 7f2d13fff640 1 -- 172.21.15.47:0/3278104587 >> v1:172.21.15.47:6789/0 conn(0x7f2d1415e2e0 legacy=0x7f2d140cffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.175+0000 7f2d13fff640 1 -- 172.21.15.47:0/3278104587 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d140d0fd0 con 0x7f2d140b1590 2024-04-14T23:35:17.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.175+0000 7f2d12ffd640 1 --2- 172.21.15.47:0/3278104587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d14073590 0x7f2d140b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:17.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.176+0000 7f2d13fff640 1 --2- 172.21.15.47:0/3278104587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d140b1590 0x7f2d140ad860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009d90 tx=0x7f2d0c02bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e1d07a2af4e15aa server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:17.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.176+0000 7f2d127fc640 1 -- 172.21.15.47:0/3278104587 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c039070 con 0x7f2d140b1590 2024-04-14T23:35:17.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.176+0000 7f2d127fc640 1 -- 172.21.15.47:0/3278104587 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0c02c810 con 0x7f2d140b1590 2024-04-14T23:35:17.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.176+0000 7f2d127fc640 1 -- 172.21.15.47:0/3278104587 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04001670 con 0x7f2d140b1590 2024-04-14T23:35:17.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.177+0000 7f2d19a69640 1 -- 172.21.15.47:0/3278104587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d140b1590 msgr2=0x7f2d140ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.177+0000 7f2d19a69640 1 --2- 172.21.15.47:0/3278104587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d140b1590 0x7f2d140ad860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009d90 tx=0x7f2d0c02bce0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.177+0000 7f2d19a69640 1 -- 172.21.15.47:0/3278104587 shutdown_connections 2024-04-14T23:35:17.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.177+0000 7f2d19a69640 1 --2- 172.21.15.47:0/3278104587 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d14073590 0x7f2d140b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.177+0000 7f2d19a69640 1 --2- 172.21.15.47:0/3278104587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d140b1590 0x7f2d140ad860 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.177+0000 7f2d19a69640 1 -- 172.21.15.47:0/3278104587 >> 172.21.15.47:0/3278104587 conn(0x7f2d14072920 msgr2=0x7f2d14072d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:17.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.177+0000 7f2d19a69640 1 -- 172.21.15.47:0/3278104587 shutdown_connections 2024-04-14T23:35:17.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.177+0000 7f2d19a69640 1 -- 172.21.15.47:0/3278104587 wait complete. 2024-04-14T23:35:17.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.178+0000 7f2d19a69640 1 Processor -- start 2024-04-14T23:35:17.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.178+0000 7f2d19a69640 1 -- start start 2024-04-14T23:35:17.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d19a69640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d14073590 0x7f2d1415d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d19a69640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d140b1590 0x7f2d140c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d19a69640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1415e2e0 0x7f2d140b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d19a69640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1415e840 con 0x7f2d1415e2e0 2024-04-14T23:35:17.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d19a69640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1415e6c0 con 0x7f2d14073590 2024-04-14T23:35:17.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d19a69640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f2d140adda0 con 0x7f2d140b1590 2024-04-14T23:35:17.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d13fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1415e2e0 0x7f2d140b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:17.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d13fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1415e2e0 0x7f2d140b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36240/0 (socket says 172.21.15.47:36240) 2024-04-14T23:35:17.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d13fff640 1 -- 172.21.15.47:0/3397077469 learned_addr learned my addr 172.21.15.47:0/3397077469 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:17.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d13fff640 1 -- 172.21.15.47:0/3397077469 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d140b1590 msgr2=0x7f2d140c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d137fe640 1 --2- 172.21.15.47:0/3397077469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d14073590 0x7f2d1415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:17.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d12ffd640 1 --2- 172.21.15.47:0/3397077469 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d140b1590 0x7f2d140c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:17.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d13fff640 1 --2- 172.21.15.47:0/3397077469 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d140b1590 0x7f2d140c7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d13fff640 1 -- 172.21.15.47:0/3397077469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d14073590 msgr2=0x7f2d1415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d13fff640 1 --2- 172.21.15.47:0/3397077469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d14073590 0x7f2d1415d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d13fff640 1 -- 172.21.15.47:0/3397077469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d140c8880 con 0x7f2d1415e2e0 2024-04-14T23:35:17.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2d13fff640 1 --2- 172.21.15.47:0/3397077469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1415e2e0 0x7f2d140b4880 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c037040 tx=0x7f2d0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:17.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.179+0000 7f2cfbfff640 1 -- 172.21.15.47:0/3397077469 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c039050 con 0x7f2d1415e2e0 2024-04-14T23:35:17.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.180+0000 7f2cfbfff640 1 -- 172.21.15.47:0/3397077469 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0c045070 con 0x7f2d1415e2e0 2024-04-14T23:35:17.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.180+0000 7f2d19a69640 1 -- 172.21.15.47:0/3397077469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d140c8b60 con 0x7f2d1415e2e0 2024-04-14T23:35:17.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.180+0000 7f2cfbfff640 1 -- 172.21.15.47:0/3397077469 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c009450 con 0x7f2d1415e2e0 2024-04-14T23:35:17.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.180+0000 7f2d19a69640 1 -- 172.21.15.47:0/3397077469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d140c9120 con 0x7f2d1415e2e0 2024-04-14T23:35:17.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.180+0000 7f2d19a69640 1 -- 172.21.15.47:0/3397077469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d140cab10 con 0x7f2d1415e2e0 2024-04-14T23:35:17.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.181+0000 7f2cfbfff640 1 -- 172.21.15.47:0/3397077469 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f2d0c040690 con 0x7f2d1415e2e0 2024-04-14T23:35:17.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.181+0000 7f2cfbfff640 1 --2- 172.21.15.47:0/3397077469 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d0006b990 0x7f2d0006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.181+0000 7f2cfbfff640 1 -- 172.21.15.47:0/3397077469 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2d0c0ad370 con 0x7f2d1415e2e0 2024-04-14T23:35:17.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.181+0000 7f2d137fe640 1 --2- 172.21.15.47:0/3397077469 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d0006b990 0x7f2d0006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:17.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.182+0000 7f2d137fe640 1 --2- 172.21.15.47:0/3397077469 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d0006b990 0x7f2d0006de50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2d040011e0 tx=0x7f2d04009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:17.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.186+0000 7f2cfbfff640 1 -- 172.21.15.47:0/3397077469 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2d140cab10 con 0x7f2d1415e2e0 2024-04-14T23:35:17.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.366+0000 7f2d19a69640 1 -- 172.21.15.47:0/3397077469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2d14073f50 con 0x7f2d1415e2e0 2024-04-14T23:35:17.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.367+0000 7f2cfbfff640 1 -- 172.21.15.47:0/3397077469 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f2d0c07bc50 con 0x7f2d1415e2e0 2024-04-14T23:35:17.370 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:35:17.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.369+0000 7f2d19a69640 1 -- 172.21.15.47:0/3397077469 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d0006b990 msgr2=0x7f2d0006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.369+0000 7f2d19a69640 1 --2- 172.21.15.47:0/3397077469 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d0006b990 0x7f2d0006de50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2d040011e0 tx=0x7f2d04009040 comp rx=0 tx=0).stop 2024-04-14T23:35:17.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.369+0000 7f2d19a69640 1 -- 172.21.15.47:0/3397077469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1415e2e0 msgr2=0x7f2d140b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.369+0000 7f2d19a69640 1 --2- 172.21.15.47:0/3397077469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1415e2e0 0x7f2d140b4880 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c037040 tx=0x7f2d0c004a40 comp rx=0 tx=0).stop 2024-04-14T23:35:17.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.369+0000 7f2d19a69640 1 -- 172.21.15.47:0/3397077469 shutdown_connections 2024-04-14T23:35:17.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.369+0000 7f2d19a69640 1 --2- 172.21.15.47:0/3397077469 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f2d0006b990 0x7f2d0006de50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.369+0000 7f2d19a69640 1 --2- 172.21.15.47:0/3397077469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1415e2e0 0x7f2d140b4880 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.369+0000 7f2d19a69640 1 --2- 172.21.15.47:0/3397077469 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2d140b1590 0x7f2d140c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.369+0000 7f2d19a69640 1 --2- 172.21.15.47:0/3397077469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d14073590 0x7f2d1415d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.369+0000 7f2d19a69640 1 -- 172.21.15.47:0/3397077469 >> 172.21.15.47:0/3397077469 conn(0x7f2d14072920 msgr2=0x7f2d140afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:17.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.369+0000 7f2d19a69640 1 -- 172.21.15.47:0/3397077469 shutdown_connections 2024-04-14T23:35:17.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.369+0000 7f2d19a69640 1 -- 172.21.15.47:0/3397077469 wait complete. 2024-04-14T23:35:17.383 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T23:35:17.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.484+0000 7f32c6f55640 1 Processor -- start 2024-04-14T23:35:17.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.484+0000 7f32c6f55640 1 -- start start 2024-04-14T23:35:17.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.485+0000 7f32c6f55640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f32c00ceae0 0x7f32c00d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.485+0000 7f32c6f55640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32c015e7b0 con 0x7f32c00c7050 2024-04-14T23:35:17.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.485+0000 7f32c6f55640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32c006f810 con 0x7f32c006b910 2024-04-14T23:35:17.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.485+0000 7f32c6f55640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f32c006faf0 con 0x7f32c00ceae0 2024-04-14T23:35:17.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.485+0000 7f32c4cf1640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f32c00c7050 0x7f32c006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60040/0 (socket says 172.21.15.47:60040) 2024-04-14T23:35:17.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.485+0000 7f32c4cf1640 1 -- 172.21.15.47:0/389498211 learned_addr learned my addr 172.21.15.47:0/389498211 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:17.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.485+0000 7f32c54f2640 1 --2- 172.21.15.47:0/389498211 >> v2:172.21.15.191:3300/0 conn(0x7f32c00ceae0 0x7f32c00d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:17.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.485+0000 7f32bf7fe640 1 -- 172.21.15.47:0/389498211 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4068762637 0 0) 0x7f32c015e7b0 con 0x7f32c00c7050 2024-04-14T23:35:17.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.485+0000 7f32bf7fe640 1 -- 172.21.15.47:0/389498211 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32ac003520 con 0x7f32c00c7050 2024-04-14T23:35:17.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.486+0000 7f32bf7fe640 1 -- 172.21.15.47:0/389498211 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2017475214 0 0) 0x7f32ac003520 con 0x7f32c00c7050 2024-04-14T23:35:17.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.486+0000 7f32c54f2640 1 -- 172.21.15.47:0/389498211 >> v1:172.21.15.191:6789/0 conn(0x7f32c006b910 legacy=0x7f32c0161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.486+0000 7f32c54f2640 1 -- 172.21.15.47:0/389498211 >> v1:172.21.15.47:6789/0 conn(0x7f32c00c7050 legacy=0x7f32c006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.486+0000 7f32c54f2640 1 -- 172.21.15.47:0/389498211 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c015ea70 con 0x7f32c00ceae0 2024-04-14T23:35:17.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.486+0000 7f32c54f2640 1 --2- 172.21.15.47:0/389498211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32c00ceae0 0x7f32c00d02c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f32b00097a0 tx=0x7f32b002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=863c633c343eb894 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:17.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.486+0000 7f32bf7fe640 1 -- 172.21.15.47:0/389498211 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b0038070 con 0x7f32c00ceae0 2024-04-14T23:35:17.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.487+0000 7f32bf7fe640 1 -- 172.21.15.47:0/389498211 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b0031500 con 0x7f32c00ceae0 2024-04-14T23:35:17.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.487+0000 7f32bf7fe640 1 -- 172.21.15.47:0/389498211 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b80019f0 con 0x7f32c00ceae0 2024-04-14T23:35:17.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.487+0000 7f32c6f55640 1 -- 172.21.15.47:0/389498211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32c00ceae0 msgr2=0x7f32c00d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.487+0000 7f32c6f55640 1 --2- 172.21.15.47:0/389498211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32c00ceae0 0x7f32c00d02c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f32b00097a0 tx=0x7f32b002b820 comp rx=0 tx=0).stop 2024-04-14T23:35:17.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.487+0000 7f32c6f55640 1 -- 172.21.15.47:0/389498211 shutdown_connections 2024-04-14T23:35:17.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.487+0000 7f32c6f55640 1 --2- 172.21.15.47:0/389498211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32c00ceae0 0x7f32c00d02c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.487+0000 7f32c6f55640 1 -- 172.21.15.47:0/389498211 >> 172.21.15.47:0/389498211 conn(0x7f32c00b2810 msgr2=0x7f32c00b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:17.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.487+0000 7f32c6f55640 1 -- 172.21.15.47:0/389498211 shutdown_connections 2024-04-14T23:35:17.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.487+0000 7f32c6f55640 1 -- 172.21.15.47:0/389498211 wait complete. 2024-04-14T23:35:17.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.488+0000 7f32c6f55640 1 Processor -- start 2024-04-14T23:35:17.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.488+0000 7f32c6f55640 1 -- start start 2024-04-14T23:35:17.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.489+0000 7f32c6f55640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32c006b910 0x7f32c0161960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.489+0000 7f32c6f55640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32c00c7050 0x7f32c01568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.489+0000 7f32c6f55640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32c00ceae0 0x7f32c00c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.489+0000 7f32c6f55640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f32c00c7430 con 0x7f32c006b910 2024-04-14T23:35:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.489+0000 7f32c6f55640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f32c006f4e0 con 0x7f32c00ceae0 2024-04-14T23:35:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.489+0000 7f32c6f55640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f32c00c75b0 con 0x7f32c00c7050 2024-04-14T23:35:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.489+0000 7f32c4cf1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32c006b910 0x7f32c0161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.489+0000 7f32c4cf1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32c006b910 0x7f32c0161960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36242/0 (socket says 172.21.15.47:36242) 2024-04-14T23:35:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.489+0000 7f32c4cf1640 1 -- 172.21.15.47:0/1467616316 learned_addr learned my addr 172.21.15.47:0/1467616316 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.489+0000 7f32c54f2640 1 --2- 172.21.15.47:0/1467616316 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32c00ceae0 0x7f32c00c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.489+0000 7f32bffff640 1 --2- 172.21.15.47:0/1467616316 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32c00c7050 0x7f32c01568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.490+0000 7f32c4cf1640 1 -- 172.21.15.47:0/1467616316 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32c00c7050 msgr2=0x7f32c01568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.490+0000 7f32c4cf1640 1 --2- 172.21.15.47:0/1467616316 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32c00c7050 0x7f32c01568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.490+0000 7f32c4cf1640 1 -- 172.21.15.47:0/1467616316 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32c00ceae0 msgr2=0x7f32c00c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.490+0000 7f32c4cf1640 1 --2- 172.21.15.47:0/1467616316 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32c00ceae0 0x7f32c00c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.490+0000 7f32c4cf1640 1 -- 172.21.15.47:0/1467616316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c00b64e0 con 0x7f32c006b910 2024-04-14T23:35:17.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.490+0000 7f32c4cf1640 1 --2- 172.21.15.47:0/1467616316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32c006b910 0x7f32c0161960 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f32b80018b0 tx=0x7f32b800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:17.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.490+0000 7f32bd7fa640 1 -- 172.21.15.47:0/1467616316 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8017070 con 0x7f32c006b910 2024-04-14T23:35:17.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.490+0000 7f32bd7fa640 1 -- 172.21.15.47:0/1467616316 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b8012400 con 0x7f32c006b910 2024-04-14T23:35:17.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.490+0000 7f32bd7fa640 1 -- 172.21.15.47:0/1467616316 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8012830 con 0x7f32c006b910 2024-04-14T23:35:17.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.490+0000 7f32c6f55640 1 -- 172.21.15.47:0/1467616316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c00c8860 con 0x7f32c006b910 2024-04-14T23:35:17.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.490+0000 7f32c6f55640 1 -- 172.21.15.47:0/1467616316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c01621e0 con 0x7f32c006b910 2024-04-14T23:35:17.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.491+0000 7f32c6f55640 1 -- 172.21.15.47:0/1467616316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32c0073f50 con 0x7f32c006b910 2024-04-14T23:35:17.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.491+0000 7f32bd7fa640 1 -- 172.21.15.47:0/1467616316 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f32b801a070 con 0x7f32c006b910 2024-04-14T23:35:17.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.492+0000 7f32bd7fa640 1 --2- 172.21.15.47:0/1467616316 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f32a006b990 0x7f32a006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.492+0000 7f32bd7fa640 1 -- 172.21.15.47:0/1467616316 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f32b808acf0 con 0x7f32c006b910 2024-04-14T23:35:17.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.492+0000 7f32bffff640 1 --2- 172.21.15.47:0/1467616316 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f32a006b990 0x7f32a006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:17.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.493+0000 7f32bffff640 1 --2- 172.21.15.47:0/1467616316 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f32a006b990 0x7f32a006de50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f32c00b5fe0 tx=0x7f32a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:17.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.496+0000 7f32bd7fa640 1 -- 172.21.15.47:0/1467616316 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f32b808f070 con 0x7f32c006b910 2024-04-14T23:35:17.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.678+0000 7f32c6f55640 1 -- 172.21.15.47:0/1467616316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f32c00721f0 con 0x7f32c006b910 2024-04-14T23:35:17.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.679+0000 7f32bd7fa640 1 -- 172.21.15.47:0/1467616316 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f32b8058e60 con 0x7f32c006b910 2024-04-14T23:35:17.682 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:17.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.681+0000 7f32c6f55640 1 -- 172.21.15.47:0/1467616316 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f32a006b990 msgr2=0x7f32a006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.681+0000 7f32c6f55640 1 --2- 172.21.15.47:0/1467616316 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f32a006b990 0x7f32a006de50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f32c00b5fe0 tx=0x7f32a8009040 comp rx=0 tx=0).stop 2024-04-14T23:35:17.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.681+0000 7f32c6f55640 1 -- 172.21.15.47:0/1467616316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32c006b910 msgr2=0x7f32c0161960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.681+0000 7f32c6f55640 1 --2- 172.21.15.47:0/1467616316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32c006b910 0x7f32c0161960 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f32b80018b0 tx=0x7f32b800a430 comp rx=0 tx=0).stop 2024-04-14T23:35:17.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.681+0000 7f32c6f55640 1 -- 172.21.15.47:0/1467616316 shutdown_connections 2024-04-14T23:35:17.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.681+0000 7f32c6f55640 1 --2- 172.21.15.47:0/1467616316 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f32a006b990 0x7f32a006de50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.681+0000 7f32c6f55640 1 --2- 172.21.15.47:0/1467616316 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32c00ceae0 0x7f32c00c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.681+0000 7f32c6f55640 1 --2- 172.21.15.47:0/1467616316 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32c00c7050 0x7f32c01568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.681+0000 7f32c6f55640 1 --2- 172.21.15.47:0/1467616316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32c006b910 0x7f32c0161960 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.681+0000 7f32c6f55640 1 -- 172.21.15.47:0/1467616316 >> 172.21.15.47:0/1467616316 conn(0x7f32c00b2810 msgr2=0x7f32c00b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:17.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.681+0000 7f32c6f55640 1 -- 172.21.15.47:0/1467616316 shutdown_connections 2024-04-14T23:35:17.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.681+0000 7f32c6f55640 1 -- 172.21.15.47:0/1467616316 wait complete. 2024-04-14T23:35:17.695 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T23:35:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.797+0000 7f67c1e95640 1 Processor -- start 2024-04-14T23:35:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.797+0000 7f67c1e95640 1 -- start start 2024-04-14T23:35:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.798+0000 7f67c1e95640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f67bc06b910 0x7f67bc0cf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.798+0000 7f67c1e95640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67bc0cfea0 0x7f67bc15e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.798+0000 7f67c1e95640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67bc0d02d0 con 0x7f67bc155310 2024-04-14T23:35:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.798+0000 7f67c1e95640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f67bc0ce500 con 0x7f67bc06b910 2024-04-14T23:35:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.798+0000 7f67c1e95640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f67bc0d0540 con 0x7f67bc0cfea0 2024-04-14T23:35:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.798+0000 7f67baffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f67bc06b910 0x7f67bc0cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.798+0000 7f67bb7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f67bc155310 0x7f67bc06b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60046/0 (socket says 172.21.15.47:60046) 2024-04-14T23:35:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.798+0000 7f67bb7fe640 1 -- 172.21.15.47:0/3143176249 learned_addr learned my addr 172.21.15.47:0/3143176249 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.798+0000 7f67baffd640 1 -- 172.21.15.47:0/3143176249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67bc0cfea0 msgr2=0x7f67bc15e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.798+0000 7f67baffd640 1 --2- 172.21.15.47:0/3143176249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67bc0cfea0 0x7f67bc15e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.798+0000 7f67baffd640 1 -- 172.21.15.47:0/3143176249 >> v1:172.21.15.47:6789/0 conn(0x7f67bc155310 legacy=0x7f67bc06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.798+0000 7f67baffd640 1 -- 172.21.15.47:0/3143176249 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67bc0cc150 con 0x7f67bc06b910 2024-04-14T23:35:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.798+0000 7f67ba7fc640 1 -- 172.21.15.47:0/3143176249 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042692152 0 0) 0x7f67bc0d02d0 con 0x7f67bc155310 2024-04-14T23:35:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.799+0000 7f67baffd640 1 --2- 172.21.15.47:0/3143176249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67bc06b910 0x7f67bc0cf960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f67b00097a0 tx=0x7f67b002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610ed5a3259dd5eb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.799+0000 7f67ba7fc640 1 -- 172.21.15.47:0/3143176249 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b0035020 con 0x7f67bc06b910 2024-04-14T23:35:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.799+0000 7f67ba7fc640 1 -- 172.21.15.47:0/3143176249 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b0031830 con 0x7f67bc06b910 2024-04-14T23:35:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.799+0000 7f67ba7fc640 1 -- 172.21.15.47:0/3143176249 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b0031c00 con 0x7f67bc06b910 2024-04-14T23:35:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.800+0000 7f67c1e95640 1 -- 172.21.15.47:0/3143176249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67bc06b910 msgr2=0x7f67bc0cf960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.800+0000 7f67c1e95640 1 --2- 172.21.15.47:0/3143176249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67bc06b910 0x7f67bc0cf960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f67b00097a0 tx=0x7f67b002b8d0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.800+0000 7f67c1e95640 1 -- 172.21.15.47:0/3143176249 shutdown_connections 2024-04-14T23:35:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.800+0000 7f67c1e95640 1 --2- 172.21.15.47:0/3143176249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67bc0cfea0 0x7f67bc15e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.800+0000 7f67c1e95640 1 --2- 172.21.15.47:0/3143176249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67bc06b910 0x7f67bc0cf960 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.800+0000 7f67c1e95640 1 -- 172.21.15.47:0/3143176249 >> 172.21.15.47:0/3143176249 conn(0x7f67bc0cd670 msgr2=0x7f67bc0cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:17.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.800+0000 7f67c1e95640 1 -- 172.21.15.47:0/3143176249 shutdown_connections 2024-04-14T23:35:17.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.800+0000 7f67c1e95640 1 -- 172.21.15.47:0/3143176249 wait complete. 2024-04-14T23:35:17.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.801+0000 7f67c1e95640 1 Processor -- start 2024-04-14T23:35:17.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.801+0000 7f67c1e95640 1 -- start start 2024-04-14T23:35:17.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67c1e95640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67bc06b910 0x7f67bc158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67c1e95640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67bc0cfea0 0x7f67bc14e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67c1e95640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67bc155310 0x7f67bc1fb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67c1e95640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f67bc162050 con 0x7f67bc06b910 2024-04-14T23:35:17.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67c1e95640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f67bc1626a0 con 0x7f67bc155310 2024-04-14T23:35:17.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67c1e95640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f67bc162330 con 0x7f67bc0cfea0 2024-04-14T23:35:17.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67bb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67bc06b910 0x7f67bc158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:17.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67bb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67bc06b910 0x7f67bc158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36266/0 (socket says 172.21.15.47:36266) 2024-04-14T23:35:17.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67bb7fe640 1 -- 172.21.15.47:0/588747931 learned_addr learned my addr 172.21.15.47:0/588747931 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:17.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67bb7fe640 1 -- 172.21.15.47:0/588747931 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67bc0cfea0 msgr2=0x7f67bc14e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67bb7fe640 1 --2- 172.21.15.47:0/588747931 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67bc0cfea0 0x7f67bc14e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67bb7fe640 1 -- 172.21.15.47:0/588747931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67bc155310 msgr2=0x7f67bc1fb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67bb7fe640 1 --2- 172.21.15.47:0/588747931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67bc155310 0x7f67bc1fb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67bb7fe640 1 -- 172.21.15.47:0/588747931 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67bc155bf0 con 0x7f67bc06b910 2024-04-14T23:35:17.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67bb7fe640 1 --2- 172.21.15.47:0/588747931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67bc06b910 0x7f67bc158260 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00c4d0 tx=0x7f67ac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:17.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67a3fff640 1 -- 172.21.15.47:0/588747931 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac018070 con 0x7f67bc06b910 2024-04-14T23:35:17.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67a3fff640 1 -- 172.21.15.47:0/588747931 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ac007500 con 0x7f67bc06b910 2024-04-14T23:35:17.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67c1e95640 1 -- 172.21.15.47:0/588747931 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67bc155ed0 con 0x7f67bc06b910 2024-04-14T23:35:17.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.802+0000 7f67a3fff640 1 -- 172.21.15.47:0/588747931 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac004a20 con 0x7f67bc06b910 2024-04-14T23:35:17.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.803+0000 7f67c1e95640 1 -- 172.21.15.47:0/588747931 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67bc156770 con 0x7f67bc06b910 2024-04-14T23:35:17.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.804+0000 7f67c1e95640 1 -- 172.21.15.47:0/588747931 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67bc1562c0 con 0x7f67bc06b910 2024-04-14T23:35:17.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.804+0000 7f67a3fff640 1 -- 172.21.15.47:0/588747931 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f67ac01b070 con 0x7f67bc06b910 2024-04-14T23:35:17.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.804+0000 7f67a3fff640 1 --2- 172.21.15.47:0/588747931 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67a806b990 0x7f67a806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:17.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.804+0000 7f67a3fff640 1 -- 172.21.15.47:0/588747931 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f67ac089ee0 con 0x7f67bc06b910 2024-04-14T23:35:17.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.805+0000 7f67baffd640 1 --2- 172.21.15.47:0/588747931 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67a806b990 0x7f67a806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:17.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.805+0000 7f67baffd640 1 --2- 172.21.15.47:0/588747931 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67a806b990 0x7f67a806de50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f67b0036000 tx=0x7f67b0030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:17.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.809+0000 7f67a3fff640 1 -- 172.21.15.47:0/588747931 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f67ac0587b0 con 0x7f67bc06b910 2024-04-14T23:35:17.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.988+0000 7f67c1e95640 1 -- 172.21.15.47:0/588747931 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f67bc073f50 con 0x7f67bc06b910 2024-04-14T23:35:17.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.988+0000 7f67a3fff640 1 -- 172.21.15.47:0/588747931 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f67ac0580b0 con 0x7f67bc06b910 2024-04-14T23:35:17.992 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-14T23:35:17.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.990+0000 7f67c1e95640 1 -- 172.21.15.47:0/588747931 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67a806b990 msgr2=0x7f67a806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.990+0000 7f67c1e95640 1 --2- 172.21.15.47:0/588747931 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67a806b990 0x7f67a806de50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f67b0036000 tx=0x7f67b0030000 comp rx=0 tx=0).stop 2024-04-14T23:35:17.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.990+0000 7f67c1e95640 1 -- 172.21.15.47:0/588747931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67bc06b910 msgr2=0x7f67bc158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:17.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.990+0000 7f67c1e95640 1 --2- 172.21.15.47:0/588747931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67bc06b910 0x7f67bc158260 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00c4d0 tx=0x7f67ac00c990 comp rx=0 tx=0).stop 2024-04-14T23:35:17.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.990+0000 7f67c1e95640 1 -- 172.21.15.47:0/588747931 shutdown_connections 2024-04-14T23:35:17.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.990+0000 7f67c1e95640 1 --2- 172.21.15.47:0/588747931 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67a806b990 0x7f67a806de50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.990+0000 7f67c1e95640 1 --2- 172.21.15.47:0/588747931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67bc155310 0x7f67bc1fb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.990+0000 7f67c1e95640 1 --2- 172.21.15.47:0/588747931 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67bc0cfea0 0x7f67bc14e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.990+0000 7f67c1e95640 1 --2- 172.21.15.47:0/588747931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67bc06b910 0x7f67bc158260 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:17.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.990+0000 7f67c1e95640 1 -- 172.21.15.47:0/588747931 >> 172.21.15.47:0/588747931 conn(0x7f67bc0cd670 msgr2=0x7f67bc06b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:17.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.990+0000 7f67c1e95640 1 -- 172.21.15.47:0/588747931 shutdown_connections 2024-04-14T23:35:17.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:17.990+0000 7f67c1e95640 1 -- 172.21.15.47:0/588747931 wait complete. 2024-04-14T23:35:18.004 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T23:35:18.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.105+0000 7fe184b84640 1 Processor -- start 2024-04-14T23:35:18.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.105+0000 7fe184b84640 1 -- start start 2024-04-14T23:35:18.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.106+0000 7fe184b84640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1800d2810 0x7fe18006ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.106+0000 7fe184b84640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1800d12e0 con 0x7fe1800ce700 2024-04-14T23:35:18.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.106+0000 7fe184b84640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe18006c3b0 con 0x7fe1800b0e20 2024-04-14T23:35:18.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.106+0000 7fe184b84640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe18006f2c0 con 0x7fe1800d2810 2024-04-14T23:35:18.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.106+0000 7fe17e59c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe1800ce700 0x7fe1800ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60062/0 (socket says 172.21.15.47:60062) 2024-04-14T23:35:18.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.106+0000 7fe17e59c640 1 -- 172.21.15.47:0/3718930070 learned_addr learned my addr 172.21.15.47:0/3718930070 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:18.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.106+0000 7fe17dd9b640 1 --2- 172.21.15.47:0/3718930070 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1800d2810 0x7fe18006ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.106+0000 7fe17d59a640 1 -- 172.21.15.47:0/3718930070 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2219363445 0 0) 0x7fe1800d12e0 con 0x7fe1800ce700 2024-04-14T23:35:18.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.106+0000 7fe17d59a640 1 -- 172.21.15.47:0/3718930070 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe16c003520 con 0x7fe1800ce700 2024-04-14T23:35:18.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.106+0000 7fe17d59a640 1 -- 172.21.15.47:0/3718930070 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3350083384 0 0) 0x7fe16c003520 con 0x7fe1800ce700 2024-04-14T23:35:18.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.106+0000 7fe17d59a640 1 -- 172.21.15.47:0/3718930070 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1800d2810 msgr2=0x7fe18006ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:18.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.106+0000 7fe17d59a640 1 --2- 172.21.15.47:0/3718930070 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1800d2810 0x7fe18006ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.106+0000 7fe17d59a640 1 -- 172.21.15.47:0/3718930070 >> v1:172.21.15.191:6789/0 conn(0x7fe1800b0e20 legacy=0x7fe18006d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17d59a640 1 -- 172.21.15.47:0/3718930070 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18006c650 con 0x7fe1800ce700 2024-04-14T23:35:18.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17d59a640 1 -- 172.21.15.47:0/3718930070 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7fe178001670 con 0x7fe1800ce700 2024-04-14T23:35:18.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17d59a640 1 -- 172.21.15.47:0/3718930070 >> v1:172.21.15.47:6789/0 conn(0x7fe1800ce700 legacy=0x7fe1800ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17d59a640 1 --2- 172.21.15.47:0/3718930070 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1800d2810 0x7fe16c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17d59a640 1 --2- 172.21.15.47:0/3718930070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe16c003f20 0x7fe16c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17d59a640 1 --2- 172.21.15.47:0/3718930070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe16c004d40 0x7fe16c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17d59a640 1 -- 172.21.15.47:0/3718930070 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe18006f2c0 con 0x7fe16c003f20 2024-04-14T23:35:18.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17d59a640 1 -- 172.21.15.47:0/3718930070 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c00ba20 con 0x7fe16c004d40 2024-04-14T23:35:18.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17d59a640 1 -- 172.21.15.47:0/3718930070 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe16c00bc20 con 0x7fe1800d2810 2024-04-14T23:35:18.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17dd9b640 1 --2- 172.21.15.47:0/3718930070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe16c003f20 0x7fe16c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17e59c640 1 --2- 172.21.15.47:0/3718930070 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1800d2810 0x7fe16c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17ed9d640 1 --2- 172.21.15.47:0/3718930070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe16c004d40 0x7fe16c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17dd9b640 1 -- 172.21.15.47:0/3718930070 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1800d2810 msgr2=0x7fe16c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:18.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17dd9b640 1 --2- 172.21.15.47:0/3718930070 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1800d2810 0x7fe16c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17dd9b640 1 -- 172.21.15.47:0/3718930070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe16c004d40 msgr2=0x7fe16c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17dd9b640 1 --2- 172.21.15.47:0/3718930070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe16c004d40 0x7fe16c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.107+0000 7fe17dd9b640 1 -- 172.21.15.47:0/3718930070 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16c003520 con 0x7fe16c003f20 2024-04-14T23:35:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.108+0000 7fe17dd9b640 1 --2- 172.21.15.47:0/3718930070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe16c003f20 0x7fe16c004800 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe168009ac0 tx=0x7fe16c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5e0fa49f34201 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.108+0000 7fe17d59a640 1 -- 172.21.15.47:0/3718930070 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168039070 con 0x7fe16c003f20 2024-04-14T23:35:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.108+0000 7fe17d59a640 1 -- 172.21.15.47:0/3718930070 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16802c600 con 0x7fe16c003f20 2024-04-14T23:35:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.108+0000 7fe17d59a640 1 -- 172.21.15.47:0/3718930070 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168009690 con 0x7fe16c003f20 2024-04-14T23:35:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.108+0000 7fe184b84640 1 -- 172.21.15.47:0/3718930070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe16c003f20 msgr2=0x7fe16c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.108+0000 7fe184b84640 1 --2- 172.21.15.47:0/3718930070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe16c003f20 0x7fe16c004800 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe168009ac0 tx=0x7fe16c005830 comp rx=0 tx=0).stop 2024-04-14T23:35:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.108+0000 7fe17ed9d640 1 -- 172.21.15.47:0/3718930070 reap_dead start 2024-04-14T23:35:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.109+0000 7fe184b84640 1 -- 172.21.15.47:0/3718930070 shutdown_connections 2024-04-14T23:35:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.109+0000 7fe184b84640 1 -- 172.21.15.47:0/3718930070 >> 172.21.15.47:0/3718930070 conn(0x7fe1800d1cf0 msgr2=0x7fe1800d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.109+0000 7fe184b84640 1 -- 172.21.15.47:0/3718930070 shutdown_connections 2024-04-14T23:35:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.109+0000 7fe184b84640 1 -- 172.21.15.47:0/3718930070 wait complete. 2024-04-14T23:35:18.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.110+0000 7fe184b84640 1 Processor -- start 2024-04-14T23:35:18.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.110+0000 7fe184b84640 1 -- start start 2024-04-14T23:35:18.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe184b84640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe16c003f20 0x7fe1800cd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe184b84640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1800cc2d0 0x7fe1801542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe184b84640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1801f4aa0 0x7fe18015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe184b84640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe18015e600 con 0x7fe1800cc2d0 2024-04-14T23:35:18.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe184b84640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe18006f5a0 con 0x7fe16c003f20 2024-04-14T23:35:18.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe184b84640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe18015e780 con 0x7fe1801f4aa0 2024-04-14T23:35:18.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe17dd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1800cc2d0 0x7fe1801542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe17dd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1800cc2d0 0x7fe1801542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36278/0 (socket says 172.21.15.47:36278) 2024-04-14T23:35:18.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe17dd9b640 1 -- 172.21.15.47:0/3570203361 learned_addr learned my addr 172.21.15.47:0/3570203361 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:18.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe17e59c640 1 --2- 172.21.15.47:0/3570203361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe16c003f20 0x7fe1800cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe17ed9d640 1 --2- 172.21.15.47:0/3570203361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1801f4aa0 0x7fe18015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe17dd9b640 1 -- 172.21.15.47:0/3570203361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1801f4aa0 msgr2=0x7fe18015b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe17dd9b640 1 --2- 172.21.15.47:0/3570203361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1801f4aa0 0x7fe18015b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe17dd9b640 1 -- 172.21.15.47:0/3570203361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe16c003f20 msgr2=0x7fe1800cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe17dd9b640 1 --2- 172.21.15.47:0/3570203361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe16c003f20 0x7fe1800cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe17dd9b640 1 -- 172.21.15.47:0/3570203361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1800cc770 con 0x7fe1800cc2d0 2024-04-14T23:35:18.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe17dd9b640 1 --2- 172.21.15.47:0/3570203361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1800cc2d0 0x7fe1801542b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe168037040 tx=0x7fe168004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:18.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe176ffd640 1 -- 172.21.15.47:0/3570203361 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168042020 con 0x7fe1800cc2d0 2024-04-14T23:35:18.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe176ffd640 1 -- 172.21.15.47:0/3570203361 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16803a040 con 0x7fe1800cc2d0 2024-04-14T23:35:18.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe184b84640 1 -- 172.21.15.47:0/3570203361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1800cca50 con 0x7fe1800cc2d0 2024-04-14T23:35:18.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe176ffd640 1 -- 172.21.15.47:0/3570203361 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168039070 con 0x7fe1800cc2d0 2024-04-14T23:35:18.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.111+0000 7fe184b84640 1 -- 172.21.15.47:0/3570203361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1800cd010 con 0x7fe1800cc2d0 2024-04-14T23:35:18.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.112+0000 7fe184b84640 1 -- 172.21.15.47:0/3570203361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1800d1400 con 0x7fe1800cc2d0 2024-04-14T23:35:18.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.113+0000 7fe176ffd640 1 -- 172.21.15.47:0/3570203361 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe168045020 con 0x7fe1800cc2d0 2024-04-14T23:35:18.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.113+0000 7fe176ffd640 1 --2- 172.21.15.47:0/3570203361 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe16006b990 0x7fe16006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.113+0000 7fe176ffd640 1 -- 172.21.15.47:0/3570203361 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe1680abf70 con 0x7fe1800cc2d0 2024-04-14T23:35:18.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.113+0000 7fe17e59c640 1 --2- 172.21.15.47:0/3570203361 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe16006b990 0x7fe16006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.114+0000 7fe17e59c640 1 --2- 172.21.15.47:0/3570203361 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe16006b990 0x7fe16006de50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe1800b0df0 tx=0x7fe178009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:18.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.117+0000 7fe176ffd640 1 -- 172.21.15.47:0/3570203361 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe1800d1400 con 0x7fe1800cc2d0 2024-04-14T23:35:18.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.298+0000 7fe184b84640 1 -- 172.21.15.47:0/3570203361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe180073f50 con 0x7fe1800cc2d0 2024-04-14T23:35:18.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.298+0000 7fe176ffd640 1 -- 172.21.15.47:0/3570203361 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fe16804c070 con 0x7fe1800cc2d0 2024-04-14T23:35:18.302 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:18.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.301+0000 7fe184b84640 1 -- 172.21.15.47:0/3570203361 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe16006b990 msgr2=0x7fe16006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.301+0000 7fe184b84640 1 --2- 172.21.15.47:0/3570203361 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe16006b990 0x7fe16006de50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe1800b0df0 tx=0x7fe178009040 comp rx=0 tx=0).stop 2024-04-14T23:35:18.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.301+0000 7fe184b84640 1 -- 172.21.15.47:0/3570203361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1800cc2d0 msgr2=0x7fe1801542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.301+0000 7fe184b84640 1 --2- 172.21.15.47:0/3570203361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1800cc2d0 0x7fe1801542b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe168037040 tx=0x7fe168004730 comp rx=0 tx=0).stop 2024-04-14T23:35:18.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.301+0000 7fe184b84640 1 -- 172.21.15.47:0/3570203361 shutdown_connections 2024-04-14T23:35:18.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.301+0000 7fe184b84640 1 --2- 172.21.15.47:0/3570203361 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe16006b990 0x7fe16006de50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.301+0000 7fe184b84640 1 --2- 172.21.15.47:0/3570203361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1801f4aa0 0x7fe18015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.301+0000 7fe184b84640 1 --2- 172.21.15.47:0/3570203361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1800cc2d0 0x7fe1801542b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.301+0000 7fe184b84640 1 --2- 172.21.15.47:0/3570203361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe16c003f20 0x7fe1800cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.301+0000 7fe184b84640 1 -- 172.21.15.47:0/3570203361 >> 172.21.15.47:0/3570203361 conn(0x7fe1800d1cf0 msgr2=0x7fe1800d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:18.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.301+0000 7fe184b84640 1 -- 172.21.15.47:0/3570203361 shutdown_connections 2024-04-14T23:35:18.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.301+0000 7fe184b84640 1 -- 172.21.15.47:0/3570203361 wait complete. 2024-04-14T23:35:18.315 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:18.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.414+0000 7f0eb04d1640 1 Processor -- start 2024-04-14T23:35:18.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.414+0000 7f0eb04d1640 1 -- start start 2024-04-14T23:35:18.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.415+0000 7f0eb04d1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ea80d09a0 0x7f0ea80b4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.415+0000 7f0eb04d1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0ea815cd40 0x7f0ea80cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.415+0000 7f0eb04d1640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea815d1d0 con 0x7f0ea80cfd70 2024-04-14T23:35:18.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.415+0000 7f0eb04d1640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea80cf010 con 0x7f0ea815cd40 2024-04-14T23:35:18.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.415+0000 7f0eb04d1640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea80ce700 con 0x7f0ea80d09a0 2024-04-14T23:35:18.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.415+0000 7f0eaea6e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0ea815cd40 0x7f0ea80cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.415+0000 7f0eaea6e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0ea815cd40 0x7f0ea80cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36290/0 (socket says 172.21.15.47:36290) 2024-04-14T23:35:18.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.415+0000 7f0eaea6e640 1 -- 172.21.15.47:0/2012655861 learned_addr learned my addr 172.21.15.47:0/2012655861 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:18.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.416+0000 7f0eada6c640 1 --2- 172.21.15.47:0/2012655861 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ea80d09a0 0x7f0ea80b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.416+0000 7f0eaea6e640 1 -- 172.21.15.47:0/2012655861 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ea80d09a0 msgr2=0x7f0ea80b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:18.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.416+0000 7f0eaea6e640 1 --2- 172.21.15.47:0/2012655861 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ea80d09a0 0x7f0ea80b4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.416+0000 7f0eaea6e640 1 -- 172.21.15.47:0/2012655861 >> v1:172.21.15.191:6789/0 conn(0x7f0ea80cfd70 legacy=0x7f0ea80d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:18.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.416+0000 7f0eaea6e640 1 -- 172.21.15.47:0/2012655861 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea815d450 con 0x7f0ea815cd40 2024-04-14T23:35:18.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.416+0000 7f0eaea6e640 1 --2- 172.21.15.47:0/2012655861 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea815cd40 0x7f0ea80cc790 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009e50 tx=0x7f0ea402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a904be3a48d0fd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:18.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.417+0000 7f0ead26b640 1 -- 172.21.15.47:0/2012655861 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea402ca70 con 0x7f0ea815cd40 2024-04-14T23:35:18.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.417+0000 7f0ead26b640 1 -- 172.21.15.47:0/2012655861 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea402cc10 con 0x7f0ea815cd40 2024-04-14T23:35:18.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.417+0000 7f0ead26b640 1 -- 172.21.15.47:0/2012655861 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40343f0 con 0x7f0ea815cd40 2024-04-14T23:35:18.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.417+0000 7f0eb04d1640 1 -- 172.21.15.47:0/2012655861 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea815cd40 msgr2=0x7f0ea80cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.417+0000 7f0eb04d1640 1 --2- 172.21.15.47:0/2012655861 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea815cd40 0x7f0ea80cc790 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009e50 tx=0x7f0ea402bed0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.417+0000 7f0eb04d1640 1 -- 172.21.15.47:0/2012655861 shutdown_connections 2024-04-14T23:35:18.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.417+0000 7f0eb04d1640 1 --2- 172.21.15.47:0/2012655861 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea815cd40 0x7f0ea80cc790 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.417+0000 7f0eb04d1640 1 --2- 172.21.15.47:0/2012655861 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ea80d09a0 0x7f0ea80b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.417+0000 7f0eb04d1640 1 -- 172.21.15.47:0/2012655861 >> 172.21.15.47:0/2012655861 conn(0x7f0ea80b3840 msgr2=0x7f0ea80b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:18.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.417+0000 7f0eb04d1640 1 -- 172.21.15.47:0/2012655861 shutdown_connections 2024-04-14T23:35:18.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.417+0000 7f0eb04d1640 1 -- 172.21.15.47:0/2012655861 wait complete. 2024-04-14T23:35:18.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.418+0000 7f0eb04d1640 1 Processor -- start 2024-04-14T23:35:18.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.418+0000 7f0eb04d1640 1 -- start start 2024-04-14T23:35:18.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.419+0000 7f0eb04d1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea80cfd70 0x7f0ea80c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.419+0000 7f0eb04d1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ea80d09a0 0x7f0ea8156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.419+0000 7f0eb04d1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ea815cd40 0x7f0ea80b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.419+0000 7f0eb04d1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea80cf4a0 con 0x7f0ea80cfd70 2024-04-14T23:35:18.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.419+0000 7f0eb04d1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea80ceca0 con 0x7f0ea80d09a0 2024-04-14T23:35:18.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.419+0000 7f0eb04d1640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea80cf620 con 0x7f0ea815cd40 2024-04-14T23:35:18.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.419+0000 7f0eae26d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea80cfd70 0x7f0ea80c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.419+0000 7f0eae26d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea80cfd70 0x7f0ea80c9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36304/0 (socket says 172.21.15.47:36304) 2024-04-14T23:35:18.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.419+0000 7f0eae26d640 1 -- 172.21.15.47:0/3736949041 learned_addr learned my addr 172.21.15.47:0/3736949041 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:18.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.419+0000 7f0eae26d640 1 -- 172.21.15.47:0/3736949041 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ea815cd40 msgr2=0x7f0ea80b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.419+0000 7f0eae26d640 1 --2- 172.21.15.47:0/3736949041 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ea815cd40 0x7f0ea80b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.419+0000 7f0eae26d640 1 -- 172.21.15.47:0/3736949041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ea80d09a0 msgr2=0x7f0ea8156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.419+0000 7f0eae26d640 1 --2- 172.21.15.47:0/3736949041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ea80d09a0 0x7f0ea8156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.419+0000 7f0eae26d640 1 -- 172.21.15.47:0/3736949041 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea80c85d0 con 0x7f0ea80cfd70 2024-04-14T23:35:18.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.420+0000 7f0eae26d640 1 --2- 172.21.15.47:0/3736949041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea80cfd70 0x7f0ea80c9af0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000b3f0 tx=0x7f0ea000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:18.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.420+0000 7f0e9effd640 1 -- 172.21.15.47:0/3736949041 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0015020 con 0x7f0ea80cfd70 2024-04-14T23:35:18.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.420+0000 7f0e9effd640 1 -- 172.21.15.47:0/3736949041 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea0011830 con 0x7f0ea80cfd70 2024-04-14T23:35:18.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.420+0000 7f0eb04d1640 1 -- 172.21.15.47:0/3736949041 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea80c9010 con 0x7f0ea80cfd70 2024-04-14T23:35:18.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.420+0000 7f0e9effd640 1 -- 172.21.15.47:0/3736949041 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0011c20 con 0x7f0ea80cfd70 2024-04-14T23:35:18.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.420+0000 7f0eb04d1640 1 -- 172.21.15.47:0/3736949041 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea80c95d0 con 0x7f0ea80cfd70 2024-04-14T23:35:18.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.421+0000 7f0eb04d1640 1 -- 172.21.15.47:0/3736949041 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea8075430 con 0x7f0ea80cfd70 2024-04-14T23:35:18.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.421+0000 7f0e9effd640 1 -- 172.21.15.47:0/3736949041 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0ea0018020 con 0x7f0ea80cfd70 2024-04-14T23:35:18.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.422+0000 7f0e9effd640 1 --2- 172.21.15.47:0/3736949041 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0e8c06b990 0x7f0e8c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.422+0000 7f0e9effd640 1 -- 172.21.15.47:0/3736949041 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0ea008a760 con 0x7f0ea80cfd70 2024-04-14T23:35:18.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.422+0000 7f0eada6c640 1 --2- 172.21.15.47:0/3736949041 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0e8c06b990 0x7f0e8c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.423+0000 7f0eada6c640 1 --2- 172.21.15.47:0/3736949041 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0e8c06b990 0x7f0e8c06de50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80ca2b0 tx=0x7f0e98008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:18.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.426+0000 7f0e9effd640 1 -- 172.21.15.47:0/3736949041 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0ea001f030 con 0x7f0ea80cfd70 2024-04-14T23:35:18.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.610+0000 7f0eb04d1640 1 -- 172.21.15.47:0/3736949041 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ea80ce4e0 con 0x7f0ea80cfd70 2024-04-14T23:35:18.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.611+0000 7f0e9effd640 1 -- 172.21.15.47:0/3736949041 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18502 (secure 0 0 0) 0x7f0ea00172c0 con 0x7f0ea80cfd70 2024-04-14T23:35:18.614 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:18.614 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:34:44.714882+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:18.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.613+0000 7f0eb04d1640 1 -- 172.21.15.47:0/3736949041 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0e8c06b990 msgr2=0x7f0e8c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.613+0000 7f0eb04d1640 1 --2- 172.21.15.47:0/3736949041 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0e8c06b990 0x7f0e8c06de50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80ca2b0 tx=0x7f0e98008040 comp rx=0 tx=0).stop 2024-04-14T23:35:18.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.613+0000 7f0eb04d1640 1 -- 172.21.15.47:0/3736949041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea80cfd70 msgr2=0x7f0ea80c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.613+0000 7f0eb04d1640 1 --2- 172.21.15.47:0/3736949041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea80cfd70 0x7f0ea80c9af0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000b3f0 tx=0x7f0ea000b8b0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.613+0000 7f0eb04d1640 1 -- 172.21.15.47:0/3736949041 shutdown_connections 2024-04-14T23:35:18.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.613+0000 7f0eb04d1640 1 --2- 172.21.15.47:0/3736949041 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0e8c06b990 0x7f0e8c06de50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.613+0000 7f0eb04d1640 1 --2- 172.21.15.47:0/3736949041 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ea815cd40 0x7f0ea80b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.613+0000 7f0eb04d1640 1 --2- 172.21.15.47:0/3736949041 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ea80d09a0 0x7f0ea8156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.613+0000 7f0eb04d1640 1 --2- 172.21.15.47:0/3736949041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea80cfd70 0x7f0ea80c9af0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.613+0000 7f0eb04d1640 1 -- 172.21.15.47:0/3736949041 >> 172.21.15.47:0/3736949041 conn(0x7f0ea80b3840 msgr2=0x7f0ea8158430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:18.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.613+0000 7f0eb04d1640 1 -- 172.21.15.47:0/3736949041 shutdown_connections 2024-04-14T23:35:18.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.613+0000 7f0eb04d1640 1 -- 172.21.15.47:0/3736949041 wait complete. 2024-04-14T23:35:18.627 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T23:34:36.382034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T23:34:37.023103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T23:34:40.726418+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T23:35:18.628 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:35:18.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.731+0000 7f54f3888640 1 Processor -- start 2024-04-14T23:35:18.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.731+0000 7f54f3888640 1 -- start start 2024-04-14T23:35:18.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54f3888640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f54ec0b2160 0x7f54ec0b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54f3888640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ec0b2540 0x7f54ec0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54f3888640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ec0b3240 con 0x7f54ec0ce9e0 2024-04-14T23:35:18.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54f3888640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f54ec0cdd50 con 0x7f54ec0b2160 2024-04-14T23:35:18.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54f3888640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f54ec0d2c30 con 0x7f54ec0b2540 2024-04-14T23:35:18.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54f1e25640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f54ec0ce9e0 0x7f54ec0c5850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60078/0 (socket says 172.21.15.47:60078) 2024-04-14T23:35:18.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54f1e25640 1 -- 172.21.15.47:0/2897358470 learned_addr learned my addr 172.21.15.47:0/2897358470 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:18.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54f1624640 1 --2- 172.21.15.47:0/2897358470 >> v2:172.21.15.191:3300/0 conn(0x7f54ec0b2160 0x7f54ec0b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54f0e23640 1 --2- 172.21.15.47:0/2897358470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ec0b2540 0x7f54ec0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54e3fff640 1 -- 172.21.15.47:0/2897358470 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 598524300 0 0) 0x7f54ec0b3240 con 0x7f54ec0ce9e0 2024-04-14T23:35:18.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54e3fff640 1 -- 172.21.15.47:0/2897358470 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54d8003520 con 0x7f54ec0ce9e0 2024-04-14T23:35:18.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54e3fff640 1 -- 172.21.15.47:0/2897358470 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3911236784 0 0) 0x7f54d8003520 con 0x7f54ec0ce9e0 2024-04-14T23:35:18.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54e3fff640 1 -- 172.21.15.47:0/2897358470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ec0b2540 msgr2=0x7f54ec0ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:18.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54e3fff640 1 --2- 172.21.15.47:0/2897358470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ec0b2540 0x7f54ec0ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54e3fff640 1 -- 172.21.15.47:0/2897358470 >> v2:172.21.15.191:3300/0 conn(0x7f54ec0b2160 msgr2=0x7f54ec0b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:18.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54e3fff640 1 --2- 172.21.15.47:0/2897358470 >> v2:172.21.15.191:3300/0 conn(0x7f54ec0b2160 0x7f54ec0b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.732+0000 7f54e3fff640 1 -- 172.21.15.47:0/2897358470 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ec0d2950 con 0x7f54ec0ce9e0 2024-04-14T23:35:18.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.733+0000 7f54e3fff640 1 -- 172.21.15.47:0/2897358470 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f54e40019f0 con 0x7f54ec0ce9e0 2024-04-14T23:35:18.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.733+0000 7f54e3fff640 1 -- 172.21.15.47:0/2897358470 >> v1:172.21.15.47:6789/0 conn(0x7f54ec0ce9e0 legacy=0x7f54ec0c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.733+0000 7f54e3fff640 1 --2- 172.21.15.47:0/2897358470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54d80039b0 0x7f54d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.733+0000 7f54e3fff640 1 --2- 172.21.15.47:0/2897358470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d8004800 0x7f54d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.733+0000 7f54e3fff640 1 --2- 172.21.15.47:0/2897358470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ec0b2540 0x7f54d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.733+0000 7f54e3fff640 1 -- 172.21.15.47:0/2897358470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec0d2c30 con 0x7f54d8004800 2024-04-14T23:35:18.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.733+0000 7f54e3fff640 1 -- 172.21.15.47:0/2897358470 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f54d800b9c0 con 0x7f54d80039b0 2024-04-14T23:35:18.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.733+0000 7f54e3fff640 1 -- 172.21.15.47:0/2897358470 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f54d800bbc0 con 0x7f54ec0b2540 2024-04-14T23:35:18.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.733+0000 7f54f0e23640 1 --2- 172.21.15.47:0/2897358470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d8004800 0x7f54d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.733+0000 7f54f1624640 1 --2- 172.21.15.47:0/2897358470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54d80039b0 0x7f54d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.733+0000 7f54f1e25640 1 --2- 172.21.15.47:0/2897358470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ec0b2540 0x7f54d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.733+0000 7f54f0e23640 1 -- 172.21.15.47:0/2897358470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ec0b2540 msgr2=0x7f54d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:18.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.733+0000 7f54f0e23640 1 --2- 172.21.15.47:0/2897358470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ec0b2540 0x7f54d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.733+0000 7f54f0e23640 1 -- 172.21.15.47:0/2897358470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54d80039b0 msgr2=0x7f54d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:18.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.733+0000 7f54f0e23640 1 --2- 172.21.15.47:0/2897358470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54d80039b0 0x7f54d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.733+0000 7f54f0e23640 1 -- 172.21.15.47:0/2897358470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d8003520 con 0x7f54d8004800 2024-04-14T23:35:18.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.734+0000 7f54f0e23640 1 --2- 172.21.15.47:0/2897358470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d8004800 0x7f54d8004c80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009a90 tx=0x7f54d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d2a0a101157ca9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:18.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.734+0000 7f54e3fff640 1 -- 172.21.15.47:0/2897358470 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc039070 con 0x7f54d8004800 2024-04-14T23:35:18.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.734+0000 7f54e3fff640 1 -- 172.21.15.47:0/2897358470 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54dc02c680 con 0x7f54d8004800 2024-04-14T23:35:18.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.734+0000 7f54e3fff640 1 -- 172.21.15.47:0/2897358470 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc009690 con 0x7f54d8004800 2024-04-14T23:35:18.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.734+0000 7f54f3888640 1 -- 172.21.15.47:0/2897358470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d8004800 msgr2=0x7f54d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.734+0000 7f54f3888640 1 --2- 172.21.15.47:0/2897358470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d8004800 0x7f54d8004c80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009a90 tx=0x7f54d8005830 comp rx=0 tx=0).stop 2024-04-14T23:35:18.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.734+0000 7f54f1e25640 1 -- 172.21.15.47:0/2897358470 reap_dead start 2024-04-14T23:35:18.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.734+0000 7f54f3888640 1 -- 172.21.15.47:0/2897358470 shutdown_connections 2024-04-14T23:35:18.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.734+0000 7f54f3888640 1 -- 172.21.15.47:0/2897358470 >> 172.21.15.47:0/2897358470 conn(0x7f54ec0d1d00 msgr2=0x7f54ec0d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:18.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.735+0000 7f54f3888640 1 -- 172.21.15.47:0/2897358470 shutdown_connections 2024-04-14T23:35:18.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.735+0000 7f54f3888640 1 -- 172.21.15.47:0/2897358470 wait complete. 2024-04-14T23:35:18.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.736+0000 7f54f3888640 1 Processor -- start 2024-04-14T23:35:18.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.736+0000 7f54f3888640 1 -- start start 2024-04-14T23:35:18.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.736+0000 7f54f3888640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54d8004800 0x7f54ec1525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.736+0000 7f54f3888640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54ec151320 0x7f54ec0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.736+0000 7f54f3888640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54ec0b0b10 0x7f54ec0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.736+0000 7f54f3888640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec0b2990 con 0x7f54ec151320 2024-04-14T23:35:18.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.736+0000 7f54f3888640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec0cd830 con 0x7f54ec0b0b10 2024-04-14T23:35:18.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.736+0000 7f54f3888640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f54ec0d0af0 con 0x7f54d8004800 2024-04-14T23:35:18.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.737+0000 7f54f0e23640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54ec151320 0x7f54ec0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.737+0000 7f54f0e23640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54ec151320 0x7f54ec0cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36312/0 (socket says 172.21.15.47:36312) 2024-04-14T23:35:18.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.737+0000 7f54f0e23640 1 -- 172.21.15.47:0/4234929122 learned_addr learned my addr 172.21.15.47:0/4234929122 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:18.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.737+0000 7f54f1e25640 1 --2- 172.21.15.47:0/4234929122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54ec0b0b10 0x7f54ec0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.737+0000 7f54f1624640 1 --2- 172.21.15.47:0/4234929122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54d8004800 0x7f54ec1525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.737+0000 7f54f0e23640 1 -- 172.21.15.47:0/4234929122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54d8004800 msgr2=0x7f54ec1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.737+0000 7f54f0e23640 1 --2- 172.21.15.47:0/4234929122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54d8004800 0x7f54ec1525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.737+0000 7f54f0e23640 1 -- 172.21.15.47:0/4234929122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54ec0b0b10 msgr2=0x7f54ec0b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.737+0000 7f54f0e23640 1 --2- 172.21.15.47:0/4234929122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54ec0b0b10 0x7f54ec0b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.737+0000 7f54f0e23640 1 -- 172.21.15.47:0/4234929122 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ec152bc0 con 0x7f54ec151320 2024-04-14T23:35:18.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.737+0000 7f54f0e23640 1 --2- 172.21.15.47:0/4234929122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54ec151320 0x7f54ec0cab00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009b80 tx=0x7f54dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:18.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.737+0000 7f54e1ffb640 1 -- 172.21.15.47:0/4234929122 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc039050 con 0x7f54ec151320 2024-04-14T23:35:18.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.737+0000 7f54e1ffb640 1 -- 172.21.15.47:0/4234929122 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54dc045070 con 0x7f54ec151320 2024-04-14T23:35:18.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.737+0000 7f54f3888640 1 -- 172.21.15.47:0/4234929122 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ec152ea0 con 0x7f54ec151320 2024-04-14T23:35:18.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.737+0000 7f54e1ffb640 1 -- 172.21.15.47:0/4234929122 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc003a50 con 0x7f54ec151320 2024-04-14T23:35:18.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.737+0000 7f54f3888640 1 -- 172.21.15.47:0/4234929122 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ec153460 con 0x7f54ec151320 2024-04-14T23:35:18.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.738+0000 7f54f3888640 1 -- 172.21.15.47:0/4234929122 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54ec073f50 con 0x7f54ec151320 2024-04-14T23:35:18.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.739+0000 7f54e1ffb640 1 -- 172.21.15.47:0/4234929122 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f54dc003bf0 con 0x7f54ec151320 2024-04-14T23:35:18.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.739+0000 7f54e1ffb640 1 --2- 172.21.15.47:0/4234929122 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f54d006b990 0x7f54d006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:18.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.739+0000 7f54e1ffb640 1 -- 172.21.15.47:0/4234929122 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f54dc0acb90 con 0x7f54ec151320 2024-04-14T23:35:18.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.740+0000 7f54f1624640 1 --2- 172.21.15.47:0/4234929122 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f54d006b990 0x7f54d006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:18.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.740+0000 7f54f1624640 1 --2- 172.21.15.47:0/4234929122 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f54d006b990 0x7f54d006de50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009bc0 tx=0x7f54e8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:18.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.744+0000 7f54e1ffb640 1 -- 172.21.15.47:0/4234929122 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f54dc07af30 con 0x7f54ec151320 2024-04-14T23:35:18.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.928+0000 7f54f3888640 1 -- 172.21.15.47:0/4234929122 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f54ec1e4e80 con 0x7f54ec151320 2024-04-14T23:35:18.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.929+0000 7f54e1ffb640 1 -- 172.21.15.47:0/4234929122 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f54dc07efd0 con 0x7f54ec151320 2024-04-14T23:35:18.932 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:35:18.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.931+0000 7f54f3888640 1 -- 172.21.15.47:0/4234929122 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f54d006b990 msgr2=0x7f54d006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.931+0000 7f54f3888640 1 --2- 172.21.15.47:0/4234929122 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f54d006b990 0x7f54d006de50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009bc0 tx=0x7f54e8009190 comp rx=0 tx=0).stop 2024-04-14T23:35:18.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.931+0000 7f54f3888640 1 -- 172.21.15.47:0/4234929122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54ec151320 msgr2=0x7f54ec0cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:18.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.931+0000 7f54f3888640 1 --2- 172.21.15.47:0/4234929122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54ec151320 0x7f54ec0cab00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009b80 tx=0x7f54dc004730 comp rx=0 tx=0).stop 2024-04-14T23:35:18.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.931+0000 7f54f3888640 1 -- 172.21.15.47:0/4234929122 shutdown_connections 2024-04-14T23:35:18.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.931+0000 7f54f3888640 1 --2- 172.21.15.47:0/4234929122 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f54d006b990 0x7f54d006de50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.931+0000 7f54f3888640 1 --2- 172.21.15.47:0/4234929122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54ec0b0b10 0x7f54ec0b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.931+0000 7f54f3888640 1 --2- 172.21.15.47:0/4234929122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54ec151320 0x7f54ec0cab00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.931+0000 7f54f3888640 1 --2- 172.21.15.47:0/4234929122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54d8004800 0x7f54ec1525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:18.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.931+0000 7f54f3888640 1 -- 172.21.15.47:0/4234929122 >> 172.21.15.47:0/4234929122 conn(0x7f54ec0d1d00 msgr2=0x7f54ec0c7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:18.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.931+0000 7f54f3888640 1 -- 172.21.15.47:0/4234929122 shutdown_connections 2024-04-14T23:35:18.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:18.931+0000 7f54f3888640 1 -- 172.21.15.47:0/4234929122 wait complete. 2024-04-14T23:35:18.945 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T23:35:19.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.046+0000 7f4c0b008640 1 Processor -- start 2024-04-14T23:35:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.046+0000 7f4c0b008640 1 -- start start 2024-04-14T23:35:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.047+0000 7f4c0b008640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c040b34d0 0x7f4c040b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.047+0000 7f4c0b008640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4c0406e330 0x7f4c0406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.047+0000 7f4c0b008640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c040b3df0 con 0x7f4c0415f310 2024-04-14T23:35:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.047+0000 7f4c0b008640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f4c0415f7a0 con 0x7f4c0406e330 2024-04-14T23:35:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.047+0000 7f4c0b008640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4c040d0ac0 con 0x7f4c040b34d0 2024-04-14T23:35:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.047+0000 7f4c03fff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4c0415f310 0x7f4c040d03b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60080/0 (socket says 172.21.15.47:60080) 2024-04-14T23:35:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.047+0000 7f4c03fff640 1 -- 172.21.15.47:0/3622980098 learned_addr learned my addr 172.21.15.47:0/3622980098 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c037fe640 1 -- 172.21.15.47:0/3622980098 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2019545149 0 0) 0x7f4c040b3df0 con 0x7f4c0415f310 2024-04-14T23:35:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c08da4640 1 --2- 172.21.15.47:0/3622980098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c040b34d0 0x7f4c040b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c037fe640 1 -- 172.21.15.47:0/3622980098 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bf4003520 con 0x7f4c0415f310 2024-04-14T23:35:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c095a5640 1 --2- 172.21.15.47:0/3622980098 >> v2:172.21.15.191:3300/0 conn(0x7f4c0406e330 0x7f4c0406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c037fe640 1 -- 172.21.15.47:0/3622980098 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1938248746 0 0) 0x7f4bf4003520 con 0x7f4c0415f310 2024-04-14T23:35:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c037fe640 1 -- 172.21.15.47:0/3622980098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c040b34d0 msgr2=0x7f4c040b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c037fe640 1 --2- 172.21.15.47:0/3622980098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c040b34d0 0x7f4c040b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c037fe640 1 -- 172.21.15.47:0/3622980098 >> v2:172.21.15.191:3300/0 conn(0x7f4c0406e330 msgr2=0x7f4c0406e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:19.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c037fe640 1 --2- 172.21.15.47:0/3622980098 >> v2:172.21.15.191:3300/0 conn(0x7f4c0406e330 0x7f4c0406e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c037fe640 1 -- 172.21.15.47:0/3622980098 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c040d0d00 con 0x7f4c0415f310 2024-04-14T23:35:19.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c037fe640 1 -- 172.21.15.47:0/3622980098 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f4bf0001670 con 0x7f4c0415f310 2024-04-14T23:35:19.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c037fe640 1 -- 172.21.15.47:0/3622980098 >> v1:172.21.15.47:6789/0 conn(0x7f4c0415f310 legacy=0x7f4c040d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c037fe640 1 --2- 172.21.15.47:0/3622980098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bf40039b0 0x7f4bf4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c037fe640 1 --2- 172.21.15.47:0/3622980098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bf4004800 0x7f4bf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c037fe640 1 --2- 172.21.15.47:0/3622980098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c040b34d0 0x7f4bf40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c037fe640 1 -- 172.21.15.47:0/3622980098 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4c040d0ac0 con 0x7f4bf40039b0 2024-04-14T23:35:19.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c037fe640 1 -- 172.21.15.47:0/3622980098 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf400b9c0 con 0x7f4bf4004800 2024-04-14T23:35:19.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c037fe640 1 -- 172.21.15.47:0/3622980098 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4bf400bb70 con 0x7f4c040b34d0 2024-04-14T23:35:19.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c08da4640 1 --2- 172.21.15.47:0/3622980098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bf40039b0 0x7f4bf4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c03fff640 1 --2- 172.21.15.47:0/3622980098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bf4004800 0x7f4bf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c095a5640 1 --2- 172.21.15.47:0/3622980098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c040b34d0 0x7f4bf40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c08da4640 1 -- 172.21.15.47:0/3622980098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c040b34d0 msgr2=0x7f4bf40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:19.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c08da4640 1 --2- 172.21.15.47:0/3622980098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c040b34d0 0x7f4bf40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c08da4640 1 -- 172.21.15.47:0/3622980098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bf4004800 msgr2=0x7f4bf4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:19.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c08da4640 1 --2- 172.21.15.47:0/3622980098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bf4004800 0x7f4bf4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c08da4640 1 -- 172.21.15.47:0/3622980098 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf4003520 con 0x7f4bf40039b0 2024-04-14T23:35:19.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.048+0000 7f4c095a5640 1 --2- 172.21.15.47:0/3622980098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c040b34d0 0x7f4bf40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:19.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.049+0000 7f4c08da4640 1 --2- 172.21.15.47:0/3622980098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bf40039b0 0x7f4bf4003dd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009ac0 tx=0x7f4bf4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ea9bfa71a39f82 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:19.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.049+0000 7f4c037fe640 1 -- 172.21.15.47:0/3622980098 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8039070 con 0x7f4bf40039b0 2024-04-14T23:35:19.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.049+0000 7f4c037fe640 1 -- 172.21.15.47:0/3622980098 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf802c6b0 con 0x7f4bf40039b0 2024-04-14T23:35:19.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.049+0000 7f4c037fe640 1 -- 172.21.15.47:0/3622980098 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8009690 con 0x7f4bf40039b0 2024-04-14T23:35:19.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.050+0000 7f4c0b008640 1 -- 172.21.15.47:0/3622980098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bf40039b0 msgr2=0x7f4bf4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.050+0000 7f4c0b008640 1 --2- 172.21.15.47:0/3622980098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bf40039b0 0x7f4bf4003dd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009ac0 tx=0x7f4bf4005830 comp rx=0 tx=0).stop 2024-04-14T23:35:19.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.050+0000 7f4c095a5640 1 -- 172.21.15.47:0/3622980098 reap_dead start 2024-04-14T23:35:19.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.050+0000 7f4c0b008640 1 -- 172.21.15.47:0/3622980098 shutdown_connections 2024-04-14T23:35:19.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.050+0000 7f4c0b008640 1 -- 172.21.15.47:0/3622980098 >> 172.21.15.47:0/3622980098 conn(0x7f4c0406b200 msgr2=0x7f4c0406b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:19.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.050+0000 7f4c0b008640 1 -- 172.21.15.47:0/3622980098 shutdown_connections 2024-04-14T23:35:19.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.050+0000 7f4c0b008640 1 -- 172.21.15.47:0/3622980098 wait complete. 2024-04-14T23:35:19.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.051+0000 7f4c0b008640 1 Processor -- start 2024-04-14T23:35:19.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.051+0000 7f4c0b008640 1 -- start start 2024-04-14T23:35:19.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.052+0000 7f4c0b008640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bf40039b0 0x7f4c04147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.052+0000 7f4c0b008640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c041f32b0 0x7f4c040b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.052+0000 7f4c0b008640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c04149280 0x7f4c04149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.052+0000 7f4c0b008640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0406db30 con 0x7f4bf40039b0 2024-04-14T23:35:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.052+0000 7f4c0b008640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0406d600 con 0x7f4c041f32b0 2024-04-14T23:35:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.052+0000 7f4c0b008640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0406de10 con 0x7f4c04149280 2024-04-14T23:35:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.052+0000 7f4c08da4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bf40039b0 0x7f4c04147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.052+0000 7f4c08da4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bf40039b0 0x7f4c04147b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36338/0 (socket says 172.21.15.47:36338) 2024-04-14T23:35:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.052+0000 7f4c08da4640 1 -- 172.21.15.47:0/1550163489 learned_addr learned my addr 172.21.15.47:0/1550163489 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.052+0000 7f4c08da4640 1 -- 172.21.15.47:0/1550163489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c04149280 msgr2=0x7f4c04149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.052+0000 7f4c095a5640 1 --2- 172.21.15.47:0/1550163489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c04149280 0x7f4c04149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.052+0000 7f4c03fff640 1 --2- 172.21.15.47:0/1550163489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c041f32b0 0x7f4c040b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.052+0000 7f4c08da4640 1 --2- 172.21.15.47:0/1550163489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c04149280 0x7f4c04149be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.052+0000 7f4c08da4640 1 -- 172.21.15.47:0/1550163489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c041f32b0 msgr2=0x7f4c040b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.052+0000 7f4c08da4640 1 --2- 172.21.15.47:0/1550163489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c041f32b0 0x7f4c040b0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.052+0000 7f4c08da4640 1 -- 172.21.15.47:0/1550163489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c041f3730 con 0x7f4bf40039b0 2024-04-14T23:35:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.053+0000 7f4c08da4640 1 --2- 172.21.15.47:0/1550163489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bf40039b0 0x7f4c04147b50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8037040 tx=0x7f4bf8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.053+0000 7f4c017fa640 1 -- 172.21.15.47:0/1550163489 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8042020 con 0x7f4bf40039b0 2024-04-14T23:35:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.053+0000 7f4c017fa640 1 -- 172.21.15.47:0/1550163489 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf803a040 con 0x7f4bf40039b0 2024-04-14T23:35:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.053+0000 7f4c0b008640 1 -- 172.21.15.47:0/1550163489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c041481e0 con 0x7f4bf40039b0 2024-04-14T23:35:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.053+0000 7f4c017fa640 1 -- 172.21.15.47:0/1550163489 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8039070 con 0x7f4bf40039b0 2024-04-14T23:35:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.053+0000 7f4c0b008640 1 -- 172.21.15.47:0/1550163489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c041487a0 con 0x7f4bf40039b0 2024-04-14T23:35:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.054+0000 7f4c0b008640 1 -- 172.21.15.47:0/1550163489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c04073f50 con 0x7f4bf40039b0 2024-04-14T23:35:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.054+0000 7f4c017fa640 1 -- 172.21.15.47:0/1550163489 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4bf8045020 con 0x7f4bf40039b0 2024-04-14T23:35:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.054+0000 7f4c017fa640 1 --2- 172.21.15.47:0/1550163489 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4be806b9c0 0x7f4be806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.055+0000 7f4c017fa640 1 -- 172.21.15.47:0/1550163489 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f4bf80ac180 con 0x7f4bf40039b0 2024-04-14T23:35:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.055+0000 7f4c03fff640 1 --2- 172.21.15.47:0/1550163489 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4be806b9c0 0x7f4be806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.055+0000 7f4c03fff640 1 --2- 172.21.15.47:0/1550163489 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4be806b9c0 0x7f4be806de80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4c040cfb90 tx=0x7f4bf0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:19.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.059+0000 7f4c017fa640 1 -- 172.21.15.47:0/1550163489 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4bf804c070 con 0x7f4bf40039b0 2024-04-14T23:35:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.240+0000 7f4c0b008640 1 -- 172.21.15.47:0/1550163489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4c0415fc00 con 0x7f4bf40039b0 2024-04-14T23:35:19.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.241+0000 7f4c017fa640 1 -- 172.21.15.47:0/1550163489 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f4c041f3730 con 0x7f4bf40039b0 2024-04-14T23:35:19.244 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:19.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.242+0000 7f4c0b008640 1 -- 172.21.15.47:0/1550163489 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4be806b9c0 msgr2=0x7f4be806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.242+0000 7f4c0b008640 1 --2- 172.21.15.47:0/1550163489 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4be806b9c0 0x7f4be806de80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4c040cfb90 tx=0x7f4bf0009040 comp rx=0 tx=0).stop 2024-04-14T23:35:19.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.242+0000 7f4c0b008640 1 -- 172.21.15.47:0/1550163489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bf40039b0 msgr2=0x7f4c04147b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.242+0000 7f4c0b008640 1 --2- 172.21.15.47:0/1550163489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bf40039b0 0x7f4c04147b50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8037040 tx=0x7f4bf8004730 comp rx=0 tx=0).stop 2024-04-14T23:35:19.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.243+0000 7f4c0b008640 1 -- 172.21.15.47:0/1550163489 shutdown_connections 2024-04-14T23:35:19.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.243+0000 7f4c0b008640 1 --2- 172.21.15.47:0/1550163489 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4be806b9c0 0x7f4be806de80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.243+0000 7f4c0b008640 1 --2- 172.21.15.47:0/1550163489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c04149280 0x7f4c04149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.243+0000 7f4c0b008640 1 --2- 172.21.15.47:0/1550163489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c041f32b0 0x7f4c040b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.243+0000 7f4c0b008640 1 --2- 172.21.15.47:0/1550163489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bf40039b0 0x7f4c04147b50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.243+0000 7f4c0b008640 1 -- 172.21.15.47:0/1550163489 >> 172.21.15.47:0/1550163489 conn(0x7f4c0406b200 msgr2=0x7f4c04160f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:19.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.243+0000 7f4c0b008640 1 -- 172.21.15.47:0/1550163489 shutdown_connections 2024-04-14T23:35:19.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.243+0000 7f4c0b008640 1 -- 172.21.15.47:0/1550163489 wait complete. 2024-04-14T23:35:19.257 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T23:35:19.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.358+0000 7efe65bed640 1 Processor -- start 2024-04-14T23:35:19.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.358+0000 7efe65bed640 1 -- start start 2024-04-14T23:35:19.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.359+0000 7efe65bed640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efe600d2b80 0x7efe600d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.359+0000 7efe65bed640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe600b4f70 0x7efe600b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.359+0000 7efe65bed640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe600b6e10 con 0x7efe60161a70 2024-04-14T23:35:19.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.359+0000 7efe65bed640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7efe600cf540 con 0x7efe600d2b80 2024-04-14T23:35:19.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.359+0000 7efe65bed640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7efe600b7110 con 0x7efe600b4f70 2024-04-14T23:35:19.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.359+0000 7efe5effd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efe600d2b80 0x7efe600d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.359+0000 7efe5f7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7efe60161a70 0x7efe600d2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60094/0 (socket says 172.21.15.47:60094) 2024-04-14T23:35:19.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.359+0000 7efe5f7fe640 1 -- 172.21.15.47:0/157115366 learned_addr learned my addr 172.21.15.47:0/157115366 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:19.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.359+0000 7efe5effd640 1 -- 172.21.15.47:0/157115366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe600b4f70 msgr2=0x7efe600b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:19.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.359+0000 7efe5effd640 1 --2- 172.21.15.47:0/157115366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe600b4f70 0x7efe600b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.359+0000 7efe5effd640 1 -- 172.21.15.47:0/157115366 >> v1:172.21.15.47:6789/0 conn(0x7efe60161a70 legacy=0x7efe600d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.359+0000 7efe5effd640 1 -- 172.21.15.47:0/157115366 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe600cf790 con 0x7efe600d2b80 2024-04-14T23:35:19.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.359+0000 7efe5e7fc640 1 -- 172.21.15.47:0/157115366 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3651550238 0 0) 0x7efe600b6e10 con 0x7efe60161a70 2024-04-14T23:35:19.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.360+0000 7efe5effd640 1 --2- 172.21.15.47:0/157115366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe600d2b80 0x7efe600d1c70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efe540097a0 tx=0x7efe5402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d69e8fd12d82623 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:19.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.360+0000 7efe5e7fc640 1 -- 172.21.15.47:0/157115366 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe540315a0 con 0x7efe600d2b80 2024-04-14T23:35:19.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.360+0000 7efe5e7fc640 1 -- 172.21.15.47:0/157115366 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe54037070 con 0x7efe600d2b80 2024-04-14T23:35:19.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.360+0000 7efe5e7fc640 1 -- 172.21.15.47:0/157115366 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe54031960 con 0x7efe600d2b80 2024-04-14T23:35:19.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.361+0000 7efe65bed640 1 -- 172.21.15.47:0/157115366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe600d2b80 msgr2=0x7efe600d1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.361+0000 7efe65bed640 1 --2- 172.21.15.47:0/157115366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe600d2b80 0x7efe600d1c70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efe540097a0 tx=0x7efe5402b840 comp rx=0 tx=0).stop 2024-04-14T23:35:19.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.361+0000 7efe65bed640 1 -- 172.21.15.47:0/157115366 shutdown_connections 2024-04-14T23:35:19.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.361+0000 7efe65bed640 1 --2- 172.21.15.47:0/157115366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe600b4f70 0x7efe600b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.361+0000 7efe65bed640 1 --2- 172.21.15.47:0/157115366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe600d2b80 0x7efe600d1c70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.361+0000 7efe65bed640 1 -- 172.21.15.47:0/157115366 >> 172.21.15.47:0/157115366 conn(0x7efe600d3f20 msgr2=0x7efe600d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:19.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.361+0000 7efe65bed640 1 -- 172.21.15.47:0/157115366 shutdown_connections 2024-04-14T23:35:19.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.361+0000 7efe65bed640 1 -- 172.21.15.47:0/157115366 wait complete. 2024-04-14T23:35:19.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.362+0000 7efe65bed640 1 Processor -- start 2024-04-14T23:35:19.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.362+0000 7efe65bed640 1 -- start start 2024-04-14T23:35:19.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe65bed640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe600b4f70 0x7efe600cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe65bed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe600d2b80 0x7efe600b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe65bed640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe60161a70 0x7efe601523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe65bed640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efe600cfd50 con 0x7efe600d2b80 2024-04-14T23:35:19.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe65bed640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efe60161e50 con 0x7efe60161a70 2024-04-14T23:35:19.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe65bed640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7efe600b7ae0 con 0x7efe600b4f70 2024-04-14T23:35:19.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe5effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe600d2b80 0x7efe600b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe5effd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe600d2b80 0x7efe600b29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36352/0 (socket says 172.21.15.47:36352) 2024-04-14T23:35:19.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe5effd640 1 -- 172.21.15.47:0/508974944 learned_addr learned my addr 172.21.15.47:0/508974944 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:19.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe5f7fe640 1 --2- 172.21.15.47:0/508974944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe600b4f70 0x7efe600cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe5ffff640 1 --2- 172.21.15.47:0/508974944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe60161a70 0x7efe601523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe5effd640 1 -- 172.21.15.47:0/508974944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe600b4f70 msgr2=0x7efe600cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe5effd640 1 --2- 172.21.15.47:0/508974944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe600b4f70 0x7efe600cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe5effd640 1 -- 172.21.15.47:0/508974944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe60161a70 msgr2=0x7efe601523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe5effd640 1 --2- 172.21.15.47:0/508974944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe60161a70 0x7efe601523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe5effd640 1 -- 172.21.15.47:0/508974944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe601528e0 con 0x7efe600d2b80 2024-04-14T23:35:19.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe5ffff640 1 --2- 172.21.15.47:0/508974944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe60161a70 0x7efe601523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:19.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.363+0000 7efe5effd640 1 --2- 172.21.15.47:0/508974944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe600d2b80 0x7efe600b29c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efe540097a0 tx=0x7efe540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:19.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.364+0000 7efe47fff640 1 -- 172.21.15.47:0/508974944 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe54004230 con 0x7efe600d2b80 2024-04-14T23:35:19.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.364+0000 7efe47fff640 1 -- 172.21.15.47:0/508974944 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe540043f0 con 0x7efe600d2b80 2024-04-14T23:35:19.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.364+0000 7efe65bed640 1 -- 172.21.15.47:0/508974944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe600cb500 con 0x7efe600d2b80 2024-04-14T23:35:19.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.364+0000 7efe47fff640 1 -- 172.21.15.47:0/508974944 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe54032880 con 0x7efe600d2b80 2024-04-14T23:35:19.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.364+0000 7efe65bed640 1 -- 172.21.15.47:0/508974944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe600cbac0 con 0x7efe600d2b80 2024-04-14T23:35:19.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.365+0000 7efe65bed640 1 -- 172.21.15.47:0/508974944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe60073f50 con 0x7efe600d2b80 2024-04-14T23:35:19.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.365+0000 7efe47fff640 1 -- 172.21.15.47:0/508974944 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7efe54032a20 con 0x7efe600d2b80 2024-04-14T23:35:19.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.365+0000 7efe47fff640 1 --2- 172.21.15.47:0/508974944 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7efe4c06b9c0 0x7efe4c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.366+0000 7efe47fff640 1 -- 172.21.15.47:0/508974944 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7efe5402f030 con 0x7efe600d2b80 2024-04-14T23:35:19.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.366+0000 7efe5f7fe640 1 --2- 172.21.15.47:0/508974944 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7efe4c06b9c0 0x7efe4c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.366+0000 7efe5f7fe640 1 --2- 172.21.15.47:0/508974944 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7efe4c06b9c0 0x7efe4c06de80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efe50000f60 tx=0x7efe50007c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:19.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.370+0000 7efe47fff640 1 -- 172.21.15.47:0/508974944 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7efe601528e0 con 0x7efe600d2b80 2024-04-14T23:35:19.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.551+0000 7efe65bed640 1 -- 172.21.15.47:0/508974944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efe600d2250 con 0x7efe600d2b80 2024-04-14T23:35:19.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.551+0000 7efe47fff640 1 -- 172.21.15.47:0/508974944 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7efe54041070 con 0x7efe600d2b80 2024-04-14T23:35:19.554 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-14T23:35:19.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.553+0000 7efe65bed640 1 -- 172.21.15.47:0/508974944 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7efe4c06b9c0 msgr2=0x7efe4c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.553+0000 7efe65bed640 1 --2- 172.21.15.47:0/508974944 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7efe4c06b9c0 0x7efe4c06de80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efe50000f60 tx=0x7efe50007c00 comp rx=0 tx=0).stop 2024-04-14T23:35:19.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.553+0000 7efe65bed640 1 -- 172.21.15.47:0/508974944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe600d2b80 msgr2=0x7efe600b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.553+0000 7efe65bed640 1 --2- 172.21.15.47:0/508974944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe600d2b80 0x7efe600b29c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efe540097a0 tx=0x7efe540046c0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.553+0000 7efe65bed640 1 -- 172.21.15.47:0/508974944 shutdown_connections 2024-04-14T23:35:19.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.553+0000 7efe65bed640 1 --2- 172.21.15.47:0/508974944 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7efe4c06b9c0 0x7efe4c06de80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.553+0000 7efe65bed640 1 --2- 172.21.15.47:0/508974944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe60161a70 0x7efe601523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.553+0000 7efe65bed640 1 --2- 172.21.15.47:0/508974944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe600d2b80 0x7efe600b29c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.553+0000 7efe65bed640 1 --2- 172.21.15.47:0/508974944 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe600b4f70 0x7efe600cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.553+0000 7efe65bed640 1 -- 172.21.15.47:0/508974944 >> 172.21.15.47:0/508974944 conn(0x7efe600d3f20 msgr2=0x7efe600b7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:19.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.553+0000 7efe65bed640 1 -- 172.21.15.47:0/508974944 shutdown_connections 2024-04-14T23:35:19.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.553+0000 7efe65bed640 1 -- 172.21.15.47:0/508974944 wait complete. 2024-04-14T23:35:19.567 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T23:35:19.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.668+0000 7ff7757c4640 1 Processor -- start 2024-04-14T23:35:19.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.668+0000 7ff7757c4640 1 -- start start 2024-04-14T23:35:19.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.669+0000 7ff7757c4640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff7700ceca0 0x7ff77006c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.669+0000 7ff7757c4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff77006d430 0x7ff77015da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.669+0000 7ff7757c4640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7700b11b0 con 0x7ff7700d0c00 2024-04-14T23:35:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.669+0000 7ff7757c4640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7ff7700d13f0 con 0x7ff7700ceca0 2024-04-14T23:35:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.669+0000 7ff7757c4640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff7700b1470 con 0x7ff77006d430 2024-04-14T23:35:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.669+0000 7ff76e7fc640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff7700d0c00 0x7ff77006cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60106/0 (socket says 172.21.15.47:60106) 2024-04-14T23:35:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.669+0000 7ff76e7fc640 1 -- 172.21.15.47:0/3017813822 learned_addr learned my addr 172.21.15.47:0/3017813822 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.669+0000 7ff76f7fe640 1 --2- 172.21.15.47:0/3017813822 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff77006d430 0x7ff77015da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.669+0000 7ff76effd640 1 --2- 172.21.15.47:0/3017813822 >> v2:172.21.15.191:3300/0 conn(0x7ff7700ceca0 0x7ff77006c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.669+0000 7ff76dffb640 1 -- 172.21.15.47:0/3017813822 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910442758 0 0) 0x7ff7700b11b0 con 0x7ff7700d0c00 2024-04-14T23:35:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.670+0000 7ff76dffb640 1 -- 172.21.15.47:0/3017813822 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff758003520 con 0x7ff7700d0c00 2024-04-14T23:35:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.670+0000 7ff76f7fe640 1 -- 172.21.15.47:0/3017813822 >> v2:172.21.15.191:3300/0 conn(0x7ff7700ceca0 msgr2=0x7ff77006c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:19.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.670+0000 7ff76f7fe640 1 --2- 172.21.15.47:0/3017813822 >> v2:172.21.15.191:3300/0 conn(0x7ff7700ceca0 0x7ff77006c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.670+0000 7ff76f7fe640 1 -- 172.21.15.47:0/3017813822 >> v1:172.21.15.47:6789/0 conn(0x7ff7700d0c00 legacy=0x7ff77006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.670+0000 7ff76dffb640 1 -- 172.21.15.47:0/3017813822 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1110551099 0 0) 0x7ff758003520 con 0x7ff7700d0c00 2024-04-14T23:35:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.670+0000 7ff76f7fe640 1 -- 172.21.15.47:0/3017813822 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7700b1750 con 0x7ff77006d430 2024-04-14T23:35:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.671+0000 7ff76f7fe640 1 --2- 172.21.15.47:0/3017813822 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff77006d430 0x7ff77015da20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff760009d90 tx=0x7ff76002bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1dc3ae51bcfff6b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.671+0000 7ff76dffb640 1 -- 172.21.15.47:0/3017813822 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760039070 con 0x7ff77006d430 2024-04-14T23:35:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.671+0000 7ff76dffb640 1 -- 172.21.15.47:0/3017813822 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff76002c8a0 con 0x7ff77006d430 2024-04-14T23:35:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.671+0000 7ff76dffb640 1 -- 172.21.15.47:0/3017813822 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764001670 con 0x7ff77006d430 2024-04-14T23:35:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.671+0000 7ff7757c4640 1 -- 172.21.15.47:0/3017813822 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff77006d430 msgr2=0x7ff77015da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.671+0000 7ff7757c4640 1 --2- 172.21.15.47:0/3017813822 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff77006d430 0x7ff77015da20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff760009d90 tx=0x7ff76002bd70 comp rx=0 tx=0).stop 2024-04-14T23:35:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.671+0000 7ff7757c4640 1 -- 172.21.15.47:0/3017813822 shutdown_connections 2024-04-14T23:35:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.671+0000 7ff7757c4640 1 --2- 172.21.15.47:0/3017813822 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff77006d430 0x7ff77015da20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.671+0000 7ff7757c4640 1 --2- 172.21.15.47:0/3017813822 >> v2:172.21.15.191:3300/0 conn(0x7ff7700ceca0 0x7ff77006c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.671+0000 7ff7757c4640 1 -- 172.21.15.47:0/3017813822 >> 172.21.15.47:0/3017813822 conn(0x7ff7700d1db0 msgr2=0x7ff7700d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:19.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.671+0000 7ff7757c4640 1 -- 172.21.15.47:0/3017813822 shutdown_connections 2024-04-14T23:35:19.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.671+0000 7ff7757c4640 1 -- 172.21.15.47:0/3017813822 wait complete. 2024-04-14T23:35:19.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.673+0000 7ff7757c4640 1 Processor -- start 2024-04-14T23:35:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.673+0000 7ff7757c4640 1 -- start start 2024-04-14T23:35:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.673+0000 7ff7757c4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff77006d430 0x7ff77006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.673+0000 7ff7757c4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff7700ceca0 0x7ff7701f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.673+0000 7ff7757c4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7700d0c00 0x7ff7701f7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.673+0000 7ff7757c4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff7700d1050 con 0x7ff7700d0c00 2024-04-14T23:35:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.673+0000 7ff7757c4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff7700cf080 con 0x7ff77006d430 2024-04-14T23:35:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.673+0000 7ff7757c4640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff7700d11d0 con 0x7ff7700ceca0 2024-04-14T23:35:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.673+0000 7ff76f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7700d0c00 0x7ff7701f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.673+0000 7ff76f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7700d0c00 0x7ff7701f7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36356/0 (socket says 172.21.15.47:36356) 2024-04-14T23:35:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.673+0000 7ff76f7fe640 1 -- 172.21.15.47:0/4092385094 learned_addr learned my addr 172.21.15.47:0/4092385094 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.674+0000 7ff76e7fc640 1 --2- 172.21.15.47:0/4092385094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff7700ceca0 0x7ff7701f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.674+0000 7ff76effd640 1 --2- 172.21.15.47:0/4092385094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff77006d430 0x7ff77006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.674+0000 7ff76f7fe640 1 -- 172.21.15.47:0/4092385094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff7700ceca0 msgr2=0x7ff7701f71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.674+0000 7ff76f7fe640 1 --2- 172.21.15.47:0/4092385094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff7700ceca0 0x7ff7701f71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.674+0000 7ff76f7fe640 1 -- 172.21.15.47:0/4092385094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff77006d430 msgr2=0x7ff77006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.674+0000 7ff76f7fe640 1 --2- 172.21.15.47:0/4092385094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff77006d430 0x7ff77006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.674+0000 7ff76f7fe640 1 -- 172.21.15.47:0/4092385094 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7701f7c60 con 0x7ff7700d0c00 2024-04-14T23:35:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.674+0000 7ff76f7fe640 1 --2- 172.21.15.47:0/4092385094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7700d0c00 0x7ff7701f7720 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff760009d90 tx=0x7ff760004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.674+0000 7ff7577fe640 1 -- 172.21.15.47:0/4092385094 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760039050 con 0x7ff7700d0c00 2024-04-14T23:35:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.674+0000 7ff7757c4640 1 -- 172.21.15.47:0/4092385094 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7701ce650 con 0x7ff7700d0c00 2024-04-14T23:35:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.674+0000 7ff7577fe640 1 -- 172.21.15.47:0/4092385094 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff760045070 con 0x7ff7700d0c00 2024-04-14T23:35:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.674+0000 7ff7577fe640 1 -- 172.21.15.47:0/4092385094 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760009450 con 0x7ff7700d0c00 2024-04-14T23:35:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.674+0000 7ff7757c4640 1 -- 172.21.15.47:0/4092385094 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7701ce910 con 0x7ff7700d0c00 2024-04-14T23:35:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.675+0000 7ff7757c4640 1 -- 172.21.15.47:0/4092385094 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7700681f0 con 0x7ff7700d0c00 2024-04-14T23:35:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.676+0000 7ff7577fe640 1 -- 172.21.15.47:0/4092385094 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ff760040690 con 0x7ff7700d0c00 2024-04-14T23:35:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.676+0000 7ff7577fe640 1 --2- 172.21.15.47:0/4092385094 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff75c06b990 0x7ff75c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.676+0000 7ff7577fe640 1 -- 172.21.15.47:0/4092385094 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7ff7600ad3a0 con 0x7ff7700d0c00 2024-04-14T23:35:19.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.676+0000 7ff76effd640 1 --2- 172.21.15.47:0/4092385094 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff75c06b990 0x7ff75c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:19.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.677+0000 7ff76effd640 1 --2- 172.21.15.47:0/4092385094 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff75c06b990 0x7ff75c06de50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff768009aa0 tx=0x7ff768009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:19.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.680+0000 7ff7577fe640 1 -- 172.21.15.47:0/4092385094 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff76007b4e0 con 0x7ff7700d0c00 2024-04-14T23:35:19.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.871+0000 7ff7757c4640 1 -- 172.21.15.47:0/4092385094 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff7700731a0 con 0x7ff7700d0c00 2024-04-14T23:35:19.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.871+0000 7ff7577fe640 1 -- 172.21.15.47:0/4092385094 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7ff76007f580 con 0x7ff7700d0c00 2024-04-14T23:35:19.874 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.873+0000 7ff7757c4640 1 -- 172.21.15.47:0/4092385094 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff75c06b990 msgr2=0x7ff75c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.873+0000 7ff7757c4640 1 --2- 172.21.15.47:0/4092385094 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff75c06b990 0x7ff75c06de50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff768009aa0 tx=0x7ff768009190 comp rx=0 tx=0).stop 2024-04-14T23:35:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.873+0000 7ff7757c4640 1 -- 172.21.15.47:0/4092385094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7700d0c00 msgr2=0x7ff7701f7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.873+0000 7ff7757c4640 1 --2- 172.21.15.47:0/4092385094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7700d0c00 0x7ff7701f7720 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff760009d90 tx=0x7ff760004a40 comp rx=0 tx=0).stop 2024-04-14T23:35:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.873+0000 7ff7757c4640 1 -- 172.21.15.47:0/4092385094 shutdown_connections 2024-04-14T23:35:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.873+0000 7ff7757c4640 1 --2- 172.21.15.47:0/4092385094 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff75c06b990 0x7ff75c06de50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.873+0000 7ff7757c4640 1 --2- 172.21.15.47:0/4092385094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7700d0c00 0x7ff7701f7720 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.873+0000 7ff7757c4640 1 --2- 172.21.15.47:0/4092385094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff7700ceca0 0x7ff7701f71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.873+0000 7ff7757c4640 1 --2- 172.21.15.47:0/4092385094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff77006d430 0x7ff77006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:19.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.873+0000 7ff7757c4640 1 -- 172.21.15.47:0/4092385094 >> 172.21.15.47:0/4092385094 conn(0x7ff7700d1db0 msgr2=0x7ff7701e64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:19.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.873+0000 7ff7757c4640 1 -- 172.21.15.47:0/4092385094 shutdown_connections 2024-04-14T23:35:19.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:19.873+0000 7ff7757c4640 1 -- 172.21.15.47:0/4092385094 wait complete. 2024-04-14T23:35:19.917 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-14T23:35:19.917 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.016+0000 7f35be288640 1 Processor -- start 2024-04-14T23:35:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.016+0000 7f35be288640 1 -- start start 2024-04-14T23:35:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.016+0000 7f35be288640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35b80cca50 0x7f35b80cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.016+0000 7f35be288640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f35b80d16d0 0x7f35b8162480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.016+0000 7f35be288640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35b815e9a0 con 0x7f35b80ceab0 2024-04-14T23:35:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.016+0000 7f35be288640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f35b815f5b0 con 0x7f35b80d16d0 2024-04-14T23:35:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.016+0000 7f35be288640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f35b815ec80 con 0x7f35b80cca50 2024-04-14T23:35:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.017+0000 7f35bc825640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f35b80d16d0 0x7f35b8162480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.017+0000 7f35bc825640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f35b80d16d0 0x7f35b8162480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36366/0 (socket says 172.21.15.47:36366) 2024-04-14T23:35:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.017+0000 7f35bc825640 1 -- 172.21.15.47:0/1459499975 learned_addr learned my addr 172.21.15.47:0/1459499975 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.017+0000 7f35b7fff640 1 --2- 172.21.15.47:0/1459499975 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35b80cca50 0x7f35b80cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.017+0000 7f35bc825640 1 -- 172.21.15.47:0/1459499975 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35b80cca50 msgr2=0x7f35b80cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.017+0000 7f35bc825640 1 --2- 172.21.15.47:0/1459499975 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35b80cca50 0x7f35b80cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.017+0000 7f35bc825640 1 -- 172.21.15.47:0/1459499975 >> v1:172.21.15.191:6789/0 conn(0x7f35b80ceab0 legacy=0x7f35b8161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.017+0000 7f35bc825640 1 -- 172.21.15.47:0/1459499975 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b815ef60 con 0x7f35b80d16d0 2024-04-14T23:35:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.017+0000 7f35b7fff640 1 --2- 172.21.15.47:0/1459499975 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35b80cca50 0x7f35b80cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.018+0000 7f35bc825640 1 --2- 172.21.15.47:0/1459499975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35b80d16d0 0x7f35b8162480 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009e50 tx=0x7f35b002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9b8390d749fc3c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.018+0000 7f35b6ffd640 1 -- 172.21.15.47:0/1459499975 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b002c950 con 0x7f35b80d16d0 2024-04-14T23:35:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.018+0000 7f35b6ffd640 1 -- 172.21.15.47:0/1459499975 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b002caf0 con 0x7f35b80d16d0 2024-04-14T23:35:20.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.018+0000 7f35b6ffd640 1 -- 172.21.15.47:0/1459499975 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b00343f0 con 0x7f35b80d16d0 2024-04-14T23:35:20.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.018+0000 7f35be288640 1 -- 172.21.15.47:0/1459499975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35b80d16d0 msgr2=0x7f35b8162480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.018+0000 7f35be288640 1 --2- 172.21.15.47:0/1459499975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35b80d16d0 0x7f35b8162480 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009e50 tx=0x7f35b002bdb0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.018+0000 7f35be288640 1 -- 172.21.15.47:0/1459499975 shutdown_connections 2024-04-14T23:35:20.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.018+0000 7f35be288640 1 --2- 172.21.15.47:0/1459499975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35b80d16d0 0x7f35b8162480 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.018+0000 7f35be288640 1 --2- 172.21.15.47:0/1459499975 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35b80cca50 0x7f35b80cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.018+0000 7f35be288640 1 -- 172.21.15.47:0/1459499975 >> 172.21.15.47:0/1459499975 conn(0x7f35b80d0bb0 msgr2=0x7f35b80d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:20.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.018+0000 7f35be288640 1 -- 172.21.15.47:0/1459499975 shutdown_connections 2024-04-14T23:35:20.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.018+0000 7f35be288640 1 -- 172.21.15.47:0/1459499975 wait complete. 2024-04-14T23:35:20.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.019+0000 7f35be288640 1 Processor -- start 2024-04-14T23:35:20.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.020+0000 7f35be288640 1 -- start start 2024-04-14T23:35:20.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.020+0000 7f35be288640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35b80cca50 0x7f35b80b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.020+0000 7f35be288640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35b80ceab0 0x7f35b815bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.020+0000 7f35be288640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35b80d16d0 0x7f35b815c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.020+0000 7f35be288640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f35b815e660 con 0x7f35b80d16d0 2024-04-14T23:35:20.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.020+0000 7f35be288640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f35b80cd370 con 0x7f35b80ceab0 2024-04-14T23:35:20.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.020+0000 7f35be288640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f35b80cb3c0 con 0x7f35b80cca50 2024-04-14T23:35:20.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.020+0000 7f35bc825640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35b80d16d0 0x7f35b815c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.020+0000 7f35bc825640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35b80d16d0 0x7f35b815c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36372/0 (socket says 172.21.15.47:36372) 2024-04-14T23:35:20.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.020+0000 7f35bc825640 1 -- 172.21.15.47:0/590651277 learned_addr learned my addr 172.21.15.47:0/590651277 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:20.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.021+0000 7f35b77fe640 1 --2- 172.21.15.47:0/590651277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35b80ceab0 0x7f35b815bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.021+0000 7f35b7fff640 1 --2- 172.21.15.47:0/590651277 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35b80cca50 0x7f35b80b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.021+0000 7f35bc825640 1 -- 172.21.15.47:0/590651277 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35b80cca50 msgr2=0x7f35b80b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.021+0000 7f35bc825640 1 --2- 172.21.15.47:0/590651277 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35b80cca50 0x7f35b80b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.021+0000 7f35bc825640 1 -- 172.21.15.47:0/590651277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35b80ceab0 msgr2=0x7f35b815bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.021+0000 7f35bc825640 1 --2- 172.21.15.47:0/590651277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35b80ceab0 0x7f35b815bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.021+0000 7f35bc825640 1 -- 172.21.15.47:0/590651277 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b80b1270 con 0x7f35b80d16d0 2024-04-14T23:35:20.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.021+0000 7f35bc825640 1 --2- 172.21.15.47:0/590651277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35b80d16d0 0x7f35b815c000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009e50 tx=0x7f35b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:20.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.021+0000 7f35b4ff9640 1 -- 172.21.15.47:0/590651277 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b0044020 con 0x7f35b80d16d0 2024-04-14T23:35:20.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.021+0000 7f35b4ff9640 1 -- 172.21.15.47:0/590651277 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b0040690 con 0x7f35b80d16d0 2024-04-14T23:35:20.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.021+0000 7f35be288640 1 -- 172.21.15.47:0/590651277 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b8161800 con 0x7f35b80d16d0 2024-04-14T23:35:20.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.021+0000 7f35b4ff9640 1 -- 172.21.15.47:0/590651277 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b0040a80 con 0x7f35b80d16d0 2024-04-14T23:35:20.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.021+0000 7f35be288640 1 -- 172.21.15.47:0/590651277 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b80b17f0 con 0x7f35b80d16d0 2024-04-14T23:35:20.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.022+0000 7f35be288640 1 -- 172.21.15.47:0/590651277 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35b8075430 con 0x7f35b80d16d0 2024-04-14T23:35:20.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.022+0000 7f35b4ff9640 1 -- 172.21.15.47:0/590651277 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f35b0047020 con 0x7f35b80d16d0 2024-04-14T23:35:20.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.023+0000 7f35b4ff9640 1 --2- 172.21.15.47:0/590651277 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f35a406b990 0x7f35a406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.023+0000 7f35b4ff9640 1 -- 172.21.15.47:0/590651277 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f35b00ad850 con 0x7f35b80d16d0 2024-04-14T23:35:20.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.023+0000 7f35b7fff640 1 --2- 172.21.15.47:0/590651277 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f35a406b990 0x7f35a406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.024+0000 7f35b7fff640 1 --2- 172.21.15.47:0/590651277 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f35a406b990 0x7f35a406de50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00a990 tx=0x7f35ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:20.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.027+0000 7f35b4ff9640 1 -- 172.21.15.47:0/590651277 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f35b004e030 con 0x7f35b80d16d0 2024-04-14T23:35:20.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.212+0000 7f35be288640 1 -- 172.21.15.47:0/590651277 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35b80cb120 con 0x7f35b80d16d0 2024-04-14T23:35:20.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.213+0000 7f35b4ff9640 1 -- 172.21.15.47:0/590651277 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18892 (secure 0 0 0) 0x7f35b007c060 con 0x7f35b80d16d0 2024-04-14T23:35:20.216 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:20.217 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:35:19.819811+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:20.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.215+0000 7f35be288640 1 -- 172.21.15.47:0/590651277 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f35a406b990 msgr2=0x7f35a406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.215+0000 7f35be288640 1 --2- 172.21.15.47:0/590651277 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f35a406b990 0x7f35a406de50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00a990 tx=0x7f35ac008040 comp rx=0 tx=0).stop 2024-04-14T23:35:20.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.215+0000 7f35be288640 1 -- 172.21.15.47:0/590651277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35b80d16d0 msgr2=0x7f35b815c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.215+0000 7f35be288640 1 --2- 172.21.15.47:0/590651277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35b80d16d0 0x7f35b815c000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009e50 tx=0x7f35b0004a40 comp rx=0 tx=0).stop 2024-04-14T23:35:20.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.215+0000 7f35be288640 1 -- 172.21.15.47:0/590651277 shutdown_connections 2024-04-14T23:35:20.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.215+0000 7f35be288640 1 --2- 172.21.15.47:0/590651277 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f35a406b990 0x7f35a406de50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.215+0000 7f35be288640 1 --2- 172.21.15.47:0/590651277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35b80d16d0 0x7f35b815c000 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.215+0000 7f35be288640 1 --2- 172.21.15.47:0/590651277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35b80ceab0 0x7f35b815bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.215+0000 7f35be288640 1 --2- 172.21.15.47:0/590651277 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35b80cca50 0x7f35b80b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.215+0000 7f35be288640 1 -- 172.21.15.47:0/590651277 >> 172.21.15.47:0/590651277 conn(0x7f35b80d0bb0 msgr2=0x7f35b809f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:20.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.215+0000 7f35be288640 1 -- 172.21.15.47:0/590651277 shutdown_connections 2024-04-14T23:35:20.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.215+0000 7f35be288640 1 -- 172.21.15.47:0/590651277 wait complete. 2024-04-14T23:35:20.229 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T23:34:36.382034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T23:34:37.023103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T23:34:40.726418+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T23:35:20.230 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:35:20.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.331+0000 7f5f64de0640 1 Processor -- start 2024-04-14T23:35:20.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.331+0000 7f5f64de0640 1 -- start start 2024-04-14T23:35:20.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.332+0000 7f5f64de0640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5f600b2540 0x7f5f600ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.332+0000 7f5f64de0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5f600ce9e0 0x7f5f600cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.332+0000 7f5f64de0640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f600d2950 con 0x7f5f600b2160 2024-04-14T23:35:20.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.332+0000 7f5f64de0640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5f600cee50 con 0x7f5f600ce9e0 2024-04-14T23:35:20.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.332+0000 7f5f64de0640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f5f600cdd50 con 0x7f5f600b2540 2024-04-14T23:35:20.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.332+0000 7f5f5e59c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5f600b2160 0x7f5f600b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60120/0 (socket says 172.21.15.47:60120) 2024-04-14T23:35:20.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.332+0000 7f5f5e59c640 1 -- 172.21.15.47:0/3633658455 learned_addr learned my addr 172.21.15.47:0/3633658455 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:20.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.332+0000 7f5f5ed9d640 1 --2- 172.21.15.47:0/3633658455 >> v2:172.21.15.47:3300/0 conn(0x7f5f600ce9e0 0x7f5f600cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.332+0000 7f5f5ed9d640 1 -- 172.21.15.47:0/3633658455 >> v2:172.21.15.191:3300/0 conn(0x7f5f600b2540 msgr2=0x7f5f600ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:20.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.332+0000 7f5f57fff640 1 --2- 172.21.15.47:0/3633658455 >> v2:172.21.15.191:3300/0 conn(0x7f5f600b2540 0x7f5f600ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.332+0000 7f5f5dd9b640 1 -- 172.21.15.47:0/3633658455 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244135625 0 0) 0x7f5f600d2950 con 0x7f5f600b2160 2024-04-14T23:35:20.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.332+0000 7f5f5ed9d640 1 --2- 172.21.15.47:0/3633658455 >> v2:172.21.15.191:3300/0 conn(0x7f5f600b2540 0x7f5f600ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.332+0000 7f5f5ed9d640 1 -- 172.21.15.47:0/3633658455 >> v1:172.21.15.47:6789/0 conn(0x7f5f600b2160 legacy=0x7f5f600b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.332+0000 7f5f5ed9d640 1 -- 172.21.15.47:0/3633658455 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f600cd550 con 0x7f5f600ce9e0 2024-04-14T23:35:20.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.332+0000 7f5f57fff640 1 --2- 172.21.15.47:0/3633658455 >> v2:172.21.15.191:3300/0 conn(0x7f5f600b2540 0x7f5f600ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:20.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.333+0000 7f5f5ed9d640 1 --2- 172.21.15.47:0/3633658455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f600ce9e0 0x7f5f600cfae0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5f60071f60 tx=0x7f5f5802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd077f8efa74e204 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:20.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.333+0000 7f5f5dd9b640 1 -- 172.21.15.47:0/3633658455 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58039070 con 0x7f5f600ce9e0 2024-04-14T23:35:20.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.333+0000 7f5f5dd9b640 1 -- 172.21.15.47:0/3633658455 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f5802cb60 con 0x7f5f600ce9e0 2024-04-14T23:35:20.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.333+0000 7f5f5dd9b640 1 -- 172.21.15.47:0/3633658455 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58034440 con 0x7f5f600ce9e0 2024-04-14T23:35:20.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.334+0000 7f5f64de0640 1 -- 172.21.15.47:0/3633658455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f600ce9e0 msgr2=0x7f5f600cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.334+0000 7f5f64de0640 1 --2- 172.21.15.47:0/3633658455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f600ce9e0 0x7f5f600cfae0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5f60071f60 tx=0x7f5f5802bdb0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.334+0000 7f5f64de0640 1 -- 172.21.15.47:0/3633658455 shutdown_connections 2024-04-14T23:35:20.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.334+0000 7f5f64de0640 1 --2- 172.21.15.47:0/3633658455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f600ce9e0 0x7f5f600cfae0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.334+0000 7f5f64de0640 1 --2- 172.21.15.47:0/3633658455 >> v2:172.21.15.191:3300/0 conn(0x7f5f600b2540 0x7f5f600ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.334+0000 7f5f64de0640 1 -- 172.21.15.47:0/3633658455 >> 172.21.15.47:0/3633658455 conn(0x7f5f600d1d00 msgr2=0x7f5f600d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:20.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.334+0000 7f5f64de0640 1 -- 172.21.15.47:0/3633658455 shutdown_connections 2024-04-14T23:35:20.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.334+0000 7f5f64de0640 1 -- 172.21.15.47:0/3633658455 wait complete. 2024-04-14T23:35:20.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.335+0000 7f5f64de0640 1 Processor -- start 2024-04-14T23:35:20.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.335+0000 7f5f64de0640 1 -- start start 2024-04-14T23:35:20.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f64de0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f600b2160 0x7f5f600cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f64de0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f600b2540 0x7f5f6015c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f64de0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f600ce9e0 0x7f5f6014d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f64de0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5f600b2990 con 0x7f5f600b2160 2024-04-14T23:35:20.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f64de0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5f600d2c30 con 0x7f5f600ce9e0 2024-04-14T23:35:20.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f64de0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5f600c6860 con 0x7f5f600b2540 2024-04-14T23:35:20.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f5e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f600b2160 0x7f5f600cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f5e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f600b2160 0x7f5f600cb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36384/0 (socket says 172.21.15.47:36384) 2024-04-14T23:35:20.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f5e59c640 1 -- 172.21.15.47:0/3419092626 learned_addr learned my addr 172.21.15.47:0/3419092626 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f5ed9d640 1 --2- 172.21.15.47:0/3419092626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f600ce9e0 0x7f5f6014d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f57fff640 1 --2- 172.21.15.47:0/3419092626 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f600b2540 0x7f5f6015c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f5e59c640 1 -- 172.21.15.47:0/3419092626 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f600b2540 msgr2=0x7f5f6015c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f5e59c640 1 --2- 172.21.15.47:0/3419092626 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f600b2540 0x7f5f6015c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f5e59c640 1 -- 172.21.15.47:0/3419092626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f600ce9e0 msgr2=0x7f5f6014d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f5e59c640 1 --2- 172.21.15.47:0/3419092626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f600ce9e0 0x7f5f6014d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f5e59c640 1 -- 172.21.15.47:0/3419092626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6006cdc0 con 0x7f5f600b2160 2024-04-14T23:35:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f5ed9d640 1 --2- 172.21.15.47:0/3419092626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f600ce9e0 0x7f5f6014d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f5e59c640 1 --2- 172.21.15.47:0/3419092626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f600b2160 0x7f5f600cb9a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000c430 tx=0x7f5f5000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.336+0000 7f5f56ffd640 1 -- 172.21.15.47:0/3419092626 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f500074e0 con 0x7f5f600b2160 2024-04-14T23:35:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.337+0000 7f5f56ffd640 1 -- 172.21.15.47:0/3419092626 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f500047e0 con 0x7f5f600b2160 2024-04-14T23:35:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.337+0000 7f5f64de0640 1 -- 172.21.15.47:0/3419092626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f6006d0a0 con 0x7f5f600b2160 2024-04-14T23:35:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.337+0000 7f5f56ffd640 1 -- 172.21.15.47:0/3419092626 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f50004bd0 con 0x7f5f600b2160 2024-04-14T23:35:20.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.337+0000 7f5f64de0640 1 -- 172.21.15.47:0/3419092626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f6006d660 con 0x7f5f600b2160 2024-04-14T23:35:20.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.338+0000 7f5f64de0640 1 -- 172.21.15.47:0/3419092626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f60073f50 con 0x7f5f600b2160 2024-04-14T23:35:20.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.338+0000 7f5f56ffd640 1 -- 172.21.15.47:0/3419092626 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f5f50011070 con 0x7f5f600b2160 2024-04-14T23:35:20.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.339+0000 7f5f56ffd640 1 --2- 172.21.15.47:0/3419092626 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5f4006b990 0x7f5f4006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.339+0000 7f5f56ffd640 1 -- 172.21.15.47:0/3419092626 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5f5008a810 con 0x7f5f600b2160 2024-04-14T23:35:20.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.339+0000 7f5f57fff640 1 --2- 172.21.15.47:0/3419092626 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5f4006b990 0x7f5f4006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.339+0000 7f5f57fff640 1 --2- 172.21.15.47:0/3419092626 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5f4006b990 0x7f5f4006de50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5f600d1430 tx=0x7f5f48008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:20.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.343+0000 7f5f56ffd640 1 -- 172.21.15.47:0/3419092626 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5f500590b0 con 0x7f5f600b2160 2024-04-14T23:35:20.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.527+0000 7f5f64de0640 1 -- 172.21.15.47:0/3419092626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5f60067340 con 0x7f5f600b2160 2024-04-14T23:35:20.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.527+0000 7f5f56ffd640 1 -- 172.21.15.47:0/3419092626 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f5f500589b0 con 0x7f5f600b2160 2024-04-14T23:35:20.531 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:35:20.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.529+0000 7f5f64de0640 1 -- 172.21.15.47:0/3419092626 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5f4006b990 msgr2=0x7f5f4006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.529+0000 7f5f64de0640 1 --2- 172.21.15.47:0/3419092626 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5f4006b990 0x7f5f4006de50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5f600d1430 tx=0x7f5f48008040 comp rx=0 tx=0).stop 2024-04-14T23:35:20.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.529+0000 7f5f64de0640 1 -- 172.21.15.47:0/3419092626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f600b2160 msgr2=0x7f5f600cb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.529+0000 7f5f64de0640 1 --2- 172.21.15.47:0/3419092626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f600b2160 0x7f5f600cb9a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000c430 tx=0x7f5f5000c8f0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.530+0000 7f5f64de0640 1 -- 172.21.15.47:0/3419092626 shutdown_connections 2024-04-14T23:35:20.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.530+0000 7f5f64de0640 1 --2- 172.21.15.47:0/3419092626 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5f4006b990 0x7f5f4006de50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.530+0000 7f5f64de0640 1 --2- 172.21.15.47:0/3419092626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f600ce9e0 0x7f5f6014d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.530+0000 7f5f64de0640 1 --2- 172.21.15.47:0/3419092626 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f600b2540 0x7f5f6015c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.530+0000 7f5f64de0640 1 --2- 172.21.15.47:0/3419092626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f600b2160 0x7f5f600cb9a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.530+0000 7f5f64de0640 1 -- 172.21.15.47:0/3419092626 >> 172.21.15.47:0/3419092626 conn(0x7f5f600d1d00 msgr2=0x7f5f6015c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:20.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.530+0000 7f5f64de0640 1 -- 172.21.15.47:0/3419092626 shutdown_connections 2024-04-14T23:35:20.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.530+0000 7f5f64de0640 1 -- 172.21.15.47:0/3419092626 wait complete. 2024-04-14T23:35:20.544 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T23:35:20.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.646+0000 7f33d58de640 1 Processor -- start 2024-04-14T23:35:20.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.646+0000 7f33d58de640 1 -- start start 2024-04-14T23:35:20.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.647+0000 7f33d58de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33d006f920 0x7f33d006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.647+0000 7f33d58de640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f33d00aeab0 0x7f33d006d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.647+0000 7f33d58de640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33d0070240 con 0x7f33d015e420 2024-04-14T23:35:20.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.647+0000 7f33d58de640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f33d006cfc0 con 0x7f33d00aeab0 2024-04-14T23:35:20.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.647+0000 7f33d58de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f33d006f3c0 con 0x7f33d006f920 2024-04-14T23:35:20.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.647+0000 7f33cf7fe640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f33d00aeab0 0x7f33d006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.647+0000 7f33ceffd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33d006f920 0x7f33d006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.647+0000 7f33cf7fe640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f33d00aeab0 0x7f33d006d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:41272/0 (socket says 172.21.15.47:41272) 2024-04-14T23:35:20.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.647+0000 7f33cf7fe640 1 -- 172.21.15.47:0/3274071719 learned_addr learned my addr 172.21.15.47:0/3274071719 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:20.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.648+0000 7f33cf7fe640 1 -- 172.21.15.47:0/3274071719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33d006f920 msgr2=0x7f33d006fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:20.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.648+0000 7f33cf7fe640 1 --2- 172.21.15.47:0/3274071719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33d006f920 0x7f33d006fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.648+0000 7f33cf7fe640 1 -- 172.21.15.47:0/3274071719 >> v1:172.21.15.191:6789/0 conn(0x7f33d015e420 legacy=0x7f33d00d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.648+0000 7f33cf7fe640 1 -- 172.21.15.47:0/3274071719 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d006c3b0 con 0x7f33d00aeab0 2024-04-14T23:35:20.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.648+0000 7f33ceffd640 1 --2- 172.21.15.47:0/3274071719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33d006f920 0x7f33d006fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:20.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.648+0000 7f33ce7fc640 1 -- 172.21.15.47:0/3274071719 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 389838595 0 0) 0x7f33d0070240 con 0x7f33d015e420 2024-04-14T23:35:20.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.648+0000 7f33cf7fe640 1 --2- 172.21.15.47:0/3274071719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33d00aeab0 0x7f33d006d450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009e50 tx=0x7f33c802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56edffce6ab3fcf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:20.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.649+0000 7f33ce7fc640 1 -- 172.21.15.47:0/3274071719 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c802cb00 con 0x7f33d00aeab0 2024-04-14T23:35:20.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.649+0000 7f33ce7fc640 1 -- 172.21.15.47:0/3274071719 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c802cca0 con 0x7f33d00aeab0 2024-04-14T23:35:20.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.649+0000 7f33ce7fc640 1 -- 172.21.15.47:0/3274071719 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8034610 con 0x7f33d00aeab0 2024-04-14T23:35:20.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.649+0000 7f33d58de640 1 -- 172.21.15.47:0/3274071719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33d00aeab0 msgr2=0x7f33d006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.649+0000 7f33d58de640 1 --2- 172.21.15.47:0/3274071719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33d00aeab0 0x7f33d006d450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009e50 tx=0x7f33c802bf60 comp rx=0 tx=0).stop 2024-04-14T23:35:20.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.650+0000 7f33d58de640 1 -- 172.21.15.47:0/3274071719 shutdown_connections 2024-04-14T23:35:20.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.650+0000 7f33d58de640 1 --2- 172.21.15.47:0/3274071719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33d00aeab0 0x7f33d006d450 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.650+0000 7f33d58de640 1 --2- 172.21.15.47:0/3274071719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33d006f920 0x7f33d006fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.650+0000 7f33d58de640 1 -- 172.21.15.47:0/3274071719 >> 172.21.15.47:0/3274071719 conn(0x7f33d00b37d0 msgr2=0x7f33d00b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:20.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.650+0000 7f33d58de640 1 -- 172.21.15.47:0/3274071719 shutdown_connections 2024-04-14T23:35:20.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.650+0000 7f33d58de640 1 -- 172.21.15.47:0/3274071719 wait complete. 2024-04-14T23:35:20.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.651+0000 7f33d58de640 1 Processor -- start 2024-04-14T23:35:20.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.651+0000 7f33d58de640 1 -- start start 2024-04-14T23:35:20.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.651+0000 7f33d58de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33d006f920 0x7f33d0156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.651+0000 7f33d58de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33d00aeab0 0x7f33d00ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.651+0000 7f33d58de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33d015e420 0x7f33d00ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.651+0000 7f33d58de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f33d006cc50 con 0x7f33d015e420 2024-04-14T23:35:20.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.651+0000 7f33d58de640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f33d006c970 con 0x7f33d006f920 2024-04-14T23:35:20.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.651+0000 7f33d58de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f33d00d1210 con 0x7f33d00aeab0 2024-04-14T23:35:20.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33cf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33d015e420 0x7f33d00ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33cf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33d015e420 0x7f33d00ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36398/0 (socket says 172.21.15.47:36398) 2024-04-14T23:35:20.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33cf7fe640 1 -- 172.21.15.47:0/75067745 learned_addr learned my addr 172.21.15.47:0/75067745 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:20.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33ceffd640 1 --2- 172.21.15.47:0/75067745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33d006f920 0x7f33d0156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33c7fff640 1 --2- 172.21.15.47:0/75067745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33d00aeab0 0x7f33d00ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33cf7fe640 1 -- 172.21.15.47:0/75067745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33d00aeab0 msgr2=0x7f33d00ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33cf7fe640 1 --2- 172.21.15.47:0/75067745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33d00aeab0 0x7f33d00ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33cf7fe640 1 -- 172.21.15.47:0/75067745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33d006f920 msgr2=0x7f33d0156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33cf7fe640 1 --2- 172.21.15.47:0/75067745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33d006f920 0x7f33d0156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33cf7fe640 1 -- 172.21.15.47:0/75067745 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d00cc2d0 con 0x7f33d015e420 2024-04-14T23:35:20.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33c7fff640 1 --2- 172.21.15.47:0/75067745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33d00aeab0 0x7f33d00ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:20.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33cf7fe640 1 --2- 172.21.15.47:0/75067745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33d015e420 0x7f33d00ce750 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f33c8036040 tx=0x7f33c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:20.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33ccff9640 1 -- 172.21.15.47:0/75067745 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8043020 con 0x7f33d015e420 2024-04-14T23:35:20.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33ccff9640 1 -- 172.21.15.47:0/75067745 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c802ce50 con 0x7f33d015e420 2024-04-14T23:35:20.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33d58de640 1 -- 172.21.15.47:0/75067745 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d00cb020 con 0x7f33d015e420 2024-04-14T23:35:20.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33ccff9640 1 -- 172.21.15.47:0/75067745 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8009510 con 0x7f33d015e420 2024-04-14T23:35:20.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.652+0000 7f33d58de640 1 -- 172.21.15.47:0/75067745 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d00cb5e0 con 0x7f33d015e420 2024-04-14T23:35:20.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.653+0000 7f33d58de640 1 -- 172.21.15.47:0/75067745 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33d0073f50 con 0x7f33d015e420 2024-04-14T23:35:20.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.654+0000 7f33ccff9640 1 -- 172.21.15.47:0/75067745 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f33c8046020 con 0x7f33d015e420 2024-04-14T23:35:20.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.654+0000 7f33ccff9640 1 --2- 172.21.15.47:0/75067745 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f33b006b990 0x7f33b006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.654+0000 7f33ccff9640 1 -- 172.21.15.47:0/75067745 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f33c80ad1d0 con 0x7f33d015e420 2024-04-14T23:35:20.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.654+0000 7f33ceffd640 1 --2- 172.21.15.47:0/75067745 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f33b006b990 0x7f33b006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.655+0000 7f33ceffd640 1 --2- 172.21.15.47:0/75067745 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f33b006b990 0x7f33b006de50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f33d00c5630 tx=0x7f33c0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:20.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.658+0000 7f33ccff9640 1 -- 172.21.15.47:0/75067745 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f33c804d030 con 0x7f33d015e420 2024-04-14T23:35:20.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.841+0000 7f33d58de640 1 -- 172.21.15.47:0/75067745 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f33d00cf910 con 0x7f33d015e420 2024-04-14T23:35:20.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.841+0000 7f33ccff9640 1 -- 172.21.15.47:0/75067745 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f33c807b9d0 con 0x7f33d015e420 2024-04-14T23:35:20.844 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:20.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.843+0000 7f33d58de640 1 -- 172.21.15.47:0/75067745 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f33b006b990 msgr2=0x7f33b006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.843+0000 7f33d58de640 1 --2- 172.21.15.47:0/75067745 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f33b006b990 0x7f33b006de50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f33d00c5630 tx=0x7f33c0009190 comp rx=0 tx=0).stop 2024-04-14T23:35:20.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.843+0000 7f33d58de640 1 -- 172.21.15.47:0/75067745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33d015e420 msgr2=0x7f33d00ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.843+0000 7f33d58de640 1 --2- 172.21.15.47:0/75067745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33d015e420 0x7f33d00ce750 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f33c8036040 tx=0x7f33c8004a40 comp rx=0 tx=0).stop 2024-04-14T23:35:20.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.843+0000 7f33d58de640 1 -- 172.21.15.47:0/75067745 shutdown_connections 2024-04-14T23:35:20.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.843+0000 7f33d58de640 1 --2- 172.21.15.47:0/75067745 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f33b006b990 0x7f33b006de50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.843+0000 7f33d58de640 1 --2- 172.21.15.47:0/75067745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33d015e420 0x7f33d00ce750 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.843+0000 7f33d58de640 1 --2- 172.21.15.47:0/75067745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33d00aeab0 0x7f33d00ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.843+0000 7f33d58de640 1 --2- 172.21.15.47:0/75067745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33d006f920 0x7f33d0156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.843+0000 7f33d58de640 1 -- 172.21.15.47:0/75067745 >> 172.21.15.47:0/75067745 conn(0x7f33d00b37d0 msgr2=0x7f33d00b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:20.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.843+0000 7f33d58de640 1 -- 172.21.15.47:0/75067745 shutdown_connections 2024-04-14T23:35:20.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.843+0000 7f33d58de640 1 -- 172.21.15.47:0/75067745 wait complete. 2024-04-14T23:35:20.857 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T23:35:20.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.959+0000 7f6ac9260640 1 Processor -- start 2024-04-14T23:35:20.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.959+0000 7f6ac9260640 1 -- start start 2024-04-14T23:35:20.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.959+0000 7f6ac9260640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ac40b2540 0x7f6ac40ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.959+0000 7f6ac9260640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6ac40ce9e0 0x7f6ac40cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.959+0000 7f6ac9260640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac40d2950 con 0x7f6ac40b2160 2024-04-14T23:35:20.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.959+0000 7f6ac9260640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac40cdd50 con 0x7f6ac40ce9e0 2024-04-14T23:35:20.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.959+0000 7f6ac9260640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac40d2c30 con 0x7f6ac40b2540 2024-04-14T23:35:20.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac2d9d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6ac40b2160 0x7f6ac40b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60122/0 (socket says 172.21.15.47:60122) 2024-04-14T23:35:20.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac2d9d640 1 -- 172.21.15.47:0/3106948934 learned_addr learned my addr 172.21.15.47:0/3106948934 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:20.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac259c640 1 -- 172.21.15.47:0/3106948934 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3420033242 0 0) 0x7f6ac40d2950 con 0x7f6ac40b2160 2024-04-14T23:35:20.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac259c640 1 -- 172.21.15.47:0/3106948934 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ab0003520 con 0x7f6ac40b2160 2024-04-14T23:35:20.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac359e640 1 --2- 172.21.15.47:0/3106948934 >> v2:172.21.15.191:3300/0 conn(0x7f6ac40ce9e0 0x7f6ac40cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6abbfff640 1 --2- 172.21.15.47:0/3106948934 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ac40b2540 0x7f6ac40ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac259c640 1 -- 172.21.15.47:0/3106948934 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2477268921 0 0) 0x7f6ab0003520 con 0x7f6ac40b2160 2024-04-14T23:35:20.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac259c640 1 -- 172.21.15.47:0/3106948934 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ac40b2540 msgr2=0x7f6ac40ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:20.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac259c640 1 --2- 172.21.15.47:0/3106948934 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ac40b2540 0x7f6ac40ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac259c640 1 -- 172.21.15.47:0/3106948934 >> v2:172.21.15.191:3300/0 conn(0x7f6ac40ce9e0 msgr2=0x7f6ac40cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:20.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac259c640 1 --2- 172.21.15.47:0/3106948934 >> v2:172.21.15.191:3300/0 conn(0x7f6ac40ce9e0 0x7f6ac40cfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac259c640 1 -- 172.21.15.47:0/3106948934 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac40cd550 con 0x7f6ac40b2160 2024-04-14T23:35:20.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac259c640 1 -- 172.21.15.47:0/3106948934 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f6ab4001670 con 0x7f6ac40b2160 2024-04-14T23:35:20.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac359e640 1 --2- 172.21.15.47:0/3106948934 >> v2:172.21.15.191:3300/0 conn(0x7f6ac40ce9e0 0x7f6ac40cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:20.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac259c640 1 -- 172.21.15.47:0/3106948934 >> v1:172.21.15.47:6789/0 conn(0x7f6ac40b2160 legacy=0x7f6ac40b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac259c640 1 --2- 172.21.15.47:0/3106948934 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ac40b2540 0x7f6ab00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac259c640 1 --2- 172.21.15.47:0/3106948934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ab0003fe0 0x7f6ab0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac259c640 1 --2- 172.21.15.47:0/3106948934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ab0004d40 0x7f6ab00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac259c640 1 -- 172.21.15.47:0/3106948934 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac40d2c30 con 0x7f6ab0004d40 2024-04-14T23:35:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac259c640 1 -- 172.21.15.47:0/3106948934 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab000bbb0 con 0x7f6ab0003fe0 2024-04-14T23:35:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac259c640 1 -- 172.21.15.47:0/3106948934 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab000bdb0 con 0x7f6ac40b2540 2024-04-14T23:35:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac359e640 1 --2- 172.21.15.47:0/3106948934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ab0004d40 0x7f6ab00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6ac2d9d640 1 --2- 172.21.15.47:0/3106948934 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ac40b2540 0x7f6ab00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.960+0000 7f6abbfff640 1 --2- 172.21.15.47:0/3106948934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ab0003fe0 0x7f6ab0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.961+0000 7f6ac359e640 1 -- 172.21.15.47:0/3106948934 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ac40b2540 msgr2=0x7f6ab00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.961+0000 7f6ac359e640 1 --2- 172.21.15.47:0/3106948934 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ac40b2540 0x7f6ab00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.961+0000 7f6ac359e640 1 -- 172.21.15.47:0/3106948934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ab0003fe0 msgr2=0x7f6ab0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.961+0000 7f6ac359e640 1 --2- 172.21.15.47:0/3106948934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ab0003fe0 0x7f6ab0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.961+0000 7f6ac359e640 1 -- 172.21.15.47:0/3106948934 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab0003520 con 0x7f6ab0004d40 2024-04-14T23:35:20.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.961+0000 7f6ac359e640 1 --2- 172.21.15.47:0/3106948934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ab0004d40 0x7f6ab00051c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0073e0 tx=0x7f6ab0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbde8f5e71b63ed6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:20.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.962+0000 7f6ac259c640 1 -- 172.21.15.47:0/3106948934 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc039070 con 0x7f6ab0004d40 2024-04-14T23:35:20.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.962+0000 7f6ac259c640 1 -- 172.21.15.47:0/3106948934 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6abc02cdc0 con 0x7f6ab0004d40 2024-04-14T23:35:20.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.962+0000 7f6ac259c640 1 -- 172.21.15.47:0/3106948934 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc009c80 con 0x7f6ab0004d40 2024-04-14T23:35:20.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.962+0000 7f6ac9260640 1 -- 172.21.15.47:0/3106948934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ab0004d40 msgr2=0x7f6ab00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.962+0000 7f6ac9260640 1 --2- 172.21.15.47:0/3106948934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ab0004d40 0x7f6ab00051c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0073e0 tx=0x7f6ab0005830 comp rx=0 tx=0).stop 2024-04-14T23:35:20.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.962+0000 7f6ac359e640 1 -- 172.21.15.47:0/3106948934 reap_dead start 2024-04-14T23:35:20.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.962+0000 7f6ac9260640 1 -- 172.21.15.47:0/3106948934 shutdown_connections 2024-04-14T23:35:20.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.962+0000 7f6ac9260640 1 -- 172.21.15.47:0/3106948934 >> 172.21.15.47:0/3106948934 conn(0x7f6ac40d1d00 msgr2=0x7f6ac40d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:20.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.962+0000 7f6ac9260640 1 -- 172.21.15.47:0/3106948934 shutdown_connections 2024-04-14T23:35:20.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.962+0000 7f6ac9260640 1 -- 172.21.15.47:0/3106948934 wait complete. 2024-04-14T23:35:20.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.963+0000 7f6ac9260640 1 Processor -- start 2024-04-14T23:35:20.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.963+0000 7f6ac9260640 1 -- start start 2024-04-14T23:35:20.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.964+0000 7f6ac9260640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ac415af50 0x7f6ac41f1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.964+0000 7f6ac9260640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ac41f1e40 0x7f6ac41e21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.964+0000 7f6ac9260640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ac41e2730 0x7f6ac40c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.964+0000 7f6ac9260640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac40c6860 con 0x7f6ac41f1e40 2024-04-14T23:35:20.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.964+0000 7f6ac9260640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac40b2990 con 0x7f6ac415af50 2024-04-14T23:35:20.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.964+0000 7f6ac9260640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac40c69e0 con 0x7f6ac41e2730 2024-04-14T23:35:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.964+0000 7f6abbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ac41f1e40 0x7f6ac41e21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.964+0000 7f6abbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ac41f1e40 0x7f6ac41e21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36420/0 (socket says 172.21.15.47:36420) 2024-04-14T23:35:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.964+0000 7f6abbfff640 1 -- 172.21.15.47:0/2912751309 learned_addr learned my addr 172.21.15.47:0/2912751309 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.964+0000 7f6ac2d9d640 1 --2- 172.21.15.47:0/2912751309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ac415af50 0x7f6ac41f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.964+0000 7f6ac359e640 1 --2- 172.21.15.47:0/2912751309 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ac41e2730 0x7f6ac40c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.964+0000 7f6abbfff640 1 -- 172.21.15.47:0/2912751309 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ac41e2730 msgr2=0x7f6ac40c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.964+0000 7f6abbfff640 1 --2- 172.21.15.47:0/2912751309 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ac41e2730 0x7f6ac40c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.964+0000 7f6abbfff640 1 -- 172.21.15.47:0/2912751309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ac415af50 msgr2=0x7f6ac41f1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.964+0000 7f6abbfff640 1 --2- 172.21.15.47:0/2912751309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ac415af50 0x7f6ac41f1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.964+0000 7f6abbfff640 1 -- 172.21.15.47:0/2912751309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac41f2350 con 0x7f6ac41f1e40 2024-04-14T23:35:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.965+0000 7f6abbfff640 1 --2- 172.21.15.47:0/2912751309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ac41f1e40 0x7f6ac41e21f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00b5c0 tx=0x7f6aac00ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.965+0000 7f6abb7fe640 1 -- 172.21.15.47:0/2912751309 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac018070 con 0x7f6ac41f1e40 2024-04-14T23:35:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.965+0000 7f6abb7fe640 1 -- 172.21.15.47:0/2912751309 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aac010760 con 0x7f6ac41f1e40 2024-04-14T23:35:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.965+0000 7f6ac9260640 1 -- 172.21.15.47:0/2912751309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac41f2630 con 0x7f6ac41f1e40 2024-04-14T23:35:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.965+0000 7f6abb7fe640 1 -- 172.21.15.47:0/2912751309 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac010b30 con 0x7f6ac41f1e40 2024-04-14T23:35:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.965+0000 7f6ac9260640 1 -- 172.21.15.47:0/2912751309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac40aedc0 con 0x7f6ac41f1e40 2024-04-14T23:35:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.966+0000 7f6ac9260640 1 -- 172.21.15.47:0/2912751309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac41e2b40 con 0x7f6ac41f1e40 2024-04-14T23:35:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.966+0000 7f6abb7fe640 1 -- 172.21.15.47:0/2912751309 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6aac01b070 con 0x7f6ac41f1e40 2024-04-14T23:35:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.967+0000 7f6abb7fe640 1 --2- 172.21.15.47:0/2912751309 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6aa406b990 0x7f6aa406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.967+0000 7f6abb7fe640 1 -- 172.21.15.47:0/2912751309 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6aac08af60 con 0x7f6ac41f1e40 2024-04-14T23:35:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.967+0000 7f6ac2d9d640 1 --2- 172.21.15.47:0/2912751309 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6aa406b990 0x7f6aa406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.967+0000 7f6ac2d9d640 1 --2- 172.21.15.47:0/2912751309 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6aa406b990 0x7f6aa406de50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4004840 tx=0x7f6ab4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:20.971+0000 7f6abb7fe640 1 -- 172.21.15.47:0/2912751309 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6ac41e2b40 con 0x7f6ac41f1e40 2024-04-14T23:35:21.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.151+0000 7f6ac9260640 1 -- 172.21.15.47:0/2912751309 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6ac4073f50 con 0x7f6ac41f1e40 2024-04-14T23:35:21.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.151+0000 7f6abb7fe640 1 -- 172.21.15.47:0/2912751309 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f6aac059800 con 0x7f6ac41f1e40 2024-04-14T23:35:21.154 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-14T23:35:21.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.153+0000 7f6ac9260640 1 -- 172.21.15.47:0/2912751309 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6aa406b990 msgr2=0x7f6aa406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:21.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.153+0000 7f6ac9260640 1 --2- 172.21.15.47:0/2912751309 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6aa406b990 0x7f6aa406de50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4004840 tx=0x7f6ab4009040 comp rx=0 tx=0).stop 2024-04-14T23:35:21.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.153+0000 7f6ac9260640 1 -- 172.21.15.47:0/2912751309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ac41f1e40 msgr2=0x7f6ac41e21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:21.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.153+0000 7f6ac9260640 1 --2- 172.21.15.47:0/2912751309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ac41f1e40 0x7f6ac41e21f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00b5c0 tx=0x7f6aac00ba80 comp rx=0 tx=0).stop 2024-04-14T23:35:21.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.153+0000 7f6ac9260640 1 -- 172.21.15.47:0/2912751309 shutdown_connections 2024-04-14T23:35:21.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.153+0000 7f6ac9260640 1 --2- 172.21.15.47:0/2912751309 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6aa406b990 0x7f6aa406de50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.153+0000 7f6ac9260640 1 --2- 172.21.15.47:0/2912751309 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ac41e2730 0x7f6ac40c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.153+0000 7f6ac9260640 1 --2- 172.21.15.47:0/2912751309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ac41f1e40 0x7f6ac41e21f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.153+0000 7f6ac9260640 1 --2- 172.21.15.47:0/2912751309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ac415af50 0x7f6ac41f1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.153+0000 7f6ac9260640 1 -- 172.21.15.47:0/2912751309 >> 172.21.15.47:0/2912751309 conn(0x7f6ac40d1d00 msgr2=0x7f6ac415c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:21.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.153+0000 7f6ac9260640 1 -- 172.21.15.47:0/2912751309 shutdown_connections 2024-04-14T23:35:21.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.153+0000 7f6ac9260640 1 -- 172.21.15.47:0/2912751309 wait complete. 2024-04-14T23:35:21.168 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T23:35:21.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.269+0000 7f78b6c0f640 1 Processor -- start 2024-04-14T23:35:21.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.269+0000 7f78b6c0f640 1 -- start start 2024-04-14T23:35:21.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.270+0000 7f78b6c0f640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f78b00ceae0 0x7f78b00d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:21.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.270+0000 7f78b6c0f640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b015e7b0 con 0x7f78b006b910 2024-04-14T23:35:21.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.270+0000 7f78b6c0f640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b006f810 con 0x7f78b00c7050 2024-04-14T23:35:21.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.270+0000 7f78b6c0f640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f78b006faf0 con 0x7f78b00ceae0 2024-04-14T23:35:21.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.270+0000 7f78affff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f78b006b910 0x7f78b0161da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60132/0 (socket says 172.21.15.47:60132) 2024-04-14T23:35:21.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.270+0000 7f78affff640 1 -- 172.21.15.47:0/1973907053 learned_addr learned my addr 172.21.15.47:0/1973907053 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:21.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.270+0000 7f78b51ac640 1 --2- 172.21.15.47:0/1973907053 >> v2:172.21.15.191:3300/0 conn(0x7f78b00ceae0 0x7f78b00d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:21.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.270+0000 7f78af7fe640 1 -- 172.21.15.47:0/1973907053 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98123703 0 0) 0x7f78b015e7b0 con 0x7f78b006b910 2024-04-14T23:35:21.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.270+0000 7f78af7fe640 1 -- 172.21.15.47:0/1973907053 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78a0003520 con 0x7f78b006b910 2024-04-14T23:35:21.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.270+0000 7f78af7fe640 1 -- 172.21.15.47:0/1973907053 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1164054622 0 0) 0x7f78a0003520 con 0x7f78b006b910 2024-04-14T23:35:21.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.270+0000 7f78af7fe640 1 -- 172.21.15.47:0/1973907053 >> v2:172.21.15.191:3300/0 conn(0x7f78b00ceae0 msgr2=0x7f78b00d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:21.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.270+0000 7f78af7fe640 1 --2- 172.21.15.47:0/1973907053 >> v2:172.21.15.191:3300/0 conn(0x7f78b00ceae0 0x7f78b00d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.270+0000 7f78af7fe640 1 -- 172.21.15.47:0/1973907053 >> v1:172.21.15.191:6789/0 conn(0x7f78b00c7050 legacy=0x7f78b006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:21.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.270+0000 7f78af7fe640 1 -- 172.21.15.47:0/1973907053 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b015ea70 con 0x7f78b006b910 2024-04-14T23:35:21.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.270+0000 7f78af7fe640 1 -- 172.21.15.47:0/1973907053 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f789c001670 con 0x7f78b006b910 2024-04-14T23:35:21.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.270+0000 7f78af7fe640 1 -- 172.21.15.47:0/1973907053 >> v1:172.21.15.47:6789/0 conn(0x7f78b006b910 legacy=0x7f78b0161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:21.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.271+0000 7f78af7fe640 1 --2- 172.21.15.47:0/1973907053 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78a00039b0 0x7f78a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:21.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.271+0000 7f78af7fe640 1 --2- 172.21.15.47:0/1973907053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78a0004800 0x7f78a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:21.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.271+0000 7f78af7fe640 1 --2- 172.21.15.47:0/1973907053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78a00051c0 0x7f78a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:21.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.271+0000 7f78af7fe640 1 -- 172.21.15.47:0/1973907053 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f78b006faf0 con 0x7f78a0004800 2024-04-14T23:35:21.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.271+0000 7f78af7fe640 1 -- 172.21.15.47:0/1973907053 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f78a000c060 con 0x7f78a00051c0 2024-04-14T23:35:21.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.271+0000 7f78af7fe640 1 -- 172.21.15.47:0/1973907053 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f78a000c260 con 0x7f78a00039b0 2024-04-14T23:35:21.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.271+0000 7f78affff640 1 --2- 172.21.15.47:0/1973907053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78a0004800 0x7f78a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:21.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.271+0000 7f78b49ab640 1 --2- 172.21.15.47:0/1973907053 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78a00039b0 0x7f78a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:21.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.271+0000 7f78b51ac640 1 --2- 172.21.15.47:0/1973907053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78a00051c0 0x7f78a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:21.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.271+0000 7f78affff640 1 -- 172.21.15.47:0/1973907053 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78a00039b0 msgr2=0x7f78a0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:21.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.271+0000 7f78affff640 1 --2- 172.21.15.47:0/1973907053 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78a00039b0 0x7f78a0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.271+0000 7f78affff640 1 -- 172.21.15.47:0/1973907053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78a00051c0 msgr2=0x7f78a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:21.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.271+0000 7f78affff640 1 --2- 172.21.15.47:0/1973907053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78a00051c0 0x7f78a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.271+0000 7f78affff640 1 -- 172.21.15.47:0/1973907053 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a0003520 con 0x7f78a0004800 2024-04-14T23:35:21.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.271+0000 7f78b51ac640 1 -- 172.21.15.47:0/1973907053 reap_dead start 2024-04-14T23:35:21.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.272+0000 7f78affff640 1 --2- 172.21.15.47:0/1973907053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78a0004800 0x7f78a0004c80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f78b00d0ac0 tx=0x7f78a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6420a8e727e0b6b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:21.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.272+0000 7f78af7fe640 1 -- 172.21.15.47:0/1973907053 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c007d10 con 0x7f78a0004800 2024-04-14T23:35:21.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.272+0000 7f78af7fe640 1 -- 172.21.15.47:0/1973907053 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c030070 con 0x7f78a0004800 2024-04-14T23:35:21.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.272+0000 7f78af7fe640 1 -- 172.21.15.47:0/1973907053 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c005d30 con 0x7f78a0004800 2024-04-14T23:35:21.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.272+0000 7f78b6c0f640 1 -- 172.21.15.47:0/1973907053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78a0004800 msgr2=0x7f78a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:21.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.272+0000 7f78b6c0f640 1 --2- 172.21.15.47:0/1973907053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78a0004800 0x7f78a0004c80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f78b00d0ac0 tx=0x7f78a0005830 comp rx=0 tx=0).stop 2024-04-14T23:35:21.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.272+0000 7f78b6c0f640 1 -- 172.21.15.47:0/1973907053 shutdown_connections 2024-04-14T23:35:21.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.272+0000 7f78b6c0f640 1 --2- 172.21.15.47:0/1973907053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78a0004800 0x7f78a0004c80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.272+0000 7f78b6c0f640 1 -- 172.21.15.47:0/1973907053 >> 172.21.15.47:0/1973907053 conn(0x7f78b00b2810 msgr2=0x7f78b00b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:21.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.272+0000 7f78b6c0f640 1 -- 172.21.15.47:0/1973907053 shutdown_connections 2024-04-14T23:35:21.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.272+0000 7f78b6c0f640 1 -- 172.21.15.47:0/1973907053 wait complete. 2024-04-14T23:35:21.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.273+0000 7f78b6c0f640 1 Processor -- start 2024-04-14T23:35:21.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.274+0000 7f78b6c0f640 1 -- start start 2024-04-14T23:35:21.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.274+0000 7f78b6c0f640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78a0004800 0x7f78b00b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:21.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.274+0000 7f78b6c0f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78b0150730 0x7f78b00aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:21.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.274+0000 7f78b6c0f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78b0160b50 0x7f78b0160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:21.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.274+0000 7f78b6c0f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f78b00c7430 con 0x7f78b0160b50 2024-04-14T23:35:21.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.274+0000 7f78b6c0f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f78b006f4e0 con 0x7f78b0150730 2024-04-14T23:35:21.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.274+0000 7f78b6c0f640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f78b00c75b0 con 0x7f78a0004800 2024-04-14T23:35:21.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.274+0000 7f78b51ac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78b0160b50 0x7f78b0160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:21.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.275+0000 7f78b51ac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78b0160b50 0x7f78b0160fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36434/0 (socket says 172.21.15.47:36434) 2024-04-14T23:35:21.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.275+0000 7f78b51ac640 1 -- 172.21.15.47:0/445675706 learned_addr learned my addr 172.21.15.47:0/445675706 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:21.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.275+0000 7f78b49ab640 1 --2- 172.21.15.47:0/445675706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78a0004800 0x7f78b00b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:21.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.275+0000 7f78affff640 1 --2- 172.21.15.47:0/445675706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78b0150730 0x7f78b00aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:21.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.275+0000 7f78b51ac640 1 -- 172.21.15.47:0/445675706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78a0004800 msgr2=0x7f78b00b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:21.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.275+0000 7f78b51ac640 1 --2- 172.21.15.47:0/445675706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78a0004800 0x7f78b00b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.275+0000 7f78b51ac640 1 -- 172.21.15.47:0/445675706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78b0150730 msgr2=0x7f78b00aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:21.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.275+0000 7f78b51ac640 1 --2- 172.21.15.47:0/445675706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78b0150730 0x7f78b00aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.275+0000 7f78b51ac640 1 -- 172.21.15.47:0/445675706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b0156820 con 0x7f78b0160b50 2024-04-14T23:35:21.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.275+0000 7f78b51ac640 1 --2- 172.21.15.47:0/445675706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78b0160b50 0x7f78b0160fd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f78b00ce700 tx=0x7f78a8011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:21.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.275+0000 7f78ad7fa640 1 -- 172.21.15.47:0/445675706 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a800fc70 con 0x7f78b0160b50 2024-04-14T23:35:21.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.275+0000 7f78ad7fa640 1 -- 172.21.15.47:0/445675706 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a800fe10 con 0x7f78b0160b50 2024-04-14T23:35:21.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.275+0000 7f78b6c0f640 1 -- 172.21.15.47:0/445675706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b00b53e0 con 0x7f78b0160b50 2024-04-14T23:35:21.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.275+0000 7f78ad7fa640 1 -- 172.21.15.47:0/445675706 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a8015670 con 0x7f78b0160b50 2024-04-14T23:35:21.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.275+0000 7f78b6c0f640 1 -- 172.21.15.47:0/445675706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b00b5980 con 0x7f78b0160b50 2024-04-14T23:35:21.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.276+0000 7f78b6c0f640 1 -- 172.21.15.47:0/445675706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b006b730 con 0x7f78b0160b50 2024-04-14T23:35:21.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.277+0000 7f78ad7fa640 1 -- 172.21.15.47:0/445675706 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f78a8015810 con 0x7f78b0160b50 2024-04-14T23:35:21.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.277+0000 7f78ad7fa640 1 --2- 172.21.15.47:0/445675706 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f789406b990 0x7f789406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:21.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.277+0000 7f78ad7fa640 1 -- 172.21.15.47:0/445675706 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f78a808b960 con 0x7f78b0160b50 2024-04-14T23:35:21.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.277+0000 7f78b49ab640 1 --2- 172.21.15.47:0/445675706 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f789406b990 0x7f789406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:21.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.278+0000 7f78b49ab640 1 --2- 172.21.15.47:0/445675706 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f789406b990 0x7f789406de50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f78a4000c00 tx=0x7f78a4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:21.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.281+0000 7f78ad7fa640 1 -- 172.21.15.47:0/445675706 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f78b006b730 con 0x7f78b0160b50 2024-04-14T23:35:21.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.461+0000 7f78b6c0f640 1 -- 172.21.15.47:0/445675706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f78b0073f50 con 0x7f78b0160b50 2024-04-14T23:35:21.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.462+0000 7f78ad7fa640 1 -- 172.21.15.47:0/445675706 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f78a8019030 con 0x7f78b0160b50 2024-04-14T23:35:21.465 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:21.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.464+0000 7f78b6c0f640 1 -- 172.21.15.47:0/445675706 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f789406b990 msgr2=0x7f789406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:21.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.464+0000 7f78b6c0f640 1 --2- 172.21.15.47:0/445675706 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f789406b990 0x7f789406de50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f78a4000c00 tx=0x7f78a4009040 comp rx=0 tx=0).stop 2024-04-14T23:35:21.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.464+0000 7f78b6c0f640 1 -- 172.21.15.47:0/445675706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78b0160b50 msgr2=0x7f78b0160fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:21.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.464+0000 7f78b6c0f640 1 --2- 172.21.15.47:0/445675706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78b0160b50 0x7f78b0160fd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f78b00ce700 tx=0x7f78a8011f20 comp rx=0 tx=0).stop 2024-04-14T23:35:21.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.464+0000 7f78b6c0f640 1 -- 172.21.15.47:0/445675706 shutdown_connections 2024-04-14T23:35:21.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.464+0000 7f78b6c0f640 1 --2- 172.21.15.47:0/445675706 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f789406b990 0x7f789406de50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.464+0000 7f78b6c0f640 1 --2- 172.21.15.47:0/445675706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78b0160b50 0x7f78b0160fd0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.464+0000 7f78b6c0f640 1 --2- 172.21.15.47:0/445675706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f78b0150730 0x7f78b00aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.464+0000 7f78b6c0f640 1 --2- 172.21.15.47:0/445675706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f78a0004800 0x7f78b00b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.464+0000 7f78b6c0f640 1 -- 172.21.15.47:0/445675706 >> 172.21.15.47:0/445675706 conn(0x7f78b00b2810 msgr2=0x7f78b00cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.464+0000 7f78b6c0f640 1 -- 172.21.15.47:0/445675706 shutdown_connections 2024-04-14T23:35:21.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.464+0000 7f78b6c0f640 1 -- 172.21.15.47:0/445675706 wait complete. 2024-04-14T23:35:21.478 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-04-14T23:35:21.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.577+0000 7f9ab0860640 1 Processor -- start 2024-04-14T23:35:21.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.577+0000 7f9ab0860640 1 -- start start 2024-04-14T23:35:21.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.577+0000 7f9ab0860640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9aac0d0980 0x7f9aac0cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:21.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.577+0000 7f9ab0860640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aac0d1040 con 0x7f9aac15e420 2024-04-14T23:35:21.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.577+0000 7f9ab0860640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aac0d1320 con 0x7f9aac0cccd0 2024-04-14T23:35:21.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.577+0000 7f9ab0860640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f9aac0d0e10 con 0x7f9aac0d0980 2024-04-14T23:35:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aaa59c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9aac15e420 0x7f9aac0ce4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60148/0 (socket says 172.21.15.47:60148) 2024-04-14T23:35:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aaa59c640 1 -- 172.21.15.47:0/2703646282 learned_addr learned my addr 172.21.15.47:0/2703646282 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa9d9b640 1 --2- 172.21.15.47:0/2703646282 >> v2:172.21.15.191:3300/0 conn(0x7f9aac0d0980 0x7f9aac0cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa959a640 1 -- 172.21.15.47:0/2703646282 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3980435570 0 0) 0x7f9aac0d1040 con 0x7f9aac15e420 2024-04-14T23:35:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa959a640 1 -- 172.21.15.47:0/2703646282 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a98003520 con 0x7f9aac15e420 2024-04-14T23:35:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa959a640 1 -- 172.21.15.47:0/2703646282 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3653141708 0 0) 0x7f9a98003520 con 0x7f9aac15e420 2024-04-14T23:35:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa959a640 1 -- 172.21.15.47:0/2703646282 >> v2:172.21.15.191:3300/0 conn(0x7f9aac0d0980 msgr2=0x7f9aac0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa959a640 1 --2- 172.21.15.47:0/2703646282 >> v2:172.21.15.191:3300/0 conn(0x7f9aac0d0980 0x7f9aac0cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa959a640 1 -- 172.21.15.47:0/2703646282 >> v1:172.21.15.191:6789/0 conn(0x7f9aac0cccd0 legacy=0x7f9aac0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa959a640 1 -- 172.21.15.47:0/2703646282 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac0cc4d0 con 0x7f9aac15e420 2024-04-14T23:35:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa959a640 1 -- 172.21.15.47:0/2703646282 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f9aa4001670 con 0x7f9aac15e420 2024-04-14T23:35:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa959a640 1 -- 172.21.15.47:0/2703646282 >> v1:172.21.15.47:6789/0 conn(0x7f9aac15e420 legacy=0x7f9aac0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa959a640 1 --2- 172.21.15.47:0/2703646282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a980039b0 0x7f9a98003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa959a640 1 --2- 172.21.15.47:0/2703646282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a98004800 0x7f9a98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa959a640 1 --2- 172.21.15.47:0/2703646282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a980051c0 0x7f9a9800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa959a640 1 -- 172.21.15.47:0/2703646282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9800c040 con 0x7f9a980039b0 2024-04-14T23:35:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa959a640 1 -- 172.21.15.47:0/2703646282 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9800c1f0 con 0x7f9a98004800 2024-04-14T23:35:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa959a640 1 -- 172.21.15.47:0/2703646282 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f9a9800c3f0 con 0x7f9a980051c0 2024-04-14T23:35:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aaa59c640 1 --2- 172.21.15.47:0/2703646282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a980039b0 0x7f9a98003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aa9d9b640 1 --2- 172.21.15.47:0/2703646282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a98004800 0x7f9a98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.578+0000 7f9aaad9d640 1 --2- 172.21.15.47:0/2703646282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a980051c0 0x7f9a9800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.579+0000 7f9aaa59c640 1 -- 172.21.15.47:0/2703646282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a980051c0 msgr2=0x7f9a9800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.579+0000 7f9aaa59c640 1 --2- 172.21.15.47:0/2703646282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9a980051c0 0x7f9a9800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.579+0000 7f9aaa59c640 1 -- 172.21.15.47:0/2703646282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a98004800 msgr2=0x7f9a98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.579+0000 7f9aaa59c640 1 --2- 172.21.15.47:0/2703646282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a98004800 0x7f9a98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.579+0000 7f9aaa59c640 1 -- 172.21.15.47:0/2703646282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a98003520 con 0x7f9a980039b0 2024-04-14T23:35:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.579+0000 7f9aaad9d640 1 -- 172.21.15.47:0/2703646282 reap_dead start 2024-04-14T23:35:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.579+0000 7f9aaa59c640 1 --2- 172.21.15.47:0/2703646282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a980039b0 0x7f9a98003dd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400c210 tx=0x7f9a98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2657fa8b1aa437cf server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.579+0000 7f9aa959a640 1 -- 172.21.15.47:0/2703646282 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4007d10 con 0x7f9a980039b0 2024-04-14T23:35:21.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.579+0000 7f9aa959a640 1 -- 172.21.15.47:0/2703646282 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa4030070 con 0x7f9a980039b0 2024-04-14T23:35:21.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.579+0000 7f9aa959a640 1 -- 172.21.15.47:0/2703646282 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4005d30 con 0x7f9a980039b0 2024-04-14T23:35:21.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.580+0000 7f9ab0860640 1 -- 172.21.15.47:0/2703646282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a980039b0 msgr2=0x7f9a98003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.580+0000 7f9ab0860640 1 --2- 172.21.15.47:0/2703646282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a980039b0 0x7f9a98003dd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400c210 tx=0x7f9a98005830 comp rx=0 tx=0).stop 2024-04-14T23:35:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.580+0000 7f9ab0860640 1 -- 172.21.15.47:0/2703646282 shutdown_connections 2024-04-14T23:35:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.580+0000 7f9ab0860640 1 --2- 172.21.15.47:0/2703646282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9a980039b0 0x7f9a98003dd0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.580+0000 7f9ab0860640 1 -- 172.21.15.47:0/2703646282 >> 172.21.15.47:0/2703646282 conn(0x7f9aac0d1c30 msgr2=0x7f9aac0d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.580+0000 7f9ab0860640 1 -- 172.21.15.47:0/2703646282 shutdown_connections 2024-04-14T23:35:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.580+0000 7f9ab0860640 1 -- 172.21.15.47:0/2703646282 wait complete. 2024-04-14T23:35:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.581+0000 7f9ab0860640 1 Processor -- start 2024-04-14T23:35:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.581+0000 7f9ab0860640 1 -- start start 2024-04-14T23:35:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.582+0000 7f9ab0860640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a980039b0 0x7f9aac160c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.582+0000 7f9ab0860640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9aac0c6dd0 0x7f9aac14bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.582+0000 7f9ab0860640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9aac0c7fd0 0x7f9aac14c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:21.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.582+0000 7f9ab0860640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac15e800 con 0x7f9aac0c7fd0 2024-04-14T23:35:21.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.582+0000 7f9ab0860640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac0cc280 con 0x7f9a980039b0 2024-04-14T23:35:21.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.582+0000 7f9ab0860640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f9aac0ce4b0 con 0x7f9aac0c6dd0 2024-04-14T23:35:21.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.582+0000 7f9aaad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9aac0c7fd0 0x7f9aac14c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:21.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.582+0000 7f9aaad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9aac0c7fd0 0x7f9aac14c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36450/0 (socket says 172.21.15.47:36450) 2024-04-14T23:35:21.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.582+0000 7f9aaad9d640 1 -- 172.21.15.47:0/979167607 learned_addr learned my addr 172.21.15.47:0/979167607 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:21.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.582+0000 7f9aa9d9b640 1 --2- 172.21.15.47:0/979167607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9aac0c6dd0 0x7f9aac14bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:21.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.582+0000 7f9aaa59c640 1 --2- 172.21.15.47:0/979167607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a980039b0 0x7f9aac160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:21.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.582+0000 7f9aaad9d640 1 -- 172.21.15.47:0/979167607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9aac0c6dd0 msgr2=0x7f9aac14bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:21.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.583+0000 7f9aaad9d640 1 --2- 172.21.15.47:0/979167607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9aac0c6dd0 0x7f9aac14bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.583+0000 7f9aaad9d640 1 -- 172.21.15.47:0/979167607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a980039b0 msgr2=0x7f9aac160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:21.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.583+0000 7f9aaad9d640 1 --2- 172.21.15.47:0/979167607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a980039b0 0x7f9aac160c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:21.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.583+0000 7f9aaad9d640 1 -- 172.21.15.47:0/979167607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac0c8540 con 0x7f9aac0c7fd0 2024-04-14T23:35:21.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.583+0000 7f9aaad9d640 1 --2- 172.21.15.47:0/979167607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9aac0c7fd0 0x7f9aac14c010 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9aac071f10 tx=0x7f9a9c00fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:21.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.583+0000 7f9aa2ffd640 1 -- 172.21.15.47:0/979167607 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c003b80 con 0x7f9aac0c7fd0 2024-04-14T23:35:21.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.583+0000 7f9aa2ffd640 1 -- 172.21.15.47:0/979167607 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9c018070 con 0x7f9aac0c7fd0 2024-04-14T23:35:21.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.583+0000 7f9ab0860640 1 -- 172.21.15.47:0/979167607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aac0c62f0 con 0x7f9aac0c7fd0 2024-04-14T23:35:21.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.583+0000 7f9aa2ffd640 1 -- 172.21.15.47:0/979167607 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c0050d0 con 0x7f9aac0c7fd0 2024-04-14T23:35:21.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.583+0000 7f9ab0860640 1 -- 172.21.15.47:0/979167607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aac0c68b0 con 0x7f9aac0c7fd0 2024-04-14T23:35:21.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.584+0000 7f9ab0860640 1 -- 172.21.15.47:0/979167607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aac0c6ab0 con 0x7f9aac0c7fd0 2024-04-14T23:35:21.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.584+0000 7f9aa2ffd640 1 -- 172.21.15.47:0/979167607 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9a9c005270 con 0x7f9aac0c7fd0 2024-04-14T23:35:21.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.585+0000 7f9aa2ffd640 1 --2- 172.21.15.47:0/979167607 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9a8c06b990 0x7f9a8c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:21.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.585+0000 7f9aa2ffd640 1 -- 172.21.15.47:0/979167607 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f9a9c08a9e0 con 0x7f9aac0c7fd0 2024-04-14T23:35:21.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.585+0000 7f9aaa59c640 1 --2- 172.21.15.47:0/979167607 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9a8c06b990 0x7f9a8c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:21.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.585+0000 7f9aaa59c640 1 --2- 172.21.15.47:0/979167607 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9a8c06b990 0x7f9a8c06de50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4034000 tx=0x7f9aa4007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:21.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.589+0000 7f9aa2ffd640 1 -- 172.21.15.47:0/979167607 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9aac0c6ab0 con 0x7f9aac0c7fd0 2024-04-14T23:35:21.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:21.843+0000 7f9ab0860640 1 -- 172.21.15.47:0/979167607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7f9aac0c60e0 con 0x7f9aac0c7fd0 2024-04-14T23:35:22.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.837+0000 7f9aa2ffd640 1 -- 172.21.15.47:0/979167607 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v68) ==== 147+0+0 (secure 0 0 0) 0x7f9a9c01a310 con 0x7f9aac0c7fd0 2024-04-14T23:35:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.840+0000 7f9ab0860640 1 -- 172.21.15.47:0/979167607 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9a8c06b990 msgr2=0x7f9a8c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.840+0000 7f9ab0860640 1 --2- 172.21.15.47:0/979167607 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9a8c06b990 0x7f9a8c06de50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4034000 tx=0x7f9aa4007000 comp rx=0 tx=0).stop 2024-04-14T23:35:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.840+0000 7f9ab0860640 1 -- 172.21.15.47:0/979167607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9aac0c7fd0 msgr2=0x7f9aac14c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.840+0000 7f9ab0860640 1 --2- 172.21.15.47:0/979167607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9aac0c7fd0 0x7f9aac14c010 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9aac071f10 tx=0x7f9a9c00fd40 comp rx=0 tx=0).stop 2024-04-14T23:35:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.840+0000 7f9ab0860640 1 -- 172.21.15.47:0/979167607 shutdown_connections 2024-04-14T23:35:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.840+0000 7f9ab0860640 1 --2- 172.21.15.47:0/979167607 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9a8c06b990 0x7f9a8c06de50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.840+0000 7f9ab0860640 1 --2- 172.21.15.47:0/979167607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9aac0c7fd0 0x7f9aac14c010 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.840+0000 7f9ab0860640 1 --2- 172.21.15.47:0/979167607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9aac0c6dd0 0x7f9aac14bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.840+0000 7f9ab0860640 1 --2- 172.21.15.47:0/979167607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9a980039b0 0x7f9aac160c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:22.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.840+0000 7f9ab0860640 1 -- 172.21.15.47:0/979167607 >> 172.21.15.47:0/979167607 conn(0x7f9aac0d1c30 msgr2=0x7f9aac0d2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:22.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.840+0000 7f9ab0860640 1 -- 172.21.15.47:0/979167607 shutdown_connections 2024-04-14T23:35:22.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.840+0000 7f9ab0860640 1 -- 172.21.15.47:0/979167607 wait complete. 2024-04-14T23:35:22.857 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-14T23:35:22.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.965+0000 7fac27ed5640 1 Processor -- start 2024-04-14T23:35:22.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.965+0000 7fac27ed5640 1 -- start start 2024-04-14T23:35:22.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac27ed5640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac2015f9b0 0x7fac200ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:22.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac27ed5640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac20160810 con 0x7fac20141fb0 2024-04-14T23:35:22.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac27ed5640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac200ce7d0 con 0x7fac20070df0 2024-04-14T23:35:22.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac27ed5640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fac200cf3e0 con 0x7fac2015f9b0 2024-04-14T23:35:22.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac25470640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fac20141fb0 0x7fac2015fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60164/0 (socket says 172.21.15.47:60164) 2024-04-14T23:35:22.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac25470640 1 -- 172.21.15.47:0/3248347672 learned_addr learned my addr 172.21.15.47:0/3248347672 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:22.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac25c71640 1 --2- 172.21.15.47:0/3248347672 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac2015f9b0 0x7fac200ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:22.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac24c6f640 1 -- 172.21.15.47:0/3248347672 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3470002863 0 0) 0x7fac10001110 con 0x7fac20141fb0 2024-04-14T23:35:22.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac24c6f640 1 -- 172.21.15.47:0/3248347672 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac0c003520 con 0x7fac20141fb0 2024-04-14T23:35:22.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac24c6f640 1 -- 172.21.15.47:0/3248347672 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1148365446 0 0) 0x7fac200ce7d0 con 0x7fac20070df0 2024-04-14T23:35:22.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac24c6f640 1 -- 172.21.15.47:0/3248347672 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac10001110 con 0x7fac20070df0 2024-04-14T23:35:22.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac24c6f640 1 -- 172.21.15.47:0/3248347672 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3664926635 0 0) 0x7fac0c003520 con 0x7fac20141fb0 2024-04-14T23:35:22.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac24c6f640 1 -- 172.21.15.47:0/3248347672 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac2015f9b0 msgr2=0x7fac200ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:22.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac24c6f640 1 --2- 172.21.15.47:0/3248347672 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac2015f9b0 0x7fac200ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:22.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac24c6f640 1 -- 172.21.15.47:0/3248347672 >> v1:172.21.15.191:6789/0 conn(0x7fac20070df0 legacy=0x7fac20071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:22.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac24c6f640 1 -- 172.21.15.47:0/3248347672 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac200ceab0 con 0x7fac20141fb0 2024-04-14T23:35:22.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.966+0000 7fac24c6f640 1 -- 172.21.15.47:0/3248347672 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7fac10001840 con 0x7fac20141fb0 2024-04-14T23:35:22.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.967+0000 7fac24c6f640 1 -- 172.21.15.47:0/3248347672 >> v1:172.21.15.47:6789/0 conn(0x7fac20141fb0 legacy=0x7fac2015fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:22.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.967+0000 7fac24c6f640 1 --2- 172.21.15.47:0/3248347672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac0c003b70 0x7fac0c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:22.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.967+0000 7fac24c6f640 1 --2- 172.21.15.47:0/3248347672 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac2015f9b0 0x7fac0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:22.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.967+0000 7fac24c6f640 1 --2- 172.21.15.47:0/3248347672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac0c004d40 0x7fac0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:22.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.967+0000 7fac24c6f640 1 -- 172.21.15.47:0/3248347672 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fac200cf3e0 con 0x7fac0c004d40 2024-04-14T23:35:22.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.967+0000 7fac24c6f640 1 -- 172.21.15.47:0/3248347672 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c00bac0 con 0x7fac0c003b70 2024-04-14T23:35:22.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.967+0000 7fac24c6f640 1 -- 172.21.15.47:0/3248347672 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fac0c00bcc0 con 0x7fac2015f9b0 2024-04-14T23:35:22.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.967+0000 7fac26472640 1 --2- 172.21.15.47:0/3248347672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac0c004d40 0x7fac0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:22.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.967+0000 7fac25c71640 1 --2- 172.21.15.47:0/3248347672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac0c003b70 0x7fac0c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:22.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.967+0000 7fac25470640 1 --2- 172.21.15.47:0/3248347672 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac2015f9b0 0x7fac0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:22.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.967+0000 7fac26472640 1 -- 172.21.15.47:0/3248347672 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac2015f9b0 msgr2=0x7fac0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:22.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.967+0000 7fac26472640 1 --2- 172.21.15.47:0/3248347672 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac2015f9b0 0x7fac0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:22.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.967+0000 7fac26472640 1 -- 172.21.15.47:0/3248347672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac0c003b70 msgr2=0x7fac0c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:22.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.967+0000 7fac26472640 1 --2- 172.21.15.47:0/3248347672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac0c003b70 0x7fac0c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:22.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.967+0000 7fac26472640 1 -- 172.21.15.47:0/3248347672 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0c003520 con 0x7fac0c004d40 2024-04-14T23:35:22.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.968+0000 7fac26472640 1 --2- 172.21.15.47:0/3248347672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac0c004d40 0x7fac0c0051c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fac18001fd0 tx=0x7fac0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef275abe44f65e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:22.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.968+0000 7fac24c6f640 1 -- 172.21.15.47:0/3248347672 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac18001bf0 con 0x7fac0c004d40 2024-04-14T23:35:22.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.968+0000 7fac24c6f640 1 -- 172.21.15.47:0/3248347672 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac18003b70 con 0x7fac0c004d40 2024-04-14T23:35:22.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.968+0000 7fac24c6f640 1 -- 172.21.15.47:0/3248347672 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac180050d0 con 0x7fac0c004d40 2024-04-14T23:35:22.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.968+0000 7fac27ed5640 1 -- 172.21.15.47:0/3248347672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac0c004d40 msgr2=0x7fac0c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:22.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.968+0000 7fac27ed5640 1 --2- 172.21.15.47:0/3248347672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac0c004d40 0x7fac0c0051c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fac18001fd0 tx=0x7fac0c005830 comp rx=0 tx=0).stop 2024-04-14T23:35:22.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.968+0000 7fac26472640 1 -- 172.21.15.47:0/3248347672 reap_dead start 2024-04-14T23:35:22.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.968+0000 7fac27ed5640 1 -- 172.21.15.47:0/3248347672 shutdown_connections 2024-04-14T23:35:22.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.968+0000 7fac27ed5640 1 -- 172.21.15.47:0/3248347672 >> 172.21.15.47:0/3248347672 conn(0x7fac200b1770 msgr2=0x7fac200b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:22.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.969+0000 7fac27ed5640 1 -- 172.21.15.47:0/3248347672 shutdown_connections 2024-04-14T23:35:22.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.969+0000 7fac27ed5640 1 -- 172.21.15.47:0/3248347672 wait complete. 2024-04-14T23:35:22.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.970+0000 7fac27ed5640 1 Processor -- start 2024-04-14T23:35:22.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.970+0000 7fac27ed5640 1 -- start start 2024-04-14T23:35:22.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.970+0000 7fac27ed5640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac0c004d40 0x7fac20139530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:22.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.970+0000 7fac27ed5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac20155f00 0x7fac2015e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:22.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.970+0000 7fac27ed5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac2015ea80 0x7fac201e7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:22.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.970+0000 7fac27ed5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fac201423f0 con 0x7fac20155f00 2024-04-14T23:35:22.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.970+0000 7fac27ed5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fac200cf070 con 0x7fac2015ea80 2024-04-14T23:35:22.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.970+0000 7fac27ed5640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fac2013f0d0 con 0x7fac0c004d40 2024-04-14T23:35:22.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac25470640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac20155f00 0x7fac2015e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:22.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac25470640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac20155f00 0x7fac2015e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36460/0 (socket says 172.21.15.47:36460) 2024-04-14T23:35:22.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac25470640 1 -- 172.21.15.47:0/1604155033 learned_addr learned my addr 172.21.15.47:0/1604155033 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:22.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac25c71640 1 --2- 172.21.15.47:0/1604155033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac0c004d40 0x7fac20139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:22.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac26472640 1 --2- 172.21.15.47:0/1604155033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac2015ea80 0x7fac201e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:22.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac25470640 1 -- 172.21.15.47:0/1604155033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac0c004d40 msgr2=0x7fac20139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:22.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac25470640 1 --2- 172.21.15.47:0/1604155033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac0c004d40 0x7fac20139530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:22.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac25470640 1 -- 172.21.15.47:0/1604155033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac2015ea80 msgr2=0x7fac201e7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:22.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac25470640 1 --2- 172.21.15.47:0/1604155033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac2015ea80 0x7fac201e7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:22.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac25470640 1 -- 172.21.15.47:0/1604155033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac20138490 con 0x7fac20155f00 2024-04-14T23:35:22.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac26472640 1 --2- 172.21.15.47:0/1604155033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac2015ea80 0x7fac201e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:22.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac25470640 1 --2- 172.21.15.47:0/1604155033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac20155f00 0x7fac2015e540 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fac10007310 tx=0x7fac10007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:22.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac167fc640 1 -- 172.21.15.47:0/1604155033 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1000f9c0 con 0x7fac20155f00 2024-04-14T23:35:22.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac167fc640 1 -- 172.21.15.47:0/1604155033 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac10018070 con 0x7fac20155f00 2024-04-14T23:35:22.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac167fc640 1 -- 172.21.15.47:0/1604155033 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1000fde0 con 0x7fac20155f00 2024-04-14T23:35:22.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac27ed5640 1 -- 172.21.15.47:0/1604155033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac20138770 con 0x7fac20155f00 2024-04-14T23:35:22.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.971+0000 7fac27ed5640 1 -- 172.21.15.47:0/1604155033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac20138d30 con 0x7fac20155f00 2024-04-14T23:35:22.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.972+0000 7fac27ed5640 1 -- 172.21.15.47:0/1604155033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac20073f50 con 0x7fac20155f00 2024-04-14T23:35:22.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.973+0000 7fac167fc640 1 -- 172.21.15.47:0/1604155033 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fac1001d460 con 0x7fac20155f00 2024-04-14T23:35:22.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.973+0000 7fac167fc640 1 --2- 172.21.15.47:0/1604155033 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fac0406b990 0x7fac0406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:22.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.973+0000 7fac167fc640 1 -- 172.21.15.47:0/1604155033 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fac1008ae20 con 0x7fac20155f00 2024-04-14T23:35:22.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.973+0000 7fac25c71640 1 --2- 172.21.15.47:0/1604155033 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fac0406b990 0x7fac0406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:22.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.974+0000 7fac25c71640 1 --2- 172.21.15.47:0/1604155033 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fac0406b990 0x7fac0406de50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fac201f5330 tx=0x7fac1c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:22.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:22.977+0000 7fac167fc640 1 -- 172.21.15.47:0/1604155033 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fac20160810 con 0x7fac20155f00 2024-04-14T23:35:23.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.160+0000 7fac27ed5640 1 -- 172.21.15.47:0/1604155033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fac2015ee60 con 0x7fac20155f00 2024-04-14T23:35:23.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.163+0000 7fac167fc640 1 -- 172.21.15.47:0/1604155033 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fac10059630 con 0x7fac20155f00 2024-04-14T23:35:23.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.166+0000 7fac27ed5640 1 -- 172.21.15.47:0/1604155033 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fac0406b990 msgr2=0x7fac0406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:23.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.166+0000 7fac27ed5640 1 --2- 172.21.15.47:0/1604155033 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fac0406b990 0x7fac0406de50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fac201f5330 tx=0x7fac1c009190 comp rx=0 tx=0).stop 2024-04-14T23:35:23.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.166+0000 7fac27ed5640 1 -- 172.21.15.47:0/1604155033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac20155f00 msgr2=0x7fac2015e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:23.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.166+0000 7fac27ed5640 1 --2- 172.21.15.47:0/1604155033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac20155f00 0x7fac2015e540 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fac10007310 tx=0x7fac10007710 comp rx=0 tx=0).stop 2024-04-14T23:35:23.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.166+0000 7fac27ed5640 1 -- 172.21.15.47:0/1604155033 shutdown_connections 2024-04-14T23:35:23.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.166+0000 7fac27ed5640 1 --2- 172.21.15.47:0/1604155033 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fac0406b990 0x7fac0406de50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:23.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.166+0000 7fac27ed5640 1 --2- 172.21.15.47:0/1604155033 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac2015ea80 0x7fac201e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:23.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.166+0000 7fac27ed5640 1 --2- 172.21.15.47:0/1604155033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac20155f00 0x7fac2015e540 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:23.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.166+0000 7fac27ed5640 1 --2- 172.21.15.47:0/1604155033 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fac0c004d40 0x7fac20139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:23.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.166+0000 7fac27ed5640 1 -- 172.21.15.47:0/1604155033 >> 172.21.15.47:0/1604155033 conn(0x7fac200b1770 msgr2=0x7fac2013d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:23.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.166+0000 7fac27ed5640 1 -- 172.21.15.47:0/1604155033 shutdown_connections 2024-04-14T23:35:23.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.166+0000 7fac27ed5640 1 -- 172.21.15.47:0/1604155033 wait complete. 2024-04-14T23:35:23.180 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-14T23:35:23.180 DEBUG:teuthology.orchestra.run.smithi047:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-14T23:35:23.219 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-14T23:35:23.276 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-14T23:35:23.276 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:35:23.276 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:23.291 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:35:23.291 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:23.347 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:35:23.347 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:23.401 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:23.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.541+0000 7f694075d640 1 Processor -- start 2024-04-14T23:35:23.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.541+0000 7f694075d640 1 -- start start 2024-04-14T23:35:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.542+0000 7f694075d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f693815bcc0 0x7f6938165dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.542+0000 7f694075d640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6938072a50 con 0x7f69380d0140 2024-04-14T23:35:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.542+0000 7f694075d640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f693815c370 con 0x7f693806e340 2024-04-14T23:35:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.542+0000 7f694075d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f693815c110 con 0x7f693815bcc0 2024-04-14T23:35:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.542+0000 7f693ecfa640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f693815bcc0 0x7f6938165dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.542+0000 7f693dcf8640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f69380d0140 0x7f693815b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:60180/0 (socket says 172.21.15.47:60180) 2024-04-14T23:35:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.542+0000 7f693dcf8640 1 -- 172.21.15.47:0/3869337290 learned_addr learned my addr 172.21.15.47:0/3869337290 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.542+0000 7f693ecfa640 1 -- 172.21.15.47:0/3869337290 >> v1:172.21.15.191:6789/0 conn(0x7f693806e340 legacy=0x7f69380cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.542+0000 7f693ecfa640 1 -- 172.21.15.47:0/3869337290 >> v1:172.21.15.47:6789/0 conn(0x7f69380d0140 legacy=0x7f693815b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.542+0000 7f693ecfa640 1 -- 172.21.15.47:0/3869337290 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693815ead0 con 0x7f693815bcc0 2024-04-14T23:35:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.542+0000 7f693d4f7640 1 -- 172.21.15.47:0/3869337290 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2428986273 0 0) 0x7f6938072a50 con 0x7f69380d0140 2024-04-14T23:35:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.543+0000 7f693ecfa640 1 --2- 172.21.15.47:0/3869337290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f693815bcc0 0x7f6938165dc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6930009d90 tx=0x7f693002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69eb5cb90e7d2d5e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.543+0000 7f693d4f7640 1 -- 172.21.15.47:0/3869337290 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930039070 con 0x7f693815bcc0 2024-04-14T23:35:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.543+0000 7f693d4f7640 1 -- 172.21.15.47:0/3869337290 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693002cbd0 con 0x7f693815bcc0 2024-04-14T23:35:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.543+0000 7f693d4f7640 1 -- 172.21.15.47:0/3869337290 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930034440 con 0x7f693815bcc0 2024-04-14T23:35:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.543+0000 7f694075d640 1 -- 172.21.15.47:0/3869337290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f693815bcc0 msgr2=0x7f6938165dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.543+0000 7f694075d640 1 --2- 172.21.15.47:0/3869337290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f693815bcc0 0x7f6938165dc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6930009d90 tx=0x7f693002be20 comp rx=0 tx=0).stop 2024-04-14T23:35:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.543+0000 7f694075d640 1 -- 172.21.15.47:0/3869337290 shutdown_connections 2024-04-14T23:35:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.543+0000 7f694075d640 1 --2- 172.21.15.47:0/3869337290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f693815bcc0 0x7f6938165dc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.543+0000 7f694075d640 1 -- 172.21.15.47:0/3869337290 >> 172.21.15.47:0/3869337290 conn(0x7f693806b200 msgr2=0x7f693806b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:23.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.543+0000 7f694075d640 1 -- 172.21.15.47:0/3869337290 shutdown_connections 2024-04-14T23:35:23.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.544+0000 7f694075d640 1 -- 172.21.15.47:0/3869337290 wait complete. 2024-04-14T23:35:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.545+0000 7f694075d640 1 Processor -- start 2024-04-14T23:35:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.545+0000 7f694075d640 1 -- start start 2024-04-14T23:35:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.545+0000 7f694075d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f693806e340 0x7f693814e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.545+0000 7f694075d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69380d0140 0x7f6938157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.545+0000 7f694075d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f693815bcc0 0x7f69381584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.545+0000 7f694075d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f693806e720 con 0x7f693806e340 2024-04-14T23:35:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.545+0000 7f694075d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f693815f090 con 0x7f693815bcc0 2024-04-14T23:35:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.545+0000 7f694075d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f693815f890 con 0x7f69380d0140 2024-04-14T23:35:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.545+0000 7f693e4f9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f693806e340 0x7f693814e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.545+0000 7f693e4f9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f693806e340 0x7f693814e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36482/0 (socket says 172.21.15.47:36482) 2024-04-14T23:35:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.545+0000 7f693e4f9640 1 -- 172.21.15.47:0/912445952 learned_addr learned my addr 172.21.15.47:0/912445952 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.546+0000 7f693ecfa640 1 --2- 172.21.15.47:0/912445952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f693815bcc0 0x7f69381584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.546+0000 7f693dcf8640 1 --2- 172.21.15.47:0/912445952 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69380d0140 0x7f6938157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.546+0000 7f693e4f9640 1 -- 172.21.15.47:0/912445952 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69380d0140 msgr2=0x7f6938157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.546+0000 7f693e4f9640 1 --2- 172.21.15.47:0/912445952 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69380d0140 0x7f6938157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.546+0000 7f693e4f9640 1 -- 172.21.15.47:0/912445952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f693815bcc0 msgr2=0x7f69381584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.546+0000 7f693e4f9640 1 --2- 172.21.15.47:0/912445952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f693815bcc0 0x7f69381584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.546+0000 7f693e4f9640 1 -- 172.21.15.47:0/912445952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6938155ba0 con 0x7f693806e340 2024-04-14T23:35:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.546+0000 7f693ecfa640 1 --2- 172.21.15.47:0/912445952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f693815bcc0 0x7f69381584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.546+0000 7f693e4f9640 1 --2- 172.21.15.47:0/912445952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f693806e340 0x7f693814e840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f693400b3f0 tx=0x7f693400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.546+0000 7f692effd640 1 -- 172.21.15.47:0/912445952 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934015020 con 0x7f693806e340 2024-04-14T23:35:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.546+0000 7f692effd640 1 -- 172.21.15.47:0/912445952 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6934011830 con 0x7f693806e340 2024-04-14T23:35:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.546+0000 7f694075d640 1 -- 172.21.15.47:0/912445952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6938156460 con 0x7f693806e340 2024-04-14T23:35:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.546+0000 7f692effd640 1 -- 172.21.15.47:0/912445952 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934011c20 con 0x7f693806e340 2024-04-14T23:35:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.546+0000 7f694075d640 1 -- 172.21.15.47:0/912445952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6938155e10 con 0x7f693806e340 2024-04-14T23:35:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.547+0000 7f694075d640 1 -- 172.21.15.47:0/912445952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6938075430 con 0x7f693806e340 2024-04-14T23:35:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.547+0000 7f692effd640 1 -- 172.21.15.47:0/912445952 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6934018020 con 0x7f693806e340 2024-04-14T23:35:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.548+0000 7f692effd640 1 --2- 172.21.15.47:0/912445952 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f691c06b990 0x7f691c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.548+0000 7f692effd640 1 -- 172.21.15.47:0/912445952 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f693408ab90 con 0x7f693806e340 2024-04-14T23:35:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.548+0000 7f693dcf8640 1 --2- 172.21.15.47:0/912445952 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f691c06b990 0x7f691c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:23.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.549+0000 7f693dcf8640 1 --2- 172.21.15.47:0/912445952 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f691c06b990 0x7f691c06de50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f69380cf680 tx=0x7f6928007b50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.552+0000 7f692effd640 1 -- 172.21.15.47:0/912445952 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f693401f020 con 0x7f693806e340 2024-04-14T23:35:23.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.734+0000 7f694075d640 1 -- 172.21.15.47:0/912445952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6938071820 con 0x7f693806e340 2024-04-14T23:35:23.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.735+0000 7f692effd640 1 -- 172.21.15.47:0/912445952 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18892 (secure 0 0 0) 0x7f6938156460 con 0x7f693806e340 2024-04-14T23:35:23.738 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:23.738 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:35:19.819811+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:23.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.737+0000 7f694075d640 1 -- 172.21.15.47:0/912445952 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f691c06b990 msgr2=0x7f691c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:23.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.737+0000 7f694075d640 1 --2- 172.21.15.47:0/912445952 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f691c06b990 0x7f691c06de50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f69380cf680 tx=0x7f6928007b50 comp rx=0 tx=0).stop 2024-04-14T23:35:23.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.737+0000 7f694075d640 1 -- 172.21.15.47:0/912445952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f693806e340 msgr2=0x7f693814e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:23.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.737+0000 7f694075d640 1 --2- 172.21.15.47:0/912445952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f693806e340 0x7f693814e840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f693400b3f0 tx=0x7f693400b8b0 comp rx=0 tx=0).stop 2024-04-14T23:35:23.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.737+0000 7f694075d640 1 -- 172.21.15.47:0/912445952 shutdown_connections 2024-04-14T23:35:23.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.737+0000 7f694075d640 1 --2- 172.21.15.47:0/912445952 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f691c06b990 0x7f691c06de50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:23.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.737+0000 7f694075d640 1 --2- 172.21.15.47:0/912445952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f693815bcc0 0x7f69381584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:23.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.737+0000 7f694075d640 1 --2- 172.21.15.47:0/912445952 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69380d0140 0x7f6938157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:23.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.737+0000 7f694075d640 1 --2- 172.21.15.47:0/912445952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f693806e340 0x7f693814e840 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:23.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.737+0000 7f694075d640 1 -- 172.21.15.47:0/912445952 >> 172.21.15.47:0/912445952 conn(0x7f693806b200 msgr2=0x7f69381541d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:23.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.737+0000 7f694075d640 1 -- 172.21.15.47:0/912445952 shutdown_connections 2024-04-14T23:35:23.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.737+0000 7f694075d640 1 -- 172.21.15.47:0/912445952 wait complete. 2024-04-14T23:35:23.750 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T23:34:36.382034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T23:34:37.023103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T23:34:40.726418+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T23:35:23.751 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:35:23.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.853+0000 7f4bc4f99640 1 Processor -- start 2024-04-14T23:35:23.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.853+0000 7f4bc4f99640 1 -- start start 2024-04-14T23:35:23.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.854+0000 7f4bc4f99640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4bc00b4e30 0x7f4bc00cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:23.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.854+0000 7f4bc4f99640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc00b5590 con 0x7f4bc00cf760 2024-04-14T23:35:23.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.854+0000 7f4bc4f99640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc00b52b0 con 0x7f4bc0161870 2024-04-14T23:35:23.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.854+0000 7f4bc4f99640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4bc00cff40 con 0x7f4bc00b4e30 2024-04-14T23:35:23.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.854+0000 7f4bbdd9b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4bc00b4e30 0x7f4bc00cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:23.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.854+0000 7f4bbed9d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4bc00cf760 0x7f4bc00c7b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54406/0 (socket says 172.21.15.47:54406) 2024-04-14T23:35:23.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.854+0000 7f4bbed9d640 1 -- 172.21.15.47:0/1913022327 learned_addr learned my addr 172.21.15.47:0/1913022327 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:23.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.855+0000 7f4bbdd9b640 1 -- 172.21.15.47:0/1913022327 >> v1:172.21.15.191:6789/0 conn(0x7f4bc0161870 legacy=0x7f4bc00ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:23.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.855+0000 7f4bbdd9b640 1 -- 172.21.15.47:0/1913022327 >> v1:172.21.15.47:6789/0 conn(0x7f4bc00cf760 legacy=0x7f4bc00c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:23.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.855+0000 7f4bbdd9b640 1 -- 172.21.15.47:0/1913022327 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc00d2680 con 0x7f4bc00b4e30 2024-04-14T23:35:23.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.855+0000 7f4bbd59a640 1 -- 172.21.15.47:0/1913022327 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1654280905 0 0) 0x7f4bc00b5590 con 0x7f4bc00cf760 2024-04-14T23:35:23.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.855+0000 7f4bbdd9b640 1 --2- 172.21.15.47:0/1913022327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc00b4e30 0x7f4bc00cf220 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80097a0 tx=0x7f4ba802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea922a3e19e1b2ab server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:23.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.855+0000 7f4bbd59a640 1 -- 172.21.15.47:0/1913022327 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8035020 con 0x7f4bc00b4e30 2024-04-14T23:35:23.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.855+0000 7f4bbd59a640 1 -- 172.21.15.47:0/1913022327 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba8031830 con 0x7f4bc00b4e30 2024-04-14T23:35:23.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.855+0000 7f4bbd59a640 1 -- 172.21.15.47:0/1913022327 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8031c00 con 0x7f4bc00b4e30 2024-04-14T23:35:23.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.856+0000 7f4bc4f99640 1 -- 172.21.15.47:0/1913022327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc00b4e30 msgr2=0x7f4bc00cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:23.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.856+0000 7f4bc4f99640 1 --2- 172.21.15.47:0/1913022327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc00b4e30 0x7f4bc00cf220 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80097a0 tx=0x7f4ba802b8d0 comp rx=0 tx=0).stop 2024-04-14T23:35:23.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.856+0000 7f4bc4f99640 1 -- 172.21.15.47:0/1913022327 shutdown_connections 2024-04-14T23:35:23.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.856+0000 7f4bc4f99640 1 --2- 172.21.15.47:0/1913022327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc00b4e30 0x7f4bc00cf220 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:23.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.856+0000 7f4bc4f99640 1 -- 172.21.15.47:0/1913022327 >> 172.21.15.47:0/1913022327 conn(0x7f4bc00d3f70 msgr2=0x7f4bc00d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:23.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.856+0000 7f4bc4f99640 1 -- 172.21.15.47:0/1913022327 shutdown_connections 2024-04-14T23:35:23.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.856+0000 7f4bc4f99640 1 -- 172.21.15.47:0/1913022327 wait complete. 2024-04-14T23:35:23.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.857+0000 7f4bc4f99640 1 Processor -- start 2024-04-14T23:35:23.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.857+0000 7f4bc4f99640 1 -- start start 2024-04-14T23:35:23.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.858+0000 7f4bc4f99640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bc00b4e30 0x7f4bc00cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:23.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.858+0000 7f4bc4f99640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4bc00cf760 0x7f4bc01f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:23.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.858+0000 7f4bc4f99640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc0161870 0x7f4bc01f7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:23.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.858+0000 7f4bc4f99640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc00d18e0 con 0x7f4bc0161870 2024-04-14T23:35:23.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.858+0000 7f4bc4f99640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc00d2c40 con 0x7f4bc00b4e30 2024-04-14T23:35:23.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.858+0000 7f4bc4f99640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc0161c50 con 0x7f4bc00cf760 2024-04-14T23:35:23.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.858+0000 7f4bbed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc0161870 0x7f4bc01f7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:23.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.858+0000 7f4bbed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc0161870 0x7f4bc01f7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43480/0 (socket says 172.21.15.47:43480) 2024-04-14T23:35:23.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.858+0000 7f4bbed9d640 1 -- 172.21.15.47:0/1728398128 learned_addr learned my addr 172.21.15.47:0/1728398128 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:23.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.858+0000 7f4bbe59c640 1 --2- 172.21.15.47:0/1728398128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bc00b4e30 0x7f4bc00cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:23.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.858+0000 7f4bbdd9b640 1 --2- 172.21.15.47:0/1728398128 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4bc00cf760 0x7f4bc01f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:23.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.859+0000 7f4bbed9d640 1 -- 172.21.15.47:0/1728398128 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4bc00cf760 msgr2=0x7f4bc01f78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:23.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.859+0000 7f4bbed9d640 1 --2- 172.21.15.47:0/1728398128 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4bc00cf760 0x7f4bc01f78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:23.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.859+0000 7f4bbed9d640 1 -- 172.21.15.47:0/1728398128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bc00b4e30 msgr2=0x7f4bc00cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:23.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.859+0000 7f4bbed9d640 1 --2- 172.21.15.47:0/1728398128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bc00b4e30 0x7f4bc00cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:23.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.859+0000 7f4bbed9d640 1 -- 172.21.15.47:0/1728398128 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc00b87c0 con 0x7f4bc0161870 2024-04-14T23:35:23.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.859+0000 7f4bbe59c640 1 --2- 172.21.15.47:0/1728398128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bc00b4e30 0x7f4bc00cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:23.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.859+0000 7f4bbed9d640 1 --2- 172.21.15.47:0/1728398128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc0161870 0x7f4bc01f7e00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000c7a0 tx=0x7f4bb000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:23.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.859+0000 7f4bb6ffd640 1 -- 172.21.15.47:0/1728398128 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0018070 con 0x7f4bc0161870 2024-04-14T23:35:23.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.859+0000 7f4bb6ffd640 1 -- 172.21.15.47:0/1728398128 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb000a640 con 0x7f4bc0161870 2024-04-14T23:35:23.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.859+0000 7f4bc4f99640 1 -- 172.21.15.47:0/1728398128 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc00b8aa0 con 0x7f4bc0161870 2024-04-14T23:35:23.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.859+0000 7f4bb6ffd640 1 -- 172.21.15.47:0/1728398128 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb000aab0 con 0x7f4bc0161870 2024-04-14T23:35:23.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.859+0000 7f4bc4f99640 1 -- 172.21.15.47:0/1728398128 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc00b9060 con 0x7f4bc0161870 2024-04-14T23:35:23.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.860+0000 7f4bc4f99640 1 -- 172.21.15.47:0/1728398128 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc0073f50 con 0x7f4bc0161870 2024-04-14T23:35:23.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.860+0000 7f4bb6ffd640 1 -- 172.21.15.47:0/1728398128 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4bb000ac50 con 0x7f4bc0161870 2024-04-14T23:35:23.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.861+0000 7f4bb6ffd640 1 --2- 172.21.15.47:0/1728398128 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4ba006b990 0x7f4ba006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:23.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.861+0000 7f4bb6ffd640 1 -- 172.21.15.47:0/1728398128 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4bb008a330 con 0x7f4bc0161870 2024-04-14T23:35:23.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.861+0000 7f4bbe59c640 1 --2- 172.21.15.47:0/1728398128 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4ba006b990 0x7f4ba006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:23.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.862+0000 7f4bbe59c640 1 --2- 172.21.15.47:0/1728398128 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4ba006b990 0x7f4ba006de50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8007fd0 tx=0x7f4bb8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:23.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:23.865+0000 7f4bb6ffd640 1 -- 172.21.15.47:0/1728398128 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4bb0058ac0 con 0x7f4bc0161870 2024-04-14T23:35:24.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.045+0000 7f4bc4f99640 1 -- 172.21.15.47:0/1728398128 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4bc00b49c0 con 0x7f4bc0161870 2024-04-14T23:35:24.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.045+0000 7f4bb6ffd640 1 -- 172.21.15.47:0/1728398128 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f4bb00583c0 con 0x7f4bc0161870 2024-04-14T23:35:24.047 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:35:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.047+0000 7f4bc4f99640 1 -- 172.21.15.47:0/1728398128 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4ba006b990 msgr2=0x7f4ba006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.047+0000 7f4bc4f99640 1 --2- 172.21.15.47:0/1728398128 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4ba006b990 0x7f4ba006de50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8007fd0 tx=0x7f4bb8009040 comp rx=0 tx=0).stop 2024-04-14T23:35:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.047+0000 7f4bc4f99640 1 -- 172.21.15.47:0/1728398128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc0161870 msgr2=0x7f4bc01f7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.047+0000 7f4bc4f99640 1 --2- 172.21.15.47:0/1728398128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc0161870 0x7f4bc01f7e00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000c7a0 tx=0x7f4bb000cc60 comp rx=0 tx=0).stop 2024-04-14T23:35:24.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.047+0000 7f4bc4f99640 1 -- 172.21.15.47:0/1728398128 shutdown_connections 2024-04-14T23:35:24.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.047+0000 7f4bc4f99640 1 --2- 172.21.15.47:0/1728398128 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4ba006b990 0x7f4ba006de50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.047+0000 7f4bc4f99640 1 --2- 172.21.15.47:0/1728398128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc0161870 0x7f4bc01f7e00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.047+0000 7f4bc4f99640 1 --2- 172.21.15.47:0/1728398128 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4bc00cf760 0x7f4bc01f78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.047+0000 7f4bc4f99640 1 --2- 172.21.15.47:0/1728398128 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bc00b4e30 0x7f4bc00cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.047+0000 7f4bc4f99640 1 -- 172.21.15.47:0/1728398128 >> 172.21.15.47:0/1728398128 conn(0x7f4bc00d3f70 msgr2=0x7f4bc006d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:24.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.047+0000 7f4bc4f99640 1 -- 172.21.15.47:0/1728398128 shutdown_connections 2024-04-14T23:35:24.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.047+0000 7f4bc4f99640 1 -- 172.21.15.47:0/1728398128 wait complete. 2024-04-14T23:35:24.060 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T23:35:24.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.162+0000 7f16150de640 1 Processor -- start 2024-04-14T23:35:24.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.163+0000 7f16150de640 1 -- start start 2024-04-14T23:35:24.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.163+0000 7f16150de640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f16100b53c0 0x7f16100cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.163+0000 7f16150de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16100cfb30 0x7f16100d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.163+0000 7f16150de640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16100d2fa0 con 0x7f16100d2b10 2024-04-14T23:35:24.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.163+0000 7f16150de640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f16100b6e40 con 0x7f16100b53c0 2024-04-14T23:35:24.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.163+0000 7f16150de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f16100b7090 con 0x7f16100cfb30 2024-04-14T23:35:24.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.163+0000 7f160f59e640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f16100d2b10 0x7f16100d0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54410/0 (socket says 172.21.15.47:54410) 2024-04-14T23:35:24.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.163+0000 7f160f59e640 1 -- 172.21.15.47:0/801430278 learned_addr learned my addr 172.21.15.47:0/801430278 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:24.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f1607fff640 1 --2- 172.21.15.47:0/801430278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16100cfb30 0x7f16100d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160ed9d640 1 --2- 172.21.15.47:0/801430278 >> v2:172.21.15.191:3300/0 conn(0x7f16100b53c0 0x7f16100cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160e59c640 1 -- 172.21.15.47:0/801430278 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160564445 0 0) 0x7f16100d2fa0 con 0x7f16100d2b10 2024-04-14T23:35:24.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160e59c640 1 -- 172.21.15.47:0/801430278 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15fc003520 con 0x7f16100d2b10 2024-04-14T23:35:24.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160e59c640 1 -- 172.21.15.47:0/801430278 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 609037745 0 0) 0x7f15fc003520 con 0x7f16100d2b10 2024-04-14T23:35:24.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160e59c640 1 -- 172.21.15.47:0/801430278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16100cfb30 msgr2=0x7f16100d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:24.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160e59c640 1 --2- 172.21.15.47:0/801430278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16100cfb30 0x7f16100d25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160e59c640 1 -- 172.21.15.47:0/801430278 >> v2:172.21.15.191:3300/0 conn(0x7f16100b53c0 msgr2=0x7f16100cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:24.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160e59c640 1 --2- 172.21.15.47:0/801430278 >> v2:172.21.15.191:3300/0 conn(0x7f16100b53c0 0x7f16100cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160e59c640 1 -- 172.21.15.47:0/801430278 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16100b7370 con 0x7f16100d2b10 2024-04-14T23:35:24.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160e59c640 1 -- 172.21.15.47:0/801430278 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f16080019f0 con 0x7f16100d2b10 2024-04-14T23:35:24.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160e59c640 1 -- 172.21.15.47:0/801430278 >> v1:172.21.15.47:6789/0 conn(0x7f16100d2b10 legacy=0x7f16100d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160e59c640 1 --2- 172.21.15.47:0/801430278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15fc0039b0 0x7f15fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160e59c640 1 --2- 172.21.15.47:0/801430278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15fc004800 0x7f15fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160e59c640 1 --2- 172.21.15.47:0/801430278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16100cfb30 0x7f15fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160e59c640 1 -- 172.21.15.47:0/801430278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f16100b6e40 con 0x7f15fc0039b0 2024-04-14T23:35:24.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160e59c640 1 -- 172.21.15.47:0/801430278 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f16100b7090 con 0x7f15fc004800 2024-04-14T23:35:24.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160e59c640 1 -- 172.21.15.47:0/801430278 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f15fc00b9f0 con 0x7f16100cfb30 2024-04-14T23:35:24.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160ed9d640 1 --2- 172.21.15.47:0/801430278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15fc0039b0 0x7f15fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f1607fff640 1 --2- 172.21.15.47:0/801430278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15fc004800 0x7f15fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160f59e640 1 --2- 172.21.15.47:0/801430278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16100cfb30 0x7f15fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160ed9d640 1 -- 172.21.15.47:0/801430278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16100cfb30 msgr2=0x7f15fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:24.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160ed9d640 1 --2- 172.21.15.47:0/801430278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16100cfb30 0x7f15fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160ed9d640 1 -- 172.21.15.47:0/801430278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15fc004800 msgr2=0x7f15fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:24.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160ed9d640 1 --2- 172.21.15.47:0/801430278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15fc004800 0x7f15fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.164+0000 7f160ed9d640 1 -- 172.21.15.47:0/801430278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15fc003520 con 0x7f15fc0039b0 2024-04-14T23:35:24.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.165+0000 7f160ed9d640 1 --2- 172.21.15.47:0/801430278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15fc0039b0 0x7f15fc003dd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1600009ac0 tx=0x7f15fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3d6dd484f8286 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:24.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.165+0000 7f160e59c640 1 -- 172.21.15.47:0/801430278 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600039070 con 0x7f15fc0039b0 2024-04-14T23:35:24.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.165+0000 7f160e59c640 1 -- 172.21.15.47:0/801430278 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f160002c710 con 0x7f15fc0039b0 2024-04-14T23:35:24.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.165+0000 7f160e59c640 1 -- 172.21.15.47:0/801430278 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600009690 con 0x7f15fc0039b0 2024-04-14T23:35:24.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.166+0000 7f16150de640 1 -- 172.21.15.47:0/801430278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15fc0039b0 msgr2=0x7f15fc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.166+0000 7f16150de640 1 --2- 172.21.15.47:0/801430278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15fc0039b0 0x7f15fc003dd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1600009ac0 tx=0x7f15fc005830 comp rx=0 tx=0).stop 2024-04-14T23:35:24.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.166+0000 7f160f59e640 1 -- 172.21.15.47:0/801430278 reap_dead start 2024-04-14T23:35:24.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.166+0000 7f16150de640 1 -- 172.21.15.47:0/801430278 shutdown_connections 2024-04-14T23:35:24.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.166+0000 7f16150de640 1 -- 172.21.15.47:0/801430278 >> 172.21.15.47:0/801430278 conn(0x7f161009d2c0 msgr2=0x7f16100d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:24.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.166+0000 7f16150de640 1 -- 172.21.15.47:0/801430278 shutdown_connections 2024-04-14T23:35:24.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.166+0000 7f16150de640 1 -- 172.21.15.47:0/801430278 wait complete. 2024-04-14T23:35:24.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.167+0000 7f16150de640 1 Processor -- start 2024-04-14T23:35:24.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.167+0000 7f16150de640 1 -- start start 2024-04-14T23:35:24.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f16150de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15fc0039b0 0x7f1610155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f16150de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16101f4fa0 0x7f16100c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f16150de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16100cb130 0x7f16101f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f16150de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f16100b57a0 con 0x7f16101f4fa0 2024-04-14T23:35:24.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f16150de640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f16100b7930 con 0x7f15fc0039b0 2024-04-14T23:35:24.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f16150de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f16100b5920 con 0x7f16100cb130 2024-04-14T23:35:24.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f1607fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16101f4fa0 0x7f16100c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f1607fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16101f4fa0 0x7f16100c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43504/0 (socket says 172.21.15.47:43504) 2024-04-14T23:35:24.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f1607fff640 1 -- 172.21.15.47:0/2487278022 learned_addr learned my addr 172.21.15.47:0/2487278022 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:24.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f160f59e640 1 --2- 172.21.15.47:0/2487278022 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16100cb130 0x7f16101f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f160ed9d640 1 --2- 172.21.15.47:0/2487278022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15fc0039b0 0x7f1610155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f1607fff640 1 -- 172.21.15.47:0/2487278022 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16100cb130 msgr2=0x7f16101f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f1607fff640 1 --2- 172.21.15.47:0/2487278022 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16100cb130 0x7f16101f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f1607fff640 1 -- 172.21.15.47:0/2487278022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15fc0039b0 msgr2=0x7f1610155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f1607fff640 1 --2- 172.21.15.47:0/2487278022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15fc0039b0 0x7f1610155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f1607fff640 1 -- 172.21.15.47:0/2487278022 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16100c9020 con 0x7f16101f4fa0 2024-04-14T23:35:24.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f160ed9d640 1 --2- 172.21.15.47:0/2487278022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15fc0039b0 0x7f1610155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:24.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.168+0000 7f160f59e640 1 --2- 172.21.15.47:0/2487278022 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16100cb130 0x7f16101f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:24.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.169+0000 7f1607fff640 1 --2- 172.21.15.47:0/2487278022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16101f4fa0 0x7f16100c84e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f15f8011910 tx=0x7f15f8011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:24.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.169+0000 7f16077fe640 1 -- 172.21.15.47:0/2487278022 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f800faf0 con 0x7f16101f4fa0 2024-04-14T23:35:24.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.169+0000 7f16077fe640 1 -- 172.21.15.47:0/2487278022 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f800fc90 con 0x7f16101f4fa0 2024-04-14T23:35:24.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.169+0000 7f16077fe640 1 -- 172.21.15.47:0/2487278022 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8014440 con 0x7f16101f4fa0 2024-04-14T23:35:24.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.169+0000 7f16150de640 1 -- 172.21.15.47:0/2487278022 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1610155590 con 0x7f16101f4fa0 2024-04-14T23:35:24.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.169+0000 7f16150de640 1 -- 172.21.15.47:0/2487278022 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16100c9810 con 0x7f16101f4fa0 2024-04-14T23:35:24.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.170+0000 7f16150de640 1 -- 172.21.15.47:0/2487278022 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16100d4a50 con 0x7f16101f4fa0 2024-04-14T23:35:24.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.170+0000 7f16077fe640 1 -- 172.21.15.47:0/2487278022 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f15f8012040 con 0x7f16101f4fa0 2024-04-14T23:35:24.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.171+0000 7f16077fe640 1 --2- 172.21.15.47:0/2487278022 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f15f006b9c0 0x7f15f006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.171+0000 7f16077fe640 1 -- 172.21.15.47:0/2487278022 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f15f808b340 con 0x7f16101f4fa0 2024-04-14T23:35:24.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.171+0000 7f160ed9d640 1 --2- 172.21.15.47:0/2487278022 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f15f006b9c0 0x7f15f006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.171+0000 7f160ed9d640 1 --2- 172.21.15.47:0/2487278022 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f15f006b9c0 0x7f15f006de80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1600036000 tx=0x7f1600030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:24.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.175+0000 7f16077fe640 1 -- 172.21.15.47:0/2487278022 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f16100d4a50 con 0x7f16101f4fa0 2024-04-14T23:35:24.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.356+0000 7f16150de640 1 -- 172.21.15.47:0/2487278022 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1610073f50 con 0x7f16101f4fa0 2024-04-14T23:35:24.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.356+0000 7f16077fe640 1 -- 172.21.15.47:0/2487278022 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f15f8019030 con 0x7f16101f4fa0 2024-04-14T23:35:24.358 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:24.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.358+0000 7f16150de640 1 -- 172.21.15.47:0/2487278022 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f15f006b9c0 msgr2=0x7f15f006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.358+0000 7f16150de640 1 --2- 172.21.15.47:0/2487278022 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f15f006b9c0 0x7f15f006de80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1600036000 tx=0x7f1600030000 comp rx=0 tx=0).stop 2024-04-14T23:35:24.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.358+0000 7f16150de640 1 -- 172.21.15.47:0/2487278022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16101f4fa0 msgr2=0x7f16100c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.358+0000 7f16150de640 1 --2- 172.21.15.47:0/2487278022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16101f4fa0 0x7f16100c84e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f15f8011910 tx=0x7f15f8011dd0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.358+0000 7f16150de640 1 -- 172.21.15.47:0/2487278022 shutdown_connections 2024-04-14T23:35:24.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.358+0000 7f16150de640 1 --2- 172.21.15.47:0/2487278022 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f15f006b9c0 0x7f15f006de80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.358+0000 7f16150de640 1 --2- 172.21.15.47:0/2487278022 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16100cb130 0x7f16101f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.358+0000 7f16150de640 1 --2- 172.21.15.47:0/2487278022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16101f4fa0 0x7f16100c84e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.358+0000 7f16150de640 1 --2- 172.21.15.47:0/2487278022 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15fc0039b0 0x7f1610155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.358+0000 7f16150de640 1 -- 172.21.15.47:0/2487278022 >> 172.21.15.47:0/2487278022 conn(0x7f161009d2c0 msgr2=0x7f16100b90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:24.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.358+0000 7f16150de640 1 -- 172.21.15.47:0/2487278022 shutdown_connections 2024-04-14T23:35:24.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.358+0000 7f16150de640 1 -- 172.21.15.47:0/2487278022 wait complete. 2024-04-14T23:35:24.371 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T23:35:24.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.474+0000 7f67048c8640 1 Processor -- start 2024-04-14T23:35:24.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.474+0000 7f67048c8640 1 -- start start 2024-04-14T23:35:24.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f67048c8640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f670006b910 0x7f67000700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f67048c8640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6700145630 con 0x7f6700144da0 2024-04-14T23:35:24.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f67048c8640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f670015fb30 con 0x7f6700145180 2024-04-14T23:35:24.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f67048c8640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f6700160440 con 0x7f670006b910 2024-04-14T23:35:24.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f66fe59c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6700144da0 0x7f670006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54414/0 (socket says 172.21.15.47:54414) 2024-04-14T23:35:24.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f66fe59c640 1 -- 172.21.15.47:0/2005025257 learned_addr learned my addr 172.21.15.47:0/2005025257 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:24.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f66f7fff640 1 --2- 172.21.15.47:0/2005025257 >> v2:172.21.15.191:3300/0 conn(0x7f670006b910 0x7f67000700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f66fdd9b640 1 -- 172.21.15.47:0/2005025257 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1541647142 0 0) 0x7f6700145630 con 0x7f6700144da0 2024-04-14T23:35:24.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f66fdd9b640 1 -- 172.21.15.47:0/2005025257 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66ec003520 con 0x7f6700144da0 2024-04-14T23:35:24.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f66fdd9b640 1 -- 172.21.15.47:0/2005025257 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1975656833 0 0) 0x7f66ec003520 con 0x7f6700144da0 2024-04-14T23:35:24.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f66fdd9b640 1 -- 172.21.15.47:0/2005025257 >> v2:172.21.15.191:3300/0 conn(0x7f670006b910 msgr2=0x7f67000700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:24.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f66fdd9b640 1 --2- 172.21.15.47:0/2005025257 >> v2:172.21.15.191:3300/0 conn(0x7f670006b910 0x7f67000700c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f66fdd9b640 1 -- 172.21.15.47:0/2005025257 >> v1:172.21.15.191:6789/0 conn(0x7f6700145180 legacy=0x7f67000ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f66fdd9b640 1 -- 172.21.15.47:0/2005025257 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67000706c0 con 0x7f6700144da0 2024-04-14T23:35:24.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f66fdd9b640 1 -- 172.21.15.47:0/2005025257 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f66f0001670 con 0x7f6700144da0 2024-04-14T23:35:24.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f66fdd9b640 1 -- 172.21.15.47:0/2005025257 >> v1:172.21.15.47:6789/0 conn(0x7f6700144da0 legacy=0x7f670006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.475+0000 7f66fdd9b640 1 --2- 172.21.15.47:0/2005025257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66ec0039b0 0x7f66ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.476+0000 7f66fdd9b640 1 --2- 172.21.15.47:0/2005025257 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f66ec004800 0x7f66ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.476+0000 7f66fdd9b640 1 --2- 172.21.15.47:0/2005025257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66ec0051c0 0x7f66ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.476+0000 7f66fdd9b640 1 -- 172.21.15.47:0/2005025257 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6700160440 con 0x7f66ec0039b0 2024-04-14T23:35:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.476+0000 7f66fdd9b640 1 -- 172.21.15.47:0/2005025257 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec00c060 con 0x7f66ec0051c0 2024-04-14T23:35:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.476+0000 7f66fdd9b640 1 -- 172.21.15.47:0/2005025257 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f66ec00c260 con 0x7f66ec004800 2024-04-14T23:35:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.476+0000 7f66fe59c640 1 --2- 172.21.15.47:0/2005025257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66ec0039b0 0x7f66ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.476+0000 7f66f7fff640 1 --2- 172.21.15.47:0/2005025257 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f66ec004800 0x7f66ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.476+0000 7f66fed9d640 1 --2- 172.21.15.47:0/2005025257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66ec0051c0 0x7f66ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.476+0000 7f66fe59c640 1 -- 172.21.15.47:0/2005025257 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f66ec004800 msgr2=0x7f66ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:24.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.476+0000 7f66fe59c640 1 --2- 172.21.15.47:0/2005025257 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f66ec004800 0x7f66ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.476+0000 7f66fe59c640 1 -- 172.21.15.47:0/2005025257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66ec0051c0 msgr2=0x7f66ec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:24.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.476+0000 7f66fe59c640 1 --2- 172.21.15.47:0/2005025257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66ec0051c0 0x7f66ec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.476+0000 7f66fe59c640 1 -- 172.21.15.47:0/2005025257 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ec003520 con 0x7f66ec0039b0 2024-04-14T23:35:24.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.476+0000 7f66fed9d640 1 -- 172.21.15.47:0/2005025257 reap_dead start 2024-04-14T23:35:24.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.477+0000 7f66fe59c640 1 --2- 172.21.15.47:0/2005025257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66ec0039b0 0x7f66ec003dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f66f000c210 tx=0x7f66ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643ae66f9cf359c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:24.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.477+0000 7f66fdd9b640 1 -- 172.21.15.47:0/2005025257 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0007d30 con 0x7f66ec0039b0 2024-04-14T23:35:24.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.477+0000 7f66fdd9b640 1 -- 172.21.15.47:0/2005025257 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f0030070 con 0x7f66ec0039b0 2024-04-14T23:35:24.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.477+0000 7f66fdd9b640 1 -- 172.21.15.47:0/2005025257 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f002cda0 con 0x7f66ec0039b0 2024-04-14T23:35:24.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.477+0000 7f67048c8640 1 -- 172.21.15.47:0/2005025257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66ec0039b0 msgr2=0x7f66ec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.477+0000 7f67048c8640 1 --2- 172.21.15.47:0/2005025257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66ec0039b0 0x7f66ec003dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f66f000c210 tx=0x7f66ec005830 comp rx=0 tx=0).stop 2024-04-14T23:35:24.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.477+0000 7f67048c8640 1 -- 172.21.15.47:0/2005025257 shutdown_connections 2024-04-14T23:35:24.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.477+0000 7f67048c8640 1 --2- 172.21.15.47:0/2005025257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66ec0039b0 0x7f66ec003dd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.477+0000 7f67048c8640 1 -- 172.21.15.47:0/2005025257 >> 172.21.15.47:0/2005025257 conn(0x7f67000cd670 msgr2=0x7f67000cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:24.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.477+0000 7f67048c8640 1 -- 172.21.15.47:0/2005025257 shutdown_connections 2024-04-14T23:35:24.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.477+0000 7f67048c8640 1 -- 172.21.15.47:0/2005025257 wait complete. 2024-04-14T23:35:24.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.479+0000 7f67048c8640 1 Processor -- start 2024-04-14T23:35:24.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.479+0000 7f67048c8640 1 -- start start 2024-04-14T23:35:24.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.479+0000 7f67048c8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66ec0039b0 0x7f6700141400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.479+0000 7f67048c8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6700159cb0 0x7f67000b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.479+0000 7f67048c8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6700157660 0x7f6700157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.479+0000 7f67048c8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6700145a00 con 0x7f6700159cb0 2024-04-14T23:35:24.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.479+0000 7f67048c8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f67001600d0 con 0x7f66ec0039b0 2024-04-14T23:35:24.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.479+0000 7f67048c8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f67001608d0 con 0x7f6700157660 2024-04-14T23:35:24.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.479+0000 7f66f7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6700159cb0 0x7f67000b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.479+0000 7f66f7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6700159cb0 0x7f67000b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43528/0 (socket says 172.21.15.47:43528) 2024-04-14T23:35:24.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.479+0000 7f66f7fff640 1 -- 172.21.15.47:0/1969051771 learned_addr learned my addr 172.21.15.47:0/1969051771 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:24.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.480+0000 7f66fed9d640 1 --2- 172.21.15.47:0/1969051771 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6700157660 0x7f6700157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.480+0000 7f66fe59c640 1 --2- 172.21.15.47:0/1969051771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66ec0039b0 0x7f6700141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.480+0000 7f66f7fff640 1 -- 172.21.15.47:0/1969051771 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6700157660 msgr2=0x7f6700157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.480+0000 7f66f7fff640 1 --2- 172.21.15.47:0/1969051771 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6700157660 0x7f6700157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.480+0000 7f66f7fff640 1 -- 172.21.15.47:0/1969051771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66ec0039b0 msgr2=0x7f6700141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.480+0000 7f66f7fff640 1 --2- 172.21.15.47:0/1969051771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66ec0039b0 0x7f6700141400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.480+0000 7f66f7fff640 1 -- 172.21.15.47:0/1969051771 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670015a420 con 0x7f6700159cb0 2024-04-14T23:35:24.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.480+0000 7f66f7fff640 1 --2- 172.21.15.47:0/1969051771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6700159cb0 0x7f67000b4e90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f66e80116d0 tx=0x7f66e8011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:24.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.480+0000 7f66f6ffd640 1 -- 172.21.15.47:0/1969051771 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e800f9c0 con 0x7f6700159cb0 2024-04-14T23:35:24.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.480+0000 7f66f6ffd640 1 -- 172.21.15.47:0/1969051771 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e800fb60 con 0x7f6700159cb0 2024-04-14T23:35:24.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.480+0000 7f67048c8640 1 -- 172.21.15.47:0/1969051771 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f670015a700 con 0x7f6700159cb0 2024-04-14T23:35:24.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.480+0000 7f66f6ffd640 1 -- 172.21.15.47:0/1969051771 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8015460 con 0x7f6700159cb0 2024-04-14T23:35:24.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.480+0000 7f67048c8640 1 -- 172.21.15.47:0/1969051771 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f670015acc0 con 0x7f6700159cb0 2024-04-14T23:35:24.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.481+0000 7f67048c8640 1 -- 172.21.15.47:0/1969051771 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6700073f50 con 0x7f6700159cb0 2024-04-14T23:35:24.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.482+0000 7f66f6ffd640 1 -- 172.21.15.47:0/1969051771 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f66e8015600 con 0x7f6700159cb0 2024-04-14T23:35:24.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.482+0000 7f66f6ffd640 1 --2- 172.21.15.47:0/1969051771 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f66e006b990 0x7f66e006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.482+0000 7f66f6ffd640 1 -- 172.21.15.47:0/1969051771 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f66e808b510 con 0x7f6700159cb0 2024-04-14T23:35:24.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.482+0000 7f66fe59c640 1 --2- 172.21.15.47:0/1969051771 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f66e006b990 0x7f66e006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.483+0000 7f66fe59c640 1 --2- 172.21.15.47:0/1969051771 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f66e006b990 0x7f66e006de50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f66f0034000 tx=0x7f66f0009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:24.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.486+0000 7f66f6ffd640 1 -- 172.21.15.47:0/1969051771 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f66e8019030 con 0x7f6700159cb0 2024-04-14T23:35:24.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.668+0000 7f67048c8640 1 -- 172.21.15.47:0/1969051771 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f670015e1a0 con 0x7f6700159cb0 2024-04-14T23:35:24.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.668+0000 7f66f6ffd640 1 -- 172.21.15.47:0/1969051771 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f66e8059640 con 0x7f6700159cb0 2024-04-14T23:35:24.671 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-14T23:35:24.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.670+0000 7f67048c8640 1 -- 172.21.15.47:0/1969051771 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f66e006b990 msgr2=0x7f66e006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.670+0000 7f67048c8640 1 --2- 172.21.15.47:0/1969051771 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f66e006b990 0x7f66e006de50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f66f0034000 tx=0x7f66f0009030 comp rx=0 tx=0).stop 2024-04-14T23:35:24.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.670+0000 7f67048c8640 1 -- 172.21.15.47:0/1969051771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6700159cb0 msgr2=0x7f67000b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.670+0000 7f67048c8640 1 --2- 172.21.15.47:0/1969051771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6700159cb0 0x7f67000b4e90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f66e80116d0 tx=0x7f66e8011b90 comp rx=0 tx=0).stop 2024-04-14T23:35:24.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.670+0000 7f67048c8640 1 -- 172.21.15.47:0/1969051771 shutdown_connections 2024-04-14T23:35:24.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.670+0000 7f67048c8640 1 --2- 172.21.15.47:0/1969051771 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f66e006b990 0x7f66e006de50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.670+0000 7f67048c8640 1 --2- 172.21.15.47:0/1969051771 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6700157660 0x7f6700157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.670+0000 7f67048c8640 1 --2- 172.21.15.47:0/1969051771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6700159cb0 0x7f67000b4e90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.670+0000 7f67048c8640 1 --2- 172.21.15.47:0/1969051771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f66ec0039b0 0x7f6700141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.670+0000 7f67048c8640 1 -- 172.21.15.47:0/1969051771 >> 172.21.15.47:0/1969051771 conn(0x7f67000cd670 msgr2=0x7f67000b60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:24.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.670+0000 7f67048c8640 1 -- 172.21.15.47:0/1969051771 shutdown_connections 2024-04-14T23:35:24.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.670+0000 7f67048c8640 1 -- 172.21.15.47:0/1969051771 wait complete. 2024-04-14T23:35:24.683 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T23:35:24.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.785+0000 7f7ecad1e640 1 Processor -- start 2024-04-14T23:35:24.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.785+0000 7f7ecad1e640 1 -- start start 2024-04-14T23:35:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.786+0000 7f7ecad1e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7ec40b8e60 0x7f7ec4168f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.786+0000 7f7ecad1e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ec40b7090 con 0x7f7ec40b53c0 2024-04-14T23:35:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.786+0000 7f7ecad1e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ec40b7370 con 0x7f7ec40d25d0 2024-04-14T23:35:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.786+0000 7f7ecad1e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f7ec40b6e40 con 0x7f7ec40b8e60 2024-04-14T23:35:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.786+0000 7f7ec92bb640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7ec40b8e60 0x7f7ec4168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.786+0000 7f7ec8aba640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7ec40b53c0 0x7f7ec40cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54416/0 (socket says 172.21.15.47:54416) 2024-04-14T23:35:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.786+0000 7f7ec8aba640 1 -- 172.21.15.47:0/2275924282 learned_addr learned my addr 172.21.15.47:0/2275924282 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:24.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.786+0000 7f7ec92bb640 1 -- 172.21.15.47:0/2275924282 >> v1:172.21.15.191:6789/0 conn(0x7f7ec40d25d0 legacy=0x7f7ec40d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:24.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.786+0000 7f7ec92bb640 1 -- 172.21.15.47:0/2275924282 >> v1:172.21.15.47:6789/0 conn(0x7f7ec40b53c0 legacy=0x7f7ec40cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.786+0000 7f7ec92bb640 1 -- 172.21.15.47:0/2275924282 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec40b7650 con 0x7f7ec40b8e60 2024-04-14T23:35:24.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.787+0000 7f7ec92bb640 1 --2- 172.21.15.47:0/2275924282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec40b8e60 0x7f7ec4168f10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc009d90 tx=0x7f7ebc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d511ed31c3993c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:24.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.787+0000 7f7ec37fe640 1 -- 172.21.15.47:0/2275924282 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc039070 con 0x7f7ec40b8e60 2024-04-14T23:35:24.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.787+0000 7f7ec37fe640 1 -- 172.21.15.47:0/2275924282 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ebc02cd00 con 0x7f7ec40b8e60 2024-04-14T23:35:24.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.787+0000 7f7ec37fe640 1 -- 172.21.15.47:0/2275924282 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc034660 con 0x7f7ec40b8e60 2024-04-14T23:35:24.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.787+0000 7f7ecad1e640 1 -- 172.21.15.47:0/2275924282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec40b8e60 msgr2=0x7f7ec4168f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.787+0000 7f7ecad1e640 1 --2- 172.21.15.47:0/2275924282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec40b8e60 0x7f7ec4168f10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc009d90 tx=0x7f7ebc02bf50 comp rx=0 tx=0).stop 2024-04-14T23:35:24.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.787+0000 7f7ecad1e640 1 -- 172.21.15.47:0/2275924282 shutdown_connections 2024-04-14T23:35:24.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.787+0000 7f7ecad1e640 1 --2- 172.21.15.47:0/2275924282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec40b8e60 0x7f7ec4168f10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.787+0000 7f7ecad1e640 1 -- 172.21.15.47:0/2275924282 >> 172.21.15.47:0/2275924282 conn(0x7f7ec409d2c0 msgr2=0x7f7ec40d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:24.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.787+0000 7f7ecad1e640 1 -- 172.21.15.47:0/2275924282 shutdown_connections 2024-04-14T23:35:24.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.788+0000 7f7ecad1e640 1 -- 172.21.15.47:0/2275924282 wait complete. 2024-04-14T23:35:24.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.789+0000 7f7ecad1e640 1 Processor -- start 2024-04-14T23:35:24.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.789+0000 7f7ecad1e640 1 -- start start 2024-04-14T23:35:24.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.789+0000 7f7ecad1e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ec40b53c0 0x7f7ec41f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.789+0000 7f7ecad1e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ec40b8e60 0x7f7ec40cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.789+0000 7f7ecad1e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec40d25d0 0x7f7ec415fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.789+0000 7f7ecad1e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec40b57a0 con 0x7f7ec40d25d0 2024-04-14T23:35:24.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.789+0000 7f7ecad1e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec40cfd00 con 0x7f7ec40b53c0 2024-04-14T23:35:24.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.789+0000 7f7ecad1e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec40b5920 con 0x7f7ec40b8e60 2024-04-14T23:35:24.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ec92bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec40d25d0 0x7f7ec415fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ec92bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec40d25d0 0x7f7ec415fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43540/0 (socket says 172.21.15.47:43540) 2024-04-14T23:35:24.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ec92bb640 1 -- 172.21.15.47:0/3912013951 learned_addr learned my addr 172.21.15.47:0/3912013951 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:24.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ec3fff640 1 --2- 172.21.15.47:0/3912013951 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ec40b8e60 0x7f7ec40cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ec8aba640 1 --2- 172.21.15.47:0/3912013951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ec40b53c0 0x7f7ec41f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ec92bb640 1 -- 172.21.15.47:0/3912013951 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ec40b8e60 msgr2=0x7f7ec40cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ec92bb640 1 --2- 172.21.15.47:0/3912013951 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ec40b8e60 0x7f7ec40cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ec92bb640 1 -- 172.21.15.47:0/3912013951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ec40b53c0 msgr2=0x7f7ec41f4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ec92bb640 1 --2- 172.21.15.47:0/3912013951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ec40b53c0 0x7f7ec41f4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ec92bb640 1 -- 172.21.15.47:0/3912013951 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec40b45e0 con 0x7f7ec40d25d0 2024-04-14T23:35:24.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ec3fff640 1 --2- 172.21.15.47:0/3912013951 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ec40b8e60 0x7f7ec40cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:24.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ec92bb640 1 --2- 172.21.15.47:0/3912013951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec40d25d0 0x7f7ec415fc60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc037040 tx=0x7f7ebc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:24.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ec17fa640 1 -- 172.21.15.47:0/3912013951 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc039050 con 0x7f7ec40d25d0 2024-04-14T23:35:24.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ec17fa640 1 -- 172.21.15.47:0/3912013951 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ebc03a040 con 0x7f7ec40d25d0 2024-04-14T23:35:24.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ecad1e640 1 -- 172.21.15.47:0/3912013951 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec40b1780 con 0x7f7ec40d25d0 2024-04-14T23:35:24.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ec17fa640 1 -- 172.21.15.47:0/3912013951 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc03e610 con 0x7f7ec40d25d0 2024-04-14T23:35:24.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.790+0000 7f7ecad1e640 1 -- 172.21.15.47:0/3912013951 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec40b1d40 con 0x7f7ec40d25d0 2024-04-14T23:35:24.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.791+0000 7f7ecad1e640 1 -- 172.21.15.47:0/3912013951 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ec4073f50 con 0x7f7ec40d25d0 2024-04-14T23:35:24.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.792+0000 7f7ec17fa640 1 -- 172.21.15.47:0/3912013951 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f7ebc047030 con 0x7f7ec40d25d0 2024-04-14T23:35:24.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.792+0000 7f7ec17fa640 1 --2- 172.21.15.47:0/3912013951 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7ea806b9c0 0x7f7ea806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:24.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.792+0000 7f7ec17fa640 1 -- 172.21.15.47:0/3912013951 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7ebc0accc0 con 0x7f7ec40d25d0 2024-04-14T23:35:24.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.792+0000 7f7ec8aba640 1 --2- 172.21.15.47:0/3912013951 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7ea806b9c0 0x7f7ea806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:24.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.793+0000 7f7ec8aba640 1 --2- 172.21.15.47:0/3912013951 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7ea806b9c0 0x7f7ea806de80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8000f60 tx=0x7f7eb8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:24.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.797+0000 7f7ec17fa640 1 -- 172.21.15.47:0/3912013951 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7ebc07b620 con 0x7f7ec40d25d0 2024-04-14T23:35:24.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.977+0000 7f7ecad1e640 1 -- 172.21.15.47:0/3912013951 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7ec40b1f10 con 0x7f7ec40d25d0 2024-04-14T23:35:24.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.977+0000 7f7ec17fa640 1 -- 172.21.15.47:0/3912013951 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f7ebc07af20 con 0x7f7ec40d25d0 2024-04-14T23:35:24.979 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:24.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.979+0000 7f7ecad1e640 1 -- 172.21.15.47:0/3912013951 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7ea806b9c0 msgr2=0x7f7ea806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.979+0000 7f7ecad1e640 1 --2- 172.21.15.47:0/3912013951 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7ea806b9c0 0x7f7ea806de80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8000f60 tx=0x7f7eb8009040 comp rx=0 tx=0).stop 2024-04-14T23:35:24.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.979+0000 7f7ecad1e640 1 -- 172.21.15.47:0/3912013951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec40d25d0 msgr2=0x7f7ec415fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:24.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.979+0000 7f7ecad1e640 1 --2- 172.21.15.47:0/3912013951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec40d25d0 0x7f7ec415fc60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc037040 tx=0x7f7ebc004a40 comp rx=0 tx=0).stop 2024-04-14T23:35:24.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.979+0000 7f7ecad1e640 1 -- 172.21.15.47:0/3912013951 shutdown_connections 2024-04-14T23:35:24.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.979+0000 7f7ecad1e640 1 --2- 172.21.15.47:0/3912013951 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f7ea806b9c0 0x7f7ea806de80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.979+0000 7f7ecad1e640 1 --2- 172.21.15.47:0/3912013951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec40d25d0 0x7f7ec415fc60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.979+0000 7f7ecad1e640 1 --2- 172.21.15.47:0/3912013951 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ec40b8e60 0x7f7ec40cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.979+0000 7f7ecad1e640 1 --2- 172.21.15.47:0/3912013951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ec40b53c0 0x7f7ec41f4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:24.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.979+0000 7f7ecad1e640 1 -- 172.21.15.47:0/3912013951 >> 172.21.15.47:0/3912013951 conn(0x7f7ec409d2c0 msgr2=0x7f7ec406d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:24.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.979+0000 7f7ecad1e640 1 -- 172.21.15.47:0/3912013951 shutdown_connections 2024-04-14T23:35:24.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:24.979+0000 7f7ecad1e640 1 -- 172.21.15.47:0/3912013951 wait complete. 2024-04-14T23:35:24.992 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T23:35:25.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.093+0000 7ffa3c555640 1 Processor -- start 2024-04-14T23:35:25.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.093+0000 7ffa3c555640 1 -- start start 2024-04-14T23:35:25.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa3c555640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ffa3415c170 0x7ffa340ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa3c555640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa340ce8d0 0x7ffa340ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa3c555640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ffa340cfa10 0x7ffa340cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa3c555640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ffa340cdeb0 con 0x7ffa3415c170 2024-04-14T23:35:25.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa3c555640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7ffa340b1730 con 0x7ffa340cfa10 2024-04-14T23:35:25.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa3c555640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ffa340d2a70 con 0x7ffa340ce8d0 2024-04-14T23:35:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa3a2f1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ffa3415c170 0x7ffa340ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa3a2f1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ffa3415c170 0x7ffa340ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43544/0 (socket says 172.21.15.47:43544) 2024-04-14T23:35:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa3a2f1640 1 -- 172.21.15.47:0/1767974105 learned_addr learned my addr 172.21.15.47:0/1767974105 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa3aaf2640 1 --2- 172.21.15.47:0/1767974105 >> v2:172.21.15.191:3300/0 conn(0x7ffa340cfa10 0x7ffa340cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa39af0640 1 --2- 172.21.15.47:0/1767974105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa340ce8d0 0x7ffa340ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa3a2f1640 1 -- 172.21.15.47:0/1767974105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa340ce8d0 msgr2=0x7ffa340ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa3a2f1640 1 --2- 172.21.15.47:0/1767974105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa340ce8d0 0x7ffa340ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa3a2f1640 1 -- 172.21.15.47:0/1767974105 >> v2:172.21.15.191:3300/0 conn(0x7ffa340cfa10 msgr2=0x7ffa340cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa3a2f1640 1 --2- 172.21.15.47:0/1767974105 >> v2:172.21.15.191:3300/0 conn(0x7ffa340cfa10 0x7ffa340cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa3a2f1640 1 -- 172.21.15.47:0/1767974105 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa340cd610 con 0x7ffa3415c170 2024-04-14T23:35:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.094+0000 7ffa39af0640 1 --2- 172.21.15.47:0/1767974105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa340ce8d0 0x7ffa340ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.095+0000 7ffa3a2f1640 1 --2- 172.21.15.47:0/1767974105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa3415c170 0x7ffa340ce390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffa34071e00 tx=0x7ffa2c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bae2411fcccf76e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.095+0000 7ffa392ef640 1 -- 172.21.15.47:0/1767974105 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c02e070 con 0x7ffa3415c170 2024-04-14T23:35:25.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.095+0000 7ffa392ef640 1 -- 172.21.15.47:0/1767974105 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa2c037070 con 0x7ffa3415c170 2024-04-14T23:35:25.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.095+0000 7ffa392ef640 1 -- 172.21.15.47:0/1767974105 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c031a00 con 0x7ffa3415c170 2024-04-14T23:35:25.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.096+0000 7ffa3c555640 1 -- 172.21.15.47:0/1767974105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa3415c170 msgr2=0x7ffa340ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:25.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.096+0000 7ffa3c555640 1 --2- 172.21.15.47:0/1767974105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa3415c170 0x7ffa340ce390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffa34071e00 tx=0x7ffa2c02b880 comp rx=0 tx=0).stop 2024-04-14T23:35:25.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.096+0000 7ffa3c555640 1 -- 172.21.15.47:0/1767974105 shutdown_connections 2024-04-14T23:35:25.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.096+0000 7ffa3c555640 1 --2- 172.21.15.47:0/1767974105 >> v2:172.21.15.191:3300/0 conn(0x7ffa340cfa10 0x7ffa340cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.096+0000 7ffa3c555640 1 --2- 172.21.15.47:0/1767974105 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa340ce8d0 0x7ffa340ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.096+0000 7ffa3c555640 1 --2- 172.21.15.47:0/1767974105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa3415c170 0x7ffa340ce390 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.096+0000 7ffa3c555640 1 -- 172.21.15.47:0/1767974105 >> 172.21.15.47:0/1767974105 conn(0x7ffa340d1c30 msgr2=0x7ffa340d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:25.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.096+0000 7ffa3c555640 1 -- 172.21.15.47:0/1767974105 shutdown_connections 2024-04-14T23:35:25.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.096+0000 7ffa3c555640 1 -- 172.21.15.47:0/1767974105 wait complete. 2024-04-14T23:35:25.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.097+0000 7ffa3c555640 1 Processor -- start 2024-04-14T23:35:25.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.097+0000 7ffa3c555640 1 -- start start 2024-04-14T23:35:25.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa3c555640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa340ce8d0 0x7ffa341f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa3c555640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa340cfa10 0x7ffa34155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa3c555640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa3415c170 0x7ffa34157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa3c555640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3415c550 con 0x7ffa340cfa10 2024-04-14T23:35:25.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa3c555640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ffa340cdbd0 con 0x7ffa340ce8d0 2024-04-14T23:35:25.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa3c555640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ffa34155b90 con 0x7ffa3415c170 2024-04-14T23:35:25.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa39af0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa340cfa10 0x7ffa34155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa39af0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa340cfa10 0x7ffa34155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43546/0 (socket says 172.21.15.47:43546) 2024-04-14T23:35:25.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa39af0640 1 -- 172.21.15.47:0/879244282 learned_addr learned my addr 172.21.15.47:0/879244282 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:25.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa39af0640 1 -- 172.21.15.47:0/879244282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa3415c170 msgr2=0x7ffa34157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:25.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa39af0640 1 --2- 172.21.15.47:0/879244282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa3415c170 0x7ffa34157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa39af0640 1 -- 172.21.15.47:0/879244282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa340ce8d0 msgr2=0x7ffa341f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:25.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa3a2f1640 1 --2- 172.21.15.47:0/879244282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa340ce8d0 0x7ffa341f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa39af0640 1 --2- 172.21.15.47:0/879244282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa340ce8d0 0x7ffa341f4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa39af0640 1 -- 172.21.15.47:0/879244282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa34155e70 con 0x7ffa340cfa10 2024-04-14T23:35:25.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa39af0640 1 --2- 172.21.15.47:0/879244282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa340cfa10 0x7ffa34155140 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ffa2800c7f0 tx=0x7ffa2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:25.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa32ffd640 1 -- 172.21.15.47:0/879244282 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa28015070 con 0x7ffa340cfa10 2024-04-14T23:35:25.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.098+0000 7ffa32ffd640 1 -- 172.21.15.47:0/879244282 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa28007820 con 0x7ffa340cfa10 2024-04-14T23:35:25.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.099+0000 7ffa32ffd640 1 -- 172.21.15.47:0/879244282 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa28007c10 con 0x7ffa340cfa10 2024-04-14T23:35:25.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.099+0000 7ffa3c555640 1 -- 172.21.15.47:0/879244282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa34156150 con 0x7ffa340cfa10 2024-04-14T23:35:25.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.099+0000 7ffa3c555640 1 -- 172.21.15.47:0/879244282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa34156710 con 0x7ffa340cfa10 2024-04-14T23:35:25.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.099+0000 7ffa3c555640 1 -- 172.21.15.47:0/879244282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa34075430 con 0x7ffa340cfa10 2024-04-14T23:35:25.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.100+0000 7ffa32ffd640 1 -- 172.21.15.47:0/879244282 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ffa28018070 con 0x7ffa340cfa10 2024-04-14T23:35:25.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.100+0000 7ffa32ffd640 1 --2- 172.21.15.47:0/879244282 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ffa2006b990 0x7ffa2006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.100+0000 7ffa32ffd640 1 -- 172.21.15.47:0/879244282 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ffa2808adf0 con 0x7ffa340cfa10 2024-04-14T23:35:25.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.101+0000 7ffa3a2f1640 1 --2- 172.21.15.47:0/879244282 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ffa2006b990 0x7ffa2006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.101+0000 7ffa3a2f1640 1 --2- 172.21.15.47:0/879244282 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ffa2006b990 0x7ffa2006de50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c036000 tx=0x7ffa2c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:25.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.105+0000 7ffa32ffd640 1 -- 172.21.15.47:0/879244282 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ffa28059580 con 0x7ffa340cfa10 2024-04-14T23:35:25.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.297+0000 7ffa3c555640 1 -- 172.21.15.47:0/879244282 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ffa3406ff70 con 0x7ffa340cfa10 2024-04-14T23:35:25.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.297+0000 7ffa32ffd640 1 -- 172.21.15.47:0/879244282 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7ffa28058e80 con 0x7ffa340cfa10 2024-04-14T23:35:25.300 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-14T23:35:25.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.299+0000 7ffa3c555640 1 -- 172.21.15.47:0/879244282 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ffa2006b990 msgr2=0x7ffa2006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:25.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.299+0000 7ffa3c555640 1 --2- 172.21.15.47:0/879244282 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ffa2006b990 0x7ffa2006de50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c036000 tx=0x7ffa2c008030 comp rx=0 tx=0).stop 2024-04-14T23:35:25.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.299+0000 7ffa3c555640 1 -- 172.21.15.47:0/879244282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa340cfa10 msgr2=0x7ffa34155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:25.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.299+0000 7ffa3c555640 1 --2- 172.21.15.47:0/879244282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa340cfa10 0x7ffa34155140 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ffa2800c7f0 tx=0x7ffa2800ccb0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.299+0000 7ffa3c555640 1 -- 172.21.15.47:0/879244282 shutdown_connections 2024-04-14T23:35:25.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.299+0000 7ffa3c555640 1 --2- 172.21.15.47:0/879244282 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ffa2006b990 0x7ffa2006de50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.299+0000 7ffa3c555640 1 --2- 172.21.15.47:0/879244282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffa3415c170 0x7ffa34157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.299+0000 7ffa3c555640 1 --2- 172.21.15.47:0/879244282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa340cfa10 0x7ffa34155140 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.299+0000 7ffa3c555640 1 --2- 172.21.15.47:0/879244282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa340ce8d0 0x7ffa341f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.299+0000 7ffa3c555640 1 -- 172.21.15.47:0/879244282 >> 172.21.15.47:0/879244282 conn(0x7ffa340d1c30 msgr2=0x7ffa340b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:25.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.299+0000 7ffa3c555640 1 -- 172.21.15.47:0/879244282 shutdown_connections 2024-04-14T23:35:25.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.299+0000 7ffa3c555640 1 -- 172.21.15.47:0/879244282 wait complete. 2024-04-14T23:35:25.312 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-14T23:35:25.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:25.313 DEBUG:teuthology.orchestra.run.smithi047:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-14T23:35:25.340 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-04-14T23:35:25.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:25.341 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-14T23:35:25.396 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:35:25.396 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:25.415 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:35:25.416 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:25.473 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:35:25.474 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:25.531 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:25.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.629+0000 7ff6ee95e640 1 Processor -- start 2024-04-14T23:35:25.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.629+0000 7ff6ee95e640 1 -- start start 2024-04-14T23:35:25.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.630+0000 7ff6ee95e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff6e80d2910 0x7ff6e8168f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.630+0000 7ff6ee95e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e80b57a0 con 0x7ff6e80d1e00 2024-04-14T23:35:25.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.630+0000 7ff6ee95e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e80d1620 con 0x7ff6e815e270 2024-04-14T23:35:25.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.630+0000 7ff6ee95e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e80b4300 con 0x7ff6e80d2910 2024-04-14T23:35:25.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.630+0000 7ff6ecefb640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff6e80d2910 0x7ff6e8168f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.630+0000 7ff6e77fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff6e80d1e00 0x7ff6e80d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54430/0 (socket says 172.21.15.47:54430) 2024-04-14T23:35:25.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.630+0000 7ff6e77fe640 1 -- 172.21.15.47:0/2187539799 learned_addr learned my addr 172.21.15.47:0/2187539799 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:25.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.631+0000 7ff6ecefb640 1 -- 172.21.15.47:0/2187539799 >> v1:172.21.15.191:6789/0 conn(0x7ff6e815e270 legacy=0x7ff6e80d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:25.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.631+0000 7ff6ecefb640 1 -- 172.21.15.47:0/2187539799 >> v1:172.21.15.47:6789/0 conn(0x7ff6e80d1e00 legacy=0x7ff6e80d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:25.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.631+0000 7ff6e6ffd640 1 -- 172.21.15.47:0/2187539799 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 855203388 0 0) 0x7ff6e80b57a0 con 0x7ff6e80d1e00 2024-04-14T23:35:25.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.631+0000 7ff6ecefb640 1 -- 172.21.15.47:0/2187539799 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e80b39d0 con 0x7ff6e80d2910 2024-04-14T23:35:25.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.631+0000 7ff6ecefb640 1 --2- 172.21.15.47:0/2187539799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e80d2910 0x7ff6e8168f40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009d90 tx=0x7ff6e002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af425dbf1f2a972c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:25.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.631+0000 7ff6e6ffd640 1 -- 172.21.15.47:0/2187539799 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0039070 con 0x7ff6e80d2910 2024-04-14T23:35:25.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.631+0000 7ff6e6ffd640 1 -- 172.21.15.47:0/2187539799 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e002cd00 con 0x7ff6e80d2910 2024-04-14T23:35:25.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.631+0000 7ff6e6ffd640 1 -- 172.21.15.47:0/2187539799 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0034660 con 0x7ff6e80d2910 2024-04-14T23:35:25.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.632+0000 7ff6ee95e640 1 -- 172.21.15.47:0/2187539799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e80d2910 msgr2=0x7ff6e8168f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:25.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.632+0000 7ff6ee95e640 1 --2- 172.21.15.47:0/2187539799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e80d2910 0x7ff6e8168f40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009d90 tx=0x7ff6e002bf50 comp rx=0 tx=0).stop 2024-04-14T23:35:25.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.632+0000 7ff6ee95e640 1 -- 172.21.15.47:0/2187539799 shutdown_connections 2024-04-14T23:35:25.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.632+0000 7ff6ee95e640 1 --2- 172.21.15.47:0/2187539799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e80d2910 0x7ff6e8168f40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.632+0000 7ff6ee95e640 1 -- 172.21.15.47:0/2187539799 >> 172.21.15.47:0/2187539799 conn(0x7ff6e80d3ed0 msgr2=0x7ff6e80d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:25.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.632+0000 7ff6ee95e640 1 -- 172.21.15.47:0/2187539799 shutdown_connections 2024-04-14T23:35:25.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.632+0000 7ff6ee95e640 1 -- 172.21.15.47:0/2187539799 wait complete. 2024-04-14T23:35:25.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.633+0000 7ff6ee95e640 1 Processor -- start 2024-04-14T23:35:25.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.633+0000 7ff6ee95e640 1 -- start start 2024-04-14T23:35:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6ee95e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6e80d1e00 0x7ff6e815a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6ee95e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e80d2910 0x7ff6e81e84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6ee95e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e815e270 0x7ff6e8157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6ee95e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e80b0c60 con 0x7ff6e815e270 2024-04-14T23:35:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6ee95e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e80b3f90 con 0x7ff6e80d2910 2024-04-14T23:35:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6ee95e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e815e650 con 0x7ff6e80d1e00 2024-04-14T23:35:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6ecefb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e815e270 0x7ff6e8157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6ecefb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e815e270 0x7ff6e8157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43578/0 (socket says 172.21.15.47:43578) 2024-04-14T23:35:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6ecefb640 1 -- 172.21.15.47:0/809316717 learned_addr learned my addr 172.21.15.47:0/809316717 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6e77fe640 1 --2- 172.21.15.47:0/809316717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e80d2910 0x7ff6e81e84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6e7fff640 1 --2- 172.21.15.47:0/809316717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6e80d1e00 0x7ff6e815a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6ecefb640 1 -- 172.21.15.47:0/809316717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6e80d1e00 msgr2=0x7ff6e815a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:25.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6ecefb640 1 --2- 172.21.15.47:0/809316717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6e80d1e00 0x7ff6e815a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6ecefb640 1 -- 172.21.15.47:0/809316717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e80d2910 msgr2=0x7ff6e81e84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:25.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6ecefb640 1 --2- 172.21.15.47:0/809316717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e80d2910 0x7ff6e81e84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6ecefb640 1 -- 172.21.15.47:0/809316717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e80b7b60 con 0x7ff6e815e270 2024-04-14T23:35:25.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6e7fff640 1 --2- 172.21.15.47:0/809316717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6e80d1e00 0x7ff6e815a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:25.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.634+0000 7ff6e77fe640 1 --2- 172.21.15.47:0/809316717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e80d2910 0x7ff6e81e84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:25.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.635+0000 7ff6ecefb640 1 --2- 172.21.15.47:0/809316717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e815e270 0x7ff6e8157650 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009eb0 tx=0x7ff6e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:25.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.635+0000 7ff6e4ff9640 1 -- 172.21.15.47:0/809316717 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0044020 con 0x7ff6e815e270 2024-04-14T23:35:25.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.635+0000 7ff6e4ff9640 1 -- 172.21.15.47:0/809316717 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e003f470 con 0x7ff6e815e270 2024-04-14T23:35:25.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.635+0000 7ff6ee95e640 1 -- 172.21.15.47:0/809316717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e80b7e00 con 0x7ff6e815e270 2024-04-14T23:35:25.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.635+0000 7ff6e4ff9640 1 -- 172.21.15.47:0/809316717 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0039040 con 0x7ff6e815e270 2024-04-14T23:35:25.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.635+0000 7ff6ee95e640 1 -- 172.21.15.47:0/809316717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e80b8380 con 0x7ff6e815e270 2024-04-14T23:35:25.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.636+0000 7ff6ee95e640 1 -- 172.21.15.47:0/809316717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e8075430 con 0x7ff6e815e270 2024-04-14T23:35:25.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.636+0000 7ff6e4ff9640 1 -- 172.21.15.47:0/809316717 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ff6e0047020 con 0x7ff6e815e270 2024-04-14T23:35:25.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.636+0000 7ff6e4ff9640 1 --2- 172.21.15.47:0/809316717 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6d406b990 0x7ff6d406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.637+0000 7ff6e4ff9640 1 -- 172.21.15.47:0/809316717 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff6e00ad8b0 con 0x7ff6e815e270 2024-04-14T23:35:25.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.637+0000 7ff6e7fff640 1 --2- 172.21.15.47:0/809316717 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6d406b990 0x7ff6d406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.637+0000 7ff6e7fff640 1 --2- 172.21.15.47:0/809316717 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6d406b990 0x7ff6d406de50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800a830 tx=0x7ff6d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:25.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.641+0000 7ff6e4ff9640 1 -- 172.21.15.47:0/809316717 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff6e004e030 con 0x7ff6e815e270 2024-04-14T23:35:25.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.826+0000 7ff6ee95e640 1 -- 172.21.15.47:0/809316717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6e80b3590 con 0x7ff6e815e270 2024-04-14T23:35:25.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.827+0000 7ff6e4ff9640 1 -- 172.21.15.47:0/809316717 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18892 (secure 0 0 0) 0x7ff6e007c0c0 con 0x7ff6e815e270 2024-04-14T23:35:25.830 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:25.830 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:35:19.819811+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:25.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.829+0000 7ff6ee95e640 1 -- 172.21.15.47:0/809316717 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6d406b990 msgr2=0x7ff6d406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:25.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.829+0000 7ff6ee95e640 1 --2- 172.21.15.47:0/809316717 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6d406b990 0x7ff6d406de50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800a830 tx=0x7ff6d8008040 comp rx=0 tx=0).stop 2024-04-14T23:35:25.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.829+0000 7ff6ee95e640 1 -- 172.21.15.47:0/809316717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e815e270 msgr2=0x7ff6e8157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:25.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.829+0000 7ff6ee95e640 1 --2- 172.21.15.47:0/809316717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e815e270 0x7ff6e8157650 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009eb0 tx=0x7ff6e0004a40 comp rx=0 tx=0).stop 2024-04-14T23:35:25.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.829+0000 7ff6ee95e640 1 -- 172.21.15.47:0/809316717 shutdown_connections 2024-04-14T23:35:25.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.829+0000 7ff6ee95e640 1 --2- 172.21.15.47:0/809316717 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6d406b990 0x7ff6d406de50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.829+0000 7ff6ee95e640 1 --2- 172.21.15.47:0/809316717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e815e270 0x7ff6e8157650 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.829+0000 7ff6ee95e640 1 --2- 172.21.15.47:0/809316717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e80d2910 0x7ff6e81e84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.829+0000 7ff6ee95e640 1 --2- 172.21.15.47:0/809316717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6e80d1e00 0x7ff6e815a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.829+0000 7ff6ee95e640 1 -- 172.21.15.47:0/809316717 >> 172.21.15.47:0/809316717 conn(0x7ff6e80d3ed0 msgr2=0x7ff6e80cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:25.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.829+0000 7ff6ee95e640 1 -- 172.21.15.47:0/809316717 shutdown_connections 2024-04-14T23:35:25.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.829+0000 7ff6ee95e640 1 -- 172.21.15.47:0/809316717 wait complete. 2024-04-14T23:35:25.844 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T23:34:36.382034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T23:34:37.023103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T23:34:40.726418+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T23:35:25.844 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:35:25.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.947+0000 7f86666b7640 1 Processor -- start 2024-04-14T23:35:25.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.947+0000 7f86666b7640 1 -- start start 2024-04-14T23:35:25.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.947+0000 7f86666b7640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86601458f0 0x7f86600b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.947+0000 7f86666b7640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f86600cec90 0x7f86600cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.947+0000 7f86666b7640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f86600cf0b0 0x7f86600d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.947+0000 7f86666b7640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f86600b31c0 con 0x7f86600cf0b0 2024-04-14T23:35:25.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.947+0000 7f86666b7640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f86600b34a0 con 0x7f86600cec90 2024-04-14T23:35:25.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.947+0000 7f86666b7640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f86600b3780 con 0x7f86601458f0 2024-04-14T23:35:25.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.947+0000 7f8664c54640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f86600cf0b0 0x7f86600d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.948+0000 7f8664c54640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f86600cf0b0 0x7f86600d0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43588/0 (socket says 172.21.15.47:43588) 2024-04-14T23:35:25.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.948+0000 7f8664c54640 1 -- 172.21.15.47:0/3290348742 learned_addr learned my addr 172.21.15.47:0/3290348742 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:25.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.948+0000 7f865ffff640 1 --2- 172.21.15.47:0/3290348742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86601458f0 0x7f86600b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.948+0000 7f865f7fe640 1 --2- 172.21.15.47:0/3290348742 >> v2:172.21.15.191:3300/0 conn(0x7f86600cec90 0x7f86600cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.948+0000 7f8664c54640 1 -- 172.21.15.47:0/3290348742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86601458f0 msgr2=0x7f86600b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:25.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.948+0000 7f8664c54640 1 --2- 172.21.15.47:0/3290348742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86601458f0 0x7f86600b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.948+0000 7f8664c54640 1 -- 172.21.15.47:0/3290348742 >> v2:172.21.15.191:3300/0 conn(0x7f86600cec90 msgr2=0x7f86600cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:25.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.948+0000 7f8664c54640 1 --2- 172.21.15.47:0/3290348742 >> v2:172.21.15.191:3300/0 conn(0x7f86600cec90 0x7f86600cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.948+0000 7f8664c54640 1 -- 172.21.15.47:0/3290348742 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86600b3a60 con 0x7f86600cf0b0 2024-04-14T23:35:25.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.948+0000 7f865ffff640 1 --2- 172.21.15.47:0/3290348742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86601458f0 0x7f86600b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:25.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.948+0000 7f865f7fe640 1 --2- 172.21.15.47:0/3290348742 >> v2:172.21.15.191:3300/0 conn(0x7f86600cec90 0x7f86600cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:25.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.949+0000 7f8664c54640 1 --2- 172.21.15.47:0/3290348742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86600cf0b0 0x7f86600d0280 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f866006f1d0 tx=0x7f865802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d770b30ef23af0a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:25.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.949+0000 7f865effd640 1 -- 172.21.15.47:0/3290348742 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865802ca70 con 0x7f86600cf0b0 2024-04-14T23:35:25.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.949+0000 7f865effd640 1 -- 172.21.15.47:0/3290348742 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f865802cc10 con 0x7f86600cf0b0 2024-04-14T23:35:25.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.949+0000 7f865effd640 1 -- 172.21.15.47:0/3290348742 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86580343f0 con 0x7f86600cf0b0 2024-04-14T23:35:25.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.949+0000 7f86666b7640 1 -- 172.21.15.47:0/3290348742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86600cf0b0 msgr2=0x7f86600d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:25.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.949+0000 7f86666b7640 1 --2- 172.21.15.47:0/3290348742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86600cf0b0 0x7f86600d0280 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f866006f1d0 tx=0x7f865802bed0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.949+0000 7f86666b7640 1 -- 172.21.15.47:0/3290348742 shutdown_connections 2024-04-14T23:35:25.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.949+0000 7f86666b7640 1 --2- 172.21.15.47:0/3290348742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86600cf0b0 0x7f86600d0280 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.949+0000 7f86666b7640 1 --2- 172.21.15.47:0/3290348742 >> v2:172.21.15.191:3300/0 conn(0x7f86600cec90 0x7f86600cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.949+0000 7f86666b7640 1 --2- 172.21.15.47:0/3290348742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86601458f0 0x7f86600b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.949+0000 7f86666b7640 1 -- 172.21.15.47:0/3290348742 >> 172.21.15.47:0/3290348742 conn(0x7f866006b3e0 msgr2=0x7f866006b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:25.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.949+0000 7f86666b7640 1 -- 172.21.15.47:0/3290348742 shutdown_connections 2024-04-14T23:35:25.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.949+0000 7f86666b7640 1 -- 172.21.15.47:0/3290348742 wait complete. 2024-04-14T23:35:25.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.951+0000 7f86666b7640 1 Processor -- start 2024-04-14T23:35:25.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.951+0000 7f86666b7640 1 -- start start 2024-04-14T23:35:25.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.951+0000 7f86666b7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86600cec90 0x7f8660139550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.951+0000 7f86666b7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86600cf0b0 0x7f86600ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.951+0000 7f86666b7640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86601458f0 0x7f86600ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.951+0000 7f86666b7640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f866015c480 con 0x7f86600cec90 2024-04-14T23:35:25.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.951+0000 7f86666b7640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f86600b2e40 con 0x7f86600cf0b0 2024-04-14T23:35:25.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.951+0000 7f86666b7640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f866015c600 con 0x7f86601458f0 2024-04-14T23:35:25.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f865ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86600cec90 0x7f8660139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f865ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86600cec90 0x7f8660139550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43604/0 (socket says 172.21.15.47:43604) 2024-04-14T23:35:25.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f865ffff640 1 -- 172.21.15.47:0/3815818680 learned_addr learned my addr 172.21.15.47:0/3815818680 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:25.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f865f7fe640 1 --2- 172.21.15.47:0/3815818680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86600cf0b0 0x7f86600ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f8664c54640 1 --2- 172.21.15.47:0/3815818680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86601458f0 0x7f86600ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f865ffff640 1 -- 172.21.15.47:0/3815818680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86601458f0 msgr2=0x7f86600ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:25.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f865ffff640 1 --2- 172.21.15.47:0/3815818680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86601458f0 0x7f86600ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f865ffff640 1 -- 172.21.15.47:0/3815818680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86600cf0b0 msgr2=0x7f86600ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:25.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f865ffff640 1 --2- 172.21.15.47:0/3815818680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86600cf0b0 0x7f86600ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:25.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f865ffff640 1 -- 172.21.15.47:0/3815818680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86600ac780 con 0x7f86600cec90 2024-04-14T23:35:25.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f865f7fe640 1 --2- 172.21.15.47:0/3815818680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86600cf0b0 0x7f86600ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:25.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f865ffff640 1 --2- 172.21.15.47:0/3815818680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86600cec90 0x7f8660139550 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f865000d800 tx=0x7f865000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:25.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f865cff9640 1 -- 172.21.15.47:0/3815818680 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650004030 con 0x7f86600cec90 2024-04-14T23:35:25.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f865cff9640 1 -- 172.21.15.47:0/3815818680 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86500041d0 con 0x7f86600cec90 2024-04-14T23:35:25.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f86666b7640 1 -- 172.21.15.47:0/3815818680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86600aca60 con 0x7f86600cec90 2024-04-14T23:35:25.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f865cff9640 1 -- 172.21.15.47:0/3815818680 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86500096a0 con 0x7f86600cec90 2024-04-14T23:35:25.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.952+0000 7f86666b7640 1 -- 172.21.15.47:0/3815818680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86600ad020 con 0x7f86600cec90 2024-04-14T23:35:25.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.953+0000 7f86666b7640 1 -- 172.21.15.47:0/3815818680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8660073f50 con 0x7f86600cec90 2024-04-14T23:35:25.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.954+0000 7f865cff9640 1 -- 172.21.15.47:0/3815818680 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f8650009840 con 0x7f86600cec90 2024-04-14T23:35:25.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.954+0000 7f865cff9640 1 --2- 172.21.15.47:0/3815818680 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f864c06b9c0 0x7f864c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:25.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.954+0000 7f865cff9640 1 -- 172.21.15.47:0/3815818680 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f865008af80 con 0x7f86600cec90 2024-04-14T23:35:25.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.954+0000 7f865f7fe640 1 --2- 172.21.15.47:0/3815818680 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f864c06b9c0 0x7f864c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:25.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.955+0000 7f865f7fe640 1 --2- 172.21.15.47:0/3815818680 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f864c06b9c0 0x7f864c06de80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f86600ade40 tx=0x7f8654008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:25.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:25.958+0000 7f865cff9640 1 -- 172.21.15.47:0/3815818680 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8650059700 con 0x7f86600cec90 2024-04-14T23:35:26.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.142+0000 7f86666b7640 1 -- 172.21.15.47:0/3815818680 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f86600b4260 con 0x7f86600cec90 2024-04-14T23:35:26.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.142+0000 7f865cff9640 1 -- 172.21.15.47:0/3815818680 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f8650059000 con 0x7f86600cec90 2024-04-14T23:35:26.145 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:35:26.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.144+0000 7f86666b7640 1 -- 172.21.15.47:0/3815818680 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f864c06b9c0 msgr2=0x7f864c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.144+0000 7f86666b7640 1 --2- 172.21.15.47:0/3815818680 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f864c06b9c0 0x7f864c06de80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f86600ade40 tx=0x7f8654008040 comp rx=0 tx=0).stop 2024-04-14T23:35:26.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.144+0000 7f86666b7640 1 -- 172.21.15.47:0/3815818680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86600cec90 msgr2=0x7f8660139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.144+0000 7f86666b7640 1 --2- 172.21.15.47:0/3815818680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86600cec90 0x7f8660139550 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f865000d800 tx=0x7f865000dcc0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.144+0000 7f86666b7640 1 -- 172.21.15.47:0/3815818680 shutdown_connections 2024-04-14T23:35:26.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.144+0000 7f86666b7640 1 --2- 172.21.15.47:0/3815818680 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f864c06b9c0 0x7f864c06de80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.144+0000 7f86666b7640 1 --2- 172.21.15.47:0/3815818680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86601458f0 0x7f86600ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.144+0000 7f86666b7640 1 --2- 172.21.15.47:0/3815818680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86600cf0b0 0x7f86600ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.144+0000 7f86666b7640 1 --2- 172.21.15.47:0/3815818680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86600cec90 0x7f8660139550 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.144+0000 7f86666b7640 1 -- 172.21.15.47:0/3815818680 >> 172.21.15.47:0/3815818680 conn(0x7f866006b3e0 msgr2=0x7f86600b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:26.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.144+0000 7f86666b7640 1 -- 172.21.15.47:0/3815818680 shutdown_connections 2024-04-14T23:35:26.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.144+0000 7f86666b7640 1 -- 172.21.15.47:0/3815818680 wait complete. 2024-04-14T23:35:26.159 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T23:35:26.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.260+0000 7f955c476640 1 Processor -- start 2024-04-14T23:35:26.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.260+0000 7f955c476640 1 -- start start 2024-04-14T23:35:26.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.261+0000 7f955c476640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95540ce700 0x7f95540ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.261+0000 7f955c476640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f955406de60 0x7f95540d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.261+0000 7f955c476640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95540d12e0 con 0x7f95540d2810 2024-04-14T23:35:26.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.261+0000 7f955c476640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f955406c3b0 con 0x7f955406de60 2024-04-14T23:35:26.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.261+0000 7f955c476640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f95540cf020 con 0x7f95540ce700 2024-04-14T23:35:26.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.261+0000 7f955aa13640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f955406de60 0x7f95540d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:26.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.261+0000 7f955a212640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95540ce700 0x7f95540ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:26.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.261+0000 7f955aa13640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f955406de60 0x7f95540d0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:58860/0 (socket says 172.21.15.47:58860) 2024-04-14T23:35:26.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.261+0000 7f955aa13640 1 -- 172.21.15.47:0/3778229252 learned_addr learned my addr 172.21.15.47:0/3778229252 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:26.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.261+0000 7f9559a11640 1 --1- 172.21.15.47:0/3778229252 >> v1:172.21.15.191:6789/0 conn(0x7f95540d2810 0x7f95540cff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.47:47676/0 (socket says 172.21.15.47:47676) 2024-04-14T23:35:26.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.262+0000 7f955aa13640 1 -- 172.21.15.47:0/3778229252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95540ce700 msgr2=0x7f95540ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:26.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.262+0000 7f955aa13640 1 --2- 172.21.15.47:0/3778229252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95540ce700 0x7f95540ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.262+0000 7f955aa13640 1 -- 172.21.15.47:0/3778229252 >> v1:172.21.15.191:6789/0 conn(0x7f95540d2810 legacy=0x7f95540cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.262+0000 7f955aa13640 1 -- 172.21.15.47:0/3778229252 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f955406f2c0 con 0x7f955406de60 2024-04-14T23:35:26.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.262+0000 7f955a212640 1 --2- 172.21.15.47:0/3778229252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95540ce700 0x7f95540ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:26.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.262+0000 7f955aa13640 1 --2- 172.21.15.47:0/3778229252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f955406de60 0x7f95540d0640 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9550009e50 tx=0x7f955002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5830a674633f1c3c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:26.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.263+0000 7f9559210640 1 -- 172.21.15.47:0/3778229252 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955002cb00 con 0x7f955406de60 2024-04-14T23:35:26.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.263+0000 7f9559210640 1 -- 172.21.15.47:0/3778229252 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f955002cca0 con 0x7f955406de60 2024-04-14T23:35:26.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.263+0000 7f9559210640 1 -- 172.21.15.47:0/3778229252 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550034610 con 0x7f955406de60 2024-04-14T23:35:26.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.263+0000 7f955c476640 1 -- 172.21.15.47:0/3778229252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f955406de60 msgr2=0x7f95540d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.263+0000 7f955c476640 1 --2- 172.21.15.47:0/3778229252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f955406de60 0x7f95540d0640 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9550009e50 tx=0x7f955002bf60 comp rx=0 tx=0).stop 2024-04-14T23:35:26.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.263+0000 7f955c476640 1 -- 172.21.15.47:0/3778229252 shutdown_connections 2024-04-14T23:35:26.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.263+0000 7f955c476640 1 --2- 172.21.15.47:0/3778229252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f955406de60 0x7f95540d0640 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.263+0000 7f955c476640 1 --2- 172.21.15.47:0/3778229252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95540ce700 0x7f95540ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.263+0000 7f955c476640 1 -- 172.21.15.47:0/3778229252 >> 172.21.15.47:0/3778229252 conn(0x7f95540d1cf0 msgr2=0x7f95540d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:26.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.263+0000 7f955c476640 1 -- 172.21.15.47:0/3778229252 shutdown_connections 2024-04-14T23:35:26.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.263+0000 7f955c476640 1 -- 172.21.15.47:0/3778229252 wait complete. 2024-04-14T23:35:26.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.264+0000 7f955c476640 1 Processor -- start 2024-04-14T23:35:26.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.264+0000 7f955c476640 1 -- start start 2024-04-14T23:35:26.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.265+0000 7f955c476640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f955406de60 0x7f9554151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.265+0000 7f955c476640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95540ce700 0x7f95540caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.265+0000 7f955c476640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95540d2810 0x7f95540caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.265+0000 7f955c476640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f955406f5a0 con 0x7f95540ce700 2024-04-14T23:35:26.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.265+0000 7f955c476640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f955406c930 con 0x7f955406de60 2024-04-14T23:35:26.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.265+0000 7f955c476640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f955415e600 con 0x7f95540d2810 2024-04-14T23:35:26.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.265+0000 7f9559a11640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95540ce700 0x7f95540caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:26.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.265+0000 7f9559a11640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95540ce700 0x7f95540caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43618/0 (socket says 172.21.15.47:43618) 2024-04-14T23:35:26.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.265+0000 7f9559a11640 1 -- 172.21.15.47:0/802322946 learned_addr learned my addr 172.21.15.47:0/802322946 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:26.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.265+0000 7f955a212640 1 --2- 172.21.15.47:0/802322946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f955406de60 0x7f9554151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:26.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.265+0000 7f955aa13640 1 --2- 172.21.15.47:0/802322946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95540d2810 0x7f95540caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:26.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.266+0000 7f9559a11640 1 -- 172.21.15.47:0/802322946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95540d2810 msgr2=0x7f95540caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.266+0000 7f9559a11640 1 --2- 172.21.15.47:0/802322946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95540d2810 0x7f95540caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.266+0000 7f9559a11640 1 -- 172.21.15.47:0/802322946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f955406de60 msgr2=0x7f9554151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.266+0000 7f9559a11640 1 --2- 172.21.15.47:0/802322946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f955406de60 0x7f9554151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.266+0000 7f9559a11640 1 -- 172.21.15.47:0/802322946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95541516c0 con 0x7f95540ce700 2024-04-14T23:35:26.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.266+0000 7f955aa13640 1 --2- 172.21.15.47:0/802322946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95540d2810 0x7f95540caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:26.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.266+0000 7f9559a11640 1 --2- 172.21.15.47:0/802322946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95540ce700 0x7f95540caa00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f954400c3c0 tx=0x7f954400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:26.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.266+0000 7f954affd640 1 -- 172.21.15.47:0/802322946 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95440074e0 con 0x7f95540ce700 2024-04-14T23:35:26.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.266+0000 7f954affd640 1 -- 172.21.15.47:0/802322946 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9544007680 con 0x7f95540ce700 2024-04-14T23:35:26.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.266+0000 7f955c476640 1 -- 172.21.15.47:0/802322946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95540c99a0 con 0x7f95540ce700 2024-04-14T23:35:26.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.266+0000 7f954affd640 1 -- 172.21.15.47:0/802322946 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544004a00 con 0x7f95540ce700 2024-04-14T23:35:26.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.266+0000 7f955c476640 1 -- 172.21.15.47:0/802322946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95540c9f60 con 0x7f95540ce700 2024-04-14T23:35:26.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.267+0000 7f955c476640 1 -- 172.21.15.47:0/802322946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9554073f50 con 0x7f95540ce700 2024-04-14T23:35:26.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.268+0000 7f954affd640 1 -- 172.21.15.47:0/802322946 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f954401a020 con 0x7f95540ce700 2024-04-14T23:35:26.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.268+0000 7f954affd640 1 --2- 172.21.15.47:0/802322946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f953806b990 0x7f953806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.268+0000 7f954affd640 1 -- 172.21.15.47:0/802322946 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f954408a330 con 0x7f95540ce700 2024-04-14T23:35:26.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.268+0000 7f955a212640 1 --2- 172.21.15.47:0/802322946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f953806b990 0x7f953806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:26.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.269+0000 7f955a212640 1 --2- 172.21.15.47:0/802322946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f953806b990 0x7f953806de50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f954c009560 tx=0x7f954c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:26.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.272+0000 7f954affd640 1 -- 172.21.15.47:0/802322946 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f95541516c0 con 0x7f95540ce700 2024-04-14T23:35:26.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.455+0000 7f955c476640 1 -- 172.21.15.47:0/802322946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f955415d2a0 con 0x7f95540ce700 2024-04-14T23:35:26.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.455+0000 7f954affd640 1 -- 172.21.15.47:0/802322946 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f9544058bd0 con 0x7f95540ce700 2024-04-14T23:35:26.459 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:26.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.457+0000 7f955c476640 1 -- 172.21.15.47:0/802322946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f953806b990 msgr2=0x7f953806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.457+0000 7f955c476640 1 --2- 172.21.15.47:0/802322946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f953806b990 0x7f953806de50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f954c009560 tx=0x7f954c008040 comp rx=0 tx=0).stop 2024-04-14T23:35:26.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.457+0000 7f955c476640 1 -- 172.21.15.47:0/802322946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95540ce700 msgr2=0x7f95540caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.457+0000 7f955c476640 1 --2- 172.21.15.47:0/802322946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95540ce700 0x7f95540caa00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f954400c3c0 tx=0x7f954400c880 comp rx=0 tx=0).stop 2024-04-14T23:35:26.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.457+0000 7f955c476640 1 -- 172.21.15.47:0/802322946 shutdown_connections 2024-04-14T23:35:26.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.457+0000 7f955c476640 1 --2- 172.21.15.47:0/802322946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f953806b990 0x7f953806de50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.457+0000 7f955c476640 1 --2- 172.21.15.47:0/802322946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95540d2810 0x7f95540caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.457+0000 7f955c476640 1 --2- 172.21.15.47:0/802322946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95540ce700 0x7f95540caa00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.457+0000 7f955c476640 1 --2- 172.21.15.47:0/802322946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f955406de60 0x7f9554151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.457+0000 7f955c476640 1 -- 172.21.15.47:0/802322946 >> 172.21.15.47:0/802322946 conn(0x7f95540d1cf0 msgr2=0x7f95540d20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:26.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.457+0000 7f955c476640 1 -- 172.21.15.47:0/802322946 shutdown_connections 2024-04-14T23:35:26.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.457+0000 7f955c476640 1 -- 172.21.15.47:0/802322946 wait complete. 2024-04-14T23:35:26.471 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T23:35:26.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.572+0000 7fbe3aded640 1 Processor -- start 2024-04-14T23:35:26.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.572+0000 7fbe3aded640 1 -- start start 2024-04-14T23:35:26.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.573+0000 7fbe3aded640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbe340d0b40 0x7fbe340cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.573+0000 7fbe3aded640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe340d1090 con 0x7fbe340cec90 2024-04-14T23:35:26.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.573+0000 7fbe3aded640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe340cc3f0 con 0x7fbe340c8410 2024-04-14T23:35:26.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.573+0000 7fbe3aded640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbe340cc6d0 con 0x7fbe340d0b40 2024-04-14T23:35:26.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.573+0000 7fbe3938a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbe340d0b40 0x7fbe340cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:26.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.573+0000 7fbe33fff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbe340cec90 0x7fbe340cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54446/0 (socket says 172.21.15.47:54446) 2024-04-14T23:35:26.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.573+0000 7fbe33fff640 1 -- 172.21.15.47:0/3830360504 learned_addr learned my addr 172.21.15.47:0/3830360504 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:26.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.573+0000 7fbe3938a640 1 -- 172.21.15.47:0/3830360504 >> v1:172.21.15.191:6789/0 conn(0x7fbe340c8410 legacy=0x7fbe340ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:26.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.573+0000 7fbe3938a640 1 -- 172.21.15.47:0/3830360504 >> v1:172.21.15.47:6789/0 conn(0x7fbe340cec90 legacy=0x7fbe340cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.573+0000 7fbe337fe640 1 -- 172.21.15.47:0/3830360504 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3283215204 0 0) 0x7fbe340d1090 con 0x7fbe340cec90 2024-04-14T23:35:26.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.573+0000 7fbe3938a640 1 -- 172.21.15.47:0/3830360504 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe340cc9b0 con 0x7fbe340d0b40 2024-04-14T23:35:26.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.574+0000 7fbe3938a640 1 --2- 172.21.15.47:0/3830360504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe340d0b40 0x7fbe340cd5e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c009d90 tx=0x7fbe2c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb4376fa479d9aa server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:26.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.574+0000 7fbe337fe640 1 -- 172.21.15.47:0/3830360504 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c039070 con 0x7fbe340d0b40 2024-04-14T23:35:26.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.574+0000 7fbe337fe640 1 -- 172.21.15.47:0/3830360504 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe2c02cbd0 con 0x7fbe340d0b40 2024-04-14T23:35:26.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.574+0000 7fbe337fe640 1 -- 172.21.15.47:0/3830360504 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c034440 con 0x7fbe340d0b40 2024-04-14T23:35:26.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.574+0000 7fbe3aded640 1 -- 172.21.15.47:0/3830360504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe340d0b40 msgr2=0x7fbe340cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.574+0000 7fbe3aded640 1 --2- 172.21.15.47:0/3830360504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe340d0b40 0x7fbe340cd5e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c009d90 tx=0x7fbe2c02be20 comp rx=0 tx=0).stop 2024-04-14T23:35:26.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.575+0000 7fbe3aded640 1 -- 172.21.15.47:0/3830360504 shutdown_connections 2024-04-14T23:35:26.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.575+0000 7fbe3aded640 1 --2- 172.21.15.47:0/3830360504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe340d0b40 0x7fbe340cd5e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.575+0000 7fbe3aded640 1 -- 172.21.15.47:0/3830360504 >> 172.21.15.47:0/3830360504 conn(0x7fbe340d1d00 msgr2=0x7fbe340d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:26.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.575+0000 7fbe3aded640 1 -- 172.21.15.47:0/3830360504 shutdown_connections 2024-04-14T23:35:26.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.575+0000 7fbe3aded640 1 -- 172.21.15.47:0/3830360504 wait complete. 2024-04-14T23:35:26.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.576+0000 7fbe3aded640 1 Processor -- start 2024-04-14T23:35:26.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.576+0000 7fbe3aded640 1 -- start start 2024-04-14T23:35:26.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe3aded640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe340c8410 0x7fbe341d50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe3aded640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbe340cec90 0x7fbe340cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe3aded640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe340d0b40 0x7fbe341d5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe3aded640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbe340cf6b0 con 0x7fbe340c8410 2024-04-14T23:35:26.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe3aded640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbe340cf530 con 0x7fbe340d0b40 2024-04-14T23:35:26.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe3aded640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbe340d2820 con 0x7fbe340cec90 2024-04-14T23:35:26.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe38b89640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe340c8410 0x7fbe341d50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:26.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe38b89640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe340c8410 0x7fbe341d50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43644/0 (socket says 172.21.15.47:43644) 2024-04-14T23:35:26.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe38b89640 1 -- 172.21.15.47:0/3180925570 learned_addr learned my addr 172.21.15.47:0/3180925570 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:26.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe38b89640 1 -- 172.21.15.47:0/3180925570 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbe340cec90 msgr2=0x7fbe340cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe38b89640 1 --2- 172.21.15.47:0/3180925570 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbe340cec90 0x7fbe340cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe38b89640 1 -- 172.21.15.47:0/3180925570 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe340d0b40 msgr2=0x7fbe341d5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe38b89640 1 --2- 172.21.15.47:0/3180925570 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe340d0b40 0x7fbe341d5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe38b89640 1 -- 172.21.15.47:0/3180925570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe341e3910 con 0x7fbe340c8410 2024-04-14T23:35:26.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe38b89640 1 --2- 172.21.15.47:0/3180925570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe340c8410 0x7fbe341d50b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800c430 tx=0x7fbe2800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:26.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe317fa640 1 -- 172.21.15.47:0/3180925570 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28011790 con 0x7fbe340c8410 2024-04-14T23:35:26.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe317fa640 1 -- 172.21.15.47:0/3180925570 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe28017070 con 0x7fbe340c8410 2024-04-14T23:35:26.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe317fa640 1 -- 172.21.15.47:0/3180925570 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28011b70 con 0x7fbe340c8410 2024-04-14T23:35:26.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe3aded640 1 -- 172.21.15.47:0/3180925570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe340c9370 con 0x7fbe340c8410 2024-04-14T23:35:26.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.577+0000 7fbe3aded640 1 -- 172.21.15.47:0/3180925570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe340b7460 con 0x7fbe340c8410 2024-04-14T23:35:26.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.578+0000 7fbe3aded640 1 -- 172.21.15.47:0/3180925570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe340b7660 con 0x7fbe340c8410 2024-04-14T23:35:26.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.579+0000 7fbe317fa640 1 -- 172.21.15.47:0/3180925570 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fbe28011d10 con 0x7fbe340c8410 2024-04-14T23:35:26.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.579+0000 7fbe317fa640 1 --2- 172.21.15.47:0/3180925570 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbe1806b990 0x7fbe1806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.579+0000 7fbe317fa640 1 -- 172.21.15.47:0/3180925570 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fbe2808aa50 con 0x7fbe340c8410 2024-04-14T23:35:26.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.579+0000 7fbe33fff640 1 --2- 172.21.15.47:0/3180925570 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbe1806b990 0x7fbe1806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:26.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.580+0000 7fbe33fff640 1 --2- 172.21.15.47:0/3180925570 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbe1806b990 0x7fbe1806de50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbe20007fd0 tx=0x7fbe20007920 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:26.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.583+0000 7fbe317fa640 1 -- 172.21.15.47:0/3180925570 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbe340b7660 con 0x7fbe340c8410 2024-04-14T23:35:26.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.766+0000 7fbe3aded640 1 -- 172.21.15.47:0/3180925570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbe34073f50 con 0x7fbe340c8410 2024-04-14T23:35:26.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.766+0000 7fbe317fa640 1 -- 172.21.15.47:0/3180925570 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fbe280592f0 con 0x7fbe340c8410 2024-04-14T23:35:26.770 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-14T23:35:26.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.768+0000 7fbe3aded640 1 -- 172.21.15.47:0/3180925570 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbe1806b990 msgr2=0x7fbe1806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.768+0000 7fbe3aded640 1 --2- 172.21.15.47:0/3180925570 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbe1806b990 0x7fbe1806de50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbe20007fd0 tx=0x7fbe20007920 comp rx=0 tx=0).stop 2024-04-14T23:35:26.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.768+0000 7fbe3aded640 1 -- 172.21.15.47:0/3180925570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe340c8410 msgr2=0x7fbe341d50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.768+0000 7fbe3aded640 1 --2- 172.21.15.47:0/3180925570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe340c8410 0x7fbe341d50b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800c430 tx=0x7fbe2800c8f0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.768+0000 7fbe3aded640 1 -- 172.21.15.47:0/3180925570 shutdown_connections 2024-04-14T23:35:26.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.768+0000 7fbe3aded640 1 --2- 172.21.15.47:0/3180925570 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbe1806b990 0x7fbe1806de50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.768+0000 7fbe3aded640 1 --2- 172.21.15.47:0/3180925570 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe340d0b40 0x7fbe341d5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.768+0000 7fbe3aded640 1 --2- 172.21.15.47:0/3180925570 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbe340cec90 0x7fbe340cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.768+0000 7fbe3aded640 1 --2- 172.21.15.47:0/3180925570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe340c8410 0x7fbe341d50b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.768+0000 7fbe3aded640 1 -- 172.21.15.47:0/3180925570 >> 172.21.15.47:0/3180925570 conn(0x7fbe340d1d00 msgr2=0x7fbe341e5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:26.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.768+0000 7fbe3aded640 1 -- 172.21.15.47:0/3180925570 shutdown_connections 2024-04-14T23:35:26.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.768+0000 7fbe3aded640 1 -- 172.21.15.47:0/3180925570 wait complete. 2024-04-14T23:35:26.782 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T23:35:26.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.884+0000 7f9989605640 1 Processor -- start 2024-04-14T23:35:26.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.884+0000 7f9989605640 1 -- start start 2024-04-14T23:35:26.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.884+0000 7f9989605640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99840ce180 0x7f998415fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.884+0000 7f9989605640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9984070df0 0x7f9984071280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.884+0000 7f9989605640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9984160810 con 0x7f998415f9b0 2024-04-14T23:35:26.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.884+0000 7f9989605640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f99840ce5a0 con 0x7f9984070df0 2024-04-14T23:35:26.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.884+0000 7f9989605640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f99840cf3e0 con 0x7f99840ce180 2024-04-14T23:35:26.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.885+0000 7f99837fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9984070df0 0x7f9984071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:26.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.885+0000 7f99837fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9984070df0 0x7f9984071280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43646/0 (socket says 172.21.15.47:43646) 2024-04-14T23:35:26.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.885+0000 7f99837fe640 1 -- 172.21.15.47:0/3405310572 learned_addr learned my addr 172.21.15.47:0/3405310572 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:26.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.885+0000 7f99827fc640 1 --2- 172.21.15.47:0/3405310572 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99840ce180 0x7f998415fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:26.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.885+0000 7f99837fe640 1 -- 172.21.15.47:0/3405310572 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99840ce180 msgr2=0x7f998415fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:26.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.885+0000 7f99837fe640 1 --2- 172.21.15.47:0/3405310572 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99840ce180 0x7f998415fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.885+0000 7f99837fe640 1 -- 172.21.15.47:0/3405310572 >> v1:172.21.15.191:6789/0 conn(0x7f998415f9b0 legacy=0x7f9984141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:26.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.885+0000 7f99837fe640 1 -- 172.21.15.47:0/3405310572 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99841602d0 con 0x7f9984070df0 2024-04-14T23:35:26.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.886+0000 7f99837fe640 1 --2- 172.21.15.47:0/3405310572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9984070df0 0x7f9984071280 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f997c009870 tx=0x7f997c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15edd9a30d595d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:26.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.886+0000 7f9981ffb640 1 -- 172.21.15.47:0/3405310572 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c0317c0 con 0x7f9984070df0 2024-04-14T23:35:26.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.886+0000 7f9981ffb640 1 -- 172.21.15.47:0/3405310572 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997c037070 con 0x7f9984070df0 2024-04-14T23:35:26.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.886+0000 7f9981ffb640 1 -- 172.21.15.47:0/3405310572 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c031b80 con 0x7f9984070df0 2024-04-14T23:35:26.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.886+0000 7f9989605640 1 -- 172.21.15.47:0/3405310572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9984070df0 msgr2=0x7f9984071280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.886+0000 7f9989605640 1 --2- 172.21.15.47:0/3405310572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9984070df0 0x7f9984071280 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f997c009870 tx=0x7f997c02b860 comp rx=0 tx=0).stop 2024-04-14T23:35:26.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.886+0000 7f9989605640 1 -- 172.21.15.47:0/3405310572 shutdown_connections 2024-04-14T23:35:26.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.886+0000 7f9989605640 1 --2- 172.21.15.47:0/3405310572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9984070df0 0x7f9984071280 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.886+0000 7f9989605640 1 --2- 172.21.15.47:0/3405310572 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99840ce180 0x7f998415fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.886+0000 7f9989605640 1 -- 172.21.15.47:0/3405310572 >> 172.21.15.47:0/3405310572 conn(0x7f99840b1770 msgr2=0x7f99840b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:26.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.886+0000 7f9989605640 1 -- 172.21.15.47:0/3405310572 shutdown_connections 2024-04-14T23:35:26.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.886+0000 7f9989605640 1 -- 172.21.15.47:0/3405310572 wait complete. 2024-04-14T23:35:26.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.888+0000 7f9989605640 1 Processor -- start 2024-04-14T23:35:26.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.888+0000 7f9989605640 1 -- start start 2024-04-14T23:35:26.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.888+0000 7f9989605640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9984070df0 0x7f9984152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.888+0000 7f9989605640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99840ce180 0x7f99841343f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.888+0000 7f9989605640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f998415f9b0 0x7f9984140120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.888+0000 7f9989605640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f99840ced90 con 0x7f9984070df0 2024-04-14T23:35:26.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.888+0000 7f9989605640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f99840ceab0 con 0x7f998415f9b0 2024-04-14T23:35:26.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.888+0000 7f9989605640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f99840cf070 con 0x7f99840ce180 2024-04-14T23:35:26.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.888+0000 7f9982ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9984070df0 0x7f9984152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:26.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.888+0000 7f9982ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9984070df0 0x7f9984152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43652/0 (socket says 172.21.15.47:43652) 2024-04-14T23:35:26.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.888+0000 7f9982ffd640 1 -- 172.21.15.47:0/4000652576 learned_addr learned my addr 172.21.15.47:0/4000652576 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:26.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.889+0000 7f99827fc640 1 --2- 172.21.15.47:0/4000652576 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99840ce180 0x7f99841343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:26.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.889+0000 7f99837fe640 1 --2- 172.21.15.47:0/4000652576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f998415f9b0 0x7f9984140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:26.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.889+0000 7f9982ffd640 1 -- 172.21.15.47:0/4000652576 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99840ce180 msgr2=0x7f99841343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.889+0000 7f9982ffd640 1 --2- 172.21.15.47:0/4000652576 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99840ce180 0x7f99841343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.889+0000 7f9982ffd640 1 -- 172.21.15.47:0/4000652576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f998415f9b0 msgr2=0x7f9984140120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:26.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.889+0000 7f9982ffd640 1 --2- 172.21.15.47:0/4000652576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f998415f9b0 0x7f9984140120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:26.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.889+0000 7f9982ffd640 1 -- 172.21.15.47:0/4000652576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9984137a10 con 0x7f9984070df0 2024-04-14T23:35:26.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.889+0000 7f9982ffd640 1 --2- 172.21.15.47:0/4000652576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9984070df0 0x7f9984152a10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f997400c7c0 tx=0x7f997400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:26.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.889+0000 7f996b7fe640 1 -- 172.21.15.47:0/4000652576 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9974016020 con 0x7f9984070df0 2024-04-14T23:35:26.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.889+0000 7f996b7fe640 1 -- 172.21.15.47:0/4000652576 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997400aa50 con 0x7f9984070df0 2024-04-14T23:35:26.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.889+0000 7f996b7fe640 1 -- 172.21.15.47:0/4000652576 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9974012420 con 0x7f9984070df0 2024-04-14T23:35:26.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.889+0000 7f9989605640 1 -- 172.21.15.47:0/4000652576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9984137cf0 con 0x7f9984070df0 2024-04-14T23:35:26.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.889+0000 7f9989605640 1 -- 172.21.15.47:0/4000652576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99841382b0 con 0x7f9984070df0 2024-04-14T23:35:26.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.890+0000 7f9989605640 1 -- 172.21.15.47:0/4000652576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99841386f0 con 0x7f9984070df0 2024-04-14T23:35:26.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.890+0000 7f996b7fe640 1 -- 172.21.15.47:0/4000652576 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9974019020 con 0x7f9984070df0 2024-04-14T23:35:26.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.891+0000 7f996b7fe640 1 --2- 172.21.15.47:0/4000652576 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f997006b990 0x7f997006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:26.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.891+0000 7f996b7fe640 1 -- 172.21.15.47:0/4000652576 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f997408a870 con 0x7f9984070df0 2024-04-14T23:35:26.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.891+0000 7f99827fc640 1 --2- 172.21.15.47:0/4000652576 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f997006b990 0x7f997006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:26.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.892+0000 7f99827fc640 1 --2- 172.21.15.47:0/4000652576 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f997006b990 0x7f997006de50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f99840b1630 tx=0x7f9978008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:26.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:26.895+0000 7f996b7fe640 1 -- 172.21.15.47:0/4000652576 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9974020070 con 0x7f9984070df0 2024-04-14T23:35:27.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.076+0000 7f9989605640 1 -- 172.21.15.47:0/4000652576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f9984073f50 con 0x7f9984070df0 2024-04-14T23:35:27.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.076+0000 7f996b7fe640 1 -- 172.21.15.47:0/4000652576 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f9974058a30 con 0x7f9984070df0 2024-04-14T23:35:27.079 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.078+0000 7f9989605640 1 -- 172.21.15.47:0/4000652576 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f997006b990 msgr2=0x7f997006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.078+0000 7f9989605640 1 --2- 172.21.15.47:0/4000652576 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f997006b990 0x7f997006de50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f99840b1630 tx=0x7f9978008040 comp rx=0 tx=0).stop 2024-04-14T23:35:27.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.078+0000 7f9989605640 1 -- 172.21.15.47:0/4000652576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9984070df0 msgr2=0x7f9984152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.078+0000 7f9989605640 1 --2- 172.21.15.47:0/4000652576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9984070df0 0x7f9984152a10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f997400c7c0 tx=0x7f997400cc80 comp rx=0 tx=0).stop 2024-04-14T23:35:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.078+0000 7f9989605640 1 -- 172.21.15.47:0/4000652576 shutdown_connections 2024-04-14T23:35:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.078+0000 7f9989605640 1 --2- 172.21.15.47:0/4000652576 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f997006b990 0x7f997006de50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.078+0000 7f9989605640 1 --2- 172.21.15.47:0/4000652576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f998415f9b0 0x7f9984140120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.078+0000 7f9989605640 1 --2- 172.21.15.47:0/4000652576 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99840ce180 0x7f99841343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.078+0000 7f9989605640 1 --2- 172.21.15.47:0/4000652576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9984070df0 0x7f9984152a10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.078+0000 7f9989605640 1 -- 172.21.15.47:0/4000652576 >> 172.21.15.47:0/4000652576 conn(0x7f99840b1770 msgr2=0x7f99840711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.078+0000 7f9989605640 1 -- 172.21.15.47:0/4000652576 shutdown_connections 2024-04-14T23:35:27.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.078+0000 7f9989605640 1 -- 172.21.15.47:0/4000652576 wait complete. 2024-04-14T23:35:27.092 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T23:35:27.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.194+0000 7fa55bc95640 1 Processor -- start 2024-04-14T23:35:27.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.194+0000 7fa55bc95640 1 -- start start 2024-04-14T23:35:27.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.195+0000 7fa55bc95640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa55415e270 0x7fa5540d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:27.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.195+0000 7fa55bc95640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa5540d1e00 0x7fa5540d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:27.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.195+0000 7fa55bc95640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5540b57a0 con 0x7fa5540d1450 2024-04-14T23:35:27.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.195+0000 7fa55bc95640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa5540b4300 con 0x7fa5540d1e00 2024-04-14T23:35:27.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.195+0000 7fa55bc95640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa5540b39d0 con 0x7fa55415e270 2024-04-14T23:35:27.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.195+0000 7fa559230640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa5540d1e00 0x7fa5540d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:27.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.195+0000 7fa55a232640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa5540d1450 0x7fa5540ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54454/0 (socket says 172.21.15.47:54454) 2024-04-14T23:35:27.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.195+0000 7fa55a232640 1 -- 172.21.15.47:0/54474937 learned_addr learned my addr 172.21.15.47:0/54474937 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:27.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.195+0000 7fa559a31640 1 --2- 172.21.15.47:0/54474937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa55415e270 0x7fa5540d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:27.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.195+0000 7fa559230640 1 -- 172.21.15.47:0/54474937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa55415e270 msgr2=0x7fa5540d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:27.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.195+0000 7fa559230640 1 --2- 172.21.15.47:0/54474937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa55415e270 0x7fa5540d0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.195+0000 7fa559230640 1 -- 172.21.15.47:0/54474937 >> v1:172.21.15.47:6789/0 conn(0x7fa5540d1450 legacy=0x7fa5540ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:27.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.195+0000 7fa559230640 1 -- 172.21.15.47:0/54474937 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5540b3cb0 con 0x7fa5540d1e00 2024-04-14T23:35:27.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.195+0000 7fa558a2f640 1 -- 172.21.15.47:0/54474937 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2625870389 0 0) 0x7fa5540b57a0 con 0x7fa5540d1450 2024-04-14T23:35:27.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.195+0000 7fa559a31640 1 --2- 172.21.15.47:0/54474937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa55415e270 0x7fa5540d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:27.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.196+0000 7fa559230640 1 --2- 172.21.15.47:0/54474937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5540d1e00 0x7fa5540d2200 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa5440097a0 tx=0x7fa54402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e759a865c12d575 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:27.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.196+0000 7fa558a2f640 1 -- 172.21.15.47:0/54474937 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa544034070 con 0x7fa5540d1e00 2024-04-14T23:35:27.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.196+0000 7fa558a2f640 1 -- 172.21.15.47:0/54474937 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa544030610 con 0x7fa5540d1e00 2024-04-14T23:35:27.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.196+0000 7fa558a2f640 1 -- 172.21.15.47:0/54474937 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5440309e0 con 0x7fa5540d1e00 2024-04-14T23:35:27.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.197+0000 7fa55bc95640 1 -- 172.21.15.47:0/54474937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5540d1e00 msgr2=0x7fa5540d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:27.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.197+0000 7fa55bc95640 1 --2- 172.21.15.47:0/54474937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5540d1e00 0x7fa5540d2200 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa5440097a0 tx=0x7fa54402b960 comp rx=0 tx=0).stop 2024-04-14T23:35:27.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.197+0000 7fa55bc95640 1 -- 172.21.15.47:0/54474937 shutdown_connections 2024-04-14T23:35:27.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.197+0000 7fa55bc95640 1 --2- 172.21.15.47:0/54474937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5540d1e00 0x7fa5540d2200 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.197+0000 7fa55bc95640 1 --2- 172.21.15.47:0/54474937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa55415e270 0x7fa5540d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.197+0000 7fa55bc95640 1 -- 172.21.15.47:0/54474937 >> 172.21.15.47:0/54474937 conn(0x7fa5540d3ed0 msgr2=0x7fa5540d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:27.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.197+0000 7fa55bc95640 1 -- 172.21.15.47:0/54474937 shutdown_connections 2024-04-14T23:35:27.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.197+0000 7fa55bc95640 1 -- 172.21.15.47:0/54474937 wait complete. 2024-04-14T23:35:27.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.198+0000 7fa55bc95640 1 Processor -- start 2024-04-14T23:35:27.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.198+0000 7fa55bc95640 1 -- start start 2024-04-14T23:35:27.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa55bc95640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa5540d1450 0x7fa5541601e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:27.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa55bc95640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5540d1e00 0x7fa5541f8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:27.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa55bc95640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa55415e270 0x7fa554153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:27.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa55bc95640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa55415e650 con 0x7fa5540d1e00 2024-04-14T23:35:27.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa55bc95640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa5540b0c60 con 0x7fa55415e270 2024-04-14T23:35:27.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa55bc95640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa55415e7d0 con 0x7fa5540d1450 2024-04-14T23:35:27.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa559230640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5540d1e00 0x7fa5541f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:27.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa559230640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5540d1e00 0x7fa5541f8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43664/0 (socket says 172.21.15.47:43664) 2024-04-14T23:35:27.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa559230640 1 -- 172.21.15.47:0/786021083 learned_addr learned my addr 172.21.15.47:0/786021083 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:27.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa559a31640 1 --2- 172.21.15.47:0/786021083 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa5540d1450 0x7fa5541601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:27.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa55a232640 1 --2- 172.21.15.47:0/786021083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa55415e270 0x7fa554153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:27.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa559230640 1 -- 172.21.15.47:0/786021083 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa5540d1450 msgr2=0x7fa5541601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:27.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa559230640 1 --2- 172.21.15.47:0/786021083 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa5540d1450 0x7fa5541601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa559230640 1 -- 172.21.15.47:0/786021083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa55415e270 msgr2=0x7fa554153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:27.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa559230640 1 --2- 172.21.15.47:0/786021083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa55415e270 0x7fa554153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa559230640 1 -- 172.21.15.47:0/786021083 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa554160800 con 0x7fa5540d1e00 2024-04-14T23:35:27.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa55a232640 1 --2- 172.21.15.47:0/786021083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa55415e270 0x7fa554153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:27.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.199+0000 7fa559230640 1 --2- 172.21.15.47:0/786021083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5540d1e00 0x7fa5541f8100 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa5440098c0 tx=0x7fa5440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:27.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.200+0000 7fa54a7fc640 1 -- 172.21.15.47:0/786021083 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa544034040 con 0x7fa5540d1e00 2024-04-14T23:35:27.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.200+0000 7fa54a7fc640 1 -- 172.21.15.47:0/786021083 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa544039a10 con 0x7fa5540d1e00 2024-04-14T23:35:27.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.200+0000 7fa55bc95640 1 -- 172.21.15.47:0/786021083 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa554160ae0 con 0x7fa5540d1e00 2024-04-14T23:35:27.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.200+0000 7fa54a7fc640 1 -- 172.21.15.47:0/786021083 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa544039e20 con 0x7fa5540d1e00 2024-04-14T23:35:27.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.200+0000 7fa55bc95640 1 -- 172.21.15.47:0/786021083 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5540b8600 con 0x7fa5540d1e00 2024-04-14T23:35:27.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.201+0000 7fa55bc95640 1 -- 172.21.15.47:0/786021083 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa554075430 con 0x7fa5540d1e00 2024-04-14T23:35:27.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.201+0000 7fa54a7fc640 1 -- 172.21.15.47:0/786021083 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fa544037070 con 0x7fa5540d1e00 2024-04-14T23:35:27.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.202+0000 7fa54a7fc640 1 --2- 172.21.15.47:0/786021083 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa53806b990 0x7fa53806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:27.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.202+0000 7fa54a7fc640 1 -- 172.21.15.47:0/786021083 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa5440acb70 con 0x7fa5540d1e00 2024-04-14T23:35:27.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.202+0000 7fa559a31640 1 --2- 172.21.15.47:0/786021083 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa53806b990 0x7fa53806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:27.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.202+0000 7fa559a31640 1 --2- 172.21.15.47:0/786021083 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa53806b990 0x7fa53806de50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa550006fd0 tx=0x7fa550008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:27.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.206+0000 7fa54a7fc640 1 -- 172.21.15.47:0/786021083 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa54407b410 con 0x7fa5540d1e00 2024-04-14T23:35:27.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.401+0000 7fa55bc95640 1 -- 172.21.15.47:0/786021083 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa5540b4df0 con 0x7fa5540d1e00 2024-04-14T23:35:27.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.401+0000 7fa54a7fc640 1 -- 172.21.15.47:0/786021083 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fa54407ad10 con 0x7fa5540d1e00 2024-04-14T23:35:27.405 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-14T23:35:27.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.403+0000 7fa55bc95640 1 -- 172.21.15.47:0/786021083 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa53806b990 msgr2=0x7fa53806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:27.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.403+0000 7fa55bc95640 1 --2- 172.21.15.47:0/786021083 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa53806b990 0x7fa53806de50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa550006fd0 tx=0x7fa550008040 comp rx=0 tx=0).stop 2024-04-14T23:35:27.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.403+0000 7fa55bc95640 1 -- 172.21.15.47:0/786021083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5540d1e00 msgr2=0x7fa5541f8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:27.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.403+0000 7fa55bc95640 1 --2- 172.21.15.47:0/786021083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5540d1e00 0x7fa5541f8100 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa5440098c0 tx=0x7fa5440046c0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.403+0000 7fa55bc95640 1 -- 172.21.15.47:0/786021083 shutdown_connections 2024-04-14T23:35:27.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.403+0000 7fa55bc95640 1 --2- 172.21.15.47:0/786021083 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa53806b990 0x7fa53806de50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.403+0000 7fa55bc95640 1 --2- 172.21.15.47:0/786021083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa55415e270 0x7fa554153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.403+0000 7fa55bc95640 1 --2- 172.21.15.47:0/786021083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5540d1e00 0x7fa5541f8100 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.403+0000 7fa55bc95640 1 --2- 172.21.15.47:0/786021083 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa5540d1450 0x7fa5541601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.403+0000 7fa55bc95640 1 -- 172.21.15.47:0/786021083 >> 172.21.15.47:0/786021083 conn(0x7fa5540d3ed0 msgr2=0x7fa5540cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:27.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.403+0000 7fa55bc95640 1 -- 172.21.15.47:0/786021083 shutdown_connections 2024-04-14T23:35:27.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.404+0000 7fa55bc95640 1 -- 172.21.15.47:0/786021083 wait complete. 2024-04-14T23:35:27.417 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-14T23:35:27.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:27.418 DEBUG:teuthology.orchestra.run.smithi191:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-14T23:35:27.452 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2024-04-14T23:35:27.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:27.452 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-14T23:35:27.520 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:35:27.520 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:27.535 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:35:27.536 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:27.591 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:35:27.591 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:27.646 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:27.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.785+0000 7f8562020640 1 Processor -- start 2024-04-14T23:35:27.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.786+0000 7f8562020640 1 -- start start 2024-04-14T23:35:27.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.786+0000 7f8562020640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f855c15bcc0 0x7f855c165dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:27.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.786+0000 7f8562020640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f855c072a50 con 0x7f855c06e340 2024-04-14T23:35:27.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.786+0000 7f8562020640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f855c15c370 con 0x7f855c0d0140 2024-04-14T23:35:27.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.786+0000 7f8562020640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f855c15c150 con 0x7f855c15bcc0 2024-04-14T23:35:27.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.786+0000 7f855b7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f855c06e340 0x7f855c0cfa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54470/0 (socket says 172.21.15.47:54470) 2024-04-14T23:35:27.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.786+0000 7f855b7fe640 1 -- 172.21.15.47:0/907294238 learned_addr learned my addr 172.21.15.47:0/907294238 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:27.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855bfff640 1 --2- 172.21.15.47:0/907294238 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f855c15bcc0 0x7f855c165dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:27.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855affd640 1 -- 172.21.15.47:0/907294238 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1955355297 0 0) 0x7f855c072a50 con 0x7f855c06e340 2024-04-14T23:35:27.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855affd640 1 -- 172.21.15.47:0/907294238 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8548003520 con 0x7f855c06e340 2024-04-14T23:35:27.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855affd640 1 -- 172.21.15.47:0/907294238 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 398712566 0 0) 0x7f8548003520 con 0x7f855c06e340 2024-04-14T23:35:27.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855affd640 1 -- 172.21.15.47:0/907294238 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f855c15bcc0 msgr2=0x7f855c165dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:27.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855affd640 1 --2- 172.21.15.47:0/907294238 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f855c15bcc0 0x7f855c165dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855affd640 1 -- 172.21.15.47:0/907294238 >> v1:172.21.15.191:6789/0 conn(0x7f855c0d0140 legacy=0x7f855c15b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:27.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855affd640 1 -- 172.21.15.47:0/907294238 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855c15ead0 con 0x7f855c06e340 2024-04-14T23:35:27.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855affd640 1 -- 172.21.15.47:0/907294238 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f854c001670 con 0x7f855c06e340 2024-04-14T23:35:27.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855affd640 1 -- 172.21.15.47:0/907294238 >> v1:172.21.15.47:6789/0 conn(0x7f855c06e340 legacy=0x7f855c0cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:27.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855affd640 1 --2- 172.21.15.47:0/907294238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85480039e0 0x7f8548003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:27.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855affd640 1 --2- 172.21.15.47:0/907294238 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f855c15bcc0 0x7f8548004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:27.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855affd640 1 --2- 172.21.15.47:0/907294238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8548004d40 0x7f85480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:27.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855affd640 1 -- 172.21.15.47:0/907294238 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f855c15c150 con 0x7f8548004d40 2024-04-14T23:35:27.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855affd640 1 -- 172.21.15.47:0/907294238 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f854800ba70 con 0x7f85480039e0 2024-04-14T23:35:27.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855affd640 1 -- 172.21.15.47:0/907294238 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f854800bc70 con 0x7f855c15bcc0 2024-04-14T23:35:27.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855bfff640 1 --2- 172.21.15.47:0/907294238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8548004d40 0x7f85480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:27.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f855b7fe640 1 --2- 172.21.15.47:0/907294238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85480039e0 0x7f8548003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:27.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.787+0000 7f8552ffd640 1 --2- 172.21.15.47:0/907294238 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f855c15bcc0 0x7f8548004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:27.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.788+0000 7f855bfff640 1 -- 172.21.15.47:0/907294238 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f855c15bcc0 msgr2=0x7f8548004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:27.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.788+0000 7f855bfff640 1 --2- 172.21.15.47:0/907294238 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f855c15bcc0 0x7f8548004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.788+0000 7f855bfff640 1 -- 172.21.15.47:0/907294238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85480039e0 msgr2=0x7f8548003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:27.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.788+0000 7f855bfff640 1 --2- 172.21.15.47:0/907294238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85480039e0 0x7f8548003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.788+0000 7f855bfff640 1 -- 172.21.15.47:0/907294238 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8548003520 con 0x7f8548004d40 2024-04-14T23:35:27.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.788+0000 7f855bfff640 1 --2- 172.21.15.47:0/907294238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8548004d40 0x7f85480051c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8554009fc0 tx=0x7f8548005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c133e507e7366155 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:27.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.789+0000 7f855affd640 1 -- 172.21.15.47:0/907294238 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8554039070 con 0x7f8548004d40 2024-04-14T23:35:27.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.789+0000 7f855affd640 1 -- 172.21.15.47:0/907294238 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f855402cc20 con 0x7f8548004d40 2024-04-14T23:35:27.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.789+0000 7f855affd640 1 -- 172.21.15.47:0/907294238 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8554009c10 con 0x7f8548004d40 2024-04-14T23:35:27.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.789+0000 7f8562020640 1 -- 172.21.15.47:0/907294238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8548004d40 msgr2=0x7f85480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:27.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.789+0000 7f8562020640 1 --2- 172.21.15.47:0/907294238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8548004d40 0x7f85480051c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8554009fc0 tx=0x7f8548005830 comp rx=0 tx=0).stop 2024-04-14T23:35:27.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.789+0000 7f855bfff640 1 -- 172.21.15.47:0/907294238 reap_dead start 2024-04-14T23:35:27.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.789+0000 7f8562020640 1 -- 172.21.15.47:0/907294238 shutdown_connections 2024-04-14T23:35:27.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.789+0000 7f8562020640 1 -- 172.21.15.47:0/907294238 >> 172.21.15.47:0/907294238 conn(0x7f855c06b200 msgr2=0x7f855c06b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:27.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.789+0000 7f8562020640 1 -- 172.21.15.47:0/907294238 shutdown_connections 2024-04-14T23:35:27.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.789+0000 7f8562020640 1 -- 172.21.15.47:0/907294238 wait complete. 2024-04-14T23:35:27.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.790+0000 7f8562020640 1 Processor -- start 2024-04-14T23:35:27.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.791+0000 7f8562020640 1 -- start start 2024-04-14T23:35:27.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.791+0000 7f8562020640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8548004d40 0x7f855c152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:27.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.791+0000 7f8562020640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f855c152ee0 0x7f855c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:27.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.791+0000 7f8562020640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f855c153360 0x7f855c1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:27.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.791+0000 7f8562020640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f855c06e720 con 0x7f8548004d40 2024-04-14T23:35:27.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.791+0000 7f8562020640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f855c15f090 con 0x7f855c152ee0 2024-04-14T23:35:27.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.791+0000 7f8562020640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f855c15f890 con 0x7f855c153360 2024-04-14T23:35:27.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.791+0000 7f855b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8548004d40 0x7f855c152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:27.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.791+0000 7f855b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8548004d40 0x7f855c152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43682/0 (socket says 172.21.15.47:43682) 2024-04-14T23:35:27.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.791+0000 7f855b7fe640 1 -- 172.21.15.47:0/3260903494 learned_addr learned my addr 172.21.15.47:0/3260903494 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:27.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.792+0000 7f855bfff640 1 --2- 172.21.15.47:0/3260903494 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f855c153360 0x7f855c1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:27.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.792+0000 7f8552ffd640 1 --2- 172.21.15.47:0/3260903494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f855c152ee0 0x7f855c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:27.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.792+0000 7f855b7fe640 1 -- 172.21.15.47:0/3260903494 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f855c153360 msgr2=0x7f855c1555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:27.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.792+0000 7f855b7fe640 1 --2- 172.21.15.47:0/3260903494 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f855c153360 0x7f855c1555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.792+0000 7f855b7fe640 1 -- 172.21.15.47:0/3260903494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f855c152ee0 msgr2=0x7f855c15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:27.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.792+0000 7f855b7fe640 1 --2- 172.21.15.47:0/3260903494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f855c152ee0 0x7f855c15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.792+0000 7f855b7fe640 1 -- 172.21.15.47:0/3260903494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855c1539f0 con 0x7f8548004d40 2024-04-14T23:35:27.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.792+0000 7f8552ffd640 1 --2- 172.21.15.47:0/3260903494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f855c152ee0 0x7f855c15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:27.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.792+0000 7f855b7fe640 1 --2- 172.21.15.47:0/3260903494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8548004d40 0x7f855c152010 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f854c004f00 tx=0x7f854c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:27.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.792+0000 7f8558ff9640 1 -- 172.21.15.47:0/3260903494 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c00f7b0 con 0x7f8548004d40 2024-04-14T23:35:27.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.792+0000 7f8558ff9640 1 -- 172.21.15.47:0/3260903494 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c018070 con 0x7f8548004d40 2024-04-14T23:35:27.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.792+0000 7f8562020640 1 -- 172.21.15.47:0/3260903494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f855c153cd0 con 0x7f8548004d40 2024-04-14T23:35:27.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.792+0000 7f8558ff9640 1 -- 172.21.15.47:0/3260903494 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c00fbb0 con 0x7f8548004d40 2024-04-14T23:35:27.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.792+0000 7f8562020640 1 -- 172.21.15.47:0/3260903494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f855c15d100 con 0x7f8548004d40 2024-04-14T23:35:27.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.793+0000 7f8562020640 1 -- 172.21.15.47:0/3260903494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855c075430 con 0x7f8548004d40 2024-04-14T23:35:27.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.794+0000 7f8558ff9640 1 -- 172.21.15.47:0/3260903494 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f854c00fd50 con 0x7f8548004d40 2024-04-14T23:35:27.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.794+0000 7f8558ff9640 1 --2- 172.21.15.47:0/3260903494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f853c06b990 0x7f853c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:27.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.794+0000 7f8558ff9640 1 -- 172.21.15.47:0/3260903494 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f854c08ad70 con 0x7f8548004d40 2024-04-14T23:35:27.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.795+0000 7f8552ffd640 1 --2- 172.21.15.47:0/3260903494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f853c06b990 0x7f853c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:27.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.795+0000 7f8552ffd640 1 --2- 172.21.15.47:0/3260903494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f853c06b990 0x7f853c06de50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f855c15e3a0 tx=0x7f8544009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:27.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.799+0000 7f8558ff9640 1 -- 172.21.15.47:0/3260903494 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f854c0594e0 con 0x7f8548004d40 2024-04-14T23:35:27.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.984+0000 7f8562020640 1 -- 172.21.15.47:0/3260903494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f855c15d300 con 0x7f8548004d40 2024-04-14T23:35:27.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.985+0000 7f8558ff9640 1 -- 172.21.15.47:0/3260903494 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18892 (secure 0 0 0) 0x7f854c058de0 con 0x7f8548004d40 2024-04-14T23:35:27.988 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:27.989 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:35:19.819811+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:27.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.987+0000 7f8562020640 1 -- 172.21.15.47:0/3260903494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f853c06b990 msgr2=0x7f853c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:27.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.987+0000 7f8562020640 1 --2- 172.21.15.47:0/3260903494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f853c06b990 0x7f853c06de50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f855c15e3a0 tx=0x7f8544009040 comp rx=0 tx=0).stop 2024-04-14T23:35:27.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.987+0000 7f8562020640 1 -- 172.21.15.47:0/3260903494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8548004d40 msgr2=0x7f855c152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:27.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.987+0000 7f8562020640 1 --2- 172.21.15.47:0/3260903494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8548004d40 0x7f855c152010 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f854c004f00 tx=0x7f854c007430 comp rx=0 tx=0).stop 2024-04-14T23:35:27.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.987+0000 7f8562020640 1 -- 172.21.15.47:0/3260903494 shutdown_connections 2024-04-14T23:35:27.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.987+0000 7f8562020640 1 --2- 172.21.15.47:0/3260903494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f853c06b990 0x7f853c06de50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.987+0000 7f8562020640 1 --2- 172.21.15.47:0/3260903494 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f855c153360 0x7f855c1555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.987+0000 7f8562020640 1 --2- 172.21.15.47:0/3260903494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f855c152ee0 0x7f855c15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.987+0000 7f8562020640 1 --2- 172.21.15.47:0/3260903494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8548004d40 0x7f855c152010 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:27.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.987+0000 7f8562020640 1 -- 172.21.15.47:0/3260903494 >> 172.21.15.47:0/3260903494 conn(0x7f855c06b200 msgr2=0x7f855c158820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:27.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.987+0000 7f8562020640 1 -- 172.21.15.47:0/3260903494 shutdown_connections 2024-04-14T23:35:27.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:27.987+0000 7f8562020640 1 -- 172.21.15.47:0/3260903494 wait complete. 2024-04-14T23:35:28.001 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T23:34:36.382034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T23:34:37.023103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T23:34:40.726418+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T23:35:28.002 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:35:28.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.103+0000 7f9f1d8de640 1 Processor -- start 2024-04-14T23:35:28.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.103+0000 7f9f1d8de640 1 -- start start 2024-04-14T23:35:28.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.104+0000 7f9f1d8de640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9f180d4810 0x7f9f180ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.104+0000 7f9f1d8de640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f180c9090 con 0x7f9f180cea80 2024-04-14T23:35:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.104+0000 7f9f1d8de640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f180c9370 con 0x7f9f1815e3f0 2024-04-14T23:35:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.104+0000 7f9f1d8de640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f9f180c9650 con 0x7f9f180d4810 2024-04-14T23:35:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.104+0000 7f9f177fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9f180d4810 0x7f9f180ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.104+0000 7f9f167fc640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9f180cea80 0x7f9f180d4100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54476/0 (socket says 172.21.15.47:54476) 2024-04-14T23:35:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.104+0000 7f9f177fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9f180d4810 0x7f9f180ceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43688/0 (socket says 172.21.15.47:43688) 2024-04-14T23:35:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.104+0000 7f9f167fc640 1 -- 172.21.15.47:0/155130550 learned_addr learned my addr 172.21.15.47:0/155130550 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.104+0000 7f9f177fe640 1 -- 172.21.15.47:0/155130550 >> v1:172.21.15.191:6789/0 conn(0x7f9f1815e3f0 legacy=0x7f9f180d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.104+0000 7f9f177fe640 1 -- 172.21.15.47:0/155130550 >> v1:172.21.15.47:6789/0 conn(0x7f9f180cea80 legacy=0x7f9f180d4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.104+0000 7f9f177fe640 1 -- 172.21.15.47:0/155130550 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f180c9930 con 0x7f9f180d4810 2024-04-14T23:35:28.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.104+0000 7f9f15ffb640 1 -- 172.21.15.47:0/155130550 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1477154267 0 0) 0x7f9f180c9090 con 0x7f9f180cea80 2024-04-14T23:35:28.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.105+0000 7f9f177fe640 1 --2- 172.21.15.47:0/155130550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f180d4810 0x7f9f180ceee0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009d90 tx=0x7f9f1002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e820b465d5c7d614 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:28.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.105+0000 7f9f15ffb640 1 -- 172.21.15.47:0/155130550 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10039070 con 0x7f9f180d4810 2024-04-14T23:35:28.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.105+0000 7f9f15ffb640 1 -- 172.21.15.47:0/155130550 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f1002cc60 con 0x7f9f180d4810 2024-04-14T23:35:28.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.105+0000 7f9f15ffb640 1 -- 172.21.15.47:0/155130550 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10034660 con 0x7f9f180d4810 2024-04-14T23:35:28.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.106+0000 7f9f1d8de640 1 -- 172.21.15.47:0/155130550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f180d4810 msgr2=0x7f9f180ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:28.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.106+0000 7f9f1d8de640 1 --2- 172.21.15.47:0/155130550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f180d4810 0x7f9f180ceee0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009d90 tx=0x7f9f1002beb0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.106+0000 7f9f1d8de640 1 -- 172.21.15.47:0/155130550 shutdown_connections 2024-04-14T23:35:28.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.106+0000 7f9f1d8de640 1 --2- 172.21.15.47:0/155130550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f180d4810 0x7f9f180ceee0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.106+0000 7f9f1d8de640 1 -- 172.21.15.47:0/155130550 >> 172.21.15.47:0/155130550 conn(0x7f9f18067940 msgr2=0x7f9f1809d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:28.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.106+0000 7f9f1d8de640 1 -- 172.21.15.47:0/155130550 shutdown_connections 2024-04-14T23:35:28.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.106+0000 7f9f1d8de640 1 -- 172.21.15.47:0/155130550 wait complete. 2024-04-14T23:35:28.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.107+0000 7f9f1d8de640 1 Processor -- start 2024-04-14T23:35:28.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.107+0000 7f9f1d8de640 1 -- start start 2024-04-14T23:35:28.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.108+0000 7f9f1d8de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f180cea80 0x7f9f180ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.108+0000 7f9f1d8de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f180d4810 0x7f9f180cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.108+0000 7f9f1d8de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f1815e3f0 0x7f9f180b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.108+0000 7f9f1d8de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9f180c8cd0 con 0x7f9f180d4810 2024-04-14T23:35:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.108+0000 7f9f1d8de640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9f180d2ef0 con 0x7f9f180cea80 2024-04-14T23:35:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.108+0000 7f9f1d8de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f9f180c8e50 con 0x7f9f1815e3f0 2024-04-14T23:35:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.108+0000 7f9f167fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f180d4810 0x7f9f180cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.108+0000 7f9f167fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f180d4810 0x7f9f180cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43696/0 (socket says 172.21.15.47:43696) 2024-04-14T23:35:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.108+0000 7f9f167fc640 1 -- 172.21.15.47:0/2036301431 learned_addr learned my addr 172.21.15.47:0/2036301431 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.108+0000 7f9f16ffd640 1 --2- 172.21.15.47:0/2036301431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f180cea80 0x7f9f180ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.108+0000 7f9f167fc640 1 -- 172.21.15.47:0/2036301431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f1815e3f0 msgr2=0x7f9f180b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.108+0000 7f9f167fc640 1 --2- 172.21.15.47:0/2036301431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f1815e3f0 0x7f9f180b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.108+0000 7f9f167fc640 1 -- 172.21.15.47:0/2036301431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f180cea80 msgr2=0x7f9f180ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.108+0000 7f9f167fc640 1 --2- 172.21.15.47:0/2036301431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f180cea80 0x7f9f180ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.109+0000 7f9f167fc640 1 -- 172.21.15.47:0/2036301431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f18154a30 con 0x7f9f180d4810 2024-04-14T23:35:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.109+0000 7f9f16ffd640 1 --2- 172.21.15.47:0/2036301431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f180cea80 0x7f9f180ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:28.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.109+0000 7f9f167fc640 1 --2- 172.21.15.47:0/2036301431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f180d4810 0x7f9f180cd320 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800c460 tx=0x7f9f0800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:28.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.109+0000 7f9efffff640 1 -- 172.21.15.47:0/2036301431 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08005ce0 con 0x7f9f180d4810 2024-04-14T23:35:28.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.109+0000 7f9efffff640 1 -- 172.21.15.47:0/2036301431 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f08007070 con 0x7f9f180d4810 2024-04-14T23:35:28.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.109+0000 7f9f1d8de640 1 -- 172.21.15.47:0/2036301431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f180cda20 con 0x7f9f180d4810 2024-04-14T23:35:28.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.109+0000 7f9efffff640 1 -- 172.21.15.47:0/2036301431 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08007460 con 0x7f9f180d4810 2024-04-14T23:35:28.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.109+0000 7f9f1d8de640 1 -- 172.21.15.47:0/2036301431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f180cdfe0 con 0x7f9f180d4810 2024-04-14T23:35:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.110+0000 7f9f1d8de640 1 -- 172.21.15.47:0/2036301431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f18073f50 con 0x7f9f180d4810 2024-04-14T23:35:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.110+0000 7f9efffff640 1 -- 172.21.15.47:0/2036301431 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9f08007600 con 0x7f9f180d4810 2024-04-14T23:35:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.111+0000 7f9efffff640 1 --2- 172.21.15.47:0/2036301431 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9f0406b990 0x7f9f0406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.111+0000 7f9efffff640 1 -- 172.21.15.47:0/2036301431 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f9f0808a970 con 0x7f9f180d4810 2024-04-14T23:35:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.111+0000 7f9f16ffd640 1 --2- 172.21.15.47:0/2036301431 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9f0406b990 0x7f9f0406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.112+0000 7f9f16ffd640 1 --2- 172.21.15.47:0/2036301431 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9f0406b990 0x7f9f0406de50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9f1815b710 tx=0x7f9f0c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:28.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.115+0000 7f9efffff640 1 -- 172.21.15.47:0/2036301431 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9f08059100 con 0x7f9f180d4810 2024-04-14T23:35:28.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.294+0000 7f9f1d8de640 1 -- 172.21.15.47:0/2036301431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9f180ca560 con 0x7f9f180d4810 2024-04-14T23:35:28.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.295+0000 7f9efffff640 1 -- 172.21.15.47:0/2036301431 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f9f08058a00 con 0x7f9f180d4810 2024-04-14T23:35:28.298 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:35:28.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.297+0000 7f9f1d8de640 1 -- 172.21.15.47:0/2036301431 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9f0406b990 msgr2=0x7f9f0406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:28.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.297+0000 7f9f1d8de640 1 --2- 172.21.15.47:0/2036301431 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9f0406b990 0x7f9f0406de50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9f1815b710 tx=0x7f9f0c009040 comp rx=0 tx=0).stop 2024-04-14T23:35:28.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.297+0000 7f9f1d8de640 1 -- 172.21.15.47:0/2036301431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f180d4810 msgr2=0x7f9f180cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:28.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.297+0000 7f9f1d8de640 1 --2- 172.21.15.47:0/2036301431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f180d4810 0x7f9f180cd320 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800c460 tx=0x7f9f0800c920 comp rx=0 tx=0).stop 2024-04-14T23:35:28.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.297+0000 7f9f1d8de640 1 -- 172.21.15.47:0/2036301431 shutdown_connections 2024-04-14T23:35:28.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.297+0000 7f9f1d8de640 1 --2- 172.21.15.47:0/2036301431 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9f0406b990 0x7f9f0406de50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.297+0000 7f9f1d8de640 1 --2- 172.21.15.47:0/2036301431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f1815e3f0 0x7f9f180b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.297+0000 7f9f1d8de640 1 --2- 172.21.15.47:0/2036301431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f180d4810 0x7f9f180cd320 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.297+0000 7f9f1d8de640 1 --2- 172.21.15.47:0/2036301431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f180cea80 0x7f9f180ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.297+0000 7f9f1d8de640 1 -- 172.21.15.47:0/2036301431 >> 172.21.15.47:0/2036301431 conn(0x7f9f18067940 msgr2=0x7f9f1806be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:28.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.297+0000 7f9f1d8de640 1 -- 172.21.15.47:0/2036301431 shutdown_connections 2024-04-14T23:35:28.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.297+0000 7f9f1d8de640 1 -- 172.21.15.47:0/2036301431 wait complete. 2024-04-14T23:35:28.311 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T23:35:28.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.413+0000 7f509395e640 1 Processor -- start 2024-04-14T23:35:28.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.413+0000 7f509395e640 1 -- start start 2024-04-14T23:35:28.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.414+0000 7f509395e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f508c144700 0x7f508c0b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.414+0000 7f509395e640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f508c15f5e0 0x7f508c0b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.414+0000 7f509395e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f508c0b33e0 con 0x7f508c06e6f0 2024-04-14T23:35:28.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.414+0000 7f509395e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f508c144ae0 con 0x7f508c144700 2024-04-14T23:35:28.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.414+0000 7f509395e640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f508c0b3ff0 con 0x7f508c15f5e0 2024-04-14T23:35:28.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.414+0000 7f50916fa640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f508c144700 0x7f508c0b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:28.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.414+0000 7f50916fa640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f508c144700 0x7f508c0b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43700/0 (socket says 172.21.15.47:43700) 2024-04-14T23:35:28.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.414+0000 7f50916fa640 1 -- 172.21.15.47:0/55438667 learned_addr learned my addr 172.21.15.47:0/55438667 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:28.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.414+0000 7f5090ef9640 1 --2- 172.21.15.47:0/55438667 >> v2:172.21.15.191:3300/0 conn(0x7f508c15f5e0 0x7f508c0b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:28.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.414+0000 7f50916fa640 1 -- 172.21.15.47:0/55438667 >> v2:172.21.15.191:3300/0 conn(0x7f508c15f5e0 msgr2=0x7f508c0b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:28.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.414+0000 7f50916fa640 1 --2- 172.21.15.47:0/55438667 >> v2:172.21.15.191:3300/0 conn(0x7f508c15f5e0 0x7f508c0b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.414+0000 7f50916fa640 1 -- 172.21.15.47:0/55438667 >> v1:172.21.15.191:6789/0 conn(0x7f508c06e6f0 legacy=0x7f508c06eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:28.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.414+0000 7f50916fa640 1 -- 172.21.15.47:0/55438667 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c0b36c0 con 0x7f508c144700 2024-04-14T23:35:28.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.414+0000 7f5090ef9640 1 --2- 172.21.15.47:0/55438667 >> v2:172.21.15.191:3300/0 conn(0x7f508c15f5e0 0x7f508c0b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:28.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.415+0000 7f50916fa640 1 --2- 172.21.15.47:0/55438667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f508c144700 0x7f508c0b4480 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f508c0504a0 tx=0x7f508802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617652e4b8a08fc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:28.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.415+0000 7f5083fff640 1 -- 172.21.15.47:0/55438667 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5088035020 con 0x7f508c144700 2024-04-14T23:35:28.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.415+0000 7f5083fff640 1 -- 172.21.15.47:0/55438667 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5088031870 con 0x7f508c144700 2024-04-14T23:35:28.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.415+0000 7f5083fff640 1 -- 172.21.15.47:0/55438667 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5088031c40 con 0x7f508c144700 2024-04-14T23:35:28.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.416+0000 7f509395e640 1 -- 172.21.15.47:0/55438667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f508c144700 msgr2=0x7f508c0b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:28.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.416+0000 7f509395e640 1 --2- 172.21.15.47:0/55438667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f508c144700 0x7f508c0b4480 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f508c0504a0 tx=0x7f508802b910 comp rx=0 tx=0).stop 2024-04-14T23:35:28.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.416+0000 7f509395e640 1 -- 172.21.15.47:0/55438667 shutdown_connections 2024-04-14T23:35:28.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.416+0000 7f509395e640 1 --2- 172.21.15.47:0/55438667 >> v2:172.21.15.191:3300/0 conn(0x7f508c15f5e0 0x7f508c0b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.416+0000 7f509395e640 1 --2- 172.21.15.47:0/55438667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f508c144700 0x7f508c0b4480 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.416+0000 7f509395e640 1 -- 172.21.15.47:0/55438667 >> 172.21.15.47:0/55438667 conn(0x7f508c0b1770 msgr2=0x7f508c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:28.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.416+0000 7f509395e640 1 -- 172.21.15.47:0/55438667 shutdown_connections 2024-04-14T23:35:28.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.416+0000 7f509395e640 1 -- 172.21.15.47:0/55438667 wait complete. 2024-04-14T23:35:28.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.417+0000 7f509395e640 1 Processor -- start 2024-04-14T23:35:28.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.417+0000 7f509395e640 1 -- start start 2024-04-14T23:35:28.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.417+0000 7f509395e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f508c06e6f0 0x7f508c0ced50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f509395e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f508c144700 0x7f508c153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f509395e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f508c15f5e0 0x7f508c15b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f509395e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f508c0b49c0 con 0x7f508c144700 2024-04-14T23:35:28.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f509395e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f508c0b3c80 con 0x7f508c15f5e0 2024-04-14T23:35:28.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f509395e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f508c0b2fb0 con 0x7f508c06e6f0 2024-04-14T23:35:28.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f5090ef9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f508c144700 0x7f508c153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:28.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f5090ef9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f508c144700 0x7f508c153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43716/0 (socket says 172.21.15.47:43716) 2024-04-14T23:35:28.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f5090ef9640 1 -- 172.21.15.47:0/2438963360 learned_addr learned my addr 172.21.15.47:0/2438963360 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:28.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f5091efb640 1 --2- 172.21.15.47:0/2438963360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f508c15f5e0 0x7f508c15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:28.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f50916fa640 1 --2- 172.21.15.47:0/2438963360 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f508c06e6f0 0x7f508c0ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:28.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f5090ef9640 1 -- 172.21.15.47:0/2438963360 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f508c06e6f0 msgr2=0x7f508c0ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:28.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f5090ef9640 1 --2- 172.21.15.47:0/2438963360 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f508c06e6f0 0x7f508c0ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f5090ef9640 1 -- 172.21.15.47:0/2438963360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f508c15f5e0 msgr2=0x7f508c15b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:28.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f5090ef9640 1 --2- 172.21.15.47:0/2438963360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f508c15f5e0 0x7f508c15b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f5090ef9640 1 -- 172.21.15.47:0/2438963360 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c15d1d0 con 0x7f508c144700 2024-04-14T23:35:28.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f5090ef9640 1 --2- 172.21.15.47:0/2438963360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f508c144700 0x7f508c153760 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f507c00c7f0 tx=0x7f507c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:28.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f5081ffb640 1 -- 172.21.15.47:0/2438963360 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c015070 con 0x7f508c144700 2024-04-14T23:35:28.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f5081ffb640 1 -- 172.21.15.47:0/2438963360 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f507c007820 con 0x7f508c144700 2024-04-14T23:35:28.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f509395e640 1 -- 172.21.15.47:0/2438963360 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508c15d4b0 con 0x7f508c144700 2024-04-14T23:35:28.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.418+0000 7f5081ffb640 1 -- 172.21.15.47:0/2438963360 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c007bd0 con 0x7f508c144700 2024-04-14T23:35:28.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.419+0000 7f509395e640 1 -- 172.21.15.47:0/2438963360 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f508c15da70 con 0x7f508c144700 2024-04-14T23:35:28.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.420+0000 7f509395e640 1 -- 172.21.15.47:0/2438963360 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f508c073f50 con 0x7f508c144700 2024-04-14T23:35:28.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.420+0000 7f5081ffb640 1 -- 172.21.15.47:0/2438963360 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f507c018070 con 0x7f508c144700 2024-04-14T23:35:28.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.420+0000 7f5081ffb640 1 --2- 172.21.15.47:0/2438963360 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f507006b990 0x7f507006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.420+0000 7f5081ffb640 1 -- 172.21.15.47:0/2438963360 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f507c08ad50 con 0x7f508c144700 2024-04-14T23:35:28.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.420+0000 7f50916fa640 1 --2- 172.21.15.47:0/2438963360 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f507006b990 0x7f507006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:28.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.421+0000 7f50916fa640 1 --2- 172.21.15.47:0/2438963360 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f507006b990 0x7f507006de50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5088036000 tx=0x7f508803c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:28.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.425+0000 7f5081ffb640 1 -- 172.21.15.47:0/2438963360 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f507c08e030 con 0x7f508c144700 2024-04-14T23:35:28.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.603+0000 7f509395e640 1 -- 172.21.15.47:0/2438963360 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f508c06d280 con 0x7f508c144700 2024-04-14T23:35:28.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.604+0000 7f5081ffb640 1 -- 172.21.15.47:0/2438963360 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f507c058e90 con 0x7f508c144700 2024-04-14T23:35:28.607 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:28.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.606+0000 7f509395e640 1 -- 172.21.15.47:0/2438963360 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f507006b990 msgr2=0x7f507006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:28.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.606+0000 7f509395e640 1 --2- 172.21.15.47:0/2438963360 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f507006b990 0x7f507006de50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5088036000 tx=0x7f508803c040 comp rx=0 tx=0).stop 2024-04-14T23:35:28.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.606+0000 7f509395e640 1 -- 172.21.15.47:0/2438963360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f508c144700 msgr2=0x7f508c153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:28.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.606+0000 7f509395e640 1 --2- 172.21.15.47:0/2438963360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f508c144700 0x7f508c153760 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f507c00c7f0 tx=0x7f507c00ccb0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.606+0000 7f509395e640 1 -- 172.21.15.47:0/2438963360 shutdown_connections 2024-04-14T23:35:28.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.606+0000 7f509395e640 1 --2- 172.21.15.47:0/2438963360 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f507006b990 0x7f507006de50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.606+0000 7f509395e640 1 --2- 172.21.15.47:0/2438963360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f508c15f5e0 0x7f508c15b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.606+0000 7f509395e640 1 --2- 172.21.15.47:0/2438963360 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f508c144700 0x7f508c153760 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.606+0000 7f509395e640 1 --2- 172.21.15.47:0/2438963360 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f508c06e6f0 0x7f508c0ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.606+0000 7f509395e640 1 -- 172.21.15.47:0/2438963360 >> 172.21.15.47:0/2438963360 conn(0x7f508c0b1770 msgr2=0x7f508c0b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:28.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.606+0000 7f509395e640 1 -- 172.21.15.47:0/2438963360 shutdown_connections 2024-04-14T23:35:28.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.606+0000 7f509395e640 1 -- 172.21.15.47:0/2438963360 wait complete. 2024-04-14T23:35:28.620 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T23:35:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.721+0000 7f8a6cdbb640 1 Processor -- start 2024-04-14T23:35:28.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.721+0000 7f8a6cdbb640 1 -- start start 2024-04-14T23:35:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.722+0000 7f8a6cdbb640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a6815e2e0 0x7f8a680cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.722+0000 7f8a6cdbb640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8a680b1760 0x7f8a680ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.722+0000 7f8a6cdbb640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a680d0a10 con 0x7f8a68073590 2024-04-14T23:35:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.722+0000 7f8a6cdbb640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f8a680d0cf0 con 0x7f8a680b1760 2024-04-14T23:35:28.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.722+0000 7f8a6cdbb640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f8a680d0fd0 con 0x7f8a6815e2e0 2024-04-14T23:35:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.722+0000 7f8a6659c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a6815e2e0 0x7f8a680cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.722+0000 7f8a66d9d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8a680b1760 0x7f8a680ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.722+0000 7f8a6659c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a6815e2e0 0x7f8a680cffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:39160/0 (socket says 172.21.15.47:39160) 2024-04-14T23:35:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.722+0000 7f8a66d9d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8a680b1760 0x7f8a680ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:58936/0 (socket says 172.21.15.47:58936) 2024-04-14T23:35:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.722+0000 7f8a6659c640 1 -- 172.21.15.47:0/88469928 learned_addr learned my addr 172.21.15.47:0/88469928 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.723+0000 7f8a6659c640 1 -- 172.21.15.47:0/88469928 >> v2:172.21.15.191:3300/0 conn(0x7f8a680b1760 msgr2=0x7f8a680ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.723+0000 7f8a6659c640 1 --2- 172.21.15.47:0/88469928 >> v2:172.21.15.191:3300/0 conn(0x7f8a680b1760 0x7f8a680ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.723+0000 7f8a6659c640 1 -- 172.21.15.47:0/88469928 >> v1:172.21.15.191:6789/0 conn(0x7f8a68073590 legacy=0x7f8a680b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:28.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.723+0000 7f8a6659c640 1 -- 172.21.15.47:0/88469928 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6815e6c0 con 0x7f8a6815e2e0 2024-04-14T23:35:28.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.723+0000 7f8a66d9d640 1 --2- 172.21.15.47:0/88469928 >> v2:172.21.15.191:3300/0 conn(0x7f8a680b1760 0x7f8a680ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.724+0000 7f8a6659c640 1 --2- 172.21.15.47:0/88469928 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a6815e2e0 0x7f8a680cffe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009870 tx=0x7f8a6002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f2c08244ae5cc26 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.724+0000 7f8a6559a640 1 -- 172.21.15.47:0/88469928 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a60035020 con 0x7f8a6815e2e0 2024-04-14T23:35:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.724+0000 7f8a6559a640 1 -- 172.21.15.47:0/88469928 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a60031640 con 0x7f8a6815e2e0 2024-04-14T23:35:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.724+0000 7f8a6559a640 1 -- 172.21.15.47:0/88469928 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6002d040 con 0x7f8a6815e2e0 2024-04-14T23:35:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.724+0000 7f8a6cdbb640 1 -- 172.21.15.47:0/88469928 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a6815e2e0 msgr2=0x7f8a680cffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.724+0000 7f8a6cdbb640 1 --2- 172.21.15.47:0/88469928 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a6815e2e0 0x7f8a680cffe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009870 tx=0x7f8a6002b8f0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.724+0000 7f8a6cdbb640 1 -- 172.21.15.47:0/88469928 shutdown_connections 2024-04-14T23:35:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.724+0000 7f8a6cdbb640 1 --2- 172.21.15.47:0/88469928 >> v2:172.21.15.191:3300/0 conn(0x7f8a680b1760 0x7f8a680ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.724+0000 7f8a6cdbb640 1 --2- 172.21.15.47:0/88469928 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a6815e2e0 0x7f8a680cffe0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.724+0000 7f8a6cdbb640 1 -- 172.21.15.47:0/88469928 >> 172.21.15.47:0/88469928 conn(0x7f8a68072920 msgr2=0x7f8a68072d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.724+0000 7f8a6cdbb640 1 -- 172.21.15.47:0/88469928 shutdown_connections 2024-04-14T23:35:28.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.724+0000 7f8a6cdbb640 1 -- 172.21.15.47:0/88469928 wait complete. 2024-04-14T23:35:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.726+0000 7f8a6cdbb640 1 Processor -- start 2024-04-14T23:35:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.726+0000 7f8a6cdbb640 1 -- start start 2024-04-14T23:35:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.726+0000 7f8a6cdbb640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a68073590 0x7f8a6806db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.726+0000 7f8a6cdbb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a680b1760 0x7f8a68161830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.726+0000 7f8a6cdbb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a6815e2e0 0x7f8a680999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.726+0000 7f8a6cdbb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8a680adda0 con 0x7f8a680b1760 2024-04-14T23:35:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.726+0000 7f8a6cdbb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8a680d07b0 con 0x7f8a6815e2e0 2024-04-14T23:35:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.726+0000 7f8a6cdbb640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f8a680adf20 con 0x7f8a68073590 2024-04-14T23:35:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.727+0000 7f8a65d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a680b1760 0x7f8a68161830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.727+0000 7f8a65d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a680b1760 0x7f8a68161830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43726/0 (socket says 172.21.15.47:43726) 2024-04-14T23:35:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.727+0000 7f8a65d9b640 1 -- 172.21.15.47:0/1873758694 learned_addr learned my addr 172.21.15.47:0/1873758694 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.727+0000 7f8a6659c640 1 --2- 172.21.15.47:0/1873758694 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a68073590 0x7f8a6806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.727+0000 7f8a66d9d640 1 --2- 172.21.15.47:0/1873758694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a6815e2e0 0x7f8a680999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.727+0000 7f8a65d9b640 1 -- 172.21.15.47:0/1873758694 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a68073590 msgr2=0x7f8a6806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:28.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.727+0000 7f8a65d9b640 1 --2- 172.21.15.47:0/1873758694 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a68073590 0x7f8a6806db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.727+0000 7f8a65d9b640 1 -- 172.21.15.47:0/1873758694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a6815e2e0 msgr2=0x7f8a680999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:28.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.727+0000 7f8a65d9b640 1 --2- 172.21.15.47:0/1873758694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a6815e2e0 0x7f8a680999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:28.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.727+0000 7f8a65d9b640 1 -- 172.21.15.47:0/1873758694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6815bcd0 con 0x7f8a680b1760 2024-04-14T23:35:28.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.727+0000 7f8a65d9b640 1 --2- 172.21.15.47:0/1873758694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a680b1760 0x7f8a68161830 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000c400 tx=0x7f8a5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:28.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.727+0000 7f8a5effd640 1 -- 172.21.15.47:0/1873758694 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50017070 con 0x7f8a680b1760 2024-04-14T23:35:28.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.727+0000 7f8a5effd640 1 -- 172.21.15.47:0/1873758694 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a500052d0 con 0x7f8a680b1760 2024-04-14T23:35:28.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.727+0000 7f8a6cdbb640 1 -- 172.21.15.47:0/1873758694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a68158580 con 0x7f8a680b1760 2024-04-14T23:35:28.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.727+0000 7f8a5effd640 1 -- 172.21.15.47:0/1873758694 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50003830 con 0x7f8a680b1760 2024-04-14T23:35:28.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.727+0000 7f8a6cdbb640 1 -- 172.21.15.47:0/1873758694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a68158b40 con 0x7f8a680b1760 2024-04-14T23:35:28.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.728+0000 7f8a6cdbb640 1 -- 172.21.15.47:0/1873758694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a68073f50 con 0x7f8a680b1760 2024-04-14T23:35:28.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.729+0000 7f8a5effd640 1 -- 172.21.15.47:0/1873758694 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f8a5001a070 con 0x7f8a680b1760 2024-04-14T23:35:28.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.729+0000 7f8a5effd640 1 --2- 172.21.15.47:0/1873758694 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8a4806b990 0x7f8a4806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:28.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.729+0000 7f8a5effd640 1 -- 172.21.15.47:0/1873758694 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8a50089f60 con 0x7f8a680b1760 2024-04-14T23:35:28.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.729+0000 7f8a6659c640 1 --2- 172.21.15.47:0/1873758694 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8a4806b990 0x7f8a4806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:28.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.730+0000 7f8a6659c640 1 --2- 172.21.15.47:0/1873758694 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8a4806b990 0x7f8a4806de50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8a60036000 tx=0x7f8a6003c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:28.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.734+0000 7f8a5effd640 1 -- 172.21.15.47:0/1873758694 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8a50058120 con 0x7f8a680b1760 2024-04-14T23:35:28.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.914+0000 7f8a6cdbb640 1 -- 172.21.15.47:0/1873758694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8a68158d10 con 0x7f8a680b1760 2024-04-14T23:35:29.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.915+0000 7f8a5effd640 1 -- 172.21.15.47:0/1873758694 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f8a5005c1c0 con 0x7f8a680b1760 2024-04-14T23:35:29.012 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-14T23:35:29.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.917+0000 7f8a6cdbb640 1 -- 172.21.15.47:0/1873758694 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8a4806b990 msgr2=0x7f8a4806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.917+0000 7f8a6cdbb640 1 --2- 172.21.15.47:0/1873758694 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8a4806b990 0x7f8a4806de50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8a60036000 tx=0x7f8a6003c040 comp rx=0 tx=0).stop 2024-04-14T23:35:29.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.917+0000 7f8a6cdbb640 1 -- 172.21.15.47:0/1873758694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a680b1760 msgr2=0x7f8a68161830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.917+0000 7f8a6cdbb640 1 --2- 172.21.15.47:0/1873758694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a680b1760 0x7f8a68161830 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000c400 tx=0x7f8a5000c8c0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.917+0000 7f8a6cdbb640 1 -- 172.21.15.47:0/1873758694 shutdown_connections 2024-04-14T23:35:29.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.917+0000 7f8a6cdbb640 1 --2- 172.21.15.47:0/1873758694 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8a4806b990 0x7f8a4806de50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.917+0000 7f8a6cdbb640 1 --2- 172.21.15.47:0/1873758694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a6815e2e0 0x7f8a680999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.917+0000 7f8a6cdbb640 1 --2- 172.21.15.47:0/1873758694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a680b1760 0x7f8a68161830 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.917+0000 7f8a6cdbb640 1 --2- 172.21.15.47:0/1873758694 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a68073590 0x7f8a6806db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.917+0000 7f8a6cdbb640 1 -- 172.21.15.47:0/1873758694 >> 172.21.15.47:0/1873758694 conn(0x7f8a68072920 msgr2=0x7f8a680b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:29.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.917+0000 7f8a6cdbb640 1 -- 172.21.15.47:0/1873758694 shutdown_connections 2024-04-14T23:35:29.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:28.917+0000 7f8a6cdbb640 1 -- 172.21.15.47:0/1873758694 wait complete. 2024-04-14T23:35:29.014 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T23:35:29.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.118+0000 7f51094a6640 1 Processor -- start 2024-04-14T23:35:29.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.118+0000 7f51094a6640 1 -- start start 2024-04-14T23:35:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f51094a6640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51041619b0 0x7f51040d1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f51094a6640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f51040b2c70 0x7f51040d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f51094a6640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f51040b0c10 0x7f51040b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f51094a6640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f51040d4cc0 con 0x7f51040b0c10 2024-04-14T23:35:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f51094a6640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f51040d0d80 con 0x7f51040b2c70 2024-04-14T23:35:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f51094a6640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f51040d2c00 con 0x7f51041619b0 2024-04-14T23:35:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f51037fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f51040b0c10 0x7f51040b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f51037fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f51040b0c10 0x7f51040b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43738/0 (socket says 172.21.15.47:43738) 2024-04-14T23:35:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f51037fe640 1 -- 172.21.15.47:0/2361038923 learned_addr learned my addr 172.21.15.47:0/2361038923 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f51027fc640 1 --2- 172.21.15.47:0/2361038923 >> v2:172.21.15.191:3300/0 conn(0x7f51040b2c70 0x7f51040d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f5102ffd640 1 --2- 172.21.15.47:0/2361038923 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51041619b0 0x7f51040d1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f51037fe640 1 -- 172.21.15.47:0/2361038923 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51041619b0 msgr2=0x7f51040d1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f51037fe640 1 --2- 172.21.15.47:0/2361038923 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51041619b0 0x7f51040d1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f51037fe640 1 -- 172.21.15.47:0/2361038923 >> v2:172.21.15.191:3300/0 conn(0x7f51040b2c70 msgr2=0x7f51040d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f51037fe640 1 --2- 172.21.15.47:0/2361038923 >> v2:172.21.15.191:3300/0 conn(0x7f51040b2c70 0x7f51040d23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f51037fe640 1 -- 172.21.15.47:0/2361038923 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51040d2ee0 con 0x7f51040b0c10 2024-04-14T23:35:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.119+0000 7f5102ffd640 1 --2- 172.21.15.47:0/2361038923 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51041619b0 0x7f51040d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.120+0000 7f51037fe640 1 --2- 172.21.15.47:0/2361038923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51040b0c10 0x7f51040b10a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5104068650 tx=0x7f50f402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ac3d55b12d15c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.120+0000 7f5101ffb640 1 -- 172.21.15.47:0/2361038923 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f402c9e0 con 0x7f51040b0c10 2024-04-14T23:35:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.120+0000 7f5101ffb640 1 -- 172.21.15.47:0/2361038923 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f402cb80 con 0x7f51040b0c10 2024-04-14T23:35:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.120+0000 7f5101ffb640 1 -- 172.21.15.47:0/2361038923 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f40343f0 con 0x7f51040b0c10 2024-04-14T23:35:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.121+0000 7f51094a6640 1 -- 172.21.15.47:0/2361038923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51040b0c10 msgr2=0x7f51040b10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.121+0000 7f51094a6640 1 --2- 172.21.15.47:0/2361038923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51040b0c10 0x7f51040b10a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5104068650 tx=0x7f50f402be40 comp rx=0 tx=0).stop 2024-04-14T23:35:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.121+0000 7f51094a6640 1 -- 172.21.15.47:0/2361038923 shutdown_connections 2024-04-14T23:35:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.121+0000 7f51094a6640 1 --2- 172.21.15.47:0/2361038923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51040b0c10 0x7f51040b10a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.121+0000 7f51094a6640 1 --2- 172.21.15.47:0/2361038923 >> v2:172.21.15.191:3300/0 conn(0x7f51040b2c70 0x7f51040d23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.121+0000 7f51094a6640 1 --2- 172.21.15.47:0/2361038923 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51041619b0 0x7f51040d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.121+0000 7f51094a6640 1 -- 172.21.15.47:0/2361038923 >> 172.21.15.47:0/2361038923 conn(0x7f51040d3f80 msgr2=0x7f51040d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.121+0000 7f51094a6640 1 -- 172.21.15.47:0/2361038923 shutdown_connections 2024-04-14T23:35:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.121+0000 7f51094a6640 1 -- 172.21.15.47:0/2361038923 wait complete. 2024-04-14T23:35:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.122+0000 7f51094a6640 1 Processor -- start 2024-04-14T23:35:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.122+0000 7f51094a6640 1 -- start start 2024-04-14T23:35:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51094a6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51040b0c10 0x7f51041583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51094a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51040b2c70 0x7f51040cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51094a6640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51041619b0 0x7f51040cf330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51094a6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f51040d2900 con 0x7f51040b2c70 2024-04-14T23:35:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51094a6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f51040d1320 con 0x7f51040b0c10 2024-04-14T23:35:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51094a6640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f51040b15e0 con 0x7f51041619b0 2024-04-14T23:35:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51027fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51040b2c70 0x7f51040cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51027fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51040b2c70 0x7f51040cedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43752/0 (socket says 172.21.15.47:43752) 2024-04-14T23:35:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51027fc640 1 -- 172.21.15.47:0/3949634732 learned_addr learned my addr 172.21.15.47:0/3949634732 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51037fe640 1 --2- 172.21.15.47:0/3949634732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51041619b0 0x7f51040cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f5102ffd640 1 --2- 172.21.15.47:0/3949634732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51040b0c10 0x7f51041583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51027fc640 1 -- 172.21.15.47:0/3949634732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51041619b0 msgr2=0x7f51040cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51027fc640 1 --2- 172.21.15.47:0/3949634732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51041619b0 0x7f51040cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51027fc640 1 -- 172.21.15.47:0/3949634732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51040b0c10 msgr2=0x7f51041583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51027fc640 1 --2- 172.21.15.47:0/3949634732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51040b0c10 0x7f51041583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51027fc640 1 -- 172.21.15.47:0/3949634732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51040c9a00 con 0x7f51040b2c70 2024-04-14T23:35:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f5102ffd640 1 --2- 172.21.15.47:0/3949634732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51040b0c10 0x7f51041583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51027fc640 1 --2- 172.21.15.47:0/3949634732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51040b2c70 0x7f51040cedf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f50f800d800 tx=0x7f50f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f50eb7fe640 1 -- 172.21.15.47:0/3949634732 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8018020 con 0x7f51040b2c70 2024-04-14T23:35:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f50eb7fe640 1 -- 172.21.15.47:0/3949634732 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f80096a0 con 0x7f51040b2c70 2024-04-14T23:35:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f51094a6640 1 -- 172.21.15.47:0/3949634732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51040c9ce0 con 0x7f51040b2c70 2024-04-14T23:35:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.123+0000 7f50eb7fe640 1 -- 172.21.15.47:0/3949634732 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8009a70 con 0x7f51040b2c70 2024-04-14T23:35:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.124+0000 7f51094a6640 1 -- 172.21.15.47:0/3949634732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51040ca2a0 con 0x7f51040b2c70 2024-04-14T23:35:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.125+0000 7f51094a6640 1 -- 172.21.15.47:0/3949634732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5104073f50 con 0x7f51040b2c70 2024-04-14T23:35:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.125+0000 7f50eb7fe640 1 -- 172.21.15.47:0/3949634732 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f50f801b020 con 0x7f51040b2c70 2024-04-14T23:35:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.125+0000 7f50eb7fe640 1 --2- 172.21.15.47:0/3949634732 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f50f006b990 0x7f50f006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.125+0000 7f50eb7fe640 1 -- 172.21.15.47:0/3949634732 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f50f808af60 con 0x7f51040b2c70 2024-04-14T23:35:29.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.126+0000 7f5102ffd640 1 --2- 172.21.15.47:0/3949634732 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f50f006b990 0x7f50f006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.126+0000 7f5102ffd640 1 --2- 172.21.15.47:0/3949634732 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f50f006b990 0x7f50f006de50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f50fc006fd0 tx=0x7f50fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:29.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.130+0000 7f50eb7fe640 1 -- 172.21.15.47:0/3949634732 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f50f8022030 con 0x7f51040b2c70 2024-04-14T23:35:29.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.309+0000 7f51094a6640 1 -- 172.21.15.47:0/3949634732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f510406d8e0 con 0x7f51040b2c70 2024-04-14T23:35:29.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.309+0000 7f50eb7fe640 1 -- 172.21.15.47:0/3949634732 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f50f80596e0 con 0x7f51040b2c70 2024-04-14T23:35:29.312 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:29.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.311+0000 7f51094a6640 1 -- 172.21.15.47:0/3949634732 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f50f006b990 msgr2=0x7f50f006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.311+0000 7f51094a6640 1 --2- 172.21.15.47:0/3949634732 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f50f006b990 0x7f50f006de50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f50fc006fd0 tx=0x7f50fc008040 comp rx=0 tx=0).stop 2024-04-14T23:35:29.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.311+0000 7f51094a6640 1 -- 172.21.15.47:0/3949634732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51040b2c70 msgr2=0x7f51040cedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.311+0000 7f51094a6640 1 --2- 172.21.15.47:0/3949634732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51040b2c70 0x7f51040cedf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f50f800d800 tx=0x7f50f800dcc0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.311+0000 7f51094a6640 1 -- 172.21.15.47:0/3949634732 shutdown_connections 2024-04-14T23:35:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.311+0000 7f51094a6640 1 --2- 172.21.15.47:0/3949634732 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f50f006b990 0x7f50f006de50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.311+0000 7f51094a6640 1 --2- 172.21.15.47:0/3949634732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51041619b0 0x7f51040cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.311+0000 7f51094a6640 1 --2- 172.21.15.47:0/3949634732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51040b2c70 0x7f51040cedf0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.311+0000 7f51094a6640 1 --2- 172.21.15.47:0/3949634732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51040b0c10 0x7f51041583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.311+0000 7f51094a6640 1 -- 172.21.15.47:0/3949634732 >> 172.21.15.47:0/3949634732 conn(0x7f51040d3f80 msgr2=0x7f51040d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.311+0000 7f51094a6640 1 -- 172.21.15.47:0/3949634732 shutdown_connections 2024-04-14T23:35:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.311+0000 7f51094a6640 1 -- 172.21.15.47:0/3949634732 wait complete. 2024-04-14T23:35:29.325 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T23:35:29.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.424+0000 7f27c1e95640 1 Processor -- start 2024-04-14T23:35:29.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.424+0000 7f27c1e95640 1 -- start start 2024-04-14T23:35:29.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.424+0000 7f27c1e95640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f27bc144a80 0x7f27bc06ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.424+0000 7f27c1e95640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27bc0b35d0 0x7f27bc0ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.424+0000 7f27c1e95640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27bc06d970 con 0x7f27bc0b2a70 2024-04-14T23:35:29.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.424+0000 7f27c1e95640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f27bc06d720 con 0x7f27bc144a80 2024-04-14T23:35:29.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.424+0000 7f27c1e95640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f27bc06dc50 con 0x7f27bc0b35d0 2024-04-14T23:35:29.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27baffd640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f27bc0b2a70 0x7f27bc0b2ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54480/0 (socket says 172.21.15.47:54480) 2024-04-14T23:35:29.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27baffd640 1 -- 172.21.15.47:0/2327984304 learned_addr learned my addr 172.21.15.47:0/2327984304 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:29.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27bbfff640 1 --2- 172.21.15.47:0/2327984304 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27bc0b35d0 0x7f27bc0ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27bb7fe640 1 --2- 172.21.15.47:0/2327984304 >> v2:172.21.15.191:3300/0 conn(0x7f27bc144a80 0x7f27bc06ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27ba7fc640 1 -- 172.21.15.47:0/2327984304 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4017426544 0 0) 0x7f27bc06d970 con 0x7f27bc0b2a70 2024-04-14T23:35:29.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27ba7fc640 1 -- 172.21.15.47:0/2327984304 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27a4003520 con 0x7f27bc0b2a70 2024-04-14T23:35:29.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27ba7fc640 1 -- 172.21.15.47:0/2327984304 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4260401989 0 0) 0x7f27a4003520 con 0x7f27bc0b2a70 2024-04-14T23:35:29.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27ba7fc640 1 -- 172.21.15.47:0/2327984304 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27bc0b35d0 msgr2=0x7f27bc0ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:29.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27ba7fc640 1 --2- 172.21.15.47:0/2327984304 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27bc0b35d0 0x7f27bc0ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27ba7fc640 1 -- 172.21.15.47:0/2327984304 >> v2:172.21.15.191:3300/0 conn(0x7f27bc144a80 msgr2=0x7f27bc06ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:29.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27ba7fc640 1 --2- 172.21.15.47:0/2327984304 >> v2:172.21.15.191:3300/0 conn(0x7f27bc144a80 0x7f27bc06ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27ba7fc640 1 -- 172.21.15.47:0/2327984304 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27bc06df30 con 0x7f27bc0b2a70 2024-04-14T23:35:29.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27ba7fc640 1 -- 172.21.15.47:0/2327984304 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f27ac001670 con 0x7f27bc0b2a70 2024-04-14T23:35:29.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27ba7fc640 1 -- 172.21.15.47:0/2327984304 >> v1:172.21.15.47:6789/0 conn(0x7f27bc0b2a70 legacy=0x7f27bc0b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27ba7fc640 1 --2- 172.21.15.47:0/2327984304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27a40039b0 0x7f27a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27ba7fc640 1 --2- 172.21.15.47:0/2327984304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27a4004800 0x7f27a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27ba7fc640 1 --2- 172.21.15.47:0/2327984304 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27bc0b35d0 0x7f27a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27ba7fc640 1 -- 172.21.15.47:0/2327984304 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc06d720 con 0x7f27a4004800 2024-04-14T23:35:29.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27ba7fc640 1 -- 172.21.15.47:0/2327984304 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc06dc50 con 0x7f27a40039b0 2024-04-14T23:35:29.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27ba7fc640 1 -- 172.21.15.47:0/2327984304 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f27a400b9c0 con 0x7f27bc0b35d0 2024-04-14T23:35:29.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27baffd640 1 --2- 172.21.15.47:0/2327984304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27a4004800 0x7f27a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27bb7fe640 1 --2- 172.21.15.47:0/2327984304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27a40039b0 0x7f27a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.425+0000 7f27bbfff640 1 --2- 172.21.15.47:0/2327984304 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27bc0b35d0 0x7f27a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.426+0000 7f27baffd640 1 -- 172.21.15.47:0/2327984304 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27bc0b35d0 msgr2=0x7f27a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:29.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.426+0000 7f27baffd640 1 --2- 172.21.15.47:0/2327984304 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27bc0b35d0 0x7f27a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.426+0000 7f27baffd640 1 -- 172.21.15.47:0/2327984304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27a40039b0 msgr2=0x7f27a4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.426+0000 7f27baffd640 1 --2- 172.21.15.47:0/2327984304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27a40039b0 0x7f27a4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.426+0000 7f27baffd640 1 -- 172.21.15.47:0/2327984304 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a4003520 con 0x7f27a4004800 2024-04-14T23:35:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.426+0000 7f27baffd640 1 --2- 172.21.15.47:0/2327984304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27a4004800 0x7f27a4004c80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c240 tx=0x7f27a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd37d00b619b68d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.426+0000 7f27ba7fc640 1 -- 172.21.15.47:0/2327984304 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac007d30 con 0x7f27a4004800 2024-04-14T23:35:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.427+0000 7f27ba7fc640 1 -- 172.21.15.47:0/2327984304 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27ac030070 con 0x7f27a4004800 2024-04-14T23:35:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.427+0000 7f27ba7fc640 1 -- 172.21.15.47:0/2327984304 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac02cd60 con 0x7f27a4004800 2024-04-14T23:35:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.427+0000 7f27c1e95640 1 -- 172.21.15.47:0/2327984304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27a4004800 msgr2=0x7f27a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.427+0000 7f27c1e95640 1 --2- 172.21.15.47:0/2327984304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27a4004800 0x7f27a4004c80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c240 tx=0x7f27a4005830 comp rx=0 tx=0).stop 2024-04-14T23:35:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.427+0000 7f27bbfff640 1 -- 172.21.15.47:0/2327984304 reap_dead start 2024-04-14T23:35:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.427+0000 7f27c1e95640 1 -- 172.21.15.47:0/2327984304 shutdown_connections 2024-04-14T23:35:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.427+0000 7f27c1e95640 1 -- 172.21.15.47:0/2327984304 >> 172.21.15.47:0/2327984304 conn(0x7f27bc06b200 msgr2=0x7f27bc06b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.427+0000 7f27c1e95640 1 -- 172.21.15.47:0/2327984304 shutdown_connections 2024-04-14T23:35:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.427+0000 7f27c1e95640 1 -- 172.21.15.47:0/2327984304 wait complete. 2024-04-14T23:35:29.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.428+0000 7f27c1e95640 1 Processor -- start 2024-04-14T23:35:29.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.428+0000 7f27c1e95640 1 -- start start 2024-04-14T23:35:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.429+0000 7f27c1e95640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27a4004800 0x7f27bc142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.429+0000 7f27c1e95640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27bc13d2e0 0x7f27bc13d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.429+0000 7f27c1e95640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27bc1e4750 0x7f27bc1e4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.429+0000 7f27c1e95640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc0ce410 con 0x7f27bc13d2e0 2024-04-14T23:35:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.429+0000 7f27c1e95640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc144e60 con 0x7f27a4004800 2024-04-14T23:35:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.429+0000 7f27c1e95640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f27bc0ce590 con 0x7f27bc1e4750 2024-04-14T23:35:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.429+0000 7f27baffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27bc13d2e0 0x7f27bc13d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.429+0000 7f27baffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27bc13d2e0 0x7f27bc13d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43772/0 (socket says 172.21.15.47:43772) 2024-04-14T23:35:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.429+0000 7f27baffd640 1 -- 172.21.15.47:0/1620964361 learned_addr learned my addr 172.21.15.47:0/1620964361 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.429+0000 7f27bb7fe640 1 --2- 172.21.15.47:0/1620964361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27a4004800 0x7f27bc142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.429+0000 7f27bbfff640 1 --2- 172.21.15.47:0/1620964361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27bc1e4750 0x7f27bc1e4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.430+0000 7f27baffd640 1 -- 172.21.15.47:0/1620964361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27bc1e4750 msgr2=0x7f27bc1e4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.430+0000 7f27baffd640 1 --2- 172.21.15.47:0/1620964361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27bc1e4750 0x7f27bc1e4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.430+0000 7f27baffd640 1 -- 172.21.15.47:0/1620964361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27a4004800 msgr2=0x7f27bc142fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.430+0000 7f27baffd640 1 --2- 172.21.15.47:0/1620964361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27a4004800 0x7f27bc142fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.430+0000 7f27baffd640 1 -- 172.21.15.47:0/1620964361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27bc1f2d90 con 0x7f27bc13d2e0 2024-04-14T23:35:29.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.430+0000 7f27bbfff640 1 --2- 172.21.15.47:0/1620964361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27bc1e4750 0x7f27bc1e4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:29.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.430+0000 7f27baffd640 1 --2- 172.21.15.47:0/1620964361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27bc13d2e0 0x7f27bc13d760 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c240 tx=0x7f27bc06e100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:29.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.430+0000 7f27a3fff640 1 -- 172.21.15.47:0/1620964361 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac001c70 con 0x7f27bc13d2e0 2024-04-14T23:35:29.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.430+0000 7f27a3fff640 1 -- 172.21.15.47:0/1620964361 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27ac004bf0 con 0x7f27bc13d2e0 2024-04-14T23:35:29.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.430+0000 7f27c1e95640 1 -- 172.21.15.47:0/1620964361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27bc13dca0 con 0x7f27bc13d2e0 2024-04-14T23:35:29.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.430+0000 7f27a3fff640 1 -- 172.21.15.47:0/1620964361 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac007070 con 0x7f27bc13d2e0 2024-04-14T23:35:29.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.430+0000 7f27c1e95640 1 -- 172.21.15.47:0/1620964361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27bc1f3050 con 0x7f27bc13d2e0 2024-04-14T23:35:29.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.431+0000 7f27c1e95640 1 -- 172.21.15.47:0/1620964361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27bc075430 con 0x7f27bc13d2e0 2024-04-14T23:35:29.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.431+0000 7f27a3fff640 1 -- 172.21.15.47:0/1620964361 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f27ac047020 con 0x7f27bc13d2e0 2024-04-14T23:35:29.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.432+0000 7f27a3fff640 1 --2- 172.21.15.47:0/1620964361 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f27a806b9c0 0x7f27a806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.432+0000 7f27a3fff640 1 -- 172.21.15.47:0/1620964361 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f27ac0abe90 con 0x7f27bc13d2e0 2024-04-14T23:35:29.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.432+0000 7f27bb7fe640 1 --2- 172.21.15.47:0/1620964361 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f27a806b9c0 0x7f27a806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.432+0000 7f27bb7fe640 1 --2- 172.21.15.47:0/1620964361 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f27a806b9c0 0x7f27a806de80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009b00 tx=0x7f27b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:29.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.436+0000 7f27a3fff640 1 -- 172.21.15.47:0/1620964361 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f27ac07a6a0 con 0x7f27bc13d2e0 2024-04-14T23:35:29.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.630+0000 7f27c1e95640 1 -- 172.21.15.47:0/1620964361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f27bc0b46d0 con 0x7f27bc13d2e0 2024-04-14T23:35:29.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.630+0000 7f27a3fff640 1 -- 172.21.15.47:0/1620964361 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f27ac079fa0 con 0x7f27bc13d2e0 2024-04-14T23:35:29.633 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-14T23:35:29.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.632+0000 7f27c1e95640 1 -- 172.21.15.47:0/1620964361 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f27a806b9c0 msgr2=0x7f27a806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.632+0000 7f27c1e95640 1 --2- 172.21.15.47:0/1620964361 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f27a806b9c0 0x7f27a806de80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009b00 tx=0x7f27b0008040 comp rx=0 tx=0).stop 2024-04-14T23:35:29.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.632+0000 7f27c1e95640 1 -- 172.21.15.47:0/1620964361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27bc13d2e0 msgr2=0x7f27bc13d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.632+0000 7f27c1e95640 1 --2- 172.21.15.47:0/1620964361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27bc13d2e0 0x7f27bc13d760 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c240 tx=0x7f27bc06e100 comp rx=0 tx=0).stop 2024-04-14T23:35:29.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.632+0000 7f27c1e95640 1 -- 172.21.15.47:0/1620964361 shutdown_connections 2024-04-14T23:35:29.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.632+0000 7f27c1e95640 1 --2- 172.21.15.47:0/1620964361 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f27a806b9c0 0x7f27a806de80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.632+0000 7f27c1e95640 1 --2- 172.21.15.47:0/1620964361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27bc1e4750 0x7f27bc1e4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.632+0000 7f27c1e95640 1 --2- 172.21.15.47:0/1620964361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27bc13d2e0 0x7f27bc13d760 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.632+0000 7f27c1e95640 1 --2- 172.21.15.47:0/1620964361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27a4004800 0x7f27bc142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.632+0000 7f27c1e95640 1 -- 172.21.15.47:0/1620964361 >> 172.21.15.47:0/1620964361 conn(0x7f27bc06b200 msgr2=0x7f27bc15df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:29.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.632+0000 7f27c1e95640 1 -- 172.21.15.47:0/1620964361 shutdown_connections 2024-04-14T23:35:29.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.632+0000 7f27c1e95640 1 -- 172.21.15.47:0/1620964361 wait complete. 2024-04-14T23:35:29.646 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-14T23:35:29.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:29.646 DEBUG:teuthology.orchestra.run.smithi047:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-14T23:35:29.674 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-04-14T23:35:29.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:29.674 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-14T23:35:29.729 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:35:29.729 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:29.747 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:35:29.748 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:29.806 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:35:29.806 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:29.865 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:29.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.963+0000 7f741c3e0640 1 Processor -- start 2024-04-14T23:35:29.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.964+0000 7f741c3e0640 1 -- start start 2024-04-14T23:35:29.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.964+0000 7f741c3e0640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f741415e420 0x7f74140d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.964+0000 7f741c3e0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74140ce4b0 0x7f74140ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.964+0000 7f741c3e0640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74140cf2e0 con 0x7f74140cee50 2024-04-14T23:35:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.964+0000 7f741c3e0640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f74140cc280 con 0x7f741415e420 2024-04-14T23:35:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.964+0000 7f741c3e0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f74140d1040 con 0x7f74140ce4b0 2024-04-14T23:35:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.965+0000 7f741a97d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f74140cee50 0x7f741406c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54490/0 (socket says 172.21.15.47:54490) 2024-04-14T23:35:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.965+0000 7f741a97d640 1 -- 172.21.15.47:0/853758090 learned_addr learned my addr 172.21.15.47:0/853758090 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.965+0000 7f741997b640 1 --2- 172.21.15.47:0/853758090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74140ce4b0 0x7f74140ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.965+0000 7f741a17c640 1 --2- 172.21.15.47:0/853758090 >> v2:172.21.15.191:3300/0 conn(0x7f741415e420 0x7f74140d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.965+0000 7f741917a640 1 -- 172.21.15.47:0/853758090 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001578877 0 0) 0x7f7404001490 con 0x7f74140cee50 2024-04-14T23:35:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.965+0000 7f741917a640 1 -- 172.21.15.47:0/853758090 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73fc003520 con 0x7f74140cee50 2024-04-14T23:35:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.965+0000 7f741a17c640 1 -- 172.21.15.47:0/853758090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74140ce4b0 msgr2=0x7f74140ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.965+0000 7f741a17c640 1 --2- 172.21.15.47:0/853758090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74140ce4b0 0x7f74140ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.965+0000 7f741a17c640 1 -- 172.21.15.47:0/853758090 >> v1:172.21.15.47:6789/0 conn(0x7f74140cee50 legacy=0x7f741406c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.965+0000 7f741917a640 1 -- 172.21.15.47:0/853758090 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1963941211 0 0) 0x7f73fc003520 con 0x7f74140cee50 2024-04-14T23:35:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.965+0000 7f741a17c640 1 -- 172.21.15.47:0/853758090 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74140d1320 con 0x7f741415e420 2024-04-14T23:35:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.965+0000 7f741997b640 1 --2- 172.21.15.47:0/853758090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74140ce4b0 0x7f74140ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:29.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.966+0000 7f741a17c640 1 --2- 172.21.15.47:0/853758090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f741415e420 0x7f74140d0980 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f740c0097a0 tx=0x7f740c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9c3d17fa6d27edd server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:29.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.966+0000 7f741917a640 1 -- 172.21.15.47:0/853758090 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c038070 con 0x7f741415e420 2024-04-14T23:35:29.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.966+0000 7f741917a640 1 -- 172.21.15.47:0/853758090 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f740c031500 con 0x7f741415e420 2024-04-14T23:35:29.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.966+0000 7f741917a640 1 -- 172.21.15.47:0/853758090 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7404001bc0 con 0x7f741415e420 2024-04-14T23:35:29.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.967+0000 7f741c3e0640 1 -- 172.21.15.47:0/853758090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f741415e420 msgr2=0x7f74140d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.967+0000 7f741c3e0640 1 --2- 172.21.15.47:0/853758090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f741415e420 0x7f74140d0980 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f740c0097a0 tx=0x7f740c02b820 comp rx=0 tx=0).stop 2024-04-14T23:35:29.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.967+0000 7f741c3e0640 1 -- 172.21.15.47:0/853758090 shutdown_connections 2024-04-14T23:35:29.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.967+0000 7f741c3e0640 1 --2- 172.21.15.47:0/853758090 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74140ce4b0 0x7f74140ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.967+0000 7f741c3e0640 1 --2- 172.21.15.47:0/853758090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f741415e420 0x7f74140d0980 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.967+0000 7f741c3e0640 1 -- 172.21.15.47:0/853758090 >> 172.21.15.47:0/853758090 conn(0x7f74140d1c30 msgr2=0x7f74140d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:29.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.967+0000 7f741c3e0640 1 -- 172.21.15.47:0/853758090 shutdown_connections 2024-04-14T23:35:29.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.967+0000 7f741c3e0640 1 -- 172.21.15.47:0/853758090 wait complete. 2024-04-14T23:35:29.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.968+0000 7f741c3e0640 1 Processor -- start 2024-04-14T23:35:29.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.968+0000 7f741c3e0640 1 -- start start 2024-04-14T23:35:29.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741c3e0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74140ce4b0 0x7f7414161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741c3e0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74140cee50 0x7f74141491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741c3e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741415e420 0x7f74140cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741c3e0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f741415e800 con 0x7f741415e420 2024-04-14T23:35:29.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741c3e0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f74140cc7b0 con 0x7f74140ce4b0 2024-04-14T23:35:29.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741c3e0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f74140cdce0 con 0x7f74140cee50 2024-04-14T23:35:29.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741a97d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741415e420 0x7f74140cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741a97d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741415e420 0x7f74140cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43782/0 (socket says 172.21.15.47:43782) 2024-04-14T23:35:29.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741a97d640 1 -- 172.21.15.47:0/3650545611 learned_addr learned my addr 172.21.15.47:0/3650545611 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:29.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741a17c640 1 --2- 172.21.15.47:0/3650545611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74140ce4b0 0x7f7414161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741997b640 1 --2- 172.21.15.47:0/3650545611 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74140cee50 0x7f74141491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741a97d640 1 -- 172.21.15.47:0/3650545611 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74140cee50 msgr2=0x7f74141491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741a97d640 1 --2- 172.21.15.47:0/3650545611 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74140cee50 0x7f74141491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741a97d640 1 -- 172.21.15.47:0/3650545611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74140ce4b0 msgr2=0x7f7414161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:29.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741a97d640 1 --2- 172.21.15.47:0/3650545611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74140ce4b0 0x7f7414161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:29.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741a97d640 1 -- 172.21.15.47:0/3650545611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74140ca880 con 0x7f741415e420 2024-04-14T23:35:29.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741a97d640 1 --2- 172.21.15.47:0/3650545611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741415e420 0x7f74140cb640 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7404001a90 tx=0x7f740400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:29.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f7412ffd640 1 -- 172.21.15.47:0/3650545611 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7404012400 con 0x7f741415e420 2024-04-14T23:35:29.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f7412ffd640 1 -- 172.21.15.47:0/3650545611 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74040125c0 con 0x7f741415e420 2024-04-14T23:35:29.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741c3e0640 1 -- 172.21.15.47:0/3650545611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74140cab60 con 0x7f741415e420 2024-04-14T23:35:29.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f7412ffd640 1 -- 172.21.15.47:0/3650545611 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74040129b0 con 0x7f741415e420 2024-04-14T23:35:29.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.969+0000 7f741c3e0640 1 -- 172.21.15.47:0/3650545611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74140ca530 con 0x7f741415e420 2024-04-14T23:35:29.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.970+0000 7f741c3e0640 1 -- 172.21.15.47:0/3650545611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7414067a40 con 0x7f741415e420 2024-04-14T23:35:29.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.971+0000 7f7412ffd640 1 -- 172.21.15.47:0/3650545611 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f7404012b50 con 0x7f741415e420 2024-04-14T23:35:29.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.971+0000 7f7412ffd640 1 --2- 172.21.15.47:0/3650545611 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f740006b990 0x7f740006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:29.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.972+0000 7f7412ffd640 1 -- 172.21.15.47:0/3650545611 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f740408b470 con 0x7f741415e420 2024-04-14T23:35:29.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.972+0000 7f741a17c640 1 --2- 172.21.15.47:0/3650545611 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f740006b990 0x7f740006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:29.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.972+0000 7f741a17c640 1 --2- 172.21.15.47:0/3650545611 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f740006b990 0x7f740006de50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f740c035000 tx=0x7f740c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:29.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:29.976+0000 7f7412ffd640 1 -- 172.21.15.47:0/3650545611 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7414067a40 con 0x7f741415e420 2024-04-14T23:35:30.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.158+0000 7f741c3e0640 1 -- 172.21.15.47:0/3650545611 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f741415cf50 con 0x7f741415e420 2024-04-14T23:35:30.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.159+0000 7f7412ffd640 1 -- 172.21.15.47:0/3650545611 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18892 (secure 0 0 0) 0x7f741415cf50 con 0x7f741415e420 2024-04-14T23:35:30.163 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:30.163 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:35:19.819811+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:30.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.161+0000 7f741c3e0640 1 -- 172.21.15.47:0/3650545611 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f740006b990 msgr2=0x7f740006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.161+0000 7f741c3e0640 1 --2- 172.21.15.47:0/3650545611 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f740006b990 0x7f740006de50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f740c035000 tx=0x7f740c008030 comp rx=0 tx=0).stop 2024-04-14T23:35:30.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.161+0000 7f741c3e0640 1 -- 172.21.15.47:0/3650545611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741415e420 msgr2=0x7f74140cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.161+0000 7f741c3e0640 1 --2- 172.21.15.47:0/3650545611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741415e420 0x7f74140cb640 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7404001a90 tx=0x7f740400a430 comp rx=0 tx=0).stop 2024-04-14T23:35:30.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.161+0000 7f741c3e0640 1 -- 172.21.15.47:0/3650545611 shutdown_connections 2024-04-14T23:35:30.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.161+0000 7f741c3e0640 1 --2- 172.21.15.47:0/3650545611 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f740006b990 0x7f740006de50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.161+0000 7f741c3e0640 1 --2- 172.21.15.47:0/3650545611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f741415e420 0x7f74140cb640 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.161+0000 7f741c3e0640 1 --2- 172.21.15.47:0/3650545611 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74140cee50 0x7f74141491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.161+0000 7f741c3e0640 1 --2- 172.21.15.47:0/3650545611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74140ce4b0 0x7f7414161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.161+0000 7f741c3e0640 1 -- 172.21.15.47:0/3650545611 >> 172.21.15.47:0/3650545611 conn(0x7f74140d1c30 msgr2=0x7f74140b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:30.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.161+0000 7f741c3e0640 1 -- 172.21.15.47:0/3650545611 shutdown_connections 2024-04-14T23:35:30.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.161+0000 7f741c3e0640 1 -- 172.21.15.47:0/3650545611 wait complete. 2024-04-14T23:35:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T23:34:36.382034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T23:34:37.023103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T23:34:40.726418+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T23:35:30.176 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:35:30.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.276+0000 7fcf777c4640 1 Processor -- start 2024-04-14T23:35:30.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.276+0000 7fcf777c4640 1 -- start start 2024-04-14T23:35:30.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.277+0000 7fcf777c4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf70161870 0x7fcf700ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.277+0000 7fcf777c4640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fcf700cf760 0x7fcf700c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.277+0000 7fcf777c4640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf700b5590 con 0x7fcf700b4e30 2024-04-14T23:35:30.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.277+0000 7fcf777c4640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fcf700cff40 con 0x7fcf700cf760 2024-04-14T23:35:30.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.277+0000 7fcf777c4640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fcf700b52b0 con 0x7fcf70161870 2024-04-14T23:35:30.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.277+0000 7fcf74d5f640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fcf700b4e30 0x7fcf700cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54498/0 (socket says 172.21.15.47:54498) 2024-04-14T23:35:30.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.277+0000 7fcf74d5f640 1 -- 172.21.15.47:0/3070555357 learned_addr learned my addr 172.21.15.47:0/3070555357 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:30.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf75560640 1 --2- 172.21.15.47:0/3070555357 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf70161870 0x7fcf700ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf75d61640 1 --2- 172.21.15.47:0/3070555357 >> v2:172.21.15.191:3300/0 conn(0x7fcf700cf760 0x7fcf700c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf6ffff640 1 -- 172.21.15.47:0/3070555357 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1727795634 0 0) 0x7fcf700b5590 con 0x7fcf700b4e30 2024-04-14T23:35:30.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf6ffff640 1 -- 172.21.15.47:0/3070555357 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf58003520 con 0x7fcf700b4e30 2024-04-14T23:35:30.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf6ffff640 1 -- 172.21.15.47:0/3070555357 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4014746484 0 0) 0x7fcf58003520 con 0x7fcf700b4e30 2024-04-14T23:35:30.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf6ffff640 1 -- 172.21.15.47:0/3070555357 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf70161870 msgr2=0x7fcf700ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:30.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf6ffff640 1 --2- 172.21.15.47:0/3070555357 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf70161870 0x7fcf700ceb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf6ffff640 1 -- 172.21.15.47:0/3070555357 >> v2:172.21.15.191:3300/0 conn(0x7fcf700cf760 msgr2=0x7fcf700c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:30.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf6ffff640 1 --2- 172.21.15.47:0/3070555357 >> v2:172.21.15.191:3300/0 conn(0x7fcf700cf760 0x7fcf700c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf6ffff640 1 -- 172.21.15.47:0/3070555357 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf700d2680 con 0x7fcf700b4e30 2024-04-14T23:35:30.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf6ffff640 1 -- 172.21.15.47:0/3070555357 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7fcf64001670 con 0x7fcf700b4e30 2024-04-14T23:35:30.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf6ffff640 1 -- 172.21.15.47:0/3070555357 >> v1:172.21.15.47:6789/0 conn(0x7fcf700b4e30 legacy=0x7fcf700cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf6ffff640 1 --2- 172.21.15.47:0/3070555357 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf580039b0 0x7fcf58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf6ffff640 1 --2- 172.21.15.47:0/3070555357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf58004800 0x7fcf58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf6ffff640 1 --2- 172.21.15.47:0/3070555357 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf70161870 0x7fcf580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf6ffff640 1 -- 172.21.15.47:0/3070555357 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcf700cff40 con 0x7fcf58004800 2024-04-14T23:35:30.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf6ffff640 1 -- 172.21.15.47:0/3070555357 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcf700b52b0 con 0x7fcf580039b0 2024-04-14T23:35:30.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf6ffff640 1 -- 172.21.15.47:0/3070555357 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5800b9c0 con 0x7fcf70161870 2024-04-14T23:35:30.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf75d61640 1 --2- 172.21.15.47:0/3070555357 >> v2:172.21.15.191:3300/0 conn(0x7fcf700cf760 0x7fcf700c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:30.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf74d5f640 1 --2- 172.21.15.47:0/3070555357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf58004800 0x7fcf58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf75560640 1 --2- 172.21.15.47:0/3070555357 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf580039b0 0x7fcf58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf75d61640 1 --2- 172.21.15.47:0/3070555357 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf70161870 0x7fcf580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf74d5f640 1 -- 172.21.15.47:0/3070555357 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf70161870 msgr2=0x7fcf580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:30.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf74d5f640 1 --2- 172.21.15.47:0/3070555357 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf70161870 0x7fcf580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf74d5f640 1 -- 172.21.15.47:0/3070555357 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf580039b0 msgr2=0x7fcf58003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:30.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf74d5f640 1 --2- 172.21.15.47:0/3070555357 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf580039b0 0x7fcf58003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.278+0000 7fcf74d5f640 1 -- 172.21.15.47:0/3070555357 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf58003520 con 0x7fcf58004800 2024-04-14T23:35:30.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.279+0000 7fcf74d5f640 1 --2- 172.21.15.47:0/3070555357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf58004800 0x7fcf58004c80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400c240 tx=0x7fcf58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a74ade57ab86a48 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:30.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.279+0000 7fcf6ffff640 1 -- 172.21.15.47:0/3070555357 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64007d50 con 0x7fcf58004800 2024-04-14T23:35:30.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.279+0000 7fcf6ffff640 1 -- 172.21.15.47:0/3070555357 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf64030070 con 0x7fcf58004800 2024-04-14T23:35:30.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.279+0000 7fcf6ffff640 1 -- 172.21.15.47:0/3070555357 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6402cd80 con 0x7fcf58004800 2024-04-14T23:35:30.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.280+0000 7fcf777c4640 1 -- 172.21.15.47:0/3070555357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf58004800 msgr2=0x7fcf58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.280+0000 7fcf777c4640 1 --2- 172.21.15.47:0/3070555357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf58004800 0x7fcf58004c80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400c240 tx=0x7fcf58005830 comp rx=0 tx=0).stop 2024-04-14T23:35:30.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.280+0000 7fcf75d61640 1 -- 172.21.15.47:0/3070555357 reap_dead start 2024-04-14T23:35:30.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.280+0000 7fcf777c4640 1 -- 172.21.15.47:0/3070555357 shutdown_connections 2024-04-14T23:35:30.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.280+0000 7fcf777c4640 1 -- 172.21.15.47:0/3070555357 >> 172.21.15.47:0/3070555357 conn(0x7fcf700d3f70 msgr2=0x7fcf700d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:30.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.280+0000 7fcf777c4640 1 -- 172.21.15.47:0/3070555357 shutdown_connections 2024-04-14T23:35:30.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.280+0000 7fcf777c4640 1 -- 172.21.15.47:0/3070555357 wait complete. 2024-04-14T23:35:30.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.281+0000 7fcf777c4640 1 Processor -- start 2024-04-14T23:35:30.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.281+0000 7fcf777c4640 1 -- start start 2024-04-14T23:35:30.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf777c4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf58004800 0x7fcf701587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf777c4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf700b8f60 0x7fcf700d4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf777c4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf700b93c0 0x7fcf700d4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf777c4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcf700d18e0 con 0x7fcf58004800 2024-04-14T23:35:30.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf777c4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcf700d2c40 con 0x7fcf700b8f60 2024-04-14T23:35:30.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf777c4640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fcf70161c50 con 0x7fcf700b93c0 2024-04-14T23:35:30.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf75560640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf58004800 0x7fcf701587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf75560640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf58004800 0x7fcf701587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43806/0 (socket says 172.21.15.47:43806) 2024-04-14T23:35:30.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf75560640 1 -- 172.21.15.47:0/2168072459 learned_addr learned my addr 172.21.15.47:0/2168072459 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:30.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf75d61640 1 --2- 172.21.15.47:0/2168072459 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf700b93c0 0x7fcf700d4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf74d5f640 1 --2- 172.21.15.47:0/2168072459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf700b8f60 0x7fcf700d4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf75560640 1 -- 172.21.15.47:0/2168072459 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf700b93c0 msgr2=0x7fcf700d4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf75560640 1 --2- 172.21.15.47:0/2168072459 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf700b93c0 0x7fcf700d4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf75560640 1 -- 172.21.15.47:0/2168072459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf700b8f60 msgr2=0x7fcf700d4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf75560640 1 --2- 172.21.15.47:0/2168072459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf700b8f60 0x7fcf700d4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf75560640 1 -- 172.21.15.47:0/2168072459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf701f4fe0 con 0x7fcf58004800 2024-04-14T23:35:30.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.282+0000 7fcf75560640 1 --2- 172.21.15.47:0/2168072459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf58004800 0x7fcf701587c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcf68011910 tx=0x7fcf68011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:30.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.283+0000 7fcf6dffb640 1 -- 172.21.15.47:0/2168072459 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6800fa30 con 0x7fcf58004800 2024-04-14T23:35:30.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.283+0000 7fcf6dffb640 1 -- 172.21.15.47:0/2168072459 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6800fbd0 con 0x7fcf58004800 2024-04-14T23:35:30.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.283+0000 7fcf777c4640 1 -- 172.21.15.47:0/2168072459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf701f52c0 con 0x7fcf58004800 2024-04-14T23:35:30.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.283+0000 7fcf6dffb640 1 -- 172.21.15.47:0/2168072459 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf68014440 con 0x7fcf58004800 2024-04-14T23:35:30.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.283+0000 7fcf777c4640 1 -- 172.21.15.47:0/2168072459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf701f5880 con 0x7fcf58004800 2024-04-14T23:35:30.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.284+0000 7fcf777c4640 1 -- 172.21.15.47:0/2168072459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf70073f50 con 0x7fcf58004800 2024-04-14T23:35:30.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.284+0000 7fcf6dffb640 1 -- 172.21.15.47:0/2168072459 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fcf68012040 con 0x7fcf58004800 2024-04-14T23:35:30.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.284+0000 7fcf6dffb640 1 --2- 172.21.15.47:0/2168072459 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fcf5c06b990 0x7fcf5c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.285+0000 7fcf6dffb640 1 -- 172.21.15.47:0/2168072459 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fcf6808b140 con 0x7fcf58004800 2024-04-14T23:35:30.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.285+0000 7fcf74d5f640 1 --2- 172.21.15.47:0/2168072459 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fcf5c06b990 0x7fcf5c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.285+0000 7fcf74d5f640 1 --2- 172.21.15.47:0/2168072459 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fcf5c06b990 0x7fcf5c06de50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcf64034000 tx=0x7fcf64007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:30.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.289+0000 7fcf6dffb640 1 -- 172.21.15.47:0/2168072459 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fcf68019030 con 0x7fcf58004800 2024-04-14T23:35:30.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.469+0000 7fcf777c4640 1 -- 172.21.15.47:0/2168072459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcf7015fa10 con 0x7fcf58004800 2024-04-14T23:35:30.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.469+0000 7fcf6dffb640 1 -- 172.21.15.47:0/2168072459 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fcf68059300 con 0x7fcf58004800 2024-04-14T23:35:30.472 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:35:30.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.471+0000 7fcf777c4640 1 -- 172.21.15.47:0/2168072459 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fcf5c06b990 msgr2=0x7fcf5c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.471+0000 7fcf777c4640 1 --2- 172.21.15.47:0/2168072459 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fcf5c06b990 0x7fcf5c06de50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcf64034000 tx=0x7fcf64007000 comp rx=0 tx=0).stop 2024-04-14T23:35:30.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.471+0000 7fcf777c4640 1 -- 172.21.15.47:0/2168072459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf58004800 msgr2=0x7fcf701587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.471+0000 7fcf777c4640 1 --2- 172.21.15.47:0/2168072459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf58004800 0x7fcf701587c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcf68011910 tx=0x7fcf68011d10 comp rx=0 tx=0).stop 2024-04-14T23:35:30.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.471+0000 7fcf777c4640 1 -- 172.21.15.47:0/2168072459 shutdown_connections 2024-04-14T23:35:30.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.471+0000 7fcf777c4640 1 --2- 172.21.15.47:0/2168072459 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fcf5c06b990 0x7fcf5c06de50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.471+0000 7fcf777c4640 1 --2- 172.21.15.47:0/2168072459 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf700b93c0 0x7fcf700d4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.471+0000 7fcf777c4640 1 --2- 172.21.15.47:0/2168072459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf700b8f60 0x7fcf700d4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.471+0000 7fcf777c4640 1 --2- 172.21.15.47:0/2168072459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf58004800 0x7fcf701587c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.471+0000 7fcf777c4640 1 -- 172.21.15.47:0/2168072459 >> 172.21.15.47:0/2168072459 conn(0x7fcf700d3f70 msgr2=0x7fcf700cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:30.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.471+0000 7fcf777c4640 1 -- 172.21.15.47:0/2168072459 shutdown_connections 2024-04-14T23:35:30.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.471+0000 7fcf777c4640 1 -- 172.21.15.47:0/2168072459 wait complete. 2024-04-14T23:35:30.485 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T23:35:30.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.585+0000 7fe69891e640 1 Processor -- start 2024-04-14T23:35:30.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.585+0000 7fe69891e640 1 -- start start 2024-04-14T23:35:30.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.586+0000 7fe69891e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6940d03b0 0x7fe6940d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.586+0000 7fe69891e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe694072400 con 0x7fe6940cebc0 2024-04-14T23:35:30.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.586+0000 7fe69891e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6941568f0 con 0x7fe69406f250 2024-04-14T23:35:30.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.586+0000 7fe69891e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe6940d0cd0 con 0x7fe6940d03b0 2024-04-14T23:35:30.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.586+0000 7fe691d9b640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe6940cebc0 0x7fe69406eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54508/0 (socket says 172.21.15.47:54508) 2024-04-14T23:35:30.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.586+0000 7fe691d9b640 1 -- 172.21.15.47:0/3077211292 learned_addr learned my addr 172.21.15.47:0/3077211292 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:30.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.586+0000 7fe69259c640 1 --2- 172.21.15.47:0/3077211292 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6940d03b0 0x7fe6940d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.586+0000 7fe69159a640 1 -- 172.21.15.47:0/3077211292 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603301793 0 0) 0x7fe694072400 con 0x7fe6940cebc0 2024-04-14T23:35:30.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.587+0000 7fe69159a640 1 -- 172.21.15.47:0/3077211292 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe680003520 con 0x7fe6940cebc0 2024-04-14T23:35:30.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.587+0000 7fe69159a640 1 -- 172.21.15.47:0/3077211292 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1125294543 0 0) 0x7fe6941568f0 con 0x7fe69406f250 2024-04-14T23:35:30.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.587+0000 7fe69159a640 1 -- 172.21.15.47:0/3077211292 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe694072400 con 0x7fe69406f250 2024-04-14T23:35:30.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.587+0000 7fe69159a640 1 -- 172.21.15.47:0/3077211292 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 710002479 0 0) 0x7fe680003520 con 0x7fe6940cebc0 2024-04-14T23:35:30.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.587+0000 7fe69259c640 1 -- 172.21.15.47:0/3077211292 >> v1:172.21.15.191:6789/0 conn(0x7fe69406f250 legacy=0x7fe69415fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.587+0000 7fe69259c640 1 -- 172.21.15.47:0/3077211292 >> v1:172.21.15.47:6789/0 conn(0x7fe6940cebc0 legacy=0x7fe69406eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.587+0000 7fe69259c640 1 -- 172.21.15.47:0/3077211292 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69415c550 con 0x7fe6940d03b0 2024-04-14T23:35:30.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.588+0000 7fe69259c640 1 --2- 172.21.15.47:0/3077211292 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6940d03b0 0x7fe6940d0790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009800 tx=0x7fe68c02b7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90677a1e31690656 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:30.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.588+0000 7fe69159a640 1 -- 172.21.15.47:0/3077211292 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c039070 con 0x7fe6940d03b0 2024-04-14T23:35:30.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.588+0000 7fe69159a640 1 -- 172.21.15.47:0/3077211292 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe68c030070 con 0x7fe6940d03b0 2024-04-14T23:35:30.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.588+0000 7fe69159a640 1 -- 172.21.15.47:0/3077211292 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c001670 con 0x7fe6940d03b0 2024-04-14T23:35:30.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.588+0000 7fe69891e640 1 -- 172.21.15.47:0/3077211292 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6940d03b0 msgr2=0x7fe6940d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.588+0000 7fe69891e640 1 --2- 172.21.15.47:0/3077211292 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6940d03b0 0x7fe6940d0790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009800 tx=0x7fe68c02b7f0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.588+0000 7fe69891e640 1 -- 172.21.15.47:0/3077211292 shutdown_connections 2024-04-14T23:35:30.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.588+0000 7fe69891e640 1 --2- 172.21.15.47:0/3077211292 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6940d03b0 0x7fe6940d0790 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.588+0000 7fe69891e640 1 -- 172.21.15.47:0/3077211292 >> 172.21.15.47:0/3077211292 conn(0x7fe69406b200 msgr2=0x7fe69406b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:30.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.588+0000 7fe69891e640 1 -- 172.21.15.47:0/3077211292 shutdown_connections 2024-04-14T23:35:30.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.588+0000 7fe69891e640 1 -- 172.21.15.47:0/3077211292 wait complete. 2024-04-14T23:35:30.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.590+0000 7fe69891e640 1 Processor -- start 2024-04-14T23:35:30.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.590+0000 7fe69891e640 1 -- start start 2024-04-14T23:35:30.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.590+0000 7fe69891e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe69406f250 0x7fe6941570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.590+0000 7fe69891e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6940cebc0 0x7fe6940b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.590+0000 7fe69891e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6940d03b0 0x7fe6941f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.590+0000 7fe69891e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe69415cdf0 con 0x7fe6940cebc0 2024-04-14T23:35:30.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.590+0000 7fe69891e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe69415cb10 con 0x7fe6940d03b0 2024-04-14T23:35:30.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.590+0000 7fe69891e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe694160140 con 0x7fe69406f250 2024-04-14T23:35:30.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.591+0000 7fe691d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6940cebc0 0x7fe6940b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.591+0000 7fe691d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6940cebc0 0x7fe6940b2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43820/0 (socket says 172.21.15.47:43820) 2024-04-14T23:35:30.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.591+0000 7fe691d9b640 1 -- 172.21.15.47:0/997757891 learned_addr learned my addr 172.21.15.47:0/997757891 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:30.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.591+0000 7fe69259c640 1 --2- 172.21.15.47:0/997757891 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe69406f250 0x7fe6941570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.591+0000 7fe692d9d640 1 --2- 172.21.15.47:0/997757891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6940d03b0 0x7fe6941f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.591+0000 7fe691d9b640 1 -- 172.21.15.47:0/997757891 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe69406f250 msgr2=0x7fe6941570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.591+0000 7fe691d9b640 1 --2- 172.21.15.47:0/997757891 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe69406f250 0x7fe6941570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.591+0000 7fe691d9b640 1 -- 172.21.15.47:0/997757891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6940d03b0 msgr2=0x7fe6941f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.591+0000 7fe691d9b640 1 --2- 172.21.15.47:0/997757891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6940d03b0 0x7fe6941f4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.591+0000 7fe691d9b640 1 -- 172.21.15.47:0/997757891 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69415e560 con 0x7fe6940cebc0 2024-04-14T23:35:30.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.591+0000 7fe691d9b640 1 --2- 172.21.15.47:0/997757891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6940cebc0 0x7fe6940b2420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00c780 tx=0x7fe67c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:30.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.591+0000 7fe68affd640 1 -- 172.21.15.47:0/997757891 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c017070 con 0x7fe6940cebc0 2024-04-14T23:35:30.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.591+0000 7fe68affd640 1 -- 172.21.15.47:0/997757891 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67c005af0 con 0x7fe6940cebc0 2024-04-14T23:35:30.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.591+0000 7fe68affd640 1 -- 172.21.15.47:0/997757891 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c007070 con 0x7fe6940cebc0 2024-04-14T23:35:30.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.591+0000 7fe69891e640 1 -- 172.21.15.47:0/997757891 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe69415e840 con 0x7fe6940cebc0 2024-04-14T23:35:30.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.591+0000 7fe69891e640 1 -- 172.21.15.47:0/997757891 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe69415ee00 con 0x7fe6940cebc0 2024-04-14T23:35:30.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.592+0000 7fe69891e640 1 -- 172.21.15.47:0/997757891 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe694073f50 con 0x7fe6940cebc0 2024-04-14T23:35:30.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.593+0000 7fe68affd640 1 -- 172.21.15.47:0/997757891 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe67c01a070 con 0x7fe6940cebc0 2024-04-14T23:35:30.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.593+0000 7fe68affd640 1 --2- 172.21.15.47:0/997757891 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe67406b990 0x7fe67406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.593+0000 7fe68affd640 1 -- 172.21.15.47:0/997757891 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe67c08a190 con 0x7fe6940cebc0 2024-04-14T23:35:30.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.593+0000 7fe69259c640 1 --2- 172.21.15.47:0/997757891 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe67406b990 0x7fe67406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.594+0000 7fe69259c640 1 --2- 172.21.15.47:0/997757891 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe67406b990 0x7fe67406de50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe68c036000 tx=0x7fe68c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:30.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.597+0000 7fe68affd640 1 -- 172.21.15.47:0/997757891 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe67c058350 con 0x7fe6940cebc0 2024-04-14T23:35:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.782+0000 7fe69891e640 1 -- 172.21.15.47:0/997757891 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe694074860 con 0x7fe6940cebc0 2024-04-14T23:35:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.782+0000 7fe68affd640 1 -- 172.21.15.47:0/997757891 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fe67c05c3f0 con 0x7fe6940cebc0 2024-04-14T23:35:30.786 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:30.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.785+0000 7fe69891e640 1 -- 172.21.15.47:0/997757891 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe67406b990 msgr2=0x7fe67406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.785+0000 7fe69891e640 1 --2- 172.21.15.47:0/997757891 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe67406b990 0x7fe67406de50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe68c036000 tx=0x7fe68c008030 comp rx=0 tx=0).stop 2024-04-14T23:35:30.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.785+0000 7fe69891e640 1 -- 172.21.15.47:0/997757891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6940cebc0 msgr2=0x7fe6940b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.785+0000 7fe69891e640 1 --2- 172.21.15.47:0/997757891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6940cebc0 0x7fe6940b2420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00c780 tx=0x7fe67c00cc40 comp rx=0 tx=0).stop 2024-04-14T23:35:30.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.785+0000 7fe69891e640 1 -- 172.21.15.47:0/997757891 shutdown_connections 2024-04-14T23:35:30.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.785+0000 7fe69891e640 1 --2- 172.21.15.47:0/997757891 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe67406b990 0x7fe67406de50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.785+0000 7fe69891e640 1 --2- 172.21.15.47:0/997757891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6940d03b0 0x7fe6941f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.785+0000 7fe69891e640 1 --2- 172.21.15.47:0/997757891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe6940cebc0 0x7fe6940b2420 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.785+0000 7fe69891e640 1 --2- 172.21.15.47:0/997757891 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe69406f250 0x7fe6941570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.785+0000 7fe69891e640 1 -- 172.21.15.47:0/997757891 >> 172.21.15.47:0/997757891 conn(0x7fe69406b200 msgr2=0x7fe6941551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:30.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.785+0000 7fe69891e640 1 -- 172.21.15.47:0/997757891 shutdown_connections 2024-04-14T23:35:30.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.785+0000 7fe69891e640 1 -- 172.21.15.47:0/997757891 wait complete. 2024-04-14T23:35:30.799 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T23:35:30.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.900+0000 7fb52d02d640 1 Processor -- start 2024-04-14T23:35:30.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.900+0000 7fb52d02d640 1 -- start start 2024-04-14T23:35:30.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.901+0000 7fb52d02d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5280cbe90 0x7fb5280b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.901+0000 7fb52d02d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb5280b1590 0x7fb5280afe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.901+0000 7fb52d02d640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb528160b90 con 0x7fb52815c980 2024-04-14T23:35:30.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.901+0000 7fb52d02d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb528160010 con 0x7fb5280b1590 2024-04-14T23:35:30.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.901+0000 7fb52d02d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb5281602f0 con 0x7fb5280cbe90 2024-04-14T23:35:30.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.901+0000 7fb52759e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb5280b1590 0x7fb5280afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.901+0000 7fb52759e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb5280b1590 0x7fb5280afe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43824/0 (socket says 172.21.15.47:43824) 2024-04-14T23:35:30.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.901+0000 7fb52759e640 1 -- 172.21.15.47:0/1949411585 learned_addr learned my addr 172.21.15.47:0/1949411585 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:30.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.901+0000 7fb52659c640 1 --2- 172.21.15.47:0/1949411585 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5280cbe90 0x7fb5280b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.901+0000 7fb52759e640 1 -- 172.21.15.47:0/1949411585 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5280cbe90 msgr2=0x7fb5280b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:30.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.901+0000 7fb52759e640 1 --2- 172.21.15.47:0/1949411585 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5280cbe90 0x7fb5280b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.901+0000 7fb52759e640 1 -- 172.21.15.47:0/1949411585 >> v1:172.21.15.191:6789/0 conn(0x7fb52815c980 legacy=0x7fb52815cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.902+0000 7fb52759e640 1 -- 172.21.15.47:0/1949411585 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5281605d0 con 0x7fb5280b1590 2024-04-14T23:35:30.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.902+0000 7fb52759e640 1 --2- 172.21.15.47:0/1949411585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5280b1590 0x7fb5280afe50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb518009e80 tx=0x7fb51802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1193660f81fcbd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:30.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.902+0000 7fb525d9b640 1 -- 172.21.15.47:0/1949411585 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51802caf0 con 0x7fb5280b1590 2024-04-14T23:35:30.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.902+0000 7fb525d9b640 1 -- 172.21.15.47:0/1949411585 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51802cc90 con 0x7fb5280b1590 2024-04-14T23:35:30.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.902+0000 7fb525d9b640 1 -- 172.21.15.47:0/1949411585 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518034610 con 0x7fb5280b1590 2024-04-14T23:35:30.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.903+0000 7fb52d02d640 1 -- 172.21.15.47:0/1949411585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5280b1590 msgr2=0x7fb5280afe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.903+0000 7fb52d02d640 1 --2- 172.21.15.47:0/1949411585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5280b1590 0x7fb5280afe50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb518009e80 tx=0x7fb51802bf50 comp rx=0 tx=0).stop 2024-04-14T23:35:30.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.903+0000 7fb52d02d640 1 -- 172.21.15.47:0/1949411585 shutdown_connections 2024-04-14T23:35:30.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.903+0000 7fb52d02d640 1 --2- 172.21.15.47:0/1949411585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5280b1590 0x7fb5280afe50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.903+0000 7fb52d02d640 1 --2- 172.21.15.47:0/1949411585 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5280cbe90 0x7fb5280b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.903+0000 7fb52d02d640 1 -- 172.21.15.47:0/1949411585 >> 172.21.15.47:0/1949411585 conn(0x7fb528072920 msgr2=0x7fb528072d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:30.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.903+0000 7fb52d02d640 1 -- 172.21.15.47:0/1949411585 shutdown_connections 2024-04-14T23:35:30.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.903+0000 7fb52d02d640 1 -- 172.21.15.47:0/1949411585 wait complete. 2024-04-14T23:35:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.904+0000 7fb52d02d640 1 Processor -- start 2024-04-14T23:35:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.905+0000 7fb52d02d640 1 -- start start 2024-04-14T23:35:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.905+0000 7fb52d02d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5280b1590 0x7fb528096540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.905+0000 7fb52d02d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5280cbe90 0x7fb5280b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.905+0000 7fb52d02d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb52815c980 0x7fb5280b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.905+0000 7fb52d02d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb528074a20 con 0x7fb52815c980 2024-04-14T23:35:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.905+0000 7fb52d02d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb52815fc90 con 0x7fb5280b1590 2024-04-14T23:35:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.905+0000 7fb52d02d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb5280c74e0 con 0x7fb5280cbe90 2024-04-14T23:35:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.905+0000 7fb52759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb52815c980 0x7fb5280b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.905+0000 7fb52759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb52815c980 0x7fb5280b5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43838/0 (socket says 172.21.15.47:43838) 2024-04-14T23:35:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.905+0000 7fb52759e640 1 -- 172.21.15.47:0/469444614 learned_addr learned my addr 172.21.15.47:0/469444614 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.906+0000 7fb52659c640 1 --2- 172.21.15.47:0/469444614 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5280cbe90 0x7fb5280b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.906+0000 7fb526d9d640 1 --2- 172.21.15.47:0/469444614 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5280b1590 0x7fb528096540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.906+0000 7fb52759e640 1 -- 172.21.15.47:0/469444614 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5280cbe90 msgr2=0x7fb5280b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.906+0000 7fb52759e640 1 --2- 172.21.15.47:0/469444614 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5280cbe90 0x7fb5280b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.906+0000 7fb52759e640 1 -- 172.21.15.47:0/469444614 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5280b1590 msgr2=0x7fb528096540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.906+0000 7fb52759e640 1 --2- 172.21.15.47:0/469444614 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5280b1590 0x7fb528096540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.906+0000 7fb52759e640 1 -- 172.21.15.47:0/469444614 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5280c77c0 con 0x7fb52815c980 2024-04-14T23:35:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.906+0000 7fb526d9d640 1 --2- 172.21.15.47:0/469444614 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5280b1590 0x7fb528096540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.906+0000 7fb52759e640 1 --2- 172.21.15.47:0/469444614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb52815c980 0x7fb5280b5b20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb518009fa0 tx=0x7fb518004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.906+0000 7fb50f7fe640 1 -- 172.21.15.47:0/469444614 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518043020 con 0x7fb52815c980 2024-04-14T23:35:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.906+0000 7fb50f7fe640 1 -- 172.21.15.47:0/469444614 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51803e450 con 0x7fb52815c980 2024-04-14T23:35:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.906+0000 7fb52d02d640 1 -- 172.21.15.47:0/469444614 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5280c7aa0 con 0x7fb52815c980 2024-04-14T23:35:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.906+0000 7fb50f7fe640 1 -- 172.21.15.47:0/469444614 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518009510 con 0x7fb52815c980 2024-04-14T23:35:30.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.906+0000 7fb52d02d640 1 -- 172.21.15.47:0/469444614 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb528096a80 con 0x7fb52815c980 2024-04-14T23:35:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.907+0000 7fb52d02d640 1 -- 172.21.15.47:0/469444614 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb528073f50 con 0x7fb52815c980 2024-04-14T23:35:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.907+0000 7fb50f7fe640 1 -- 172.21.15.47:0/469444614 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb518046020 con 0x7fb52815c980 2024-04-14T23:35:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.908+0000 7fb50f7fe640 1 --2- 172.21.15.47:0/469444614 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb51406b990 0x7fb51406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.908+0000 7fb50f7fe640 1 -- 172.21.15.47:0/469444614 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb5180ad320 con 0x7fb52815c980 2024-04-14T23:35:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.908+0000 7fb526d9d640 1 --2- 172.21.15.47:0/469444614 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb51406b990 0x7fb51406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.909+0000 7fb526d9d640 1 --2- 172.21.15.47:0/469444614 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb51406b990 0x7fb51406de50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb5200015e0 tx=0x7fb520009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:30.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:30.912+0000 7fb50f7fe640 1 -- 172.21.15.47:0/469444614 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb51804d030 con 0x7fb52815c980 2024-04-14T23:35:31.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.090+0000 7fb52d02d640 1 -- 172.21.15.47:0/469444614 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb528099e80 con 0x7fb52815c980 2024-04-14T23:35:31.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.091+0000 7fb50f7fe640 1 -- 172.21.15.47:0/469444614 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fb51807ba90 con 0x7fb52815c980 2024-04-14T23:35:31.094 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-14T23:35:31.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.093+0000 7fb52d02d640 1 -- 172.21.15.47:0/469444614 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb51406b990 msgr2=0x7fb51406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.093+0000 7fb52d02d640 1 --2- 172.21.15.47:0/469444614 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb51406b990 0x7fb51406de50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb5200015e0 tx=0x7fb520009040 comp rx=0 tx=0).stop 2024-04-14T23:35:31.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.093+0000 7fb52d02d640 1 -- 172.21.15.47:0/469444614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb52815c980 msgr2=0x7fb5280b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.093+0000 7fb52d02d640 1 --2- 172.21.15.47:0/469444614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb52815c980 0x7fb5280b5b20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb518009fa0 tx=0x7fb518004a40 comp rx=0 tx=0).stop 2024-04-14T23:35:31.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.093+0000 7fb52d02d640 1 -- 172.21.15.47:0/469444614 shutdown_connections 2024-04-14T23:35:31.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.093+0000 7fb52d02d640 1 --2- 172.21.15.47:0/469444614 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb51406b990 0x7fb51406de50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.093+0000 7fb52d02d640 1 --2- 172.21.15.47:0/469444614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb52815c980 0x7fb5280b5b20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.093+0000 7fb52d02d640 1 --2- 172.21.15.47:0/469444614 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5280cbe90 0x7fb5280b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.093+0000 7fb52d02d640 1 --2- 172.21.15.47:0/469444614 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5280b1590 0x7fb528096540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.093+0000 7fb52d02d640 1 -- 172.21.15.47:0/469444614 >> 172.21.15.47:0/469444614 conn(0x7fb528072920 msgr2=0x7fb52806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:31.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.093+0000 7fb52d02d640 1 -- 172.21.15.47:0/469444614 shutdown_connections 2024-04-14T23:35:31.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.093+0000 7fb52d02d640 1 -- 172.21.15.47:0/469444614 wait complete. 2024-04-14T23:35:31.106 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T23:35:31.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.209+0000 7f1c8cfbb640 1 Processor -- start 2024-04-14T23:35:31.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.209+0000 7f1c8cfbb640 1 -- start start 2024-04-14T23:35:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.210+0000 7f1c8cfbb640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1c881619b0 0x7f1c880d1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.210+0000 7f1c8cfbb640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c880b1c20 0x7f1c880ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.210+0000 7f1c8cfbb640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c880d4cc0 con 0x7f1c880b2c70 2024-04-14T23:35:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.210+0000 7f1c8cfbb640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f1c880d0d80 con 0x7f1c881619b0 2024-04-14T23:35:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.210+0000 7f1c8cfbb640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f1c880d2c00 con 0x7f1c880b1c20 2024-04-14T23:35:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.210+0000 7f1c8659c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1c881619b0 0x7f1c880d1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.210+0000 7f1c8659c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1c881619b0 0x7f1c880d1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43854/0 (socket says 172.21.15.47:43854) 2024-04-14T23:35:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.210+0000 7f1c8659c640 1 -- 172.21.15.47:0/3604650094 learned_addr learned my addr 172.21.15.47:0/3604650094 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.210+0000 7f1c86d9d640 1 --2- 172.21.15.47:0/3604650094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c880b1c20 0x7f1c880ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.210+0000 7f1c8659c640 1 -- 172.21.15.47:0/3604650094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c880b1c20 msgr2=0x7f1c880ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:31.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.210+0000 7f1c8659c640 1 --2- 172.21.15.47:0/3604650094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c880b1c20 0x7f1c880ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.210+0000 7f1c8659c640 1 -- 172.21.15.47:0/3604650094 >> v1:172.21.15.191:6789/0 conn(0x7f1c880b2c70 legacy=0x7f1c880d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:31.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.210+0000 7f1c8659c640 1 -- 172.21.15.47:0/3604650094 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c880d2ee0 con 0x7f1c881619b0 2024-04-14T23:35:31.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.211+0000 7f1c8659c640 1 --2- 172.21.15.47:0/3604650094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c881619b0 0x7f1c880d1e80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009e50 tx=0x7f1c7802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e578edae36987bd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:31.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.211+0000 7f1c8559a640 1 -- 172.21.15.47:0/3604650094 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7802c9e0 con 0x7f1c881619b0 2024-04-14T23:35:31.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.211+0000 7f1c8559a640 1 -- 172.21.15.47:0/3604650094 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c7802cb80 con 0x7f1c881619b0 2024-04-14T23:35:31.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.211+0000 7f1c8559a640 1 -- 172.21.15.47:0/3604650094 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c780343f0 con 0x7f1c881619b0 2024-04-14T23:35:31.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.212+0000 7f1c8cfbb640 1 -- 172.21.15.47:0/3604650094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c881619b0 msgr2=0x7f1c880d1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.212+0000 7f1c8cfbb640 1 --2- 172.21.15.47:0/3604650094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c881619b0 0x7f1c880d1e80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009e50 tx=0x7f1c7802be40 comp rx=0 tx=0).stop 2024-04-14T23:35:31.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.212+0000 7f1c8cfbb640 1 -- 172.21.15.47:0/3604650094 shutdown_connections 2024-04-14T23:35:31.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.212+0000 7f1c8cfbb640 1 --2- 172.21.15.47:0/3604650094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c880b1c20 0x7f1c880ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.212+0000 7f1c8cfbb640 1 --2- 172.21.15.47:0/3604650094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c881619b0 0x7f1c880d1e80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.212+0000 7f1c8cfbb640 1 -- 172.21.15.47:0/3604650094 >> 172.21.15.47:0/3604650094 conn(0x7f1c880d3f80 msgr2=0x7f1c880d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:31.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.212+0000 7f1c8cfbb640 1 -- 172.21.15.47:0/3604650094 shutdown_connections 2024-04-14T23:35:31.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.212+0000 7f1c8cfbb640 1 -- 172.21.15.47:0/3604650094 wait complete. 2024-04-14T23:35:31.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.213+0000 7f1c8cfbb640 1 Processor -- start 2024-04-14T23:35:31.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.213+0000 7f1c8cfbb640 1 -- start start 2024-04-14T23:35:31.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.214+0000 7f1c8cfbb640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c880b1c20 0x7f1c8815b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.214+0000 7f1c8cfbb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c880b2c70 0x7f1c880cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.214+0000 7f1c8cfbb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c881619b0 0x7f1c881f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.214+0000 7f1c8cfbb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1c880cf0d0 con 0x7f1c880b2c70 2024-04-14T23:35:31.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.214+0000 7f1c8cfbb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1c880d1320 con 0x7f1c881619b0 2024-04-14T23:35:31.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.214+0000 7f1c8cfbb640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f1c880cf250 con 0x7f1c880b1c20 2024-04-14T23:35:31.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.214+0000 7f1c85d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c880b2c70 0x7f1c880cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.214+0000 7f1c85d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c880b2c70 0x7f1c880cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43856/0 (socket says 172.21.15.47:43856) 2024-04-14T23:35:31.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.214+0000 7f1c85d9b640 1 -- 172.21.15.47:0/881350573 learned_addr learned my addr 172.21.15.47:0/881350573 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:31.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.214+0000 7f1c8659c640 1 --2- 172.21.15.47:0/881350573 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c880b1c20 0x7f1c8815b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.214+0000 7f1c86d9d640 1 --2- 172.21.15.47:0/881350573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c881619b0 0x7f1c881f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.214+0000 7f1c85d9b640 1 -- 172.21.15.47:0/881350573 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c880b1c20 msgr2=0x7f1c8815b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.214+0000 7f1c85d9b640 1 --2- 172.21.15.47:0/881350573 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c880b1c20 0x7f1c8815b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.214+0000 7f1c85d9b640 1 -- 172.21.15.47:0/881350573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c881619b0 msgr2=0x7f1c881f3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.214+0000 7f1c85d9b640 1 --2- 172.21.15.47:0/881350573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c881619b0 0x7f1c881f3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.214+0000 7f1c85d9b640 1 -- 172.21.15.47:0/881350573 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c881f4560 con 0x7f1c880b2c70 2024-04-14T23:35:31.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.215+0000 7f1c85d9b640 1 --2- 172.21.15.47:0/881350573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c880b2c70 0x7f1c880cb980 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000c400 tx=0x7f1c7000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:31.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.215+0000 7f1c7effd640 1 -- 172.21.15.47:0/881350573 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c700052d0 con 0x7f1c880b2c70 2024-04-14T23:35:31.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.215+0000 7f1c7effd640 1 -- 172.21.15.47:0/881350573 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c70005490 con 0x7f1c880b2c70 2024-04-14T23:35:31.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.215+0000 7f1c8cfbb640 1 -- 172.21.15.47:0/881350573 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c881f4840 con 0x7f1c880b2c70 2024-04-14T23:35:31.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.215+0000 7f1c7effd640 1 -- 172.21.15.47:0/881350573 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70007260 con 0x7f1c880b2c70 2024-04-14T23:35:31.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.215+0000 7f1c8cfbb640 1 -- 172.21.15.47:0/881350573 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c880cb460 con 0x7f1c880b2c70 2024-04-14T23:35:31.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.216+0000 7f1c8cfbb640 1 -- 172.21.15.47:0/881350573 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c88073f50 con 0x7f1c880b2c70 2024-04-14T23:35:31.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.216+0000 7f1c7effd640 1 -- 172.21.15.47:0/881350573 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f1c70007400 con 0x7f1c880b2c70 2024-04-14T23:35:31.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.217+0000 7f1c7effd640 1 --2- 172.21.15.47:0/881350573 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f1c6806b9c0 0x7f1c6806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.217+0000 7f1c7effd640 1 -- 172.21.15.47:0/881350573 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f1c7008a120 con 0x7f1c880b2c70 2024-04-14T23:35:31.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.217+0000 7f1c8659c640 1 --2- 172.21.15.47:0/881350573 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f1c6806b9c0 0x7f1c6806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.218+0000 7f1c8659c640 1 --2- 172.21.15.47:0/881350573 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f1c6806b9c0 0x7f1c6806de80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1c78035000 tx=0x7f1c78030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:31.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.221+0000 7f1c7effd640 1 -- 172.21.15.47:0/881350573 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1c70058920 con 0x7f1c880b2c70 2024-04-14T23:35:31.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.400+0000 7f1c8cfbb640 1 -- 172.21.15.47:0/881350573 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1c880686e0 con 0x7f1c880b2c70 2024-04-14T23:35:31.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.401+0000 7f1c7effd640 1 -- 172.21.15.47:0/881350573 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f1c70058220 con 0x7f1c880b2c70 2024-04-14T23:35:31.404 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:31.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.402+0000 7f1c8cfbb640 1 -- 172.21.15.47:0/881350573 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f1c6806b9c0 msgr2=0x7f1c6806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.402+0000 7f1c8cfbb640 1 --2- 172.21.15.47:0/881350573 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f1c6806b9c0 0x7f1c6806de80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1c78035000 tx=0x7f1c78030000 comp rx=0 tx=0).stop 2024-04-14T23:35:31.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.402+0000 7f1c8cfbb640 1 -- 172.21.15.47:0/881350573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c880b2c70 msgr2=0x7f1c880cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.402+0000 7f1c8cfbb640 1 --2- 172.21.15.47:0/881350573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c880b2c70 0x7f1c880cb980 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000c400 tx=0x7f1c7000c8c0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.403+0000 7f1c8cfbb640 1 -- 172.21.15.47:0/881350573 shutdown_connections 2024-04-14T23:35:31.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.403+0000 7f1c8cfbb640 1 --2- 172.21.15.47:0/881350573 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f1c6806b9c0 0x7f1c6806de80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.403+0000 7f1c8cfbb640 1 --2- 172.21.15.47:0/881350573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c881619b0 0x7f1c881f3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.403+0000 7f1c8cfbb640 1 --2- 172.21.15.47:0/881350573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c880b2c70 0x7f1c880cb980 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.403+0000 7f1c8cfbb640 1 --2- 172.21.15.47:0/881350573 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c880b1c20 0x7f1c8815b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.403+0000 7f1c8cfbb640 1 -- 172.21.15.47:0/881350573 >> 172.21.15.47:0/881350573 conn(0x7f1c880d3f80 msgr2=0x7f1c8806bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:31.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.403+0000 7f1c8cfbb640 1 -- 172.21.15.47:0/881350573 shutdown_connections 2024-04-14T23:35:31.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.403+0000 7f1c8cfbb640 1 -- 172.21.15.47:0/881350573 wait complete. 2024-04-14T23:35:31.416 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T23:35:31.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.516+0000 7faf2039c640 1 Processor -- start 2024-04-14T23:35:31.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.516+0000 7faf2039c640 1 -- start start 2024-04-14T23:35:31.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.517+0000 7faf2039c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7faf180d0a20 0x7faf180ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.517+0000 7faf2039c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf180cd610 con 0x7faf1815c170 2024-04-14T23:35:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.517+0000 7faf2039c640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf180cd8f0 con 0x7faf180b1bc0 2024-04-14T23:35:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.517+0000 7faf2039c640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7faf180cdeb0 con 0x7faf180d0a20 2024-04-14T23:35:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.517+0000 7faf1e138640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7faf1815c170 0x7faf180ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54510/0 (socket says 172.21.15.47:54510) 2024-04-14T23:35:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.517+0000 7faf1e138640 1 -- 172.21.15.47:0/3948730064 learned_addr learned my addr 172.21.15.47:0/3948730064 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.517+0000 7faf1d937640 1 --2- 172.21.15.47:0/3948730064 >> v2:172.21.15.191:3300/0 conn(0x7faf180d0a20 0x7faf180ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.517+0000 7faf1d136640 1 -- 172.21.15.47:0/3948730064 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 902542932 0 0) 0x7faf180cd610 con 0x7faf1815c170 2024-04-14T23:35:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.517+0000 7faf1d136640 1 -- 172.21.15.47:0/3948730064 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf00003520 con 0x7faf1815c170 2024-04-14T23:35:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d136640 1 -- 172.21.15.47:0/3948730064 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2003137269 0 0) 0x7faf00003520 con 0x7faf1815c170 2024-04-14T23:35:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d136640 1 -- 172.21.15.47:0/3948730064 >> v2:172.21.15.191:3300/0 conn(0x7faf180d0a20 msgr2=0x7faf180ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d136640 1 --2- 172.21.15.47:0/3948730064 >> v2:172.21.15.191:3300/0 conn(0x7faf180d0a20 0x7faf180ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d136640 1 -- 172.21.15.47:0/3948730064 >> v1:172.21.15.191:6789/0 conn(0x7faf180b1bc0 legacy=0x7faf180b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d136640 1 -- 172.21.15.47:0/3948730064 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf180cdbd0 con 0x7faf1815c170 2024-04-14T23:35:31.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d136640 1 -- 172.21.15.47:0/3948730064 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7faf10001670 con 0x7faf1815c170 2024-04-14T23:35:31.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d136640 1 -- 172.21.15.47:0/3948730064 >> v1:172.21.15.47:6789/0 conn(0x7faf1815c170 legacy=0x7faf180ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d136640 1 --2- 172.21.15.47:0/3948730064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf000039b0 0x7faf00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d136640 1 --2- 172.21.15.47:0/3948730064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf00004800 0x7faf00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d136640 1 --2- 172.21.15.47:0/3948730064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf000051c0 0x7faf0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d136640 1 -- 172.21.15.47:0/3948730064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faf180cdeb0 con 0x7faf00004800 2024-04-14T23:35:31.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d136640 1 -- 172.21.15.47:0/3948730064 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faf0000c160 con 0x7faf000039b0 2024-04-14T23:35:31.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d136640 1 -- 172.21.15.47:0/3948730064 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7faf0000c360 con 0x7faf000051c0 2024-04-14T23:35:31.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d937640 1 --2- 172.21.15.47:0/3948730064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf00004800 0x7faf00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1e138640 1 --2- 172.21.15.47:0/3948730064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf000039b0 0x7faf00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1e939640 1 --2- 172.21.15.47:0/3948730064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf000051c0 0x7faf0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d937640 1 -- 172.21.15.47:0/3948730064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf000051c0 msgr2=0x7faf0000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:31.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d937640 1 --2- 172.21.15.47:0/3948730064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf000051c0 0x7faf0000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d937640 1 -- 172.21.15.47:0/3948730064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf000039b0 msgr2=0x7faf00003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d937640 1 --2- 172.21.15.47:0/3948730064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf000039b0 0x7faf00003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1d937640 1 -- 172.21.15.47:0/3948730064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf00003520 con 0x7faf00004800 2024-04-14T23:35:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1e939640 1 --2- 172.21.15.47:0/3948730064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf000051c0 0x7faf0000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1e138640 1 --2- 172.21.15.47:0/3948730064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf000039b0 0x7faf00003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.518+0000 7faf1e939640 1 -- 172.21.15.47:0/3948730064 reap_dead start 2024-04-14T23:35:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.519+0000 7faf1d937640 1 --2- 172.21.15.47:0/3948730064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf00004800 0x7faf00004c80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009ac0 tx=0x7faf00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d19d6a3a266304 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.519+0000 7faf1d136640 1 -- 172.21.15.47:0/3948730064 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c039070 con 0x7faf00004800 2024-04-14T23:35:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.519+0000 7faf1d136640 1 -- 172.21.15.47:0/3948730064 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0c02c6b0 con 0x7faf00004800 2024-04-14T23:35:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.519+0000 7faf1d136640 1 -- 172.21.15.47:0/3948730064 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c009690 con 0x7faf00004800 2024-04-14T23:35:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.519+0000 7faf2039c640 1 -- 172.21.15.47:0/3948730064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf00004800 msgr2=0x7faf00004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.519+0000 7faf2039c640 1 --2- 172.21.15.47:0/3948730064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf00004800 0x7faf00004c80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009ac0 tx=0x7faf00005830 comp rx=0 tx=0).stop 2024-04-14T23:35:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.519+0000 7faf2039c640 1 -- 172.21.15.47:0/3948730064 shutdown_connections 2024-04-14T23:35:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.519+0000 7faf2039c640 1 --2- 172.21.15.47:0/3948730064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf00004800 0x7faf00004c80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.519+0000 7faf2039c640 1 -- 172.21.15.47:0/3948730064 >> 172.21.15.47:0/3948730064 conn(0x7faf180d1c30 msgr2=0x7faf180d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:31.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.520+0000 7faf2039c640 1 -- 172.21.15.47:0/3948730064 shutdown_connections 2024-04-14T23:35:31.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.520+0000 7faf2039c640 1 -- 172.21.15.47:0/3948730064 wait complete. 2024-04-14T23:35:31.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.521+0000 7faf2039c640 1 Processor -- start 2024-04-14T23:35:31.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.521+0000 7faf2039c640 1 -- start start 2024-04-14T23:35:31.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.521+0000 7faf2039c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf00004800 0x7faf18151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.521+0000 7faf2039c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf18151170 0x7faf1815f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.521+0000 7faf2039c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf180c6b80 0x7faf180c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.521+0000 7faf2039c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faf180d2a70 con 0x7faf180c6b80 2024-04-14T23:35:31.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.521+0000 7faf2039c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faf180b1730 con 0x7faf00004800 2024-04-14T23:35:31.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.521+0000 7faf2039c640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7faf180cd250 con 0x7faf18151170 2024-04-14T23:35:31.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.521+0000 7faf1e939640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf180c6b80 0x7faf180c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.521+0000 7faf1e939640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf180c6b80 0x7faf180c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43888/0 (socket says 172.21.15.47:43888) 2024-04-14T23:35:31.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.521+0000 7faf1e939640 1 -- 172.21.15.47:0/2268357675 learned_addr learned my addr 172.21.15.47:0/2268357675 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:31.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.522+0000 7faf1e138640 1 --2- 172.21.15.47:0/2268357675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf00004800 0x7faf18151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.522+0000 7faf1d937640 1 --2- 172.21.15.47:0/2268357675 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf18151170 0x7faf1815f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.522+0000 7faf1e939640 1 -- 172.21.15.47:0/2268357675 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf18151170 msgr2=0x7faf1815f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.522+0000 7faf1e939640 1 --2- 172.21.15.47:0/2268357675 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf18151170 0x7faf1815f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.522+0000 7faf1e939640 1 -- 172.21.15.47:0/2268357675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf00004800 msgr2=0x7faf18151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.522+0000 7faf1e939640 1 --2- 172.21.15.47:0/2268357675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf00004800 0x7faf18151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.522+0000 7faf1e939640 1 -- 172.21.15.47:0/2268357675 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1815f720 con 0x7faf180c6b80 2024-04-14T23:35:31.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.522+0000 7faf1e939640 1 --2- 172.21.15.47:0/2268357675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf180c6b80 0x7faf180c7000 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faf18068730 tx=0x7faf0800db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:31.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.522+0000 7faf16ffd640 1 -- 172.21.15.47:0/2268357675 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08018070 con 0x7faf180c6b80 2024-04-14T23:35:31.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.522+0000 7faf16ffd640 1 -- 172.21.15.47:0/2268357675 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf08003b90 con 0x7faf180c6b80 2024-04-14T23:35:31.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.522+0000 7faf2039c640 1 -- 172.21.15.47:0/2268357675 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf1815ce50 con 0x7faf180c6b80 2024-04-14T23:35:31.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.522+0000 7faf16ffd640 1 -- 172.21.15.47:0/2268357675 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08005070 con 0x7faf180c6b80 2024-04-14T23:35:31.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.522+0000 7faf2039c640 1 -- 172.21.15.47:0/2268357675 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf1815c890 con 0x7faf180c6b80 2024-04-14T23:35:31.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.523+0000 7faf2039c640 1 -- 172.21.15.47:0/2268357675 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf18075430 con 0x7faf180c6b80 2024-04-14T23:35:31.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.523+0000 7faf16ffd640 1 -- 172.21.15.47:0/2268357675 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7faf0801b070 con 0x7faf180c6b80 2024-04-14T23:35:31.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.524+0000 7faf16ffd640 1 --2- 172.21.15.47:0/2268357675 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7faf0406b990 0x7faf0406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.524+0000 7faf16ffd640 1 -- 172.21.15.47:0/2268357675 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7faf0808a120 con 0x7faf180c6b80 2024-04-14T23:35:31.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.524+0000 7faf1e138640 1 --2- 172.21.15.47:0/2268357675 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7faf0406b990 0x7faf0406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.525+0000 7faf1e138640 1 --2- 172.21.15.47:0/2268357675 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7faf0406b990 0x7faf0406de50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faf100017e0 tx=0x7faf10007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:31.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.528+0000 7faf16ffd640 1 -- 172.21.15.47:0/2268357675 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7faf080015b0 con 0x7faf180c6b80 2024-04-14T23:35:31.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.720+0000 7faf2039c640 1 -- 172.21.15.47:0/2268357675 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faf180af800 con 0x7faf180c6b80 2024-04-14T23:35:31.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.721+0000 7faf16ffd640 1 -- 172.21.15.47:0/2268357675 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7faf08058370 con 0x7faf180c6b80 2024-04-14T23:35:31.724 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-14T23:35:31.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.723+0000 7faf2039c640 1 -- 172.21.15.47:0/2268357675 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7faf0406b990 msgr2=0x7faf0406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.723+0000 7faf2039c640 1 --2- 172.21.15.47:0/2268357675 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7faf0406b990 0x7faf0406de50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faf100017e0 tx=0x7faf10007040 comp rx=0 tx=0).stop 2024-04-14T23:35:31.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.723+0000 7faf2039c640 1 -- 172.21.15.47:0/2268357675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf180c6b80 msgr2=0x7faf180c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.723+0000 7faf2039c640 1 --2- 172.21.15.47:0/2268357675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf180c6b80 0x7faf180c7000 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faf18068730 tx=0x7faf0800db80 comp rx=0 tx=0).stop 2024-04-14T23:35:31.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.723+0000 7faf2039c640 1 -- 172.21.15.47:0/2268357675 shutdown_connections 2024-04-14T23:35:31.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.723+0000 7faf2039c640 1 --2- 172.21.15.47:0/2268357675 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7faf0406b990 0x7faf0406de50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.723+0000 7faf2039c640 1 --2- 172.21.15.47:0/2268357675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf180c6b80 0x7faf180c7000 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.723+0000 7faf2039c640 1 --2- 172.21.15.47:0/2268357675 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf18151170 0x7faf1815f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.723+0000 7faf2039c640 1 --2- 172.21.15.47:0/2268357675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf00004800 0x7faf18151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.723+0000 7faf2039c640 1 -- 172.21.15.47:0/2268357675 >> 172.21.15.47:0/2268357675 conn(0x7faf180d1c30 msgr2=0x7faf180aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:31.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.723+0000 7faf2039c640 1 -- 172.21.15.47:0/2268357675 shutdown_connections 2024-04-14T23:35:31.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.723+0000 7faf2039c640 1 -- 172.21.15.47:0/2268357675 wait complete. 2024-04-14T23:35:31.736 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-14T23:35:31.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:31.736 DEBUG:teuthology.orchestra.run.smithi191:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-14T23:35:31.770 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2024-04-14T23:35:31.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:31.771 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-14T23:35:31.828 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-14T23:35:31.828 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T23:35:31.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.927+0000 7f6bfa599640 1 Processor -- start 2024-04-14T23:35:31.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.928+0000 7f6bfa599640 1 -- start start 2024-04-14T23:35:31.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.928+0000 7f6bfa599640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bf40d1e00 0x7f6bf40d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.928+0000 7f6bfa599640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bf40d1620 con 0x7f6bf415e270 2024-04-14T23:35:31.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.928+0000 7f6bfa599640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bf40b39d0 con 0x7f6bf40d2740 2024-04-14T23:35:31.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.928+0000 7f6bfa599640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf40d2b90 con 0x7f6bf40d1e00 2024-04-14T23:35:31.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.928+0000 7f6bf3fff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6bf415e270 0x7f6bf40d0f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54512/0 (socket says 172.21.15.47:54512) 2024-04-14T23:35:31.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.928+0000 7f6bf3fff640 1 -- 172.21.15.47:0/1265883942 learned_addr learned my addr 172.21.15.47:0/1265883942 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:31.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.929+0000 7f6bf37fe640 1 --2- 172.21.15.47:0/1265883942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bf40d1e00 0x7f6bf40d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.929+0000 7f6bf2ffd640 1 -- 172.21.15.47:0/1265883942 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 287229238 0 0) 0x7f6bf40d1620 con 0x7f6bf415e270 2024-04-14T23:35:31.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.929+0000 7f6bf2ffd640 1 -- 172.21.15.47:0/1265883942 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bdc003520 con 0x7f6bf415e270 2024-04-14T23:35:31.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.929+0000 7f6bf2ffd640 1 -- 172.21.15.47:0/1265883942 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4227635195 0 0) 0x7f6bf40b39d0 con 0x7f6bf40d2740 2024-04-14T23:35:31.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.929+0000 7f6bf2ffd640 1 -- 172.21.15.47:0/1265883942 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bf40d1620 con 0x7f6bf40d2740 2024-04-14T23:35:31.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.929+0000 7f6bf37fe640 1 -- 172.21.15.47:0/1265883942 >> v1:172.21.15.191:6789/0 conn(0x7f6bf40d2740 legacy=0x7f6bf40b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.929+0000 7f6bf2ffd640 1 -- 172.21.15.47:0/1265883942 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1764112701 0 0) 0x7f6bdc003520 con 0x7f6bf415e270 2024-04-14T23:35:31.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.929+0000 7f6bf37fe640 1 -- 172.21.15.47:0/1265883942 >> v1:172.21.15.47:6789/0 conn(0x7f6bf415e270 legacy=0x7f6bf40d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.929+0000 7f6bf37fe640 1 -- 172.21.15.47:0/1265883942 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf40b3cb0 con 0x7f6bf40d1e00 2024-04-14T23:35:31.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.930+0000 7f6bf37fe640 1 --2- 172.21.15.47:0/1265883942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bf40d1e00 0x7f6bf40d2200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6be80097d0 tx=0x7f6be802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adae471de2c7a804 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:31.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.930+0000 7f6bf2ffd640 1 -- 172.21.15.47:0/1265883942 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4001670 con 0x7f6bf40d1e00 2024-04-14T23:35:31.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.930+0000 7f6bf2ffd640 1 -- 172.21.15.47:0/1265883942 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be8037070 con 0x7f6bf40d1e00 2024-04-14T23:35:31.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.930+0000 7f6bf2ffd640 1 -- 172.21.15.47:0/1265883942 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be8031780 con 0x7f6bf40d1e00 2024-04-14T23:35:31.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.930+0000 7f6bfa599640 1 -- 172.21.15.47:0/1265883942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bf40d1e00 msgr2=0x7f6bf40d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.930+0000 7f6bfa599640 1 --2- 172.21.15.47:0/1265883942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bf40d1e00 0x7f6bf40d2200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6be80097d0 tx=0x7f6be802b8a0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.931+0000 7f6bfa599640 1 -- 172.21.15.47:0/1265883942 shutdown_connections 2024-04-14T23:35:31.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.931+0000 7f6bfa599640 1 --2- 172.21.15.47:0/1265883942 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bf40d1e00 0x7f6bf40d2200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.931+0000 7f6bfa599640 1 -- 172.21.15.47:0/1265883942 >> 172.21.15.47:0/1265883942 conn(0x7f6bf40d3ed0 msgr2=0x7f6bf40d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:31.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.931+0000 7f6bfa599640 1 -- 172.21.15.47:0/1265883942 shutdown_connections 2024-04-14T23:35:31.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.931+0000 7f6bfa599640 1 -- 172.21.15.47:0/1265883942 wait complete. 2024-04-14T23:35:31.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.932+0000 7f6bfa599640 1 Processor -- start 2024-04-14T23:35:31.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.932+0000 7f6bfa599640 1 -- start start 2024-04-14T23:35:31.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bfa599640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf40d1e00 0x7f6bf40cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bfa599640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6bf40d2740 0x7f6bf40b8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bfa599640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bf415e270 0x7f6bf41532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bfa599640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf40b0c60 con 0x7f6bf40d1e00 2024-04-14T23:35:31.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bfa599640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf40b4300 con 0x7f6bf40d2740 2024-04-14T23:35:31.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bfa599640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf415e650 con 0x7f6bf415e270 2024-04-14T23:35:31.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bf3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf40d1e00 0x7f6bf40cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bf3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf40d1e00 0x7f6bf40cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43902/0 (socket says 172.21.15.47:43902) 2024-04-14T23:35:31.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bf3fff640 1 -- 172.21.15.47:0/596902202 learned_addr learned my addr 172.21.15.47:0/596902202 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:31.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bf8b36640 1 --2- 172.21.15.47:0/596902202 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bf415e270 0x7f6bf41532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bf37fe640 1 --2- 172.21.15.47:0/596902202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6bf40d2740 0x7f6bf40b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bf3fff640 1 -- 172.21.15.47:0/596902202 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bf415e270 msgr2=0x7f6bf41532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bf3fff640 1 --2- 172.21.15.47:0/596902202 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bf415e270 0x7f6bf41532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bf3fff640 1 -- 172.21.15.47:0/596902202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6bf40d2740 msgr2=0x7f6bf40b8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:31.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bf3fff640 1 --2- 172.21.15.47:0/596902202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6bf40d2740 0x7f6bf40b8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:31.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bf3fff640 1 -- 172.21.15.47:0/596902202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf40cb580 con 0x7f6bf40d1e00 2024-04-14T23:35:31.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bf8b36640 1 --2- 172.21.15.47:0/596902202 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bf415e270 0x7f6bf41532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:31.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bf3fff640 1 --2- 172.21.15.47:0/596902202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf40d1e00 0x7f6bf40cafa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c7b0 tx=0x7f6be400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:31.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bf0ff9640 1 -- 172.21.15.47:0/596902202 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4017070 con 0x7f6bf40d1e00 2024-04-14T23:35:31.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bf0ff9640 1 -- 172.21.15.47:0/596902202 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be4005ad0 con 0x7f6bf40d1e00 2024-04-14T23:35:31.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bfa599640 1 -- 172.21.15.47:0/596902202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf40cb860 con 0x7f6bf40d1e00 2024-04-14T23:35:31.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bf0ff9640 1 -- 172.21.15.47:0/596902202 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4007070 con 0x7f6bf40d1e00 2024-04-14T23:35:31.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.933+0000 7f6bfa599640 1 -- 172.21.15.47:0/596902202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf40cbe20 con 0x7f6bf40d1e00 2024-04-14T23:35:31.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.934+0000 7f6bfa599640 1 -- 172.21.15.47:0/596902202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf4075430 con 0x7f6bf40d1e00 2024-04-14T23:35:31.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.935+0000 7f6bf0ff9640 1 -- 172.21.15.47:0/596902202 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6be401a070 con 0x7f6bf40d1e00 2024-04-14T23:35:31.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.935+0000 7f6bf0ff9640 1 --2- 172.21.15.47:0/596902202 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6be006b990 0x7f6be006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:31.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.935+0000 7f6bf0ff9640 1 -- 172.21.15.47:0/596902202 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6be408a200 con 0x7f6bf40d1e00 2024-04-14T23:35:31.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.935+0000 7f6bf37fe640 1 --2- 172.21.15.47:0/596902202 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6be006b990 0x7f6be006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:31.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.936+0000 7f6bf37fe640 1 --2- 172.21.15.47:0/596902202 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6be006b990 0x7f6be006de50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6be8036000 tx=0x7f6be8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:31.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:31.939+0000 7f6bf0ff9640 1 -- 172.21.15.47:0/596902202 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6be4058a10 con 0x7f6bf40d1e00 2024-04-14T23:35:32.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.157+0000 7f6bfa599640 1 -- 172.21.15.47:0/596902202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bf40b1080 con 0x7f6bf40d1e00 2024-04-14T23:35:32.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.157+0000 7f6bf0ff9640 1 -- 172.21.15.47:0/596902202 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f6be4058310 con 0x7f6bf40d1e00 2024-04-14T23:35:32.161 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:32.161 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/416388535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":416388535},{"type":"v1","addr":"172.21.15.191:6837","nonce":416388535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/2830978927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2830978927},{"type":"v1","addr":"172.21.15.47:6833","nonce":2830978927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/4025654680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":4025654680},{"type":"v1","addr":"172.21.15.191:6836","nonce":4025654680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T23:34:38.059644+0000","modified":"2024-04-14T23:34:54.105483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/1169029730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1169029730},{"type":"v1","addr":"172.21.15.47:6835","nonce":1169029730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-14T23:35:32.161 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-04-14T23:35:32.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.159+0000 7f6bfa599640 1 -- 172.21.15.47:0/596902202 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6be006b990 msgr2=0x7f6be006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.159+0000 7f6bfa599640 1 --2- 172.21.15.47:0/596902202 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6be006b990 0x7f6be006de50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6be8036000 tx=0x7f6be8008030 comp rx=0 tx=0).stop 2024-04-14T23:35:32.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.159+0000 7f6bfa599640 1 -- 172.21.15.47:0/596902202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf40d1e00 msgr2=0x7f6bf40cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.159+0000 7f6bfa599640 1 --2- 172.21.15.47:0/596902202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf40d1e00 0x7f6bf40cafa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c7b0 tx=0x7f6be400cc70 comp rx=0 tx=0).stop 2024-04-14T23:35:32.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.159+0000 7f6bfa599640 1 -- 172.21.15.47:0/596902202 shutdown_connections 2024-04-14T23:35:32.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.159+0000 7f6bfa599640 1 --2- 172.21.15.47:0/596902202 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6be006b990 0x7f6be006de50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.159+0000 7f6bfa599640 1 --2- 172.21.15.47:0/596902202 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6bf415e270 0x7f6bf41532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.159+0000 7f6bfa599640 1 --2- 172.21.15.47:0/596902202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6bf40d2740 0x7f6bf40b8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.159+0000 7f6bfa599640 1 --2- 172.21.15.47:0/596902202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf40d1e00 0x7f6bf40cafa0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.159+0000 7f6bfa599640 1 -- 172.21.15.47:0/596902202 >> 172.21.15.47:0/596902202 conn(0x7f6bf40d3ed0 msgr2=0x7f6bf40b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:32.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.159+0000 7f6bfa599640 1 -- 172.21.15.47:0/596902202 shutdown_connections 2024-04-14T23:35:32.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.159+0000 7f6bfa599640 1 -- 172.21.15.47:0/596902202 wait complete. 2024-04-14T23:35:32.173 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:32.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.272+0000 7fe190036640 1 Processor -- start 2024-04-14T23:35:32.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.272+0000 7fe190036640 1 -- start start 2024-04-14T23:35:32.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe190036640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe18806e340 0x7fe1880cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe190036640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe18815c370 con 0x7fe1880cff70 2024-04-14T23:35:32.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe190036640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe18815ead0 con 0x7fe18815bcc0 2024-04-14T23:35:32.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe190036640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fe18815c130 con 0x7fe18806e340 2024-04-14T23:35:32.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18d5d1640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe1880cff70 0x7fe18815b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54520/0 (socket says 172.21.15.47:54520) 2024-04-14T23:35:32.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18d5d1640 1 -- 172.21.15.47:0/482122572 learned_addr learned my addr 172.21.15.47:0/482122572 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:32.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18cdd0640 1 -- 172.21.15.47:0/482122572 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 679923935 0 0) 0x7fe18815c370 con 0x7fe1880cff70 2024-04-14T23:35:32.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18ddd2640 1 --2- 172.21.15.47:0/482122572 >> v2:172.21.15.191:3300/0 conn(0x7fe18806e340 0x7fe1880cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18cdd0640 1 -- 172.21.15.47:0/482122572 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe174005730 con 0x7fe1880cff70 2024-04-14T23:35:32.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18cdd0640 1 -- 172.21.15.47:0/482122572 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3199442573 0 0) 0x7fe174005730 con 0x7fe1880cff70 2024-04-14T23:35:32.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18cdd0640 1 -- 172.21.15.47:0/482122572 >> v2:172.21.15.191:3300/0 conn(0x7fe18806e340 msgr2=0x7fe1880cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:32.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18cdd0640 1 --2- 172.21.15.47:0/482122572 >> v2:172.21.15.191:3300/0 conn(0x7fe18806e340 0x7fe1880cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18cdd0640 1 -- 172.21.15.47:0/482122572 >> v1:172.21.15.191:6789/0 conn(0x7fe18815bcc0 legacy=0x7fe188071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18cdd0640 1 -- 172.21.15.47:0/482122572 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18815edb0 con 0x7fe1880cff70 2024-04-14T23:35:32.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18cdd0640 1 -- 172.21.15.47:0/482122572 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7fe178001670 con 0x7fe1880cff70 2024-04-14T23:35:32.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18cdd0640 1 -- 172.21.15.47:0/482122572 >> v1:172.21.15.47:6789/0 conn(0x7fe1880cff70 legacy=0x7fe18815b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18cdd0640 1 --2- 172.21.15.47:0/482122572 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe174005bc0 0x7fe174005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18cdd0640 1 --2- 172.21.15.47:0/482122572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe174006a10 0x7fe174006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18cdd0640 1 --2- 172.21.15.47:0/482122572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1740073d0 0x7fe17400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18cdd0640 1 -- 172.21.15.47:0/482122572 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe18815c130 con 0x7fe174006a10 2024-04-14T23:35:32.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18cdd0640 1 -- 172.21.15.47:0/482122572 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe17400e370 con 0x7fe1740073d0 2024-04-14T23:35:32.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.273+0000 7fe18cdd0640 1 -- 172.21.15.47:0/482122572 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe17400e570 con 0x7fe174005bc0 2024-04-14T23:35:32.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.274+0000 7fe18d5d1640 1 --2- 172.21.15.47:0/482122572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe174006a10 0x7fe174006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.274+0000 7fe18ddd2640 1 --2- 172.21.15.47:0/482122572 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe174005bc0 0x7fe174005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.274+0000 7fe18e5d3640 1 --2- 172.21.15.47:0/482122572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1740073d0 0x7fe17400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.274+0000 7fe18d5d1640 1 -- 172.21.15.47:0/482122572 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe174005bc0 msgr2=0x7fe174005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:32.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.274+0000 7fe18d5d1640 1 --2- 172.21.15.47:0/482122572 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe174005bc0 0x7fe174005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.274+0000 7fe18d5d1640 1 -- 172.21.15.47:0/482122572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1740073d0 msgr2=0x7fe17400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:32.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.274+0000 7fe18d5d1640 1 --2- 172.21.15.47:0/482122572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1740073d0 0x7fe17400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.274+0000 7fe18d5d1640 1 -- 172.21.15.47:0/482122572 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe174005730 con 0x7fe174006a10 2024-04-14T23:35:32.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.274+0000 7fe18e5d3640 1 -- 172.21.15.47:0/482122572 reap_dead start 2024-04-14T23:35:32.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.274+0000 7fe18ddd2640 1 --2- 172.21.15.47:0/482122572 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe174005bc0 0x7fe174005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:32.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.275+0000 7fe18d5d1640 1 --2- 172.21.15.47:0/482122572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe174006a10 0x7fe174006e90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c240 tx=0x7fe174007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b9c8f4cd8a8458 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:32.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.275+0000 7fe18cdd0640 1 -- 172.21.15.47:0/482122572 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178007cf0 con 0x7fe174006a10 2024-04-14T23:35:32.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.275+0000 7fe18cdd0640 1 -- 172.21.15.47:0/482122572 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe178030070 con 0x7fe174006a10 2024-04-14T23:35:32.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.275+0000 7fe18cdd0640 1 -- 172.21.15.47:0/482122572 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178005d30 con 0x7fe174006a10 2024-04-14T23:35:32.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.275+0000 7fe190036640 1 -- 172.21.15.47:0/482122572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe174006a10 msgr2=0x7fe174006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.275+0000 7fe190036640 1 --2- 172.21.15.47:0/482122572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe174006a10 0x7fe174006e90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c240 tx=0x7fe174007a40 comp rx=0 tx=0).stop 2024-04-14T23:35:32.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.275+0000 7fe190036640 1 -- 172.21.15.47:0/482122572 shutdown_connections 2024-04-14T23:35:32.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.275+0000 7fe190036640 1 --2- 172.21.15.47:0/482122572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe174006a10 0x7fe174006e90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.275+0000 7fe190036640 1 -- 172.21.15.47:0/482122572 >> 172.21.15.47:0/482122572 conn(0x7fe18806b200 msgr2=0x7fe18806b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:32.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.275+0000 7fe190036640 1 -- 172.21.15.47:0/482122572 shutdown_connections 2024-04-14T23:35:32.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.275+0000 7fe190036640 1 -- 172.21.15.47:0/482122572 wait complete. 2024-04-14T23:35:32.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.277+0000 7fe190036640 1 Processor -- start 2024-04-14T23:35:32.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.277+0000 7fe190036640 1 -- start start 2024-04-14T23:35:32.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.277+0000 7fe190036640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe174006a10 0x7fe18815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.277+0000 7fe190036640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe18815a010 0x7fe18815a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.277+0000 7fe190036640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe188153f90 0x7fe188154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.277+0000 7fe190036640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe18815f890 con 0x7fe18815a010 2024-04-14T23:35:32.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.277+0000 7fe190036640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe18806e720 con 0x7fe174006a10 2024-04-14T23:35:32.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.277+0000 7fe190036640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe1880cfa30 con 0x7fe188153f90 2024-04-14T23:35:32.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.277+0000 7fe18d5d1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe18815a010 0x7fe18815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.277+0000 7fe18d5d1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe18815a010 0x7fe18815a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43912/0 (socket says 172.21.15.47:43912) 2024-04-14T23:35:32.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.277+0000 7fe18d5d1640 1 -- 172.21.15.47:0/1284093826 learned_addr learned my addr 172.21.15.47:0/1284093826 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:32.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.277+0000 7fe18ddd2640 1 --2- 172.21.15.47:0/1284093826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe174006a10 0x7fe18815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.277+0000 7fe18e5d3640 1 --2- 172.21.15.47:0/1284093826 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe188153f90 0x7fe188154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.278+0000 7fe18d5d1640 1 -- 172.21.15.47:0/1284093826 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe188153f90 msgr2=0x7fe188154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.278+0000 7fe18d5d1640 1 --2- 172.21.15.47:0/1284093826 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe188153f90 0x7fe188154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.278+0000 7fe18d5d1640 1 -- 172.21.15.47:0/1284093826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe174006a10 msgr2=0x7fe18815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.278+0000 7fe18d5d1640 1 --2- 172.21.15.47:0/1284093826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe174006a10 0x7fe18815cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.278+0000 7fe18d5d1640 1 -- 172.21.15.47:0/1284093826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18815d110 con 0x7fe18815a010 2024-04-14T23:35:32.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.278+0000 7fe18e5d3640 1 --2- 172.21.15.47:0/1284093826 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe188153f90 0x7fe188154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:32.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.278+0000 7fe18d5d1640 1 --2- 172.21.15.47:0/1284093826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe18815a010 0x7fe18815a490 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c240 tx=0x7fe188155a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:32.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.278+0000 7fe17e7fc640 1 -- 172.21.15.47:0/1284093826 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178046070 con 0x7fe18815a010 2024-04-14T23:35:32.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.278+0000 7fe17e7fc640 1 -- 172.21.15.47:0/1284093826 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe178004bf0 con 0x7fe18815a010 2024-04-14T23:35:32.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.278+0000 7fe190036640 1 -- 172.21.15.47:0/1284093826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe188155ba0 con 0x7fe18815a010 2024-04-14T23:35:32.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.278+0000 7fe17e7fc640 1 -- 172.21.15.47:0/1284093826 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178007070 con 0x7fe18815a010 2024-04-14T23:35:32.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.278+0000 7fe190036640 1 -- 172.21.15.47:0/1284093826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe188156160 con 0x7fe18815a010 2024-04-14T23:35:32.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.279+0000 7fe190036640 1 -- 172.21.15.47:0/1284093826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe188075430 con 0x7fe18815a010 2024-04-14T23:35:32.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.279+0000 7fe17e7fc640 1 -- 172.21.15.47:0/1284093826 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe178007210 con 0x7fe18815a010 2024-04-14T23:35:32.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.280+0000 7fe17e7fc640 1 --2- 172.21.15.47:0/1284093826 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe16c06b990 0x7fe16c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.280+0000 7fe17e7fc640 1 -- 172.21.15.47:0/1284093826 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe1780ac070 con 0x7fe18815a010 2024-04-14T23:35:32.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.280+0000 7fe18ddd2640 1 --2- 172.21.15.47:0/1284093826 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe16c06b990 0x7fe16c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.281+0000 7fe18ddd2640 1 --2- 172.21.15.47:0/1284093826 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe16c06b990 0x7fe16c06de50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe1880cbde0 tx=0x7fe184008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:32.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.284+0000 7fe17e7fc640 1 -- 172.21.15.47:0/1284093826 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe17807a230 con 0x7fe18815a010 2024-04-14T23:35:32.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.468+0000 7fe190036640 1 -- 172.21.15.47:0/1284093826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe188071820 con 0x7fe18815a010 2024-04-14T23:35:32.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.470+0000 7fe17e7fc640 1 -- 172.21.15.47:0/1284093826 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18892 (secure 0 0 0) 0x7fe17807e2d0 con 0x7fe18815a010 2024-04-14T23:35:32.476 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:32.476 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:35:19.819811+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:32.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.471+0000 7fe190036640 1 -- 172.21.15.47:0/1284093826 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe16c06b990 msgr2=0x7fe16c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.471+0000 7fe190036640 1 --2- 172.21.15.47:0/1284093826 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe16c06b990 0x7fe16c06de50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe1880cbde0 tx=0x7fe184008040 comp rx=0 tx=0).stop 2024-04-14T23:35:32.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.471+0000 7fe190036640 1 -- 172.21.15.47:0/1284093826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe18815a010 msgr2=0x7fe18815a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.471+0000 7fe190036640 1 --2- 172.21.15.47:0/1284093826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe18815a010 0x7fe18815a490 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c240 tx=0x7fe188155a90 comp rx=0 tx=0).stop 2024-04-14T23:35:32.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.471+0000 7fe190036640 1 -- 172.21.15.47:0/1284093826 shutdown_connections 2024-04-14T23:35:32.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.471+0000 7fe190036640 1 --2- 172.21.15.47:0/1284093826 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe16c06b990 0x7fe16c06de50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.472+0000 7fe190036640 1 --2- 172.21.15.47:0/1284093826 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe188153f90 0x7fe188154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.472+0000 7fe190036640 1 --2- 172.21.15.47:0/1284093826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe18815a010 0x7fe18815a490 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.472+0000 7fe190036640 1 --2- 172.21.15.47:0/1284093826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe174006a10 0x7fe18815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.472+0000 7fe190036640 1 -- 172.21.15.47:0/1284093826 >> 172.21.15.47:0/1284093826 conn(0x7fe18806b200 msgr2=0x7fe188159620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:32.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.472+0000 7fe190036640 1 -- 172.21.15.47:0/1284093826 shutdown_connections 2024-04-14T23:35:32.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.472+0000 7fe190036640 1 -- 172.21.15.47:0/1284093826 wait complete. 2024-04-14T23:35:32.487 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T23:34:36.382034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T23:34:37.023103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T23:34:40.726418+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T23:35:32.488 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:35:32.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.594+0000 7fdb59676640 1 Processor -- start 2024-04-14T23:35:32.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.594+0000 7fdb59676640 1 -- start start 2024-04-14T23:35:32.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.594+0000 7fdb59676640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb540c8410 0x7fdb540ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.594+0000 7fdb59676640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdb540d0b40 0x7fdb540ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.594+0000 7fdb59676640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb540d1090 con 0x7fdb540d2820 2024-04-14T23:35:32.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.594+0000 7fdb59676640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fdb540cc3f0 con 0x7fdb540d0b40 2024-04-14T23:35:32.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.594+0000 7fdb59676640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fdb540cc6d0 con 0x7fdb540c8410 2024-04-14T23:35:32.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.595+0000 7fdb537fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fdb540d2820 0x7fdb5406c6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54532/0 (socket says 172.21.15.47:54532) 2024-04-14T23:35:32.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.595+0000 7fdb537fe640 1 -- 172.21.15.47:0/800014445 learned_addr learned my addr 172.21.15.47:0/800014445 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:32.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.595+0000 7fdb527fc640 1 --2- 172.21.15.47:0/800014445 >> v2:172.21.15.191:3300/0 conn(0x7fdb540d0b40 0x7fdb540ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.595+0000 7fdb52ffd640 1 --2- 172.21.15.47:0/800014445 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb540c8410 0x7fdb540ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.595+0000 7fdb51ffb640 1 -- 172.21.15.47:0/800014445 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 201929528 0 0) 0x7fdb540d1090 con 0x7fdb540d2820 2024-04-14T23:35:32.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.595+0000 7fdb51ffb640 1 -- 172.21.15.47:0/800014445 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb3c003520 con 0x7fdb540d2820 2024-04-14T23:35:32.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.595+0000 7fdb527fc640 1 -- 172.21.15.47:0/800014445 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb540c8410 msgr2=0x7fdb540ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:32.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.595+0000 7fdb527fc640 1 --2- 172.21.15.47:0/800014445 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb540c8410 0x7fdb540ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.595+0000 7fdb527fc640 1 -- 172.21.15.47:0/800014445 >> v1:172.21.15.47:6789/0 conn(0x7fdb540d2820 legacy=0x7fdb5406c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.595+0000 7fdb527fc640 1 -- 172.21.15.47:0/800014445 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb540cc9b0 con 0x7fdb540d0b40 2024-04-14T23:35:32.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.596+0000 7fdb527fc640 1 --2- 172.21.15.47:0/800014445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb540d0b40 0x7fdb540ceac0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdb480097a0 tx=0x7fdb4802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6e995ece7406652 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:32.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.596+0000 7fdb51ffb640 1 -- 172.21.15.47:0/800014445 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb480315a0 con 0x7fdb540d0b40 2024-04-14T23:35:32.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.596+0000 7fdb51ffb640 1 -- 172.21.15.47:0/800014445 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb48037070 con 0x7fdb540d0b40 2024-04-14T23:35:32.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.596+0000 7fdb51ffb640 1 -- 172.21.15.47:0/800014445 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48031940 con 0x7fdb540d0b40 2024-04-14T23:35:32.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.596+0000 7fdb59676640 1 -- 172.21.15.47:0/800014445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb540d0b40 msgr2=0x7fdb540ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.597+0000 7fdb59676640 1 --2- 172.21.15.47:0/800014445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb540d0b40 0x7fdb540ceac0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdb480097a0 tx=0x7fdb4802b840 comp rx=0 tx=0).stop 2024-04-14T23:35:32.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.597+0000 7fdb59676640 1 -- 172.21.15.47:0/800014445 shutdown_connections 2024-04-14T23:35:32.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.597+0000 7fdb59676640 1 --2- 172.21.15.47:0/800014445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb540d0b40 0x7fdb540ceac0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.597+0000 7fdb59676640 1 --2- 172.21.15.47:0/800014445 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb540c8410 0x7fdb540ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.597+0000 7fdb59676640 1 -- 172.21.15.47:0/800014445 >> 172.21.15.47:0/800014445 conn(0x7fdb540d1d00 msgr2=0x7fdb540d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:32.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.597+0000 7fdb59676640 1 -- 172.21.15.47:0/800014445 shutdown_connections 2024-04-14T23:35:32.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.597+0000 7fdb59676640 1 -- 172.21.15.47:0/800014445 wait complete. 2024-04-14T23:35:32.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.598+0000 7fdb59676640 1 Processor -- start 2024-04-14T23:35:32.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.598+0000 7fdb59676640 1 -- start start 2024-04-14T23:35:32.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb59676640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb540c8410 0x7fdb541e0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb59676640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb540d0b40 0x7fdb540ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb59676640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb540d2820 0x7fdb540cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb59676640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdb540cf6b0 con 0x7fdb540d2820 2024-04-14T23:35:32.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb59676640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdb540cf530 con 0x7fdb540c8410 2024-04-14T23:35:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb59676640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fdb540cdee0 con 0x7fdb540d0b40 2024-04-14T23:35:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb540d2820 0x7fdb540cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb537fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb540d2820 0x7fdb540cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43920/0 (socket says 172.21.15.47:43920) 2024-04-14T23:35:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb537fe640 1 -- 172.21.15.47:0/1448387083 learned_addr learned my addr 172.21.15.47:0/1448387083 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb52ffd640 1 --2- 172.21.15.47:0/1448387083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb540c8410 0x7fdb541e0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb537fe640 1 -- 172.21.15.47:0/1448387083 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb540d0b40 msgr2=0x7fdb540ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb537fe640 1 --2- 172.21.15.47:0/1448387083 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb540d0b40 0x7fdb540ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb537fe640 1 -- 172.21.15.47:0/1448387083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb540c8410 msgr2=0x7fdb541e0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb537fe640 1 --2- 172.21.15.47:0/1448387083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb540c8410 0x7fdb541e0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb537fe640 1 -- 172.21.15.47:0/1448387083 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb540b70b0 con 0x7fdb540d2820 2024-04-14T23:35:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb537fe640 1 --2- 172.21.15.47:0/1448387083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb540d2820 0x7fdb540cd310 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00caa0 tx=0x7fdb4c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb3b7fe640 1 -- 172.21.15.47:0/1448387083 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c017070 con 0x7fdb540d2820 2024-04-14T23:35:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb3b7fe640 1 -- 172.21.15.47:0/1448387083 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4c00ac00 con 0x7fdb540d2820 2024-04-14T23:35:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb3b7fe640 1 -- 172.21.15.47:0/1448387083 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c012400 con 0x7fdb540d2820 2024-04-14T23:35:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.599+0000 7fdb59676640 1 -- 172.21.15.47:0/1448387083 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb540b48c0 con 0x7fdb540d2820 2024-04-14T23:35:32.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.600+0000 7fdb59676640 1 -- 172.21.15.47:0/1448387083 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb540b4e80 con 0x7fdb540d2820 2024-04-14T23:35:32.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.601+0000 7fdb59676640 1 -- 172.21.15.47:0/1448387083 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb54073f50 con 0x7fdb540d2820 2024-04-14T23:35:32.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.601+0000 7fdb3b7fe640 1 -- 172.21.15.47:0/1448387083 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fdb4c01a070 con 0x7fdb540d2820 2024-04-14T23:35:32.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.601+0000 7fdb3b7fe640 1 --2- 172.21.15.47:0/1448387083 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdb4006b9c0 0x7fdb4006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.601+0000 7fdb3b7fe640 1 -- 172.21.15.47:0/1448387083 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fdb4c08aa00 con 0x7fdb540d2820 2024-04-14T23:35:32.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.602+0000 7fdb52ffd640 1 --2- 172.21.15.47:0/1448387083 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdb4006b9c0 0x7fdb4006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.602+0000 7fdb52ffd640 1 --2- 172.21.15.47:0/1448387083 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdb4006b9c0 0x7fdb4006de80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009a10 tx=0x7fdb44008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:32.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.606+0000 7fdb3b7fe640 1 -- 172.21.15.47:0/1448387083 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdb4c059210 con 0x7fdb540d2820 2024-04-14T23:35:32.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.785+0000 7fdb59676640 1 -- 172.21.15.47:0/1448387083 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdb5406cec0 con 0x7fdb540d2820 2024-04-14T23:35:32.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.785+0000 7fdb3b7fe640 1 -- 172.21.15.47:0/1448387083 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fdb4c058b10 con 0x7fdb540d2820 2024-04-14T23:35:32.789 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:35:32.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.787+0000 7fdb59676640 1 -- 172.21.15.47:0/1448387083 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdb4006b9c0 msgr2=0x7fdb4006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.787+0000 7fdb59676640 1 --2- 172.21.15.47:0/1448387083 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdb4006b9c0 0x7fdb4006de80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009a10 tx=0x7fdb44008040 comp rx=0 tx=0).stop 2024-04-14T23:35:32.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.787+0000 7fdb59676640 1 -- 172.21.15.47:0/1448387083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb540d2820 msgr2=0x7fdb540cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.787+0000 7fdb59676640 1 --2- 172.21.15.47:0/1448387083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb540d2820 0x7fdb540cd310 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00caa0 tx=0x7fdb4c00cf60 comp rx=0 tx=0).stop 2024-04-14T23:35:32.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.787+0000 7fdb59676640 1 -- 172.21.15.47:0/1448387083 shutdown_connections 2024-04-14T23:35:32.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.787+0000 7fdb59676640 1 --2- 172.21.15.47:0/1448387083 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fdb4006b9c0 0x7fdb4006de80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.787+0000 7fdb59676640 1 --2- 172.21.15.47:0/1448387083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdb540d2820 0x7fdb540cd310 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.787+0000 7fdb59676640 1 --2- 172.21.15.47:0/1448387083 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdb540d0b40 0x7fdb540ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.787+0000 7fdb59676640 1 --2- 172.21.15.47:0/1448387083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb540c8410 0x7fdb541e0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.787+0000 7fdb59676640 1 -- 172.21.15.47:0/1448387083 >> 172.21.15.47:0/1448387083 conn(0x7fdb540d1d00 msgr2=0x7fdb541e5360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:32.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.787+0000 7fdb59676640 1 -- 172.21.15.47:0/1448387083 shutdown_connections 2024-04-14T23:35:32.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.787+0000 7fdb59676640 1 -- 172.21.15.47:0/1448387083 wait complete. 2024-04-14T23:35:32.801 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T23:35:32.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.904+0000 7f5b6498c640 1 Processor -- start 2024-04-14T23:35:32.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.904+0000 7f5b6498c640 1 -- start start 2024-04-14T23:35:32.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.904+0000 7f5b6498c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5b600d2810 0x7f5b6006ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.904+0000 7f5b6498c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5b600b0e20 0x7f5b6006d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.904+0000 7f5b6498c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b600d12e0 con 0x7f5b600ce700 2024-04-14T23:35:32.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.904+0000 7f5b6498c640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5b6006c3b0 con 0x7f5b600d2810 2024-04-14T23:35:32.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.904+0000 7f5b6498c640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f5b6006f2c0 con 0x7f5b600b0e20 2024-04-14T23:35:32.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.905+0000 7f5b57fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5b600d2810 0x7f5b6006ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.905+0000 7f5b57fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5b600d2810 0x7f5b6006ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43932/0 (socket says 172.21.15.47:43932) 2024-04-14T23:35:32.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.905+0000 7f5b57fff640 1 -- 172.21.15.47:0/569091625 learned_addr learned my addr 172.21.15.47:0/569091625 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:32.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.905+0000 7f5b5e59c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5b600ce700 0x7f5b600ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54538/0 (socket says 172.21.15.47:54538) 2024-04-14T23:35:32.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.905+0000 7f5b5ed9d640 1 --2- 172.21.15.47:0/569091625 >> v2:172.21.15.191:3300/0 conn(0x7f5b600b0e20 0x7f5b6006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.905+0000 7f5b57fff640 1 -- 172.21.15.47:0/569091625 >> v2:172.21.15.191:3300/0 conn(0x7f5b600b0e20 msgr2=0x7f5b6006d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:32.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.905+0000 7f5b57fff640 1 --2- 172.21.15.47:0/569091625 >> v2:172.21.15.191:3300/0 conn(0x7f5b600b0e20 0x7f5b6006d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.905+0000 7f5b5dd9b640 1 -- 172.21.15.47:0/569091625 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 345840045 0 0) 0x7f5b600d12e0 con 0x7f5b600ce700 2024-04-14T23:35:32.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.905+0000 7f5b57fff640 1 -- 172.21.15.47:0/569091625 >> v1:172.21.15.47:6789/0 conn(0x7f5b600ce700 legacy=0x7f5b600ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.905+0000 7f5b57fff640 1 -- 172.21.15.47:0/569091625 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6006c650 con 0x7f5b600d2810 2024-04-14T23:35:32.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.905+0000 7f5b5ed9d640 1 --2- 172.21.15.47:0/569091625 >> v2:172.21.15.191:3300/0 conn(0x7f5b600b0e20 0x7f5b6006d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:32.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.906+0000 7f5b57fff640 1 --2- 172.21.15.47:0/569091625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b600d2810 0x7f5b6006ce50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5b600732c0 tx=0x7f5b4802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbbe9d81cfb6e1f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:32.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.906+0000 7f5b5dd9b640 1 -- 172.21.15.47:0/569091625 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b48034070 con 0x7f5b600d2810 2024-04-14T23:35:32.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.906+0000 7f5b5dd9b640 1 -- 172.21.15.47:0/569091625 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b48030860 con 0x7f5b600d2810 2024-04-14T23:35:32.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.906+0000 7f5b5dd9b640 1 -- 172.21.15.47:0/569091625 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b48030c30 con 0x7f5b600d2810 2024-04-14T23:35:32.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.906+0000 7f5b6498c640 1 -- 172.21.15.47:0/569091625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b600d2810 msgr2=0x7f5b6006ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.906+0000 7f5b6498c640 1 --2- 172.21.15.47:0/569091625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b600d2810 0x7f5b6006ce50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5b600732c0 tx=0x7f5b4802b9a0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.906+0000 7f5b6498c640 1 -- 172.21.15.47:0/569091625 shutdown_connections 2024-04-14T23:35:32.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.906+0000 7f5b6498c640 1 --2- 172.21.15.47:0/569091625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b600d2810 0x7f5b6006ce50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.906+0000 7f5b6498c640 1 --2- 172.21.15.47:0/569091625 >> v2:172.21.15.191:3300/0 conn(0x7f5b600b0e20 0x7f5b6006d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.906+0000 7f5b6498c640 1 -- 172.21.15.47:0/569091625 >> 172.21.15.47:0/569091625 conn(0x7f5b600d1cf0 msgr2=0x7f5b600d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:32.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.906+0000 7f5b6498c640 1 -- 172.21.15.47:0/569091625 shutdown_connections 2024-04-14T23:35:32.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.906+0000 7f5b6498c640 1 -- 172.21.15.47:0/569091625 wait complete. 2024-04-14T23:35:32.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.908+0000 7f5b6498c640 1 Processor -- start 2024-04-14T23:35:32.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.908+0000 7f5b6498c640 1 -- start start 2024-04-14T23:35:32.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.908+0000 7f5b6498c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5b600b0e20 0x7f5b600c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.908+0000 7f5b6498c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b600ce700 0x7f5b600c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.908+0000 7f5b6498c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b600d2810 0x7f5b600c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.908+0000 7f5b6498c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6015e600 con 0x7f5b600d2810 2024-04-14T23:35:32.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.908+0000 7f5b6498c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6006f5a0 con 0x7f5b600ce700 2024-04-14T23:35:32.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.908+0000 7f5b6498c640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5b6015e780 con 0x7f5b600b0e20 2024-04-14T23:35:32.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.908+0000 7f5b5ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b600d2810 0x7f5b600c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.909+0000 7f5b5ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b600d2810 0x7f5b600c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43940/0 (socket says 172.21.15.47:43940) 2024-04-14T23:35:32.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.909+0000 7f5b5ed9d640 1 -- 172.21.15.47:0/757814638 learned_addr learned my addr 172.21.15.47:0/757814638 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:32.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.909+0000 7f5b57fff640 1 --2- 172.21.15.47:0/757814638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b600ce700 0x7f5b600c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.909+0000 7f5b5e59c640 1 --2- 172.21.15.47:0/757814638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5b600b0e20 0x7f5b600c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.909+0000 7f5b5ed9d640 1 -- 172.21.15.47:0/757814638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5b600b0e20 msgr2=0x7f5b600c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.909+0000 7f5b5ed9d640 1 --2- 172.21.15.47:0/757814638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5b600b0e20 0x7f5b600c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.909+0000 7f5b5ed9d640 1 -- 172.21.15.47:0/757814638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b600ce700 msgr2=0x7f5b600c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.909+0000 7f5b5ed9d640 1 --2- 172.21.15.47:0/757814638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b600ce700 0x7f5b600c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.909+0000 7f5b5ed9d640 1 -- 172.21.15.47:0/757814638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b600c6930 con 0x7f5b600d2810 2024-04-14T23:35:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.909+0000 7f5b5e59c640 1 --2- 172.21.15.47:0/757814638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5b600b0e20 0x7f5b600c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.909+0000 7f5b5ed9d640 1 --2- 172.21.15.47:0/757814638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b600d2810 0x7f5b600c9c20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800cd80 tx=0x7f5b5800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.909+0000 7f5b56ffd640 1 -- 172.21.15.47:0/757814638 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5800f680 con 0x7f5b600d2810 2024-04-14T23:35:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.909+0000 7f5b56ffd640 1 -- 172.21.15.47:0/757814638 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b5800f840 con 0x7f5b600d2810 2024-04-14T23:35:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.909+0000 7f5b6498c640 1 -- 172.21.15.47:0/757814638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b600c6c10 con 0x7f5b600d2810 2024-04-14T23:35:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.909+0000 7f5b56ffd640 1 -- 172.21.15.47:0/757814638 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5800fc30 con 0x7f5b600d2810 2024-04-14T23:35:32.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.909+0000 7f5b6498c640 1 -- 172.21.15.47:0/757814638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b600c71d0 con 0x7f5b600d2810 2024-04-14T23:35:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.910+0000 7f5b6498c640 1 -- 172.21.15.47:0/757814638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b60073f50 con 0x7f5b600d2810 2024-04-14T23:35:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.911+0000 7f5b56ffd640 1 -- 172.21.15.47:0/757814638 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f5b580213f0 con 0x7f5b600d2810 2024-04-14T23:35:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.911+0000 7f5b56ffd640 1 --2- 172.21.15.47:0/757814638 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5b4006b990 0x7f5b4006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.911+0000 7f5b56ffd640 1 -- 172.21.15.47:0/757814638 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5b5808b910 con 0x7f5b600d2810 2024-04-14T23:35:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.911+0000 7f5b5e59c640 1 --2- 172.21.15.47:0/757814638 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5b4006b990 0x7f5b4006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.912+0000 7f5b5e59c640 1 --2- 172.21.15.47:0/757814638 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5b4006b990 0x7f5b4006de50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5b50000f60 tx=0x7f5b50007ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:32.915+0000 7f5b56ffd640 1 -- 172.21.15.47:0/757814638 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5b58014030 con 0x7f5b600d2810 2024-04-14T23:35:33.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.098+0000 7f5b6498c640 1 -- 172.21.15.47:0/757814638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5b600ccac0 con 0x7f5b600d2810 2024-04-14T23:35:33.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.098+0000 7f5b56ffd640 1 -- 172.21.15.47:0/757814638 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f5b5805a1b0 con 0x7f5b600d2810 2024-04-14T23:35:33.102 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:33.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.100+0000 7f5b6498c640 1 -- 172.21.15.47:0/757814638 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5b4006b990 msgr2=0x7f5b4006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.100+0000 7f5b6498c640 1 --2- 172.21.15.47:0/757814638 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5b4006b990 0x7f5b4006de50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5b50000f60 tx=0x7f5b50007ca0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.100+0000 7f5b6498c640 1 -- 172.21.15.47:0/757814638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b600d2810 msgr2=0x7f5b600c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.100+0000 7f5b6498c640 1 --2- 172.21.15.47:0/757814638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b600d2810 0x7f5b600c9c20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800cd80 tx=0x7f5b5800a650 comp rx=0 tx=0).stop 2024-04-14T23:35:33.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.100+0000 7f5b6498c640 1 -- 172.21.15.47:0/757814638 shutdown_connections 2024-04-14T23:35:33.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.100+0000 7f5b6498c640 1 --2- 172.21.15.47:0/757814638 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5b4006b990 0x7f5b4006de50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.100+0000 7f5b6498c640 1 --2- 172.21.15.47:0/757814638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b600d2810 0x7f5b600c9c20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.100+0000 7f5b6498c640 1 --2- 172.21.15.47:0/757814638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b600ce700 0x7f5b600c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.100+0000 7f5b6498c640 1 --2- 172.21.15.47:0/757814638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5b600b0e20 0x7f5b600c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.100+0000 7f5b6498c640 1 -- 172.21.15.47:0/757814638 >> 172.21.15.47:0/757814638 conn(0x7f5b600d1cf0 msgr2=0x7f5b6015d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:33.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.100+0000 7f5b6498c640 1 -- 172.21.15.47:0/757814638 shutdown_connections 2024-04-14T23:35:33.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.101+0000 7f5b6498c640 1 -- 172.21.15.47:0/757814638 wait complete. 2024-04-14T23:35:33.115 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T23:35:33.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.216+0000 7fbb9e60f640 1 Processor -- start 2024-04-14T23:35:33.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.216+0000 7fbb9e60f640 1 -- start start 2024-04-14T23:35:33.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.217+0000 7fbb9e60f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbb98161870 0x7fbb980ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.217+0000 7fbb9e60f640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb980cf760 0x7fbb980c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.217+0000 7fbb9e60f640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb980b5590 con 0x7fbb980b4e30 2024-04-14T23:35:33.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.217+0000 7fbb9e60f640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbb980cff40 con 0x7fbb98161870 2024-04-14T23:35:33.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.217+0000 7fbb9e60f640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbb980b52b0 con 0x7fbb980cf760 2024-04-14T23:35:33.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.217+0000 7fbb97fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbb98161870 0x7fbb980ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.217+0000 7fbb977fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbb980b4e30 0x7fbb980cf050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54550/0 (socket says 172.21.15.47:54550) 2024-04-14T23:35:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.217+0000 7fbb977fe640 1 -- 172.21.15.47:0/3292314924 learned_addr learned my addr 172.21.15.47:0/3292314924 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.218+0000 7fbb97fff640 1 -- 172.21.15.47:0/3292314924 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb980cf760 msgr2=0x7fbb980c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.218+0000 7fbb9cbac640 1 --2- 172.21.15.47:0/3292314924 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb980cf760 0x7fbb980c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.218+0000 7fbb97fff640 1 --2- 172.21.15.47:0/3292314924 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb980cf760 0x7fbb980c7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.218+0000 7fbb96ffd640 1 -- 172.21.15.47:0/3292314924 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2944873054 0 0) 0x7fbb980b5590 con 0x7fbb980b4e30 2024-04-14T23:35:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.218+0000 7fbb97fff640 1 -- 172.21.15.47:0/3292314924 >> v1:172.21.15.47:6789/0 conn(0x7fbb980b4e30 legacy=0x7fbb980cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.218+0000 7fbb97fff640 1 -- 172.21.15.47:0/3292314924 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb980d2680 con 0x7fbb98161870 2024-04-14T23:35:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.219+0000 7fbb97fff640 1 --2- 172.21.15.47:0/3292314924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb98161870 0x7fbb980ceb10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbb880097a0 tx=0x7fbb8802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fed222ed30bba0d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.219+0000 7fbb96ffd640 1 -- 172.21.15.47:0/3292314924 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb880315a0 con 0x7fbb98161870 2024-04-14T23:35:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.219+0000 7fbb96ffd640 1 -- 172.21.15.47:0/3292314924 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb88037070 con 0x7fbb98161870 2024-04-14T23:35:33.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.219+0000 7fbb96ffd640 1 -- 172.21.15.47:0/3292314924 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb88031960 con 0x7fbb98161870 2024-04-14T23:35:33.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.219+0000 7fbb9e60f640 1 -- 172.21.15.47:0/3292314924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb98161870 msgr2=0x7fbb980ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.219+0000 7fbb9e60f640 1 --2- 172.21.15.47:0/3292314924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb98161870 0x7fbb980ceb10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbb880097a0 tx=0x7fbb8802b840 comp rx=0 tx=0).stop 2024-04-14T23:35:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.219+0000 7fbb9e60f640 1 -- 172.21.15.47:0/3292314924 shutdown_connections 2024-04-14T23:35:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.219+0000 7fbb9e60f640 1 --2- 172.21.15.47:0/3292314924 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb980cf760 0x7fbb980c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.219+0000 7fbb9e60f640 1 --2- 172.21.15.47:0/3292314924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb98161870 0x7fbb980ceb10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.219+0000 7fbb9e60f640 1 -- 172.21.15.47:0/3292314924 >> 172.21.15.47:0/3292314924 conn(0x7fbb980d3f70 msgr2=0x7fbb980d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.219+0000 7fbb9e60f640 1 -- 172.21.15.47:0/3292314924 shutdown_connections 2024-04-14T23:35:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.219+0000 7fbb9e60f640 1 -- 172.21.15.47:0/3292314924 wait complete. 2024-04-14T23:35:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.220+0000 7fbb9e60f640 1 Processor -- start 2024-04-14T23:35:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.221+0000 7fbb9e60f640 1 -- start start 2024-04-14T23:35:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.221+0000 7fbb9e60f640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb980b4e30 0x7fbb9815d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.221+0000 7fbb9e60f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb980cf760 0x7fbb980b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.221+0000 7fbb9e60f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb98161870 0x7fbb980cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.221+0000 7fbb9e60f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbb980d18e0 con 0x7fbb98161870 2024-04-14T23:35:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.221+0000 7fbb9e60f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb980d2c40 con 0x7fbb980cf760 2024-04-14T23:35:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.221+0000 7fbb9e60f640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbb98161c50 con 0x7fbb980b4e30 2024-04-14T23:35:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.221+0000 7fbb9cbac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb98161870 0x7fbb980cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.221+0000 7fbb9cbac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb98161870 0x7fbb980cc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43952/0 (socket says 172.21.15.47:43952) 2024-04-14T23:35:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.221+0000 7fbb9cbac640 1 -- 172.21.15.47:0/4067581089 learned_addr learned my addr 172.21.15.47:0/4067581089 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.222+0000 7fbb977fe640 1 --2- 172.21.15.47:0/4067581089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb980cf760 0x7fbb980b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.222+0000 7fbb97fff640 1 --2- 172.21.15.47:0/4067581089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb980b4e30 0x7fbb9815d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.222+0000 7fbb9cbac640 1 -- 172.21.15.47:0/4067581089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb980b4e30 msgr2=0x7fbb9815d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.222+0000 7fbb9cbac640 1 --2- 172.21.15.47:0/4067581089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb980b4e30 0x7fbb9815d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.222+0000 7fbb9cbac640 1 -- 172.21.15.47:0/4067581089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb980cf760 msgr2=0x7fbb980b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.222+0000 7fbb9cbac640 1 --2- 172.21.15.47:0/4067581089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb980cf760 0x7fbb980b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.222+0000 7fbb9cbac640 1 -- 172.21.15.47:0/4067581089 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb980b4830 con 0x7fbb98161870 2024-04-14T23:35:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.222+0000 7fbb977fe640 1 --2- 172.21.15.47:0/4067581089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb980cf760 0x7fbb980b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.222+0000 7fbb9cbac640 1 --2- 172.21.15.47:0/4067581089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb98161870 0x7fbb980cc510 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000cc80 tx=0x7fbb9000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:33.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.222+0000 7fbb94ff9640 1 -- 172.21.15.47:0/4067581089 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb90003990 con 0x7fbb98161870 2024-04-14T23:35:33.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.222+0000 7fbb94ff9640 1 -- 172.21.15.47:0/4067581089 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb90003b50 con 0x7fbb98161870 2024-04-14T23:35:33.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.222+0000 7fbb9e60f640 1 -- 172.21.15.47:0/4067581089 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb980b7d60 con 0x7fbb98161870 2024-04-14T23:35:33.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.222+0000 7fbb94ff9640 1 -- 172.21.15.47:0/4067581089 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb90004020 con 0x7fbb98161870 2024-04-14T23:35:33.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.222+0000 7fbb9e60f640 1 -- 172.21.15.47:0/4067581089 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb980b8600 con 0x7fbb98161870 2024-04-14T23:35:33.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.223+0000 7fbb9e60f640 1 -- 172.21.15.47:0/4067581089 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb980b8800 con 0x7fbb98161870 2024-04-14T23:35:33.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.224+0000 7fbb94ff9640 1 -- 172.21.15.47:0/4067581089 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fbb900041c0 con 0x7fbb98161870 2024-04-14T23:35:33.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.224+0000 7fbb94ff9640 1 --2- 172.21.15.47:0/4067581089 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbb8406b990 0x7fbb8406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.224+0000 7fbb94ff9640 1 -- 172.21.15.47:0/4067581089 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fbb9008b100 con 0x7fbb98161870 2024-04-14T23:35:33.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.224+0000 7fbb97fff640 1 --2- 172.21.15.47:0/4067581089 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbb8406b990 0x7fbb8406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.225+0000 7fbb97fff640 1 --2- 172.21.15.47:0/4067581089 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbb8406b990 0x7fbb8406de50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbb88036000 tx=0x7fbb8803d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:33.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.229+0000 7fbb94ff9640 1 -- 172.21.15.47:0/4067581089 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbb90014030 con 0x7fbb98161870 2024-04-14T23:35:33.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.410+0000 7fbb9e60f640 1 -- 172.21.15.47:0/4067581089 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbb98073f50 con 0x7fbb98161870 2024-04-14T23:35:33.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.411+0000 7fbb94ff9640 1 -- 172.21.15.47:0/4067581089 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fbb90059910 con 0x7fbb98161870 2024-04-14T23:35:33.414 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-14T23:35:33.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.412+0000 7fbb9e60f640 1 -- 172.21.15.47:0/4067581089 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbb8406b990 msgr2=0x7fbb8406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.412+0000 7fbb9e60f640 1 --2- 172.21.15.47:0/4067581089 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbb8406b990 0x7fbb8406de50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbb88036000 tx=0x7fbb8803d040 comp rx=0 tx=0).stop 2024-04-14T23:35:33.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.412+0000 7fbb9e60f640 1 -- 172.21.15.47:0/4067581089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb98161870 msgr2=0x7fbb980cc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.412+0000 7fbb9e60f640 1 --2- 172.21.15.47:0/4067581089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb98161870 0x7fbb980cc510 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000cc80 tx=0x7fbb9000a5c0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.413+0000 7fbb9e60f640 1 -- 172.21.15.47:0/4067581089 shutdown_connections 2024-04-14T23:35:33.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.413+0000 7fbb9e60f640 1 --2- 172.21.15.47:0/4067581089 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbb8406b990 0x7fbb8406de50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.413+0000 7fbb9e60f640 1 --2- 172.21.15.47:0/4067581089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb98161870 0x7fbb980cc510 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.413+0000 7fbb9e60f640 1 --2- 172.21.15.47:0/4067581089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb980cf760 0x7fbb980b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.413+0000 7fbb9e60f640 1 --2- 172.21.15.47:0/4067581089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb980b4e30 0x7fbb9815d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.413+0000 7fbb9e60f640 1 -- 172.21.15.47:0/4067581089 >> 172.21.15.47:0/4067581089 conn(0x7fbb980d3f70 msgr2=0x7fbb980d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:33.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.413+0000 7fbb9e60f640 1 -- 172.21.15.47:0/4067581089 shutdown_connections 2024-04-14T23:35:33.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.413+0000 7fbb9e60f640 1 -- 172.21.15.47:0/4067581089 wait complete. 2024-04-14T23:35:33.427 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T23:35:33.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.528+0000 7fe532405640 1 Processor -- start 2024-04-14T23:35:33.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.528+0000 7fe532405640 1 -- start start 2024-04-14T23:35:33.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.529+0000 7fe532405640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe52c0b53c0 0x7fe52c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.529+0000 7fe532405640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe52c0cfb30 0x7fe52c0d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.529+0000 7fe532405640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe52c0d2b10 0x7fe52c0d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.529+0000 7fe532405640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe52c0b6e40 con 0x7fe52c0b53c0 2024-04-14T23:35:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.529+0000 7fe532405640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fe52c0d2fa0 con 0x7fe52c0d2b10 2024-04-14T23:35:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.529+0000 7fe532405640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe52c0b7090 con 0x7fe52c0cfb30 2024-04-14T23:35:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.529+0000 7fe52bfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe52c0b53c0 0x7fe52c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.529+0000 7fe52bfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe52c0b53c0 0x7fe52c0cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43958/0 (socket says 172.21.15.47:43958) 2024-04-14T23:35:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.529+0000 7fe52bfff640 1 -- 172.21.15.47:0/1801868144 learned_addr learned my addr 172.21.15.47:0/1801868144 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.529+0000 7fe5309a2640 1 --2- 172.21.15.47:0/1801868144 >> v2:172.21.15.191:3300/0 conn(0x7fe52c0d2b10 0x7fe52c0d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.529+0000 7fe52b7fe640 1 --2- 172.21.15.47:0/1801868144 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe52c0cfb30 0x7fe52c0d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.530+0000 7fe52bfff640 1 -- 172.21.15.47:0/1801868144 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe52c0cfb30 msgr2=0x7fe52c0d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.530+0000 7fe52bfff640 1 --2- 172.21.15.47:0/1801868144 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe52c0cfb30 0x7fe52c0d25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.530+0000 7fe52bfff640 1 -- 172.21.15.47:0/1801868144 >> v2:172.21.15.191:3300/0 conn(0x7fe52c0d2b10 msgr2=0x7fe52c0d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.530+0000 7fe52bfff640 1 --2- 172.21.15.47:0/1801868144 >> v2:172.21.15.191:3300/0 conn(0x7fe52c0d2b10 0x7fe52c0d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.530+0000 7fe52bfff640 1 -- 172.21.15.47:0/1801868144 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe52c0b7370 con 0x7fe52c0b53c0 2024-04-14T23:35:33.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.530+0000 7fe5309a2640 1 --2- 172.21.15.47:0/1801868144 >> v2:172.21.15.191:3300/0 conn(0x7fe52c0d2b10 0x7fe52c0d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:33.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.530+0000 7fe52bfff640 1 --2- 172.21.15.47:0/1801868144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c0b53c0 0x7fe52c0cf5f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0d1730 tx=0x7fe51c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c1464e9ad9293e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:33.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.530+0000 7fe52affd640 1 -- 172.21.15.47:0/1801868144 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51c034070 con 0x7fe52c0b53c0 2024-04-14T23:35:33.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.530+0000 7fe52affd640 1 -- 172.21.15.47:0/1801868144 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe51c030860 con 0x7fe52c0b53c0 2024-04-14T23:35:33.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.530+0000 7fe52affd640 1 -- 172.21.15.47:0/1801868144 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51c030c30 con 0x7fe52c0b53c0 2024-04-14T23:35:33.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.531+0000 7fe532405640 1 -- 172.21.15.47:0/1801868144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c0b53c0 msgr2=0x7fe52c0cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.531+0000 7fe532405640 1 --2- 172.21.15.47:0/1801868144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c0b53c0 0x7fe52c0cf5f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0d1730 tx=0x7fe51c02b9a0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.531+0000 7fe532405640 1 -- 172.21.15.47:0/1801868144 shutdown_connections 2024-04-14T23:35:33.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.531+0000 7fe532405640 1 --2- 172.21.15.47:0/1801868144 >> v2:172.21.15.191:3300/0 conn(0x7fe52c0d2b10 0x7fe52c0d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.531+0000 7fe532405640 1 --2- 172.21.15.47:0/1801868144 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe52c0cfb30 0x7fe52c0d25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.531+0000 7fe532405640 1 --2- 172.21.15.47:0/1801868144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c0b53c0 0x7fe52c0cf5f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.531+0000 7fe532405640 1 -- 172.21.15.47:0/1801868144 >> 172.21.15.47:0/1801868144 conn(0x7fe52c09d2c0 msgr2=0x7fe52c0d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:33.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.531+0000 7fe532405640 1 -- 172.21.15.47:0/1801868144 shutdown_connections 2024-04-14T23:35:33.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.531+0000 7fe532405640 1 -- 172.21.15.47:0/1801868144 wait complete. 2024-04-14T23:35:33.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.532+0000 7fe532405640 1 Processor -- start 2024-04-14T23:35:33.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.532+0000 7fe532405640 1 -- start start 2024-04-14T23:35:33.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.533+0000 7fe532405640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c0b53c0 0x7fe52c14e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.533+0000 7fe532405640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe52c0cfb30 0x7fe52c15b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.533+0000 7fe532405640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe52c0d2b10 0x7fe52c0cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.533+0000 7fe532405640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe52c0b57a0 con 0x7fe52c0b53c0 2024-04-14T23:35:33.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.533+0000 7fe532405640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe52c0b7930 con 0x7fe52c0cfb30 2024-04-14T23:35:33.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.533+0000 7fe532405640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe52c0b5920 con 0x7fe52c0d2b10 2024-04-14T23:35:33.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.533+0000 7fe52bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c0b53c0 0x7fe52c14e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.533+0000 7fe52bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c0b53c0 0x7fe52c14e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43970/0 (socket says 172.21.15.47:43970) 2024-04-14T23:35:33.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.533+0000 7fe52bfff640 1 -- 172.21.15.47:0/500944725 learned_addr learned my addr 172.21.15.47:0/500944725 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:33.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.533+0000 7fe5309a2640 1 --2- 172.21.15.47:0/500944725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe52c0d2b10 0x7fe52c0cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.534+0000 7fe52b7fe640 1 --2- 172.21.15.47:0/500944725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe52c0cfb30 0x7fe52c15b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.534+0000 7fe52bfff640 1 -- 172.21.15.47:0/500944725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe52c0d2b10 msgr2=0x7fe52c0cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.534+0000 7fe52bfff640 1 --2- 172.21.15.47:0/500944725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe52c0d2b10 0x7fe52c0cc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.534+0000 7fe52bfff640 1 -- 172.21.15.47:0/500944725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe52c0cfb30 msgr2=0x7fe52c15b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.534+0000 7fe52bfff640 1 --2- 172.21.15.47:0/500944725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe52c0cfb30 0x7fe52c15b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.534+0000 7fe52bfff640 1 -- 172.21.15.47:0/500944725 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe52c15bc80 con 0x7fe52c0b53c0 2024-04-14T23:35:33.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.534+0000 7fe52bfff640 1 --2- 172.21.15.47:0/500944725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c0b53c0 0x7fe52c14e190 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe51c02b9e0 tx=0x7fe51c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:33.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.534+0000 7fe528ff9640 1 -- 172.21.15.47:0/500944725 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51c048070 con 0x7fe52c0b53c0 2024-04-14T23:35:33.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.534+0000 7fe528ff9640 1 -- 172.21.15.47:0/500944725 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe51c030660 con 0x7fe52c0b53c0 2024-04-14T23:35:33.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.534+0000 7fe532405640 1 -- 172.21.15.47:0/500944725 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe52c15bf60 con 0x7fe52c0b53c0 2024-04-14T23:35:33.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.534+0000 7fe528ff9640 1 -- 172.21.15.47:0/500944725 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51c034040 con 0x7fe52c0b53c0 2024-04-14T23:35:33.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.534+0000 7fe532405640 1 -- 172.21.15.47:0/500944725 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe52c15c520 con 0x7fe52c0b53c0 2024-04-14T23:35:33.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.535+0000 7fe532405640 1 -- 172.21.15.47:0/500944725 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe52c073f50 con 0x7fe52c0b53c0 2024-04-14T23:35:33.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.535+0000 7fe528ff9640 1 -- 172.21.15.47:0/500944725 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe51c04b070 con 0x7fe52c0b53c0 2024-04-14T23:35:33.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.536+0000 7fe528ff9640 1 --2- 172.21.15.47:0/500944725 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe50c06b9c0 0x7fe50c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.536+0000 7fe528ff9640 1 -- 172.21.15.47:0/500944725 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe51c0accb0 con 0x7fe52c0b53c0 2024-04-14T23:35:33.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.536+0000 7fe52b7fe640 1 --2- 172.21.15.47:0/500944725 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe50c06b9c0 0x7fe50c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.536+0000 7fe52b7fe640 1 --2- 172.21.15.47:0/500944725 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe50c06b9c0 0x7fe50c06de80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe52c1611c0 tx=0x7fe514008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:33.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.540+0000 7fe528ff9640 1 -- 172.21.15.47:0/500944725 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe51c030830 con 0x7fe52c0b53c0 2024-04-14T23:35:33.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.722+0000 7fe532405640 1 -- 172.21.15.47:0/500944725 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe52c0d0e10 con 0x7fe52c0b53c0 2024-04-14T23:35:33.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.722+0000 7fe528ff9640 1 -- 172.21.15.47:0/500944725 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fe51c07b4c0 con 0x7fe52c0b53c0 2024-04-14T23:35:33.726 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:35:33.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.724+0000 7fe532405640 1 -- 172.21.15.47:0/500944725 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe50c06b9c0 msgr2=0x7fe50c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.724+0000 7fe532405640 1 --2- 172.21.15.47:0/500944725 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe50c06b9c0 0x7fe50c06de80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe52c1611c0 tx=0x7fe514008040 comp rx=0 tx=0).stop 2024-04-14T23:35:33.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.724+0000 7fe532405640 1 -- 172.21.15.47:0/500944725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c0b53c0 msgr2=0x7fe52c14e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.724+0000 7fe532405640 1 --2- 172.21.15.47:0/500944725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c0b53c0 0x7fe52c14e190 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe51c02b9e0 tx=0x7fe51c004730 comp rx=0 tx=0).stop 2024-04-14T23:35:33.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.724+0000 7fe532405640 1 -- 172.21.15.47:0/500944725 shutdown_connections 2024-04-14T23:35:33.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.724+0000 7fe532405640 1 --2- 172.21.15.47:0/500944725 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe50c06b9c0 0x7fe50c06de80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.724+0000 7fe532405640 1 --2- 172.21.15.47:0/500944725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe52c0d2b10 0x7fe52c0cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.724+0000 7fe532405640 1 --2- 172.21.15.47:0/500944725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe52c0cfb30 0x7fe52c15b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.724+0000 7fe532405640 1 --2- 172.21.15.47:0/500944725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c0b53c0 0x7fe52c14e190 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.724+0000 7fe532405640 1 -- 172.21.15.47:0/500944725 >> 172.21.15.47:0/500944725 conn(0x7fe52c09d2c0 msgr2=0x7fe52c06d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:33.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.725+0000 7fe532405640 1 -- 172.21.15.47:0/500944725 shutdown_connections 2024-04-14T23:35:33.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.725+0000 7fe532405640 1 -- 172.21.15.47:0/500944725 wait complete. 2024-04-14T23:35:33.738 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T23:35:33.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.836+0000 7fb1f4dcf640 1 Processor -- start 2024-04-14T23:35:33.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.836+0000 7fb1f4dcf640 1 -- start start 2024-04-14T23:35:33.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.837+0000 7fb1f4dcf640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1f015e270 0x7fb1f00d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.837+0000 7fb1f4dcf640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb1f00d1e00 0x7fb1f00d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.837+0000 7fb1f4dcf640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f00b57a0 con 0x7fb1f00d1450 2024-04-14T23:35:33.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.837+0000 7fb1f4dcf640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f00b4300 con 0x7fb1f00d1e00 2024-04-14T23:35:33.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.837+0000 7fb1f4dcf640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f00b39d0 con 0x7fb1f015e270 2024-04-14T23:35:33.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.837+0000 7fb1edd9b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb1f00d1e00 0x7fb1f00d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.837+0000 7fb1eed9d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb1f00d1450 0x7fb1f00ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:38580/0 (socket says 172.21.15.47:38580) 2024-04-14T23:35:33.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.837+0000 7fb1eed9d640 1 -- 172.21.15.47:0/964185190 learned_addr learned my addr 172.21.15.47:0/964185190 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:33.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.837+0000 7fb1edd9b640 1 --2- 172.21.15.47:0/964185190 >> v2:172.21.15.47:3300/0 conn(0x7fb1f00d1e00 0x7fb1f00d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52224/0 (socket says 172.21.15.47:52224) 2024-04-14T23:35:33.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.838+0000 7fb1ee59c640 1 --2- 172.21.15.47:0/964185190 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1f015e270 0x7fb1f00d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.838+0000 7fb1edd9b640 1 -- 172.21.15.47:0/964185190 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1f015e270 msgr2=0x7fb1f00d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:33.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.838+0000 7fb1edd9b640 1 --2- 172.21.15.47:0/964185190 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1f015e270 0x7fb1f00d0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.838+0000 7fb1edd9b640 1 -- 172.21.15.47:0/964185190 >> v1:172.21.15.47:6789/0 conn(0x7fb1f00d1450 legacy=0x7fb1f00ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.838+0000 7fb1ed59a640 1 -- 172.21.15.47:0/964185190 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 636305648 0 0) 0x7fb1f00b57a0 con 0x7fb1f00d1450 2024-04-14T23:35:33.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.838+0000 7fb1edd9b640 1 -- 172.21.15.47:0/964185190 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f00b3cb0 con 0x7fb1f00d1e00 2024-04-14T23:35:33.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.838+0000 7fb1ee59c640 1 --2- 172.21.15.47:0/964185190 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1f015e270 0x7fb1f00d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:33.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.838+0000 7fb1edd9b640 1 --2- 172.21.15.47:0/964185190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1f00d1e00 0x7fb1f00d2200 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40097a0 tx=0x7fb1e402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6715c091ee0f41d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:33.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.839+0000 7fb1ed59a640 1 -- 172.21.15.47:0/964185190 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4034070 con 0x7fb1f00d1e00 2024-04-14T23:35:33.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.839+0000 7fb1ed59a640 1 -- 172.21.15.47:0/964185190 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e4030610 con 0x7fb1f00d1e00 2024-04-14T23:35:33.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.839+0000 7fb1ed59a640 1 -- 172.21.15.47:0/964185190 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40309e0 con 0x7fb1f00d1e00 2024-04-14T23:35:33.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.839+0000 7fb1f4dcf640 1 -- 172.21.15.47:0/964185190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1f00d1e00 msgr2=0x7fb1f00d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.839+0000 7fb1f4dcf640 1 --2- 172.21.15.47:0/964185190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1f00d1e00 0x7fb1f00d2200 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40097a0 tx=0x7fb1e402b960 comp rx=0 tx=0).stop 2024-04-14T23:35:33.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.839+0000 7fb1f4dcf640 1 -- 172.21.15.47:0/964185190 shutdown_connections 2024-04-14T23:35:33.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.839+0000 7fb1f4dcf640 1 --2- 172.21.15.47:0/964185190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1f00d1e00 0x7fb1f00d2200 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.839+0000 7fb1f4dcf640 1 --2- 172.21.15.47:0/964185190 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1f015e270 0x7fb1f00d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.839+0000 7fb1f4dcf640 1 -- 172.21.15.47:0/964185190 >> 172.21.15.47:0/964185190 conn(0x7fb1f00d3ed0 msgr2=0x7fb1f00d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:33.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.839+0000 7fb1f4dcf640 1 -- 172.21.15.47:0/964185190 shutdown_connections 2024-04-14T23:35:33.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.839+0000 7fb1f4dcf640 1 -- 172.21.15.47:0/964185190 wait complete. 2024-04-14T23:35:33.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.841+0000 7fb1f4dcf640 1 Processor -- start 2024-04-14T23:35:33.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.841+0000 7fb1f4dcf640 1 -- start start 2024-04-14T23:35:33.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.841+0000 7fb1f4dcf640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1f00d1450 0x7fb1f00b8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.841+0000 7fb1f4dcf640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1f00d1e00 0x7fb1f01534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.841+0000 7fb1f4dcf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1f015e270 0x7fb1f015ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.841+0000 7fb1f4dcf640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f015e650 con 0x7fb1f015e270 2024-04-14T23:35:33.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.841+0000 7fb1f4dcf640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f00b0c60 con 0x7fb1f00d1e00 2024-04-14T23:35:33.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.841+0000 7fb1f4dcf640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f015e7d0 con 0x7fb1f00d1450 2024-04-14T23:35:33.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.841+0000 7fb1eed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1f015e270 0x7fb1f015ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.841+0000 7fb1eed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1f015e270 0x7fb1f015ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52232/0 (socket says 172.21.15.47:52232) 2024-04-14T23:35:33.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.841+0000 7fb1eed9d640 1 -- 172.21.15.47:0/3986571627 learned_addr learned my addr 172.21.15.47:0/3986571627 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:33.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.842+0000 7fb1edd9b640 1 --2- 172.21.15.47:0/3986571627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1f00d1e00 0x7fb1f01534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.842+0000 7fb1ee59c640 1 --2- 172.21.15.47:0/3986571627 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1f00d1450 0x7fb1f00b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.842+0000 7fb1eed9d640 1 -- 172.21.15.47:0/3986571627 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1f00d1450 msgr2=0x7fb1f00b8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.842+0000 7fb1eed9d640 1 --2- 172.21.15.47:0/3986571627 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1f00d1450 0x7fb1f00b8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.842+0000 7fb1eed9d640 1 -- 172.21.15.47:0/3986571627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1f00d1e00 msgr2=0x7fb1f01534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:33.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.842+0000 7fb1eed9d640 1 --2- 172.21.15.47:0/3986571627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1f00d1e00 0x7fb1f01534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:33.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.842+0000 7fb1eed9d640 1 -- 172.21.15.47:0/3986571627 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f015f3d0 con 0x7fb1f015e270 2024-04-14T23:35:33.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.842+0000 7fb1eed9d640 1 --2- 172.21.15.47:0/3986571627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1f015e270 0x7fb1f015ee90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800c4b0 tx=0x7fb1e800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:33.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.842+0000 7fb1deffd640 1 -- 172.21.15.47:0/3986571627 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8018070 con 0x7fb1f015e270 2024-04-14T23:35:33.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.842+0000 7fb1deffd640 1 -- 172.21.15.47:0/3986571627 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e80074e0 con 0x7fb1f015e270 2024-04-14T23:35:33.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.842+0000 7fb1f4dcf640 1 -- 172.21.15.47:0/3986571627 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f00cde20 con 0x7fb1f015e270 2024-04-14T23:35:33.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.842+0000 7fb1deffd640 1 -- 172.21.15.47:0/3986571627 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8004a20 con 0x7fb1f015e270 2024-04-14T23:35:33.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.842+0000 7fb1f4dcf640 1 -- 172.21.15.47:0/3986571627 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f00b9290 con 0x7fb1f015e270 2024-04-14T23:35:33.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.843+0000 7fb1f4dcf640 1 -- 172.21.15.47:0/3986571627 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f0075430 con 0x7fb1f015e270 2024-04-14T23:35:33.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.844+0000 7fb1deffd640 1 -- 172.21.15.47:0/3986571627 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fb1e801b070 con 0x7fb1f015e270 2024-04-14T23:35:33.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.844+0000 7fb1deffd640 1 --2- 172.21.15.47:0/3986571627 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb1d006b990 0x7fb1d006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:33.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.844+0000 7fb1deffd640 1 -- 172.21.15.47:0/3986571627 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb1e8089cf0 con 0x7fb1f015e270 2024-04-14T23:35:33.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.844+0000 7fb1ee59c640 1 --2- 172.21.15.47:0/3986571627 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb1d006b990 0x7fb1d006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:33.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.845+0000 7fb1ee59c640 1 --2- 172.21.15.47:0/3986571627 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb1d006b990 0x7fb1d006de50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00d2f60 tx=0x7fb1e00097f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:33.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:33.848+0000 7fb1deffd640 1 -- 172.21.15.47:0/3986571627 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb1e808e070 con 0x7fb1f015e270 2024-04-14T23:35:34.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.070+0000 7fb1f4dcf640 1 -- 172.21.15.47:0/3986571627 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1f006c050 con 0x7fb1f015e270 2024-04-14T23:35:34.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.071+0000 7fb1deffd640 1 -- 172.21.15.47:0/3986571627 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7fb1e8057f40 con 0x7fb1f015e270 2024-04-14T23:35:34.074 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:34.075 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/416388535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":416388535},{"type":"v1","addr":"172.21.15.191:6837","nonce":416388535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/2830978927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2830978927},{"type":"v1","addr":"172.21.15.47:6833","nonce":2830978927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/4025654680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":4025654680},{"type":"v1","addr":"172.21.15.191:6836","nonce":4025654680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T23:34:38.059644+0000","modified":"2024-04-14T23:34:54.105483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/1169029730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1169029730},{"type":"v1","addr":"172.21.15.47:6835","nonce":1169029730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-14T23:35:34.075 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-04-14T23:35:34.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.073+0000 7fb1f4dcf640 1 -- 172.21.15.47:0/3986571627 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb1d006b990 msgr2=0x7fb1d006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:34.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.073+0000 7fb1f4dcf640 1 --2- 172.21.15.47:0/3986571627 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb1d006b990 0x7fb1d006de50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00d2f60 tx=0x7fb1e00097f0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.073+0000 7fb1f4dcf640 1 -- 172.21.15.47:0/3986571627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1f015e270 msgr2=0x7fb1f015ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:34.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.073+0000 7fb1f4dcf640 1 --2- 172.21.15.47:0/3986571627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1f015e270 0x7fb1f015ee90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800c4b0 tx=0x7fb1e800c970 comp rx=0 tx=0).stop 2024-04-14T23:35:34.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.073+0000 7fb1f4dcf640 1 -- 172.21.15.47:0/3986571627 shutdown_connections 2024-04-14T23:35:34.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.073+0000 7fb1f4dcf640 1 --2- 172.21.15.47:0/3986571627 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fb1d006b990 0x7fb1d006de50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.073+0000 7fb1f4dcf640 1 --2- 172.21.15.47:0/3986571627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb1f015e270 0x7fb1f015ee90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.073+0000 7fb1f4dcf640 1 --2- 172.21.15.47:0/3986571627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1f00d1e00 0x7fb1f01534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.073+0000 7fb1f4dcf640 1 --2- 172.21.15.47:0/3986571627 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1f00d1450 0x7fb1f00b8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.073+0000 7fb1f4dcf640 1 -- 172.21.15.47:0/3986571627 >> 172.21.15.47:0/3986571627 conn(0x7fb1f00d3ed0 msgr2=0x7fb1f00d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:34.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.073+0000 7fb1f4dcf640 1 -- 172.21.15.47:0/3986571627 shutdown_connections 2024-04-14T23:35:34.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.073+0000 7fb1f4dcf640 1 -- 172.21.15.47:0/3986571627 wait complete. 2024-04-14T23:35:34.088 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:34.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.190+0000 7f8bbdede640 1 Processor -- start 2024-04-14T23:35:34.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.190+0000 7f8bbdede640 1 -- start start 2024-04-14T23:35:34.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.190+0000 7f8bbdede640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bb80702e0 0x7f8bb80d16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.190+0000 7f8bbdede640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8bb8071d70 0x7f8bb806f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.190+0000 7f8bbdede640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8bb806f880 0x7f8bb806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.190+0000 7f8bbdede640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f8bb8072280 con 0x7f8bb806f880 2024-04-14T23:35:34.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.190+0000 7f8bbdede640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f8bb8072560 con 0x7f8bb8071d70 2024-04-14T23:35:34.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.190+0000 7f8bbdede640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb8072840 con 0x7f8bb80702e0 2024-04-14T23:35:34.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.191+0000 7f8bb7fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8bb806f880 0x7f8bb806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.191+0000 7f8bb7fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8bb806f880 0x7f8bb806b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52246/0 (socket says 172.21.15.47:52246) 2024-04-14T23:35:34.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.191+0000 7f8bb7fff640 1 -- 172.21.15.47:0/2024424730 learned_addr learned my addr 172.21.15.47:0/2024424730 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:34.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.191+0000 7f8baeffd640 1 --2- 172.21.15.47:0/2024424730 >> v2:172.21.15.191:3300/0 conn(0x7f8bb8071d70 0x7f8bb806f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.191+0000 7f8bb77fe640 1 --2- 172.21.15.47:0/2024424730 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bb80702e0 0x7f8bb80d16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.191+0000 7f8bb7fff640 1 -- 172.21.15.47:0/2024424730 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bb80702e0 msgr2=0x7f8bb80d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:34.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.191+0000 7f8bb7fff640 1 --2- 172.21.15.47:0/2024424730 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bb80702e0 0x7f8bb80d16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.191+0000 7f8bb7fff640 1 -- 172.21.15.47:0/2024424730 >> v2:172.21.15.191:3300/0 conn(0x7f8bb8071d70 msgr2=0x7f8bb806f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:34.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.191+0000 7f8bb7fff640 1 --2- 172.21.15.47:0/2024424730 >> v2:172.21.15.191:3300/0 conn(0x7f8bb8071d70 0x7f8bb806f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.191+0000 7f8bb7fff640 1 -- 172.21.15.47:0/2024424730 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb8072b20 con 0x7f8bb806f880 2024-04-14T23:35:34.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.191+0000 7f8bb77fe640 1 --2- 172.21.15.47:0/2024424730 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bb80702e0 0x7f8bb80d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:34.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.192+0000 7f8bb7fff640 1 --2- 172.21.15.47:0/2024424730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bb806f880 0x7f8bb806b200 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8074e30 tx=0x7f8bb002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12976ed2dd7c56b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:34.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.192+0000 7f8bb6ffd640 1 -- 172.21.15.47:0/2024424730 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb002ca70 con 0x7f8bb806f880 2024-04-14T23:35:34.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.192+0000 7f8bb6ffd640 1 -- 172.21.15.47:0/2024424730 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb002cc10 con 0x7f8bb806f880 2024-04-14T23:35:34.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.192+0000 7f8bb6ffd640 1 -- 172.21.15.47:0/2024424730 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00343f0 con 0x7f8bb806f880 2024-04-14T23:35:34.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.192+0000 7f8bbdede640 1 -- 172.21.15.47:0/2024424730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bb806f880 msgr2=0x7f8bb806b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:34.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.192+0000 7f8bbdede640 1 --2- 172.21.15.47:0/2024424730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bb806f880 0x7f8bb806b200 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8074e30 tx=0x7f8bb002bed0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.192+0000 7f8bbdede640 1 -- 172.21.15.47:0/2024424730 shutdown_connections 2024-04-14T23:35:34.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.192+0000 7f8bbdede640 1 --2- 172.21.15.47:0/2024424730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bb806f880 0x7f8bb806b200 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.192+0000 7f8bbdede640 1 --2- 172.21.15.47:0/2024424730 >> v2:172.21.15.191:3300/0 conn(0x7f8bb8071d70 0x7f8bb806f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.192+0000 7f8bbdede640 1 --2- 172.21.15.47:0/2024424730 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bb80702e0 0x7f8bb80d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.192+0000 7f8bbdede640 1 -- 172.21.15.47:0/2024424730 >> 172.21.15.47:0/2024424730 conn(0x7f8bb80d0bb0 msgr2=0x7f8bb80d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:34.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.192+0000 7f8bbdede640 1 -- 172.21.15.47:0/2024424730 shutdown_connections 2024-04-14T23:35:34.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.192+0000 7f8bbdede640 1 -- 172.21.15.47:0/2024424730 wait complete. 2024-04-14T23:35:34.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.194+0000 7f8bbdede640 1 Processor -- start 2024-04-14T23:35:34.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.194+0000 7f8bbdede640 1 -- start start 2024-04-14T23:35:34.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.194+0000 7f8bbdede640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bb806f880 0x7f8bb81590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.194+0000 7f8bbdede640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bb80702e0 0x7f8bb8158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.194+0000 7f8bbdede640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bb8071d70 0x7f8bb80a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.194+0000 7f8bbdede640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb806b740 con 0x7f8bb806f880 2024-04-14T23:35:34.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.194+0000 7f8bbdede640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb80706c0 con 0x7f8bb80702e0 2024-04-14T23:35:34.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.194+0000 7f8bbdede640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb806b8c0 con 0x7f8bb8071d70 2024-04-14T23:35:34.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.194+0000 7f8bb77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bb806f880 0x7f8bb81590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.195+0000 7f8bb77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bb806f880 0x7f8bb81590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52258/0 (socket says 172.21.15.47:52258) 2024-04-14T23:35:34.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.195+0000 7f8bb77fe640 1 -- 172.21.15.47:0/1798756402 learned_addr learned my addr 172.21.15.47:0/1798756402 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:34.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.195+0000 7f8baeffd640 1 --2- 172.21.15.47:0/1798756402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bb80702e0 0x7f8bb8158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.195+0000 7f8bb7fff640 1 --2- 172.21.15.47:0/1798756402 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bb8071d70 0x7f8bb80a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.195+0000 7f8bb77fe640 1 -- 172.21.15.47:0/1798756402 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bb8071d70 msgr2=0x7f8bb80a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:34.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.195+0000 7f8bb77fe640 1 --2- 172.21.15.47:0/1798756402 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bb8071d70 0x7f8bb80a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.195+0000 7f8bb77fe640 1 -- 172.21.15.47:0/1798756402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bb80702e0 msgr2=0x7f8bb8158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:34.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.195+0000 7f8bb77fe640 1 --2- 172.21.15.47:0/1798756402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bb80702e0 0x7f8bb8158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.195+0000 7f8bb77fe640 1 -- 172.21.15.47:0/1798756402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb80b41e0 con 0x7f8bb806f880 2024-04-14T23:35:34.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.195+0000 7f8bb77fe640 1 --2- 172.21.15.47:0/1798756402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bb806f880 0x7f8bb81590c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800c7c0 tx=0x7f8ba800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:34.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.195+0000 7f8bb4ff9640 1 -- 172.21.15.47:0/1798756402 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8015070 con 0x7f8bb806f880 2024-04-14T23:35:34.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.195+0000 7f8bb4ff9640 1 -- 172.21.15.47:0/1798756402 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba8007a30 con 0x7f8bb806f880 2024-04-14T23:35:34.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.195+0000 7f8bbdede640 1 -- 172.21.15.47:0/1798756402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb80b2050 con 0x7f8bb806f880 2024-04-14T23:35:34.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.195+0000 7f8bb4ff9640 1 -- 172.21.15.47:0/1798756402 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8007e00 con 0x7f8bb806f880 2024-04-14T23:35:34.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.195+0000 7f8bbdede640 1 -- 172.21.15.47:0/1798756402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb815cd00 con 0x7f8bb806f880 2024-04-14T23:35:34.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.196+0000 7f8bbdede640 1 -- 172.21.15.47:0/1798756402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb8075430 con 0x7f8bb806f880 2024-04-14T23:35:34.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.197+0000 7f8bb4ff9640 1 -- 172.21.15.47:0/1798756402 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f8ba8018070 con 0x7f8bb806f880 2024-04-14T23:35:34.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.197+0000 7f8bb4ff9640 1 --2- 172.21.15.47:0/1798756402 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8b9806b990 0x7f8b9806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.197+0000 7f8bb4ff9640 1 -- 172.21.15.47:0/1798756402 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8ba808ab50 con 0x7f8bb806f880 2024-04-14T23:35:34.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.197+0000 7f8baeffd640 1 --2- 172.21.15.47:0/1798756402 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8b9806b990 0x7f8b9806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.198+0000 7f8baeffd640 1 --2- 172.21.15.47:0/1798756402 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8b9806b990 0x7f8b9806de50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0006fd0 tx=0x7f8ba0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:34.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.202+0000 7f8bb4ff9640 1 -- 172.21.15.47:0/1798756402 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8ba80593f0 con 0x7f8bb806f880 2024-04-14T23:35:34.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.383+0000 7f8bbdede640 1 -- 172.21.15.47:0/1798756402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8bb806dda0 con 0x7f8bb806f880 2024-04-14T23:35:34.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.384+0000 7f8bb4ff9640 1 -- 172.21.15.47:0/1798756402 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18892 (secure 0 0 0) 0x7f8ba8058cf0 con 0x7f8bb806f880 2024-04-14T23:35:34.388 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:34.388 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:35:19.819811+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:34.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.386+0000 7f8bbdede640 1 -- 172.21.15.47:0/1798756402 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8b9806b990 msgr2=0x7f8b9806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:34.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.386+0000 7f8bbdede640 1 --2- 172.21.15.47:0/1798756402 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8b9806b990 0x7f8b9806de50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0006fd0 tx=0x7f8ba0008040 comp rx=0 tx=0).stop 2024-04-14T23:35:34.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.386+0000 7f8bbdede640 1 -- 172.21.15.47:0/1798756402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bb806f880 msgr2=0x7f8bb81590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:34.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.386+0000 7f8bbdede640 1 --2- 172.21.15.47:0/1798756402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bb806f880 0x7f8bb81590c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800c7c0 tx=0x7f8ba800cc80 comp rx=0 tx=0).stop 2024-04-14T23:35:34.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.386+0000 7f8bbdede640 1 -- 172.21.15.47:0/1798756402 shutdown_connections 2024-04-14T23:35:34.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.386+0000 7f8bbdede640 1 --2- 172.21.15.47:0/1798756402 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8b9806b990 0x7f8b9806de50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.386+0000 7f8bbdede640 1 --2- 172.21.15.47:0/1798756402 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8bb8071d70 0x7f8bb80a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.386+0000 7f8bbdede640 1 --2- 172.21.15.47:0/1798756402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bb80702e0 0x7f8bb8158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.386+0000 7f8bbdede640 1 --2- 172.21.15.47:0/1798756402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bb806f880 0x7f8bb81590c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.387+0000 7f8bbdede640 1 -- 172.21.15.47:0/1798756402 >> 172.21.15.47:0/1798756402 conn(0x7f8bb80d0bb0 msgr2=0x7f8bb80b4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:34.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.387+0000 7f8bbdede640 1 -- 172.21.15.47:0/1798756402 shutdown_connections 2024-04-14T23:35:34.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.387+0000 7f8bbdede640 1 -- 172.21.15.47:0/1798756402 wait complete. 2024-04-14T23:35:34.401 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-14T23:35:34.401 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T23:35:34.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.499+0000 7f2467e36640 1 Processor -- start 2024-04-14T23:35:34.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.499+0000 7f2467e36640 1 -- start start 2024-04-14T23:35:34.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.500+0000 7f2467e36640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f246015e270 0x7f24600d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.500+0000 7f2467e36640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24600d1e00 0x7f24600d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.500+0000 7f2467e36640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24600b57a0 con 0x7f24600d1450 2024-04-14T23:35:34.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.500+0000 7f2467e36640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f24600b4300 con 0x7f246015e270 2024-04-14T23:35:34.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.500+0000 7f2467e36640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f24600b39d0 con 0x7f24600d1e00 2024-04-14T23:35:34.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.500+0000 7f2465bd2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f246015e270 0x7f24600d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.500+0000 7f2465bd2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f246015e270 0x7f24600d0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52268/0 (socket says 172.21.15.47:52268) 2024-04-14T23:35:34.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.500+0000 7f2465bd2640 1 -- 172.21.15.47:0/4093833544 learned_addr learned my addr 172.21.15.47:0/4093833544 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:34.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.501+0000 7f24653d1640 1 --2- 172.21.15.47:0/4093833544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24600d1e00 0x7f24600d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.501+0000 7f2465bd2640 1 -- 172.21.15.47:0/4093833544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24600d1e00 msgr2=0x7f24600d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:34.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.501+0000 7f2465bd2640 1 --2- 172.21.15.47:0/4093833544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24600d1e00 0x7f24600d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.501+0000 7f2465bd2640 1 -- 172.21.15.47:0/4093833544 >> v1:172.21.15.191:6789/0 conn(0x7f24600d1450 legacy=0x7f24600ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:34.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.501+0000 7f2465bd2640 1 -- 172.21.15.47:0/4093833544 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24600b3cb0 con 0x7f246015e270 2024-04-14T23:35:34.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.501+0000 7f2465bd2640 1 --2- 172.21.15.47:0/4093833544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f246015e270 0x7f24600d0f10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2458009870 tx=0x7f245802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84774d2d5738ecd server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:34.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.501+0000 7f2464bd0640 1 -- 172.21.15.47:0/4093833544 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2458034070 con 0x7f246015e270 2024-04-14T23:35:34.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.502+0000 7f2464bd0640 1 -- 172.21.15.47:0/4093833544 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2458030840 con 0x7f246015e270 2024-04-14T23:35:34.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.502+0000 7f2464bd0640 1 -- 172.21.15.47:0/4093833544 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2458030c10 con 0x7f246015e270 2024-04-14T23:35:34.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.502+0000 7f2467e36640 1 -- 172.21.15.47:0/4093833544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f246015e270 msgr2=0x7f24600d0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:34.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.502+0000 7f2467e36640 1 --2- 172.21.15.47:0/4093833544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f246015e270 0x7f24600d0f10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2458009870 tx=0x7f245802b980 comp rx=0 tx=0).stop 2024-04-14T23:35:34.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.502+0000 7f2467e36640 1 -- 172.21.15.47:0/4093833544 shutdown_connections 2024-04-14T23:35:34.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.502+0000 7f2467e36640 1 --2- 172.21.15.47:0/4093833544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24600d1e00 0x7f24600d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.502+0000 7f2467e36640 1 --2- 172.21.15.47:0/4093833544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f246015e270 0x7f24600d0f10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.502+0000 7f2467e36640 1 -- 172.21.15.47:0/4093833544 >> 172.21.15.47:0/4093833544 conn(0x7f24600d3ed0 msgr2=0x7f24600d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:34.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.502+0000 7f2467e36640 1 -- 172.21.15.47:0/4093833544 shutdown_connections 2024-04-14T23:35:34.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.502+0000 7f2467e36640 1 -- 172.21.15.47:0/4093833544 wait complete. 2024-04-14T23:35:34.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.503+0000 7f2467e36640 1 Processor -- start 2024-04-14T23:35:34.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.503+0000 7f2467e36640 1 -- start start 2024-04-14T23:35:34.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f2467e36640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24600d1450 0x7f24600b7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f2467e36640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24600d1e00 0x7f24600cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f2467e36640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f246015e270 0x7f24600cd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f2467e36640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f246015e650 con 0x7f24600d1450 2024-04-14T23:35:34.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f2467e36640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f24600b0c60 con 0x7f24600d1e00 2024-04-14T23:35:34.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f2467e36640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f246015e7d0 con 0x7f246015e270 2024-04-14T23:35:34.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f2465bd2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24600d1450 0x7f24600b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f2465bd2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24600d1450 0x7f24600b7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52284/0 (socket says 172.21.15.47:52284) 2024-04-14T23:35:34.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f2465bd2640 1 -- 172.21.15.47:0/3683570528 learned_addr learned my addr 172.21.15.47:0/3683570528 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:34.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f24653d1640 1 --2- 172.21.15.47:0/3683570528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24600d1e00 0x7f24600cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f24663d3640 1 --2- 172.21.15.47:0/3683570528 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f246015e270 0x7f24600cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f2465bd2640 1 -- 172.21.15.47:0/3683570528 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f246015e270 msgr2=0x7f24600cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:34.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f2465bd2640 1 --2- 172.21.15.47:0/3683570528 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f246015e270 0x7f24600cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f2465bd2640 1 -- 172.21.15.47:0/3683570528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24600d1e00 msgr2=0x7f24600cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:34.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f2465bd2640 1 --2- 172.21.15.47:0/3683570528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24600d1e00 0x7f24600cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f2465bd2640 1 -- 172.21.15.47:0/3683570528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f246009f4c0 con 0x7f24600d1450 2024-04-14T23:35:34.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.504+0000 7f24653d1640 1 --2- 172.21.15.47:0/3683570528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24600d1e00 0x7f24600cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:34.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.505+0000 7f2465bd2640 1 --2- 172.21.15.47:0/3683570528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24600d1450 0x7f24600b7840 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2458009870 tx=0x7f24580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:34.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.505+0000 7f245e7fc640 1 -- 172.21.15.47:0/3683570528 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2458034040 con 0x7f24600d1450 2024-04-14T23:35:34.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.505+0000 7f245e7fc640 1 -- 172.21.15.47:0/3683570528 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2458039d90 con 0x7f24600d1450 2024-04-14T23:35:34.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.505+0000 7f2467e36640 1 -- 172.21.15.47:0/3683570528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24600b8070 con 0x7f24600d1450 2024-04-14T23:35:34.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.505+0000 7f245e7fc640 1 -- 172.21.15.47:0/3683570528 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2458043610 con 0x7f24600d1450 2024-04-14T23:35:34.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.505+0000 7f2467e36640 1 -- 172.21.15.47:0/3683570528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24600b8630 con 0x7f24600d1450 2024-04-14T23:35:34.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.506+0000 7f2467e36640 1 -- 172.21.15.47:0/3683570528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2460075430 con 0x7f24600d1450 2024-04-14T23:35:34.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.506+0000 7f245e7fc640 1 -- 172.21.15.47:0/3683570528 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f245804a060 con 0x7f24600d1450 2024-04-14T23:35:34.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.507+0000 7f245e7fc640 1 --2- 172.21.15.47:0/3683570528 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f244c06b990 0x7f244c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.507+0000 7f245e7fc640 1 -- 172.21.15.47:0/3683570528 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f24580accf0 con 0x7f24600d1450 2024-04-14T23:35:34.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.507+0000 7f24653d1640 1 --2- 172.21.15.47:0/3683570528 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f244c06b990 0x7f244c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.507+0000 7f24653d1640 1 --2- 172.21.15.47:0/3683570528 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f244c06b990 0x7f244c06de50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2460160b20 tx=0x7f2454008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:34.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.511+0000 7f245e7fc640 1 -- 172.21.15.47:0/3683570528 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f24580b1070 con 0x7f24600d1450 2024-04-14T23:35:34.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.733+0000 7f2467e36640 1 -- 172.21.15.47:0/3683570528 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24600cee40 con 0x7f24600d1450 2024-04-14T23:35:34.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.733+0000 7f245e7fc640 1 -- 172.21.15.47:0/3683570528 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f246009f4c0 con 0x7f24600d1450 2024-04-14T23:35:34.737 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:34.737 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/416388535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":416388535},{"type":"v1","addr":"172.21.15.191:6837","nonce":416388535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/2830978927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2830978927},{"type":"v1","addr":"172.21.15.47:6833","nonce":2830978927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/4025654680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":4025654680},{"type":"v1","addr":"172.21.15.191:6836","nonce":4025654680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T23:34:38.059644+0000","modified":"2024-04-14T23:34:54.105483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/1169029730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1169029730},{"type":"v1","addr":"172.21.15.47:6835","nonce":1169029730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-14T23:35:34.737 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-04-14T23:35:34.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.735+0000 7f2467e36640 1 -- 172.21.15.47:0/3683570528 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f244c06b990 msgr2=0x7f244c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:34.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.735+0000 7f2467e36640 1 --2- 172.21.15.47:0/3683570528 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f244c06b990 0x7f244c06de50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2460160b20 tx=0x7f2454008040 comp rx=0 tx=0).stop 2024-04-14T23:35:34.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.735+0000 7f2467e36640 1 -- 172.21.15.47:0/3683570528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24600d1450 msgr2=0x7f24600b7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:34.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.735+0000 7f2467e36640 1 --2- 172.21.15.47:0/3683570528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24600d1450 0x7f24600b7840 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2458009870 tx=0x7f24580046c0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.735+0000 7f2467e36640 1 -- 172.21.15.47:0/3683570528 shutdown_connections 2024-04-14T23:35:34.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.735+0000 7f2467e36640 1 --2- 172.21.15.47:0/3683570528 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f244c06b990 0x7f244c06de50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.735+0000 7f2467e36640 1 --2- 172.21.15.47:0/3683570528 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f246015e270 0x7f24600cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.736+0000 7f2467e36640 1 --2- 172.21.15.47:0/3683570528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24600d1e00 0x7f24600cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.736+0000 7f2467e36640 1 --2- 172.21.15.47:0/3683570528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24600d1450 0x7f24600b7840 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.736+0000 7f2467e36640 1 -- 172.21.15.47:0/3683570528 >> 172.21.15.47:0/3683570528 conn(0x7f24600d3ed0 msgr2=0x7f24600d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:34.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.736+0000 7f2467e36640 1 -- 172.21.15.47:0/3683570528 shutdown_connections 2024-04-14T23:35:34.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.736+0000 7f2467e36640 1 -- 172.21.15.47:0/3683570528 wait complete. 2024-04-14T23:35:34.749 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T23:35:34.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.848+0000 7f77d67e0640 1 Processor -- start 2024-04-14T23:35:34.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.848+0000 7f77d67e0640 1 -- start start 2024-04-14T23:35:34.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.848+0000 7f77d67e0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77d00d0980 0x7f77d00cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.848+0000 7f77d67e0640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f77d00cccd0 0x7f77d00cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.848+0000 7f77d67e0640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77d00d1040 con 0x7f77d015e420 2024-04-14T23:35:34.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.848+0000 7f77d67e0640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f77d00cc280 con 0x7f77d00cccd0 2024-04-14T23:35:34.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.848+0000 7f77d67e0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f77d006d750 con 0x7f77d00d0980 2024-04-14T23:35:34.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.849+0000 7f77d4d7d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f77d00cccd0 0x7f77d00cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.849+0000 7f77d4d7d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f77d00cccd0 0x7f77d00cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:59642/0 (socket says 172.21.15.47:59642) 2024-04-14T23:35:34.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.849+0000 7f77cf7fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77d00d0980 0x7f77d00cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.849+0000 7f77d4d7d640 1 -- 172.21.15.47:0/1194494743 learned_addr learned my addr 172.21.15.47:0/1194494743 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:34.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.849+0000 7f77d4d7d640 1 -- 172.21.15.47:0/1194494743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77d00d0980 msgr2=0x7f77d00cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:34.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.849+0000 7f77d4d7d640 1 --2- 172.21.15.47:0/1194494743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77d00d0980 0x7f77d00cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.849+0000 7f77d4d7d640 1 -- 172.21.15.47:0/1194494743 >> v1:172.21.15.191:6789/0 conn(0x7f77d015e420 legacy=0x7f77d00ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:34.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.849+0000 7f77ceffd640 1 -- 172.21.15.47:0/1194494743 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 37030272 0 0) 0x7f77d00d1040 con 0x7f77d015e420 2024-04-14T23:35:34.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.849+0000 7f77d4d7d640 1 -- 172.21.15.47:0/1194494743 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d00d1320 con 0x7f77d00cccd0 2024-04-14T23:35:34.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.850+0000 7f77d4d7d640 1 --2- 172.21.15.47:0/1194494743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77d00cccd0 0x7f77d00cd160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f77c8009e50 tx=0x7f77c802bff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5db9f96c4266059a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:34.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.850+0000 7f77ceffd640 1 -- 172.21.15.47:0/1194494743 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c802cb90 con 0x7f77d00cccd0 2024-04-14T23:35:34.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.850+0000 7f77ceffd640 1 -- 172.21.15.47:0/1194494743 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c802cd30 con 0x7f77d00cccd0 2024-04-14T23:35:34.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.850+0000 7f77ceffd640 1 -- 172.21.15.47:0/1194494743 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c8034610 con 0x7f77d00cccd0 2024-04-14T23:35:34.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.850+0000 7f77d67e0640 1 -- 172.21.15.47:0/1194494743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77d00cccd0 msgr2=0x7f77d00cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:34.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.850+0000 7f77d67e0640 1 --2- 172.21.15.47:0/1194494743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77d00cccd0 0x7f77d00cd160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f77c8009e50 tx=0x7f77c802bff0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.851+0000 7f77d67e0640 1 -- 172.21.15.47:0/1194494743 shutdown_connections 2024-04-14T23:35:34.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.851+0000 7f77d67e0640 1 --2- 172.21.15.47:0/1194494743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77d00cccd0 0x7f77d00cd160 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.851+0000 7f77d67e0640 1 --2- 172.21.15.47:0/1194494743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77d00d0980 0x7f77d00cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.851+0000 7f77d67e0640 1 -- 172.21.15.47:0/1194494743 >> 172.21.15.47:0/1194494743 conn(0x7f77d00d1c30 msgr2=0x7f77d00d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:34.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.851+0000 7f77d67e0640 1 -- 172.21.15.47:0/1194494743 shutdown_connections 2024-04-14T23:35:34.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.851+0000 7f77d67e0640 1 -- 172.21.15.47:0/1194494743 wait complete. 2024-04-14T23:35:34.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.852+0000 7f77d67e0640 1 Processor -- start 2024-04-14T23:35:34.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.852+0000 7f77d67e0640 1 -- start start 2024-04-14T23:35:34.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77d67e0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77d00cccd0 0x7f77d006fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77d67e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d00d0980 0x7f77d0070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77d67e0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77d015e420 0x7f77d0160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77d67e0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77d00cc7b0 con 0x7f77d00d0980 2024-04-14T23:35:34.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77d67e0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f77d00d0de0 con 0x7f77d00cccd0 2024-04-14T23:35:34.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77d67e0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f77d015e800 con 0x7f77d015e420 2024-04-14T23:35:34.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77cf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d00d0980 0x7f77d0070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77cf7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d00d0980 0x7f77d0070090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52294/0 (socket says 172.21.15.47:52294) 2024-04-14T23:35:34.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77cf7fe640 1 -- 172.21.15.47:0/835764333 learned_addr learned my addr 172.21.15.47:0/835764333 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:34.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77cffff640 1 --2- 172.21.15.47:0/835764333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77d00cccd0 0x7f77d006fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77d4d7d640 1 --2- 172.21.15.47:0/835764333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77d015e420 0x7f77d0160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77cf7fe640 1 -- 172.21.15.47:0/835764333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77d015e420 msgr2=0x7f77d0160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:34.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77cf7fe640 1 --2- 172.21.15.47:0/835764333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77d015e420 0x7f77d0160050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77cf7fe640 1 -- 172.21.15.47:0/835764333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77d00cccd0 msgr2=0x7f77d006fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:34.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77cf7fe640 1 --2- 172.21.15.47:0/835764333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77d00cccd0 0x7f77d006fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:34.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77cf7fe640 1 -- 172.21.15.47:0/835764333 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d0160cc0 con 0x7f77d00d0980 2024-04-14T23:35:34.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77cf7fe640 1 --2- 172.21.15.47:0/835764333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d00d0980 0x7f77d0070090 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f77c400e9e0 tx=0x7f77c400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:34.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77ccff9640 1 -- 172.21.15.47:0/835764333 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c4017070 con 0x7f77d00d0980 2024-04-14T23:35:34.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77ccff9640 1 -- 172.21.15.47:0/835764333 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c400c9d0 con 0x7f77d00d0980 2024-04-14T23:35:34.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77ccff9640 1 -- 172.21.15.47:0/835764333 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c400cdc0 con 0x7f77d00d0980 2024-04-14T23:35:34.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77d67e0640 1 -- 172.21.15.47:0/835764333 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d0160fa0 con 0x7f77d00d0980 2024-04-14T23:35:34.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.853+0000 7f77d67e0640 1 -- 172.21.15.47:0/835764333 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d00ca830 con 0x7f77d00d0980 2024-04-14T23:35:34.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.854+0000 7f77d67e0640 1 -- 172.21.15.47:0/835764333 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d0075430 con 0x7f77d00d0980 2024-04-14T23:35:34.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.855+0000 7f77ccff9640 1 -- 172.21.15.47:0/835764333 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f77c401a070 con 0x7f77d00d0980 2024-04-14T23:35:34.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.855+0000 7f77ccff9640 1 --2- 172.21.15.47:0/835764333 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f77bc06b990 0x7f77bc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:34.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.855+0000 7f77ccff9640 1 -- 172.21.15.47:0/835764333 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f77c408aed0 con 0x7f77d00d0980 2024-04-14T23:35:34.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.855+0000 7f77cffff640 1 --2- 172.21.15.47:0/835764333 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f77bc06b990 0x7f77bc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:34.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.856+0000 7f77cffff640 1 --2- 172.21.15.47:0/835764333 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f77bc06b990 0x7f77bc06de50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f77c0000f60 tx=0x7f77c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:34.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:34.859+0000 7f77ccff9640 1 -- 172.21.15.47:0/835764333 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f77c4059120 con 0x7f77d00d0980 2024-04-14T23:35:35.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.079+0000 7f77d67e0640 1 -- 172.21.15.47:0/835764333 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77d006c310 con 0x7f77d00d0980 2024-04-14T23:35:35.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.079+0000 7f77ccff9640 1 -- 172.21.15.47:0/835764333 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5180 (secure 0 0 0) 0x7f77c405d1c0 con 0x7f77d00d0980 2024-04-14T23:35:35.083 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:35.083 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/416388535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":416388535},{"type":"v1","addr":"172.21.15.191:6837","nonce":416388535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/2830978927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2830978927},{"type":"v1","addr":"172.21.15.47:6833","nonce":2830978927}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/4025654680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":4025654680},{"type":"v1","addr":"172.21.15.191:6836","nonce":4025654680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T23:34:38.059644+0000","modified":"2024-04-14T23:34:54.105483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/1169029730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1169029730},{"type":"v1","addr":"172.21.15.47:6835","nonce":1169029730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-14T23:35:35.083 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-04-14T23:35:35.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.081+0000 7f77d67e0640 1 -- 172.21.15.47:0/835764333 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f77bc06b990 msgr2=0x7f77bc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.081+0000 7f77d67e0640 1 --2- 172.21.15.47:0/835764333 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f77bc06b990 0x7f77bc06de50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f77c0000f60 tx=0x7f77c0009040 comp rx=0 tx=0).stop 2024-04-14T23:35:35.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.081+0000 7f77d67e0640 1 -- 172.21.15.47:0/835764333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d00d0980 msgr2=0x7f77d0070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.081+0000 7f77d67e0640 1 --2- 172.21.15.47:0/835764333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d00d0980 0x7f77d0070090 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f77c400e9e0 tx=0x7f77c400eea0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.081+0000 7f77d67e0640 1 -- 172.21.15.47:0/835764333 shutdown_connections 2024-04-14T23:35:35.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.081+0000 7f77d67e0640 1 --2- 172.21.15.47:0/835764333 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f77bc06b990 0x7f77bc06de50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.081+0000 7f77d67e0640 1 --2- 172.21.15.47:0/835764333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77d015e420 0x7f77d0160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.081+0000 7f77d67e0640 1 --2- 172.21.15.47:0/835764333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d00d0980 0x7f77d0070090 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.081+0000 7f77d67e0640 1 --2- 172.21.15.47:0/835764333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77d00cccd0 0x7f77d006fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.081+0000 7f77d67e0640 1 -- 172.21.15.47:0/835764333 >> 172.21.15.47:0/835764333 conn(0x7f77d00d1c30 msgr2=0x7f77d00cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:35.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.081+0000 7f77d67e0640 1 -- 172.21.15.47:0/835764333 shutdown_connections 2024-04-14T23:35:35.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.081+0000 7f77d67e0640 1 -- 172.21.15.47:0/835764333 wait complete. 2024-04-14T23:35:35.095 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:35.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.194+0000 7f8ec91b4640 1 Processor -- start 2024-04-14T23:35:35.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.194+0000 7f8ec91b4640 1 -- start start 2024-04-14T23:35:35.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.195+0000 7f8ec91b4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ec406b200 0x7f8ec406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.195+0000 7f8ec91b4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8ec406b5e0 0x7f8ec40b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.195+0000 7f8ec91b4640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec406fc40 con 0x7f8ec40b4130 2024-04-14T23:35:35.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.195+0000 7f8ec91b4640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f8ec40b47b0 con 0x7f8ec406b5e0 2024-04-14T23:35:35.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.195+0000 7f8ec91b4640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f8ec406e940 con 0x7f8ec406b200 2024-04-14T23:35:35.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.195+0000 7f8ebbfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8ec406b5e0 0x7f8ec40b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.195+0000 7f8ebbfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8ec406b5e0 0x7f8ec40b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52306/0 (socket says 172.21.15.47:52306) 2024-04-14T23:35:35.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.195+0000 7f8ec359e640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8ec40b4130 0x7f8ec40ad8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:38584/0 (socket says 172.21.15.47:38584) 2024-04-14T23:35:35.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.195+0000 7f8ebbfff640 1 -- 172.21.15.47:0/3720791377 learned_addr learned my addr 172.21.15.47:0/3720791377 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:35.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.195+0000 7f8ec2d9d640 1 --2- 172.21.15.47:0/3720791377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ec406b200 0x7f8ec406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.195+0000 7f8ebbfff640 1 -- 172.21.15.47:0/3720791377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ec406b200 msgr2=0x7f8ec406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:35.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.195+0000 7f8ebbfff640 1 --2- 172.21.15.47:0/3720791377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ec406b200 0x7f8ec406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.195+0000 7f8ebbfff640 1 -- 172.21.15.47:0/3720791377 >> v1:172.21.15.47:6789/0 conn(0x7f8ec40b4130 legacy=0x7f8ec40ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.195+0000 7f8ebbfff640 1 -- 172.21.15.47:0/3720791377 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec406ec20 con 0x7f8ec406b5e0 2024-04-14T23:35:35.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.195+0000 7f8ec259c640 1 -- 172.21.15.47:0/3720791377 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3120634180 0 0) 0x7f8ec406fc40 con 0x7f8ec40b4130 2024-04-14T23:35:35.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.196+0000 7f8ebbfff640 1 --2- 172.21.15.47:0/3720791377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec406b5e0 0x7f8ec40b3bf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009870 tx=0x7f8eac02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2b32341d2f4c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:35.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.196+0000 7f8ec259c640 1 -- 172.21.15.47:0/3720791377 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac034070 con 0x7f8ec406b5e0 2024-04-14T23:35:35.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.196+0000 7f8ec259c640 1 -- 172.21.15.47:0/3720791377 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eac030840 con 0x7f8ec406b5e0 2024-04-14T23:35:35.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.196+0000 7f8ec259c640 1 -- 172.21.15.47:0/3720791377 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac030c10 con 0x7f8ec406b5e0 2024-04-14T23:35:35.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.197+0000 7f8ec91b4640 1 -- 172.21.15.47:0/3720791377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec406b5e0 msgr2=0x7f8ec40b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.197+0000 7f8ec91b4640 1 --2- 172.21.15.47:0/3720791377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec406b5e0 0x7f8ec40b3bf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009870 tx=0x7f8eac02b980 comp rx=0 tx=0).stop 2024-04-14T23:35:35.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.197+0000 7f8ec91b4640 1 -- 172.21.15.47:0/3720791377 shutdown_connections 2024-04-14T23:35:35.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.197+0000 7f8ec91b4640 1 --2- 172.21.15.47:0/3720791377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec406b5e0 0x7f8ec40b3bf0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.197+0000 7f8ec91b4640 1 --2- 172.21.15.47:0/3720791377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ec406b200 0x7f8ec406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.197+0000 7f8ec91b4640 1 -- 172.21.15.47:0/3720791377 >> 172.21.15.47:0/3720791377 conn(0x7f8ec406c310 msgr2=0x7f8ec406c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:35.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.197+0000 7f8ec91b4640 1 -- 172.21.15.47:0/3720791377 shutdown_connections 2024-04-14T23:35:35.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.197+0000 7f8ec91b4640 1 -- 172.21.15.47:0/3720791377 wait complete. 2024-04-14T23:35:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.198+0000 7f8ec91b4640 1 Processor -- start 2024-04-14T23:35:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.198+0000 7f8ec91b4640 1 -- start start 2024-04-14T23:35:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ec91b4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec406b200 0x7f8ec413c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ec91b4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ec406b5e0 0x7f8ec4139920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ec91b4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ec40b4130 0x7f8ec413ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ec91b4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec4147d10 con 0x7f8ec406b200 2024-04-14T23:35:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ec91b4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec406f1e0 con 0x7f8ec40b4130 2024-04-14T23:35:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ec91b4640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f8ec406ba20 con 0x7f8ec406b5e0 2024-04-14T23:35:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ec2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec406b200 0x7f8ec413c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ec2d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec406b200 0x7f8ec413c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52320/0 (socket says 172.21.15.47:52320) 2024-04-14T23:35:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ec2d9d640 1 -- 172.21.15.47:0/4089896600 learned_addr learned my addr 172.21.15.47:0/4089896600 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ec359e640 1 --2- 172.21.15.47:0/4089896600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ec40b4130 0x7f8ec413ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ebbfff640 1 --2- 172.21.15.47:0/4089896600 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ec406b5e0 0x7f8ec4139920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ec2d9d640 1 -- 172.21.15.47:0/4089896600 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ec406b5e0 msgr2=0x7f8ec4139920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ec2d9d640 1 --2- 172.21.15.47:0/4089896600 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ec406b5e0 0x7f8ec4139920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ec2d9d640 1 -- 172.21.15.47:0/4089896600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ec40b4130 msgr2=0x7f8ec413ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ec2d9d640 1 --2- 172.21.15.47:0/4089896600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ec40b4130 0x7f8ec413ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ec2d9d640 1 -- 172.21.15.47:0/4089896600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec413b4c0 con 0x7f8ec406b200 2024-04-14T23:35:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.199+0000 7f8ec359e640 1 --2- 172.21.15.47:0/4089896600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ec40b4130 0x7f8ec413ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.200+0000 7f8ec2d9d640 1 --2- 172.21.15.47:0/4089896600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec406b200 0x7f8ec413c560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8eb400d800 tx=0x7f8eb400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.200+0000 7f8ebb7fe640 1 -- 172.21.15.47:0/4089896600 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb400b6c0 con 0x7f8ec406b200 2024-04-14T23:35:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.200+0000 7f8ebb7fe640 1 -- 172.21.15.47:0/4089896600 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb4019070 con 0x7f8ec406b200 2024-04-14T23:35:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.200+0000 7f8ec91b4640 1 -- 172.21.15.47:0/4089896600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec413b7a0 con 0x7f8ec406b200 2024-04-14T23:35:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.200+0000 7f8ebb7fe640 1 -- 172.21.15.47:0/4089896600 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb400ba80 con 0x7f8ec406b200 2024-04-14T23:35:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.200+0000 7f8ec91b4640 1 -- 172.21.15.47:0/4089896600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec413bd60 con 0x7f8ec406b200 2024-04-14T23:35:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.201+0000 7f8ec91b4640 1 -- 172.21.15.47:0/4089896600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ec4075430 con 0x7f8ec406b200 2024-04-14T23:35:35.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.201+0000 7f8ebb7fe640 1 -- 172.21.15.47:0/4089896600 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f8eb400bc20 con 0x7f8ec406b200 2024-04-14T23:35:35.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.201+0000 7f8ebb7fe640 1 --2- 172.21.15.47:0/4089896600 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8ea406b990 0x7f8ea406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.202+0000 7f8ebb7fe640 1 -- 172.21.15.47:0/4089896600 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8eb408b1a0 con 0x7f8ec406b200 2024-04-14T23:35:35.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.202+0000 7f8ebbfff640 1 --2- 172.21.15.47:0/4089896600 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8ea406b990 0x7f8ea406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.202+0000 7f8ebbfff640 1 --2- 172.21.15.47:0/4089896600 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8ea406b990 0x7f8ea406de50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8eac036000 tx=0x7f8eac03b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:35.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.206+0000 7f8ebb7fe640 1 -- 172.21.15.47:0/4089896600 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8eb4059930 con 0x7f8ec406b200 2024-04-14T23:35:35.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.389+0000 7f8ec91b4640 1 -- 172.21.15.47:0/4089896600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ec4074940 con 0x7f8ec406b200 2024-04-14T23:35:35.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.391+0000 7f8ebb7fe640 1 -- 172.21.15.47:0/4089896600 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18892 (secure 0 0 0) 0x7f8eb4059230 con 0x7f8ec406b200 2024-04-14T23:35:35.394 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:35.394 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:35:19.819811+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:34:36.382034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T23:34:37.023103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T23:34:40.726418+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:35.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.392+0000 7f8ec91b4640 1 -- 172.21.15.47:0/4089896600 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8ea406b990 msgr2=0x7f8ea406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.392+0000 7f8ec91b4640 1 --2- 172.21.15.47:0/4089896600 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8ea406b990 0x7f8ea406de50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8eac036000 tx=0x7f8eac03b040 comp rx=0 tx=0).stop 2024-04-14T23:35:35.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.393+0000 7f8ec91b4640 1 -- 172.21.15.47:0/4089896600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec406b200 msgr2=0x7f8ec413c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.393+0000 7f8ec91b4640 1 --2- 172.21.15.47:0/4089896600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec406b200 0x7f8ec413c560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8eb400d800 tx=0x7f8eb400dcc0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.393+0000 7f8ec91b4640 1 -- 172.21.15.47:0/4089896600 shutdown_connections 2024-04-14T23:35:35.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.393+0000 7f8ec91b4640 1 --2- 172.21.15.47:0/4089896600 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8ea406b990 0x7f8ea406de50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.393+0000 7f8ec91b4640 1 --2- 172.21.15.47:0/4089896600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ec40b4130 0x7f8ec413ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.393+0000 7f8ec91b4640 1 --2- 172.21.15.47:0/4089896600 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ec406b5e0 0x7f8ec4139920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.393+0000 7f8ec91b4640 1 --2- 172.21.15.47:0/4089896600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec406b200 0x7f8ec413c560 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.393+0000 7f8ec91b4640 1 -- 172.21.15.47:0/4089896600 >> 172.21.15.47:0/4089896600 conn(0x7f8ec406c310 msgr2=0x7f8ec40726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:35.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.393+0000 7f8ec91b4640 1 -- 172.21.15.47:0/4089896600 shutdown_connections 2024-04-14T23:35:35.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.393+0000 7f8ec91b4640 1 -- 172.21.15.47:0/4089896600 wait complete. 2024-04-14T23:35:35.407 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-14T23:35:35.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.506+0000 7faedf20f640 1 Processor -- start 2024-04-14T23:35:35.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.506+0000 7faedf20f640 1 -- start start 2024-04-14T23:35:35.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.507+0000 7faedf20f640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7faed80cdcb0 0x7faed80cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.507+0000 7faedf20f640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faed8162d10 con 0x7faed806d0b0 2024-04-14T23:35:35.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.507+0000 7faedf20f640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faed80cfed0 con 0x7faed806cc20 2024-04-14T23:35:35.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.507+0000 7faedf20f640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7faed80d0170 con 0x7faed80cdcb0 2024-04-14T23:35:35.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.507+0000 7faedd7ac640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7faed806d0b0 0x7faed8162600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:38592/0 (socket says 172.21.15.47:38592) 2024-04-14T23:35:35.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.507+0000 7faedd7ac640 1 -- 172.21.15.47:0/1877672450 learned_addr learned my addr 172.21.15.47:0/1877672450 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.507+0000 7faedcfab640 1 --2- 172.21.15.47:0/1877672450 >> v2:172.21.15.191:3300/0 conn(0x7faed80cdcb0 0x7faed80cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.507+0000 7faed77fe640 1 -- 172.21.15.47:0/1877672450 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2961274529 0 0) 0x7faed8162d10 con 0x7faed806d0b0 2024-04-14T23:35:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.508+0000 7faed77fe640 1 -- 172.21.15.47:0/1877672450 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faec8003520 con 0x7faed806d0b0 2024-04-14T23:35:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.508+0000 7faed77fe640 1 -- 172.21.15.47:0/1877672450 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1427876911 0 0) 0x7faec8003520 con 0x7faed806d0b0 2024-04-14T23:35:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.508+0000 7faedcfab640 1 -- 172.21.15.47:0/1877672450 >> v1:172.21.15.191:6789/0 conn(0x7faed806cc20 legacy=0x7faed8161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.508+0000 7faedcfab640 1 -- 172.21.15.47:0/1877672450 >> v1:172.21.15.47:6789/0 conn(0x7faed806d0b0 legacy=0x7faed8162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.508+0000 7faedcfab640 1 -- 172.21.15.47:0/1877672450 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed80d0450 con 0x7faed80cdcb0 2024-04-14T23:35:35.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.509+0000 7faedcfab640 1 --2- 172.21.15.47:0/1877672450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faed80cdcb0 0x7faed80cef20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faecc0097a0 tx=0x7faecc02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcc9c30f1126c3f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:35.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.509+0000 7faed77fe640 1 -- 172.21.15.47:0/1877672450 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc038070 con 0x7faed80cdcb0 2024-04-14T23:35:35.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.509+0000 7faed77fe640 1 -- 172.21.15.47:0/1877672450 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faecc031500 con 0x7faed80cdcb0 2024-04-14T23:35:35.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.509+0000 7faed77fe640 1 -- 172.21.15.47:0/1877672450 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed00019f0 con 0x7faed80cdcb0 2024-04-14T23:35:35.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.509+0000 7faedf20f640 1 -- 172.21.15.47:0/1877672450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faed80cdcb0 msgr2=0x7faed80cef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.509+0000 7faedf20f640 1 --2- 172.21.15.47:0/1877672450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faed80cdcb0 0x7faed80cef20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faecc0097a0 tx=0x7faecc02b820 comp rx=0 tx=0).stop 2024-04-14T23:35:35.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.509+0000 7faedf20f640 1 -- 172.21.15.47:0/1877672450 shutdown_connections 2024-04-14T23:35:35.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.509+0000 7faedf20f640 1 --2- 172.21.15.47:0/1877672450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faed80cdcb0 0x7faed80cef20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.509+0000 7faedf20f640 1 -- 172.21.15.47:0/1877672450 >> 172.21.15.47:0/1877672450 conn(0x7faed80d1c90 msgr2=0x7faed80d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:35.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.509+0000 7faedf20f640 1 -- 172.21.15.47:0/1877672450 shutdown_connections 2024-04-14T23:35:35.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.509+0000 7faedf20f640 1 -- 172.21.15.47:0/1877672450 wait complete. 2024-04-14T23:35:35.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.510+0000 7faedf20f640 1 Processor -- start 2024-04-14T23:35:35.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.510+0000 7faedf20f640 1 -- start start 2024-04-14T23:35:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.511+0000 7faedf20f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faed806cc20 0x7faed814b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.511+0000 7faedf20f640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faed806d0b0 0x7faed80c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.511+0000 7faedf20f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed80cdcb0 0x7faed80b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.511+0000 7faedf20f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faed80d0cf0 con 0x7faed80cdcb0 2024-04-14T23:35:35.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.511+0000 7faedf20f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faed80d0a10 con 0x7faed806cc20 2024-04-14T23:35:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.511+0000 7faedf20f640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7faed80ce090 con 0x7faed806d0b0 2024-04-14T23:35:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.511+0000 7faedd7ac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed80cdcb0 0x7faed80b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.512+0000 7faedd7ac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed80cdcb0 0x7faed80b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52332/0 (socket says 172.21.15.47:52332) 2024-04-14T23:35:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.512+0000 7faedd7ac640 1 -- 172.21.15.47:0/4253119096 learned_addr learned my addr 172.21.15.47:0/4253119096 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.512+0000 7faedcfab640 1 --2- 172.21.15.47:0/4253119096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faed806cc20 0x7faed814b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.512+0000 7faed7fff640 1 --2- 172.21.15.47:0/4253119096 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faed806d0b0 0x7faed80c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.512+0000 7faedd7ac640 1 -- 172.21.15.47:0/4253119096 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faed806d0b0 msgr2=0x7faed80c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.512+0000 7faedd7ac640 1 --2- 172.21.15.47:0/4253119096 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faed806d0b0 0x7faed80c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.512+0000 7faedd7ac640 1 -- 172.21.15.47:0/4253119096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faed806cc20 msgr2=0x7faed814b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.512+0000 7faedd7ac640 1 --2- 172.21.15.47:0/4253119096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faed806cc20 0x7faed814b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.512+0000 7faedd7ac640 1 -- 172.21.15.47:0/4253119096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed814e3e0 con 0x7faed80cdcb0 2024-04-14T23:35:35.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.512+0000 7faedd7ac640 1 --2- 172.21.15.47:0/4253119096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed80cdcb0 0x7faed80b3750 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7faed000cc90 tx=0x7faed000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:35.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.512+0000 7faed57fa640 1 -- 172.21.15.47:0/4253119096 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed000ce40 con 0x7faed80cdcb0 2024-04-14T23:35:35.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.512+0000 7faed57fa640 1 -- 172.21.15.47:0/4253119096 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed0012400 con 0x7faed80cdcb0 2024-04-14T23:35:35.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.512+0000 7faed57fa640 1 -- 172.21.15.47:0/4253119096 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed00127f0 con 0x7faed80cdcb0 2024-04-14T23:35:35.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.512+0000 7faedf20f640 1 -- 172.21.15.47:0/4253119096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed814e6c0 con 0x7faed80cdcb0 2024-04-14T23:35:35.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.512+0000 7faedf20f640 1 -- 172.21.15.47:0/4253119096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed814ec80 con 0x7faed80cdcb0 2024-04-14T23:35:35.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.513+0000 7faedf20f640 1 -- 172.21.15.47:0/4253119096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faed8075430 con 0x7faed80cdcb0 2024-04-14T23:35:35.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.514+0000 7faed57fa640 1 -- 172.21.15.47:0/4253119096 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7faed0012990 con 0x7faed80cdcb0 2024-04-14T23:35:35.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.514+0000 7faed57fa640 1 --2- 172.21.15.47:0/4253119096 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7faebc06b990 0x7faebc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.514+0000 7faed57fa640 1 -- 172.21.15.47:0/4253119096 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7faed008b260 con 0x7faed80cdcb0 2024-04-14T23:35:35.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.514+0000 7faedcfab640 1 --2- 172.21.15.47:0/4253119096 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7faebc06b990 0x7faebc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.515+0000 7faedcfab640 1 --2- 172.21.15.47:0/4253119096 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7faebc06b990 0x7faebc06de50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faecc035000 tx=0x7faecc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:35.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.519+0000 7faed57fa640 1 -- 172.21.15.47:0/4253119096 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7faed00594b0 con 0x7faed80cdcb0 2024-04-14T23:35:35.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.741+0000 7faedf20f640 1 -- 172.21.15.47:0/4253119096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7faed80b7c10 con 0x7faed80cdcb0 2024-04-14T23:35:35.744 INFO:tasks.ceph.mon.a.smithi047.stderr:2024-04-14T23:35:35.742+0000 7f5595832640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-14T23:35:35.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.743+0000 7faed57fa640 1 -- 172.21.15.47:0/4253119096 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7faed005d550 con 0x7faed80cdcb0 2024-04-14T23:35:35.746 INFO:teuthology.orchestra.run.smithi047.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-14T23:35:35.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.746+0000 7faedf20f640 1 -- 172.21.15.47:0/4253119096 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7faebc06b990 msgr2=0x7faebc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.746+0000 7faedf20f640 1 --2- 172.21.15.47:0/4253119096 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7faebc06b990 0x7faebc06de50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faecc035000 tx=0x7faecc008030 comp rx=0 tx=0).stop 2024-04-14T23:35:35.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.746+0000 7faedf20f640 1 -- 172.21.15.47:0/4253119096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed80cdcb0 msgr2=0x7faed80b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.746+0000 7faedf20f640 1 --2- 172.21.15.47:0/4253119096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed80cdcb0 0x7faed80b3750 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7faed000cc90 tx=0x7faed000a430 comp rx=0 tx=0).stop 2024-04-14T23:35:35.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.746+0000 7faedf20f640 1 -- 172.21.15.47:0/4253119096 shutdown_connections 2024-04-14T23:35:35.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.746+0000 7faedf20f640 1 --2- 172.21.15.47:0/4253119096 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7faebc06b990 0x7faebc06de50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.746+0000 7faedf20f640 1 --2- 172.21.15.47:0/4253119096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faed80cdcb0 0x7faed80b3750 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.746+0000 7faedf20f640 1 --2- 172.21.15.47:0/4253119096 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faed806d0b0 0x7faed80c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.746+0000 7faedf20f640 1 --2- 172.21.15.47:0/4253119096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faed806cc20 0x7faed814b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.746+0000 7faedf20f640 1 -- 172.21.15.47:0/4253119096 >> 172.21.15.47:0/4253119096 conn(0x7faed80d1c90 msgr2=0x7faed80ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:35.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.746+0000 7faedf20f640 1 -- 172.21.15.47:0/4253119096 shutdown_connections 2024-04-14T23:35:35.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.746+0000 7faedf20f640 1 -- 172.21.15.47:0/4253119096 wait complete. 2024-04-14T23:35:35.751 INFO:tasks.ceph.mds.c.smithi047.stderr: -5317> 2024-04-14T23:34:42.894+0000 7f65f17f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-14T23:35:35.762 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-14T23:35:35.782 INFO:tasks.ceph.mds.c.smithi047.stdout:starting mds.c at 2024-04-14T23:35:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.863+0000 7f1705a98640 1 Processor -- start 2024-04-14T23:35:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.863+0000 7f1705a98640 1 -- start start 2024-04-14T23:35:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.863+0000 7f1705a98640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f170006f920 0x7f170006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.863+0000 7f1705a98640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f170015e420 0x7f17000d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.863+0000 7f1705a98640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1700070240 con 0x7f17000aeab0 2024-04-14T23:35:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.863+0000 7f1705a98640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f170006cfc0 con 0x7f170006f920 2024-04-14T23:35:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.863+0000 7f1705a98640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f170006f3c0 con 0x7f170015e420 2024-04-14T23:35:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.864+0000 7f16ff7fe640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f170006f920 0x7f170006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.864+0000 7f16feffd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f170015e420 0x7f17000d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.864+0000 7f16ff7fe640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f170006f920 0x7f170006fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:59700/0 (socket says 172.21.15.47:59700) 2024-04-14T23:35:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.864+0000 7f16ff7fe640 1 -- 172.21.15.47:0/3528669515 learned_addr learned my addr 172.21.15.47:0/3528669515 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.864+0000 7f16ff7fe640 1 -- 172.21.15.47:0/3528669515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f170015e420 msgr2=0x7f17000d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.864+0000 7f16ff7fe640 1 --2- 172.21.15.47:0/3528669515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f170015e420 0x7f17000d0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.864+0000 7f16ff7fe640 1 -- 172.21.15.47:0/3528669515 >> v1:172.21.15.191:6789/0 conn(0x7f17000aeab0 legacy=0x7f1700161d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.864+0000 7f16ff7fe640 1 -- 172.21.15.47:0/3528669515 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170006c3b0 con 0x7f170006f920 2024-04-14T23:35:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.864+0000 7f16feffd640 1 --2- 172.21.15.47:0/3528669515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f170015e420 0x7f17000d0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.865+0000 7f16ff7fe640 1 --2- 172.21.15.47:0/3528669515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f170006f920 0x7f170006fd00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009870 tx=0x7f16f002b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faa51f8872e1ca31 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.865+0000 7f16fe7fc640 1 -- 172.21.15.47:0/3528669515 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0037070 con 0x7f170006f920 2024-04-14T23:35:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.865+0000 7f16fe7fc640 1 -- 172.21.15.47:0/3528669515 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f0004230 con 0x7f170006f920 2024-04-14T23:35:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.865+0000 7f16fe7fc640 1 -- 172.21.15.47:0/3528669515 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0003610 con 0x7f170006f920 2024-04-14T23:35:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.866+0000 7f1705a98640 1 -- 172.21.15.47:0/3528669515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f170006f920 msgr2=0x7f170006fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.866+0000 7f1705a98640 1 --2- 172.21.15.47:0/3528669515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f170006f920 0x7f170006fd00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009870 tx=0x7f16f002b7e0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.866+0000 7f1705a98640 1 -- 172.21.15.47:0/3528669515 shutdown_connections 2024-04-14T23:35:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.866+0000 7f1705a98640 1 --2- 172.21.15.47:0/3528669515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f170015e420 0x7f17000d0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.866+0000 7f1705a98640 1 --2- 172.21.15.47:0/3528669515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f170006f920 0x7f170006fd00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.866+0000 7f1705a98640 1 -- 172.21.15.47:0/3528669515 >> 172.21.15.47:0/3528669515 conn(0x7f17000b37d0 msgr2=0x7f17000b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.866+0000 7f1705a98640 1 -- 172.21.15.47:0/3528669515 shutdown_connections 2024-04-14T23:35:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.866+0000 7f1705a98640 1 -- 172.21.15.47:0/3528669515 wait complete. 2024-04-14T23:35:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.867+0000 7f1705a98640 1 Processor -- start 2024-04-14T23:35:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.867+0000 7f1705a98640 1 -- start start 2024-04-14T23:35:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f1705a98640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f170006f920 0x7f17000ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f1705a98640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17000aeab0 0x7f170015e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f1705a98640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f170015e420 0x7f17001f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f1705a98640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f170006cc50 con 0x7f17000aeab0 2024-04-14T23:35:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f1705a98640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f170006c970 con 0x7f170015e420 2024-04-14T23:35:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f1705a98640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f17000d1040 con 0x7f170006f920 2024-04-14T23:35:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f16feffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17000aeab0 0x7f170015e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f16feffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17000aeab0 0x7f170015e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52374/0 (socket says 172.21.15.47:52374) 2024-04-14T23:35:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f16feffd640 1 -- 172.21.15.47:0/4121915871 learned_addr learned my addr 172.21.15.47:0/4121915871 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f16fffff640 1 --2- 172.21.15.47:0/4121915871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f170015e420 0x7f17001f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f16ff7fe640 1 --2- 172.21.15.47:0/4121915871 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f170006f920 0x7f17000ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f16feffd640 1 -- 172.21.15.47:0/4121915871 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f170006f920 msgr2=0x7f17000ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f16feffd640 1 --2- 172.21.15.47:0/4121915871 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f170006f920 0x7f17000ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f16feffd640 1 -- 172.21.15.47:0/4121915871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f170015e420 msgr2=0x7f17001f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f16feffd640 1 --2- 172.21.15.47:0/4121915871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f170015e420 0x7f17001f7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f16feffd640 1 -- 172.21.15.47:0/4121915871 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17000cf2c0 con 0x7f17000aeab0 2024-04-14T23:35:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.868+0000 7f16feffd640 1 --2- 172.21.15.47:0/4121915871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17000aeab0 0x7f170015e800 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f16e800e990 tx=0x7f16e800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.869+0000 7f16f7fff640 1 -- 172.21.15.47:0/4121915871 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8017070 con 0x7f17000aeab0 2024-04-14T23:35:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.869+0000 7f16f7fff640 1 -- 172.21.15.47:0/4121915871 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e800c9e0 con 0x7f17000aeab0 2024-04-14T23:35:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.869+0000 7f1705a98640 1 -- 172.21.15.47:0/4121915871 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17000b5910 con 0x7f17000aeab0 2024-04-14T23:35:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.869+0000 7f16f7fff640 1 -- 172.21.15.47:0/4121915871 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e800cdb0 con 0x7f17000aeab0 2024-04-14T23:35:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.869+0000 7f1705a98640 1 -- 172.21.15.47:0/4121915871 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1700161470 con 0x7f17000aeab0 2024-04-14T23:35:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.870+0000 7f1705a98640 1 -- 172.21.15.47:0/4121915871 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1700073f50 con 0x7f17000aeab0 2024-04-14T23:35:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.870+0000 7f16f7fff640 1 -- 172.21.15.47:0/4121915871 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f16e801a070 con 0x7f17000aeab0 2024-04-14T23:35:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.870+0000 7f16f7fff640 1 --2- 172.21.15.47:0/4121915871 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f16e006b990 0x7f16e006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.871+0000 7f16f7fff640 1 -- 172.21.15.47:0/4121915871 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f16e808abd0 con 0x7f17000aeab0 2024-04-14T23:35:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.871+0000 7f16ff7fe640 1 --2- 172.21.15.47:0/4121915871 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f16e006b990 0x7f16e006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.871+0000 7f16ff7fe640 1 --2- 172.21.15.47:0/4121915871 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f16e006b990 0x7f16e006de50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f16f0034000 tx=0x7f16f0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:35.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:35.875+0000 7f16f7fff640 1 -- 172.21.15.47:0/4121915871 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f16e8059300 con 0x7f17000aeab0 2024-04-14T23:35:36.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.095+0000 7f1705a98640 1 -- 172.21.15.47:0/4121915871 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1700070410 con 0x7f17000aeab0 2024-04-14T23:35:36.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.744+0000 7f16f7fff640 1 -- 172.21.15.47:0/4121915871 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f16e8058c00 con 0x7f17000aeab0 2024-04-14T23:35:36.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.747+0000 7f1705a98640 1 -- 172.21.15.47:0/4121915871 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f16e006b990 msgr2=0x7f16e006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:36.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.747+0000 7f1705a98640 1 --2- 172.21.15.47:0/4121915871 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f16e006b990 0x7f16e006de50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f16f0034000 tx=0x7f16f0008030 comp rx=0 tx=0).stop 2024-04-14T23:35:36.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.747+0000 7f1705a98640 1 -- 172.21.15.47:0/4121915871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17000aeab0 msgr2=0x7f170015e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:36.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.747+0000 7f1705a98640 1 --2- 172.21.15.47:0/4121915871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17000aeab0 0x7f170015e800 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f16e800e990 tx=0x7f16e800ee50 comp rx=0 tx=0).stop 2024-04-14T23:35:36.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.747+0000 7f1705a98640 1 -- 172.21.15.47:0/4121915871 shutdown_connections 2024-04-14T23:35:36.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.747+0000 7f1705a98640 1 --2- 172.21.15.47:0/4121915871 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f16e006b990 0x7f16e006de50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:36.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.747+0000 7f1705a98640 1 --2- 172.21.15.47:0/4121915871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f170015e420 0x7f17001f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:36.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.747+0000 7f1705a98640 1 --2- 172.21.15.47:0/4121915871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17000aeab0 0x7f170015e800 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:36.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.747+0000 7f1705a98640 1 --2- 172.21.15.47:0/4121915871 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f170006f920 0x7f17000ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:36.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.747+0000 7f1705a98640 1 -- 172.21.15.47:0/4121915871 >> 172.21.15.47:0/4121915871 conn(0x7f17000b37d0 msgr2=0x7f17000d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:36.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.747+0000 7f1705a98640 1 -- 172.21.15.47:0/4121915871 shutdown_connections 2024-04-14T23:35:36.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.747+0000 7f1705a98640 1 -- 172.21.15.47:0/4121915871 wait complete. 2024-04-14T23:35:36.764 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-14T23:35:36.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.914+0000 7fee93269640 1 Processor -- start 2024-04-14T23:35:36.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.914+0000 7fee93269640 1 -- start start 2024-04-14T23:35:36.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.915+0000 7fee93269640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fee8c0d0c40 0x7fee8c0cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:36.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.915+0000 7fee93269640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fee8c0d1020 0x7fee8c0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:36.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.915+0000 7fee93269640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee8c0cf850 con 0x7fee8c15dcc0 2024-04-14T23:35:36.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.915+0000 7fee93269640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fee8c0d00c0 con 0x7fee8c0d0c40 2024-04-14T23:35:36.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.915+0000 7fee93269640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fee8c0cfb00 con 0x7fee8c0d1020 2024-04-14T23:35:36.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.915+0000 7fee91005640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fee8c0d0c40 0x7fee8c0cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:36.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.915+0000 7fee91005640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fee8c0d0c40 0x7fee8c0cedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52380/0 (socket says 172.21.15.47:52380) 2024-04-14T23:35:36.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.915+0000 7fee91005640 1 -- 172.21.15.47:0/152844831 learned_addr learned my addr 172.21.15.47:0/152844831 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:36.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.915+0000 7fee91005640 1 -- 172.21.15.47:0/152844831 >> v2:172.21.15.191:3300/0 conn(0x7fee8c0d1020 msgr2=0x7fee8c0cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:36.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.915+0000 7fee91005640 1 --2- 172.21.15.47:0/152844831 >> v2:172.21.15.191:3300/0 conn(0x7fee8c0d1020 0x7fee8c0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:36.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.915+0000 7fee91005640 1 -- 172.21.15.47:0/152844831 >> v1:172.21.15.191:6789/0 conn(0x7fee8c15dcc0 legacy=0x7fee8c15e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:36.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.915+0000 7fee91005640 1 -- 172.21.15.47:0/152844831 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8c0cfde0 con 0x7fee8c0d0c40 2024-04-14T23:35:36.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.916+0000 7fee91005640 1 --2- 172.21.15.47:0/152844831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c0d0c40 0x7fee8c0cedd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fee88009870 tx=0x7fee8802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7af9bed559012b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:36.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.916+0000 7fee83fff640 1 -- 172.21.15.47:0/152844831 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88035020 con 0x7fee8c0d0c40 2024-04-14T23:35:36.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.916+0000 7fee83fff640 1 -- 172.21.15.47:0/152844831 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee88031870 con 0x7fee8c0d0c40 2024-04-14T23:35:36.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.916+0000 7fee83fff640 1 -- 172.21.15.47:0/152844831 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88031c40 con 0x7fee8c0d0c40 2024-04-14T23:35:36.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.916+0000 7fee93269640 1 -- 172.21.15.47:0/152844831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c0d0c40 msgr2=0x7fee8c0cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:36.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.916+0000 7fee93269640 1 --2- 172.21.15.47:0/152844831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c0d0c40 0x7fee8c0cedd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fee88009870 tx=0x7fee8802b910 comp rx=0 tx=0).stop 2024-04-14T23:35:36.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.917+0000 7fee93269640 1 -- 172.21.15.47:0/152844831 shutdown_connections 2024-04-14T23:35:36.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.917+0000 7fee93269640 1 --2- 172.21.15.47:0/152844831 >> v2:172.21.15.191:3300/0 conn(0x7fee8c0d1020 0x7fee8c0cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:36.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.917+0000 7fee93269640 1 --2- 172.21.15.47:0/152844831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c0d0c40 0x7fee8c0cedd0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:36.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.917+0000 7fee93269640 1 -- 172.21.15.47:0/152844831 >> 172.21.15.47:0/152844831 conn(0x7fee8c09d340 msgr2=0x7fee8c0d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:36.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.917+0000 7fee93269640 1 -- 172.21.15.47:0/152844831 shutdown_connections 2024-04-14T23:35:36.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.917+0000 7fee93269640 1 -- 172.21.15.47:0/152844831 wait complete. 2024-04-14T23:35:36.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.918+0000 7fee93269640 1 Processor -- start 2024-04-14T23:35:36.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.918+0000 7fee93269640 1 -- start start 2024-04-14T23:35:36.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.918+0000 7fee93269640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee8c0d0c40 0x7fee8c1533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:36.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.918+0000 7fee93269640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c0d1020 0x7fee8c15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:36.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.918+0000 7fee93269640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee8c15dcc0 0x7fee8c0b7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:36.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.918+0000 7fee93269640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c0b41b0 con 0x7fee8c0d1020 2024-04-14T23:35:36.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.918+0000 7fee93269640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c0b3cb0 con 0x7fee8c15dcc0 2024-04-14T23:35:36.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.918+0000 7fee93269640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fee8c0b4330 con 0x7fee8c0d0c40 2024-04-14T23:35:36.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee90804640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c0d1020 0x7fee8c15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:36.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee90804640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c0d1020 0x7fee8c15beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52394/0 (socket says 172.21.15.47:52394) 2024-04-14T23:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee90804640 1 -- 172.21.15.47:0/2186127799 learned_addr learned my addr 172.21.15.47:0/2186127799 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee91005640 1 --2- 172.21.15.47:0/2186127799 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee8c0d0c40 0x7fee8c1533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee90804640 1 -- 172.21.15.47:0/2186127799 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee8c0d0c40 msgr2=0x7fee8c1533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee91806640 1 --2- 172.21.15.47:0/2186127799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee8c15dcc0 0x7fee8c0b7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee90804640 1 --2- 172.21.15.47:0/2186127799 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee8c0d0c40 0x7fee8c1533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee90804640 1 -- 172.21.15.47:0/2186127799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee8c15dcc0 msgr2=0x7fee8c0b7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee90804640 1 --2- 172.21.15.47:0/2186127799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee8c15dcc0 0x7fee8c0b7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee90804640 1 -- 172.21.15.47:0/2186127799 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8c0b6c90 con 0x7fee8c0d1020 2024-04-14T23:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee91005640 1 --2- 172.21.15.47:0/2186127799 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee8c0d0c40 0x7fee8c1533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee91806640 1 --2- 172.21.15.47:0/2186127799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee8c15dcc0 0x7fee8c0b7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee90804640 1 --2- 172.21.15.47:0/2186127799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c0d1020 0x7fee8c15beb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00b4a0 tx=0x7fee7c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee81ffb640 1 -- 172.21.15.47:0/2186127799 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c014070 con 0x7fee8c0d1020 2024-04-14T23:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee81ffb640 1 -- 172.21.15.47:0/2186127799 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7c010610 con 0x7fee8c0d1020 2024-04-14T23:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee81ffb640 1 -- 172.21.15.47:0/2186127799 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c010a00 con 0x7fee8c0d1020 2024-04-14T23:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.919+0000 7fee93269640 1 -- 172.21.15.47:0/2186127799 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee8c0b6fd0 con 0x7fee8c0d1020 2024-04-14T23:35:36.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.920+0000 7fee93269640 1 -- 172.21.15.47:0/2186127799 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee8c0b7810 con 0x7fee8c0d1020 2024-04-14T23:35:36.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.920+0000 7fee93269640 1 -- 172.21.15.47:0/2186127799 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee8c0754a0 con 0x7fee8c0d1020 2024-04-14T23:35:36.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.921+0000 7fee81ffb640 1 -- 172.21.15.47:0/2186127799 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fee7c017070 con 0x7fee8c0d1020 2024-04-14T23:35:36.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.921+0000 7fee81ffb640 1 --2- 172.21.15.47:0/2186127799 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fee7006b990 0x7fee7006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:36.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.921+0000 7fee81ffb640 1 -- 172.21.15.47:0/2186127799 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7fee7c08a7c0 con 0x7fee8c0d1020 2024-04-14T23:35:36.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.922+0000 7fee91005640 1 --2- 172.21.15.47:0/2186127799 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fee7006b990 0x7fee7006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:36.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.922+0000 7fee91005640 1 --2- 172.21.15.47:0/2186127799 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fee7006b990 0x7fee7006de50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fee88036000 tx=0x7fee8803c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:36.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:36.925+0000 7fee81ffb640 1 -- 172.21.15.47:0/2186127799 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fee8c0b6fd0 con 0x7fee8c0d1020 2024-04-14T23:35:37.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:37.105+0000 7fee93269640 1 -- 172.21.15.47:0/2186127799 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fee8c0b71e0 con 0x7fee8c0d1020 2024-04-14T23:35:37.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:37.885+0000 7fee81ffb640 1 -- 172.21.15.47:0/2186127799 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7fee8c0b71e0 con 0x7fee8c0d1020 2024-04-14T23:35:37.888 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' removed 2024-04-14T23:35:37.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:37.887+0000 7fee93269640 1 -- 172.21.15.47:0/2186127799 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fee7006b990 msgr2=0x7fee7006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:37.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:37.888+0000 7fee93269640 1 --2- 172.21.15.47:0/2186127799 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fee7006b990 0x7fee7006de50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fee88036000 tx=0x7fee8803c040 comp rx=0 tx=0).stop 2024-04-14T23:35:37.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:37.888+0000 7fee93269640 1 -- 172.21.15.47:0/2186127799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c0d1020 msgr2=0x7fee8c15beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:37.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:37.888+0000 7fee93269640 1 --2- 172.21.15.47:0/2186127799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c0d1020 0x7fee8c15beb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00b4a0 tx=0x7fee7c00b960 comp rx=0 tx=0).stop 2024-04-14T23:35:37.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:37.888+0000 7fee93269640 1 -- 172.21.15.47:0/2186127799 shutdown_connections 2024-04-14T23:35:37.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:37.888+0000 7fee93269640 1 --2- 172.21.15.47:0/2186127799 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fee7006b990 0x7fee7006de50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:37.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:37.888+0000 7fee93269640 1 --2- 172.21.15.47:0/2186127799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee8c15dcc0 0x7fee8c0b7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:37.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:37.888+0000 7fee93269640 1 --2- 172.21.15.47:0/2186127799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c0d1020 0x7fee8c15beb0 secure :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00b4a0 tx=0x7fee7c00b960 comp rx=0 tx=0).stop 2024-04-14T23:35:37.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:37.888+0000 7fee93269640 1 --2- 172.21.15.47:0/2186127799 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee8c0d0c40 0x7fee8c1533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:37.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:37.888+0000 7fee93269640 1 -- 172.21.15.47:0/2186127799 >> 172.21.15.47:0/2186127799 conn(0x7fee8c09d340 msgr2=0x7fee8c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:37.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:37.888+0000 7fee93269640 1 -- 172.21.15.47:0/2186127799 shutdown_connections 2024-04-14T23:35:37.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:37.888+0000 7fee93269640 1 -- 172.21.15.47:0/2186127799 wait complete. 2024-04-14T23:35:37.905 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-14T23:35:38.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.012+0000 7f73e19cc640 1 Processor -- start 2024-04-14T23:35:38.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.012+0000 7f73e19cc640 1 -- start start 2024-04-14T23:35:38.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.013+0000 7f73e19cc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73dc15e370 0x7f73dc0d1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:38.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.013+0000 7f73e19cc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f73dc0ad8a0 0x7f73dc06b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:38.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.013+0000 7f73e19cc640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73dc0b55e0 con 0x7f73dc06b740 2024-04-14T23:35:38.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.013+0000 7f73e19cc640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f73dc0b3d40 con 0x7f73dc0ad8a0 2024-04-14T23:35:38.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.013+0000 7f73e19cc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f73dc0b58c0 con 0x7f73dc15e370 2024-04-14T23:35:38.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.013+0000 7f73da7fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f73dc0ad8a0 0x7f73dc06b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:38.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.013+0000 7f73da7fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f73dc0ad8a0 0x7f73dc06b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52406/0 (socket says 172.21.15.47:52406) 2024-04-14T23:35:38.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.013+0000 7f73da7fc640 1 -- 172.21.15.47:0/2278127745 learned_addr learned my addr 172.21.15.47:0/2278127745 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:38.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.013+0000 7f73da7fc640 1 -- 172.21.15.47:0/2278127745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73dc15e370 msgr2=0x7f73dc0d1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:38.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.013+0000 7f73da7fc640 1 --2- 172.21.15.47:0/2278127745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73dc15e370 0x7f73dc0d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:38.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.013+0000 7f73da7fc640 1 -- 172.21.15.47:0/2278127745 >> v1:172.21.15.191:6789/0 conn(0x7f73dc06b740 legacy=0x7f73dc0b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:38.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.013+0000 7f73da7fc640 1 -- 172.21.15.47:0/2278127745 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73dc0b5ba0 con 0x7f73dc0ad8a0 2024-04-14T23:35:38.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.014+0000 7f73da7fc640 1 --2- 172.21.15.47:0/2278127745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73dc0ad8a0 0x7f73dc06b200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f73d0009870 tx=0x7f73d002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50610480e15aa956 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:38.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.014+0000 7f73d9ffb640 1 -- 172.21.15.47:0/2278127745 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d0035020 con 0x7f73dc0ad8a0 2024-04-14T23:35:38.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.014+0000 7f73d9ffb640 1 -- 172.21.15.47:0/2278127745 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73d0031640 con 0x7f73dc0ad8a0 2024-04-14T23:35:38.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.014+0000 7f73d9ffb640 1 -- 172.21.15.47:0/2278127745 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d002d040 con 0x7f73dc0ad8a0 2024-04-14T23:35:38.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.015+0000 7f73e19cc640 1 -- 172.21.15.47:0/2278127745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73dc0ad8a0 msgr2=0x7f73dc06b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:38.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.015+0000 7f73e19cc640 1 --2- 172.21.15.47:0/2278127745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73dc0ad8a0 0x7f73dc06b200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f73d0009870 tx=0x7f73d002b8f0 comp rx=0 tx=0).stop 2024-04-14T23:35:38.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.015+0000 7f73e19cc640 1 -- 172.21.15.47:0/2278127745 shutdown_connections 2024-04-14T23:35:38.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.015+0000 7f73e19cc640 1 --2- 172.21.15.47:0/2278127745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73dc0ad8a0 0x7f73dc06b200 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:38.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.015+0000 7f73e19cc640 1 --2- 172.21.15.47:0/2278127745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73dc15e370 0x7f73dc0d1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:38.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.015+0000 7f73e19cc640 1 -- 172.21.15.47:0/2278127745 >> 172.21.15.47:0/2278127745 conn(0x7f73dc0d0be0 msgr2=0x7f73dc0d0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:38.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.015+0000 7f73e19cc640 1 -- 172.21.15.47:0/2278127745 shutdown_connections 2024-04-14T23:35:38.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.015+0000 7f73e19cc640 1 -- 172.21.15.47:0/2278127745 wait complete. 2024-04-14T23:35:38.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.016+0000 7f73e19cc640 1 Processor -- start 2024-04-14T23:35:38.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.016+0000 7f73e19cc640 1 -- start start 2024-04-14T23:35:38.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73e19cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73dc06b740 0x7f73dc14c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:38.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73e19cc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73dc0ad8a0 0x7f73dc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:38.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73e19cc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73dc15e370 0x7f73dc0b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73e19cc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc070650 con 0x7f73dc06b740 2024-04-14T23:35:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73e19cc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc0704d0 con 0x7f73dc0ad8a0 2024-04-14T23:35:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73e19cc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f73dc0b48e0 con 0x7f73dc15e370 2024-04-14T23:35:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73daffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73dc06b740 0x7f73dc14c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73daffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73dc06b740 0x7f73dc14c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52412/0 (socket says 172.21.15.47:52412) 2024-04-14T23:35:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73daffd640 1 -- 172.21.15.47:0/1063763609 learned_addr learned my addr 172.21.15.47:0/1063763609 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73db7fe640 1 --2- 172.21.15.47:0/1063763609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73dc15e370 0x7f73dc0b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73da7fc640 1 --2- 172.21.15.47:0/1063763609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73dc0ad8a0 0x7f73dc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73daffd640 1 -- 172.21.15.47:0/1063763609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73dc15e370 msgr2=0x7f73dc0b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73daffd640 1 --2- 172.21.15.47:0/1063763609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73dc15e370 0x7f73dc0b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73daffd640 1 -- 172.21.15.47:0/1063763609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73dc0ad8a0 msgr2=0x7f73dc0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73daffd640 1 --2- 172.21.15.47:0/1063763609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73dc0ad8a0 0x7f73dc0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73daffd640 1 -- 172.21.15.47:0/1063763609 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73dc14cd00 con 0x7f73dc06b740 2024-04-14T23:35:38.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73daffd640 1 --2- 172.21.15.47:0/1063763609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73dc06b740 0x7f73dc14c7c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00b410 tx=0x7f73cc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:38.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.017+0000 7f73c3fff640 1 -- 172.21.15.47:0/1063763609 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73cc015020 con 0x7f73dc06b740 2024-04-14T23:35:38.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.018+0000 7f73c3fff640 1 -- 172.21.15.47:0/1063763609 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73cc011850 con 0x7f73dc06b740 2024-04-14T23:35:38.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.018+0000 7f73e19cc640 1 -- 172.21.15.47:0/1063763609 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73dc1f5ac0 con 0x7f73dc06b740 2024-04-14T23:35:38.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.018+0000 7f73c3fff640 1 -- 172.21.15.47:0/1063763609 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73cc011c40 con 0x7f73dc06b740 2024-04-14T23:35:38.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.018+0000 7f73e19cc640 1 -- 172.21.15.47:0/1063763609 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73dc1f6360 con 0x7f73dc06b740 2024-04-14T23:35:38.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.018+0000 7f73e19cc640 1 -- 172.21.15.47:0/1063763609 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73dc1f5eb0 con 0x7f73dc06b740 2024-04-14T23:35:38.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.019+0000 7f73c3fff640 1 -- 172.21.15.47:0/1063763609 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f73cc018020 con 0x7f73dc06b740 2024-04-14T23:35:38.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.019+0000 7f73c3fff640 1 --2- 172.21.15.47:0/1063763609 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f73c806b9c0 0x7f73c806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:38.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.019+0000 7f73c3fff640 1 -- 172.21.15.47:0/1063763609 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6383+0+0 (secure 0 0 0) 0x7f73cc08a9b0 con 0x7f73dc06b740 2024-04-14T23:35:38.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.020+0000 7f73da7fc640 1 --2- 172.21.15.47:0/1063763609 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f73c806b9c0 0x7f73c806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:38.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.020+0000 7f73da7fc640 1 --2- 172.21.15.47:0/1063763609 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f73c806b9c0 0x7f73c806de80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f73d0036000 tx=0x7f73d003c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:38.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.024+0000 7f73c3fff640 1 -- 172.21.15.47:0/1063763609 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f73cc01f020 con 0x7f73dc06b740 2024-04-14T23:35:38.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.207+0000 7f73e19cc640 1 -- 172.21.15.47:0/1063763609 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f73dc0754a0 con 0x7f73dc06b740 2024-04-14T23:35:38.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.889+0000 7f73c3fff640 1 -- 172.21.15.47:0/1063763609 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f73cc0172c0 con 0x7f73dc06b740 2024-04-14T23:35:38.893 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' removed 2024-04-14T23:35:38.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.893+0000 7f73e19cc640 1 -- 172.21.15.47:0/1063763609 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f73c806b9c0 msgr2=0x7f73c806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:38.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.893+0000 7f73e19cc640 1 --2- 172.21.15.47:0/1063763609 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f73c806b9c0 0x7f73c806de80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f73d0036000 tx=0x7f73d003c040 comp rx=0 tx=0).stop 2024-04-14T23:35:38.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.893+0000 7f73e19cc640 1 -- 172.21.15.47:0/1063763609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73dc06b740 msgr2=0x7f73dc14c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:38.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.893+0000 7f73e19cc640 1 --2- 172.21.15.47:0/1063763609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73dc06b740 0x7f73dc14c7c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00b410 tx=0x7f73cc00b8d0 comp rx=0 tx=0).stop 2024-04-14T23:35:38.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.894+0000 7f73e19cc640 1 -- 172.21.15.47:0/1063763609 shutdown_connections 2024-04-14T23:35:38.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.894+0000 7f73e19cc640 1 --2- 172.21.15.47:0/1063763609 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f73c806b9c0 0x7f73c806de80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:38.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.894+0000 7f73e19cc640 1 --2- 172.21.15.47:0/1063763609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73dc15e370 0x7f73dc0b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:38.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.894+0000 7f73e19cc640 1 --2- 172.21.15.47:0/1063763609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73dc0ad8a0 0x7f73dc0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:38.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.894+0000 7f73e19cc640 1 --2- 172.21.15.47:0/1063763609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73dc06b740 0x7f73dc14c7c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:38.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.894+0000 7f73e19cc640 1 -- 172.21.15.47:0/1063763609 >> 172.21.15.47:0/1063763609 conn(0x7f73dc0d0be0 msgr2=0x7f73dc0aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:38.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.894+0000 7f73e19cc640 1 -- 172.21.15.47:0/1063763609 shutdown_connections 2024-04-14T23:35:38.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:38.894+0000 7f73e19cc640 1 -- 172.21.15.47:0/1063763609 wait complete. 2024-04-14T23:35:38.911 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-14T23:35:39.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.025+0000 7fa3a5a9d640 1 Processor -- start 2024-04-14T23:35:39.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.026+0000 7fa3a5a9d640 1 -- start start 2024-04-14T23:35:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.026+0000 7fa3a5a9d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa3a0072fa0 0x7fa3a00cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.026+0000 7fa3a5a9d640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3a00717b0 con 0x7fa3a00cdf10 2024-04-14T23:35:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.026+0000 7fa3a5a9d640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3a0074a20 con 0x7fa3a015e460 2024-04-14T23:35:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.026+0000 7fa3a5a9d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa3a00cc670 con 0x7fa3a0072fa0 2024-04-14T23:35:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.026+0000 7fa39ffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa3a0072fa0 0x7fa3a00cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.026+0000 7fa39effd640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa3a00cdf10 0x7fa3a00b3190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:38610/0 (socket says 172.21.15.47:38610) 2024-04-14T23:35:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.026+0000 7fa39effd640 1 -- 172.21.15.47:0/4044091140 learned_addr learned my addr 172.21.15.47:0/4044091140 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.026+0000 7fa39ffff640 1 --2- 172.21.15.47:0/4044091140 >> v2:172.21.15.47:3300/0 conn(0x7fa3a0072fa0 0x7fa3a00cbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52420/0 (socket says 172.21.15.47:52420) 2024-04-14T23:35:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.027+0000 7fa39ffff640 1 -- 172.21.15.47:0/4044091140 >> v1:172.21.15.191:6789/0 conn(0x7fa3a015e460 legacy=0x7fa3a0072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.027+0000 7fa39ffff640 1 -- 172.21.15.47:0/4044091140 >> v1:172.21.15.47:6789/0 conn(0x7fa3a00cdf10 legacy=0x7fa3a00b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.027+0000 7fa39ffff640 1 -- 172.21.15.47:0/4044091140 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a00cc950 con 0x7fa3a0072fa0 2024-04-14T23:35:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.027+0000 7fa39e7fc640 1 -- 172.21.15.47:0/4044091140 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1827358834 0 0) 0x7fa3a00717b0 con 0x7fa3a00cdf10 2024-04-14T23:35:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.027+0000 7fa39ffff640 1 --2- 172.21.15.47:0/4044091140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3a0072fa0 0x7fa3a00cbd80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa398009d90 tx=0x7fa39802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17bb1eb19d078c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.028+0000 7fa39e7fc640 1 -- 172.21.15.47:0/4044091140 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398039070 con 0x7fa3a0072fa0 2024-04-14T23:35:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.028+0000 7fa39e7fc640 1 -- 172.21.15.47:0/4044091140 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39802cc60 con 0x7fa3a0072fa0 2024-04-14T23:35:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.028+0000 7fa39e7fc640 1 -- 172.21.15.47:0/4044091140 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398034660 con 0x7fa3a0072fa0 2024-04-14T23:35:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.028+0000 7fa3a5a9d640 1 -- 172.21.15.47:0/4044091140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3a0072fa0 msgr2=0x7fa3a00cbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.028+0000 7fa3a5a9d640 1 --2- 172.21.15.47:0/4044091140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3a0072fa0 0x7fa3a00cbd80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa398009d90 tx=0x7fa39802beb0 comp rx=0 tx=0).stop 2024-04-14T23:35:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.028+0000 7fa3a5a9d640 1 -- 172.21.15.47:0/4044091140 shutdown_connections 2024-04-14T23:35:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.028+0000 7fa3a5a9d640 1 --2- 172.21.15.47:0/4044091140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3a0072fa0 0x7fa3a00cbd80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:39.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.028+0000 7fa3a5a9d640 1 -- 172.21.15.47:0/4044091140 >> 172.21.15.47:0/4044091140 conn(0x7fa3a00b1e30 msgr2=0x7fa3a00b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:39.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.028+0000 7fa3a5a9d640 1 -- 172.21.15.47:0/4044091140 shutdown_connections 2024-04-14T23:35:39.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.028+0000 7fa3a5a9d640 1 -- 172.21.15.47:0/4044091140 wait complete. 2024-04-14T23:35:39.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.029+0000 7fa3a5a9d640 1 Processor -- start 2024-04-14T23:35:39.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.030+0000 7fa3a5a9d640 1 -- start start 2024-04-14T23:35:39.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.030+0000 7fa3a5a9d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3a0072fa0 0x7fa3a00b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:39.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.030+0000 7fa3a5a9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3a00cdf10 0x7fa3a014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:39.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.030+0000 7fa3a5a9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3a015e460 0x7fa3a0160e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:39.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.030+0000 7fa3a5a9d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0074730 con 0x7fa3a015e460 2024-04-14T23:35:39.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.030+0000 7fa3a5a9d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a00745b0 con 0x7fa3a00cdf10 2024-04-14T23:35:39.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.030+0000 7fa3a5a9d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a00b38a0 con 0x7fa3a0072fa0 2024-04-14T23:35:39.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.030+0000 7fa39ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3a015e460 0x7fa3a0160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:39.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.030+0000 7fa39ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3a015e460 0x7fa3a0160e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52428/0 (socket says 172.21.15.47:52428) 2024-04-14T23:35:39.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.030+0000 7fa39ffff640 1 -- 172.21.15.47:0/1104065768 learned_addr learned my addr 172.21.15.47:0/1104065768 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:39.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.031+0000 7fa39effd640 1 --2- 172.21.15.47:0/1104065768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3a00cdf10 0x7fa3a014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:39.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.031+0000 7fa39f7fe640 1 --2- 172.21.15.47:0/1104065768 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3a0072fa0 0x7fa3a00b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:39.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.031+0000 7fa39ffff640 1 -- 172.21.15.47:0/1104065768 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3a0072fa0 msgr2=0x7fa3a00b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:39.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.031+0000 7fa39ffff640 1 --2- 172.21.15.47:0/1104065768 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3a0072fa0 0x7fa3a00b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:39.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.031+0000 7fa39ffff640 1 -- 172.21.15.47:0/1104065768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3a00cdf10 msgr2=0x7fa3a014fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.031+0000 7fa39ffff640 1 --2- 172.21.15.47:0/1104065768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3a00cdf10 0x7fa3a014fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.031+0000 7fa39ffff640 1 -- 172.21.15.47:0/1104065768 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a015fdc0 con 0x7fa3a015e460 2024-04-14T23:35:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.031+0000 7fa39f7fe640 1 --2- 172.21.15.47:0/1104065768 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3a0072fa0 0x7fa3a00b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.031+0000 7fa39ffff640 1 --2- 172.21.15.47:0/1104065768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3a015e460 0x7fa3a0160e60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa398009eb0 tx=0x7fa398004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.031+0000 7fa387fff640 1 -- 172.21.15.47:0/1104065768 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398044020 con 0x7fa3a015e460 2024-04-14T23:35:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.031+0000 7fa387fff640 1 -- 172.21.15.47:0/1104065768 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39803f470 con 0x7fa3a015e460 2024-04-14T23:35:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.031+0000 7fa3a5a9d640 1 -- 172.21.15.47:0/1104065768 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a01600a0 con 0x7fa3a015e460 2024-04-14T23:35:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.031+0000 7fa387fff640 1 -- 172.21.15.47:0/1104065768 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398039040 con 0x7fa3a015e460 2024-04-14T23:35:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.031+0000 7fa3a5a9d640 1 -- 172.21.15.47:0/1104065768 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a0160660 con 0x7fa3a015e460 2024-04-14T23:35:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.032+0000 7fa3a5a9d640 1 -- 172.21.15.47:0/1104065768 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a00754a0 con 0x7fa3a015e460 2024-04-14T23:35:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.032+0000 7fa387fff640 1 -- 172.21.15.47:0/1104065768 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fa398047020 con 0x7fa3a015e460 2024-04-14T23:35:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.033+0000 7fa387fff640 1 --2- 172.21.15.47:0/1104065768 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa38c06b990 0x7fa38c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.033+0000 7fa387fff640 1 -- 172.21.15.47:0/1104065768 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7fa3980ad4b0 con 0x7fa3a015e460 2024-04-14T23:35:39.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.033+0000 7fa39f7fe640 1 --2- 172.21.15.47:0/1104065768 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa38c06b990 0x7fa38c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:39.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.034+0000 7fa39f7fe640 1 --2- 172.21.15.47:0/1104065768 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa38c06b990 0x7fa38c06de50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa39000a830 tx=0x7fa390008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:39.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.037+0000 7fa387fff640 1 -- 172.21.15.47:0/1104065768 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa39804e030 con 0x7fa3a015e460 2024-04-14T23:35:39.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.222+0000 7fa3a5a9d640 1 -- 172.21.15.47:0/1104065768 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa3a00b5f00 con 0x7fa3a015e460 2024-04-14T23:35:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.897+0000 7fa387fff640 1 -- 172.21.15.47:0/1104065768 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7fa39807c0c0 con 0x7fa3a015e460 2024-04-14T23:35:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data_ec' removed 2024-04-14T23:35:39.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.900+0000 7fa3a5a9d640 1 -- 172.21.15.47:0/1104065768 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa38c06b990 msgr2=0x7fa38c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:39.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.900+0000 7fa3a5a9d640 1 --2- 172.21.15.47:0/1104065768 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa38c06b990 0x7fa38c06de50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa39000a830 tx=0x7fa390008040 comp rx=0 tx=0).stop 2024-04-14T23:35:39.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.900+0000 7fa3a5a9d640 1 -- 172.21.15.47:0/1104065768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3a015e460 msgr2=0x7fa3a0160e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:39.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.900+0000 7fa3a5a9d640 1 --2- 172.21.15.47:0/1104065768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3a015e460 0x7fa3a0160e60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa398009eb0 tx=0x7fa398004a40 comp rx=0 tx=0).stop 2024-04-14T23:35:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.901+0000 7fa3a5a9d640 1 -- 172.21.15.47:0/1104065768 shutdown_connections 2024-04-14T23:35:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.901+0000 7fa3a5a9d640 1 --2- 172.21.15.47:0/1104065768 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa38c06b990 0x7fa38c06de50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.901+0000 7fa3a5a9d640 1 --2- 172.21.15.47:0/1104065768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3a015e460 0x7fa3a0160e60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.901+0000 7fa3a5a9d640 1 --2- 172.21.15.47:0/1104065768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3a00cdf10 0x7fa3a014fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.901+0000 7fa3a5a9d640 1 --2- 172.21.15.47:0/1104065768 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3a0072fa0 0x7fa3a00b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.901+0000 7fa3a5a9d640 1 -- 172.21.15.47:0/1104065768 >> 172.21.15.47:0/1104065768 conn(0x7fa3a00b1e30 msgr2=0x7fa3a006e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.901+0000 7fa3a5a9d640 1 -- 172.21.15.47:0/1104065768 shutdown_connections 2024-04-14T23:35:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:39.901+0000 7fa3a5a9d640 1 -- 172.21.15.47:0/1104065768 wait complete. 2024-04-14T23:35:39.918 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-14T23:35:39.918 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-14T23:35:39.919 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-14T23:35:39.919 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:35:39.919 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-14T23:35:39.919 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-14T23:35:39.919 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-14T23:35:39.919 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:35:39.919 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-14T23:35:39.920 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-14T23:35:39.920 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-14T23:35:39.920 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:35:39.920 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-14T23:35:39.920 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-14T23:35:39.920 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-14T23:35:39.920 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:35:39.930 INFO:tasks.ceph.mds.a:Stopped 2024-04-14T23:35:39.931 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-14T23:35:39.931 INFO:tasks.ceph.mds.c:Stopped 2024-04-14T23:35:39.932 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-14T23:35:39.932 INFO:tasks.ceph.mds.b:Stopped 2024-04-14T23:35:39.933 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-14T23:35:39.933 INFO:tasks.ceph.mds.d:Stopped 2024-04-14T23:35:39.933 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-14T23:35:39.972 INFO:tasks.ceph.mds.a:Started 2024-04-14T23:35:39.973 DEBUG:teuthology.parallel:result is None 2024-04-14T23:35:39.973 INFO:tasks.ceph.mds.c:Started 2024-04-14T23:35:39.973 DEBUG:teuthology.parallel:result is None 2024-04-14T23:35:39.975 INFO:tasks.ceph.mds.b:Started 2024-04-14T23:35:39.976 DEBUG:teuthology.parallel:result is None 2024-04-14T23:35:39.976 INFO:tasks.ceph.mds.d:Started 2024-04-14T23:35:39.976 DEBUG:teuthology.parallel:result is None 2024-04-14T23:35:39.976 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-14T23:35:39.995 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T23:35:40.021 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T23:35:40.055 INFO:tasks.ceph.mds.a.smithi047.stdout:starting mds.a at 2024-04-14T23:35:40.055 INFO:tasks.ceph.mds.c.smithi047.stdout:starting mds.c at 2024-04-14T23:35:40.058 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2024-04-14T23:35:40.058 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2024-04-14T23:35:40.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.085+0000 7fd36a8de640 1 Processor -- start 2024-04-14T23:35:40.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.085+0000 7fd36a8de640 1 -- start start 2024-04-14T23:35:40.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd36a8de640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd364144a80 0x7fd36406ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:40.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd36a8de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd3640b2a70 0x7fd3640b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:40.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd36a8de640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd3640b33d0 0x7fd36415f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:40.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd36a8de640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd36406d720 con 0x7fd3640b33d0 2024-04-14T23:35:40.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd36a8de640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fd36406d970 con 0x7fd364144a80 2024-04-14T23:35:40.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd36a8de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd36406dc50 con 0x7fd3640b2a70 2024-04-14T23:35:40.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd368e7b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd3640b33d0 0x7fd36415f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:40.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd368e7b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd3640b33d0 0x7fd36415f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52476/0 (socket says 172.21.15.47:52476) 2024-04-14T23:35:40.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd368e7b640 1 -- 172.21.15.47:0/770894069 learned_addr learned my addr 172.21.15.47:0/770894069 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:40.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd363fff640 1 --2- 172.21.15.47:0/770894069 >> v2:172.21.15.191:3300/0 conn(0x7fd364144a80 0x7fd36406ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:40.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd3637fe640 1 --2- 172.21.15.47:0/770894069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd3640b2a70 0x7fd3640b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:40.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd368e7b640 1 -- 172.21.15.47:0/770894069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd3640b2a70 msgr2=0x7fd3640b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:40.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd368e7b640 1 --2- 172.21.15.47:0/770894069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd3640b2a70 0x7fd3640b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:40.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd368e7b640 1 -- 172.21.15.47:0/770894069 >> v2:172.21.15.191:3300/0 conn(0x7fd364144a80 msgr2=0x7fd36406ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:40.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd368e7b640 1 --2- 172.21.15.47:0/770894069 >> v2:172.21.15.191:3300/0 conn(0x7fd364144a80 0x7fd36406ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:40.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd368e7b640 1 -- 172.21.15.47:0/770894069 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36406df30 con 0x7fd3640b33d0 2024-04-14T23:35:40.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.086+0000 7fd363fff640 1 --2- 172.21.15.47:0/770894069 >> v2:172.21.15.191:3300/0 conn(0x7fd364144a80 0x7fd36406ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:40.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.087+0000 7fd368e7b640 1 --2- 172.21.15.47:0/770894069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3640b33d0 0x7fd36415f9f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd3640d06b0 tx=0x7fd35c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ff9cd3c92439e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:40.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.087+0000 7fd362ffd640 1 -- 172.21.15.47:0/770894069 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c02ca70 con 0x7fd3640b33d0 2024-04-14T23:35:40.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.087+0000 7fd362ffd640 1 -- 172.21.15.47:0/770894069 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35c02cc10 con 0x7fd3640b33d0 2024-04-14T23:35:40.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.087+0000 7fd362ffd640 1 -- 172.21.15.47:0/770894069 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0343f0 con 0x7fd3640b33d0 2024-04-14T23:35:40.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.088+0000 7fd36a8de640 1 -- 172.21.15.47:0/770894069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3640b33d0 msgr2=0x7fd36415f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:40.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.088+0000 7fd36a8de640 1 --2- 172.21.15.47:0/770894069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3640b33d0 0x7fd36415f9f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd3640d06b0 tx=0x7fd35c02bed0 comp rx=0 tx=0).stop 2024-04-14T23:35:40.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.088+0000 7fd36a8de640 1 -- 172.21.15.47:0/770894069 shutdown_connections 2024-04-14T23:35:40.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.088+0000 7fd36a8de640 1 --2- 172.21.15.47:0/770894069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3640b33d0 0x7fd36415f9f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:40.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.088+0000 7fd36a8de640 1 --2- 172.21.15.47:0/770894069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd3640b2a70 0x7fd3640b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:40.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.088+0000 7fd36a8de640 1 --2- 172.21.15.47:0/770894069 >> v2:172.21.15.191:3300/0 conn(0x7fd364144a80 0x7fd36406ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:40.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.088+0000 7fd36a8de640 1 -- 172.21.15.47:0/770894069 >> 172.21.15.47:0/770894069 conn(0x7fd36406b200 msgr2=0x7fd36406b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:40.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.088+0000 7fd36a8de640 1 -- 172.21.15.47:0/770894069 shutdown_connections 2024-04-14T23:35:40.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.088+0000 7fd36a8de640 1 -- 172.21.15.47:0/770894069 wait complete. 2024-04-14T23:35:40.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.089+0000 7fd36a8de640 1 Processor -- start 2024-04-14T23:35:40.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.089+0000 7fd36a8de640 1 -- start start 2024-04-14T23:35:40.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.090+0000 7fd36a8de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3640b2a70 0x7fd364141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:40.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.090+0000 7fd36a8de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3640b33d0 0x7fd36413f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:40.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.090+0000 7fd36a8de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd364144a80 0x7fd3640a9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:40.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.090+0000 7fd36a8de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd364144e60 con 0x7fd3640b33d0 2024-04-14T23:35:40.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.090+0000 7fd36a8de640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd3640b3840 con 0x7fd3640b2a70 2024-04-14T23:35:40.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.090+0000 7fd36a8de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd36415ff30 con 0x7fd364144a80 2024-04-14T23:35:40.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.090+0000 7fd3637fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3640b33d0 0x7fd36413f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:40.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.090+0000 7fd3637fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3640b33d0 0x7fd36413f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52490/0 (socket says 172.21.15.47:52490) 2024-04-14T23:35:40.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.090+0000 7fd3637fe640 1 -- 172.21.15.47:0/2401250107 learned_addr learned my addr 172.21.15.47:0/2401250107 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.090+0000 7fd368e7b640 1 --2- 172.21.15.47:0/2401250107 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd364144a80 0x7fd3640a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.090+0000 7fd363fff640 1 --2- 172.21.15.47:0/2401250107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3640b2a70 0x7fd364141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.091+0000 7fd3637fe640 1 -- 172.21.15.47:0/2401250107 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd364144a80 msgr2=0x7fd3640a9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.091+0000 7fd3637fe640 1 --2- 172.21.15.47:0/2401250107 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd364144a80 0x7fd3640a9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.091+0000 7fd3637fe640 1 -- 172.21.15.47:0/2401250107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3640b2a70 msgr2=0x7fd364141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.091+0000 7fd3637fe640 1 --2- 172.21.15.47:0/2401250107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3640b2a70 0x7fd364141800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.091+0000 7fd3637fe640 1 -- 172.21.15.47:0/2401250107 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3640af2e0 con 0x7fd3640b33d0 2024-04-14T23:35:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.091+0000 7fd3637fe640 1 --2- 172.21.15.47:0/2401250107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3640b33d0 0x7fd36413f1b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd35400d800 tx=0x7fd35400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.091+0000 7fd360ff9640 1 -- 172.21.15.47:0/2401250107 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd354018020 con 0x7fd3640b33d0 2024-04-14T23:35:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.091+0000 7fd360ff9640 1 -- 172.21.15.47:0/2401250107 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3540096a0 con 0x7fd3640b33d0 2024-04-14T23:35:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.091+0000 7fd360ff9640 1 -- 172.21.15.47:0/2401250107 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd354009a70 con 0x7fd3640b33d0 2024-04-14T23:35:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.091+0000 7fd36a8de640 1 -- 172.21.15.47:0/2401250107 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd364140d20 con 0x7fd3640b33d0 2024-04-14T23:35:40.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.091+0000 7fd36a8de640 1 -- 172.21.15.47:0/2401250107 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd36413f6f0 con 0x7fd3640b33d0 2024-04-14T23:35:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.092+0000 7fd36a8de640 1 -- 172.21.15.47:0/2401250107 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd364075430 con 0x7fd3640b33d0 2024-04-14T23:35:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.093+0000 7fd360ff9640 1 -- 172.21.15.47:0/2401250107 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd35401b020 con 0x7fd3640b33d0 2024-04-14T23:35:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.093+0000 7fd360ff9640 1 --2- 172.21.15.47:0/2401250107 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd35006b990 0x7fd35006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.093+0000 7fd360ff9640 1 -- 172.21.15.47:0/2401250107 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5335+0+0 (secure 0 0 0) 0x7fd35408aa80 con 0x7fd3640b33d0 2024-04-14T23:35:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.093+0000 7fd363fff640 1 --2- 172.21.15.47:0/2401250107 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd35006b990 0x7fd35006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:40.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.094+0000 7fd363fff640 1 --2- 172.21.15.47:0/2401250107 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd35006b990 0x7fd35006de50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd364140200 tx=0x7fd358008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:40.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.098+0000 7fd360ff9640 1 -- 172.21.15.47:0/2401250107 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd354022020 con 0x7fd3640b33d0 2024-04-14T23:35:40.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.291+0000 7fd36a8de640 1 -- 172.21.15.47:0/2401250107 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd3640b46d0 con 0x7fd3640b33d0 2024-04-14T23:35:40.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.909+0000 7fd360ff9640 1 -- 172.21.15.47:0/2401250107 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) ==== 97+0+0 (secure 0 0 0) 0x7fd354059240 con 0x7fd3640b33d0 2024-04-14T23:35:40.912 INFO:teuthology.orchestra.run.smithi047.stderr: removed all blocklist entries 2024-04-14T23:35:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.912+0000 7fd36a8de640 1 -- 172.21.15.47:0/2401250107 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd35006b990 msgr2=0x7fd35006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.912+0000 7fd36a8de640 1 --2- 172.21.15.47:0/2401250107 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd35006b990 0x7fd35006de50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd364140200 tx=0x7fd358008040 comp rx=0 tx=0).stop 2024-04-14T23:35:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.912+0000 7fd36a8de640 1 -- 172.21.15.47:0/2401250107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3640b33d0 msgr2=0x7fd36413f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.912+0000 7fd36a8de640 1 --2- 172.21.15.47:0/2401250107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3640b33d0 0x7fd36413f1b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd35400d800 tx=0x7fd35400dcc0 comp rx=0 tx=0).stop 2024-04-14T23:35:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.912+0000 7fd36a8de640 1 -- 172.21.15.47:0/2401250107 shutdown_connections 2024-04-14T23:35:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.912+0000 7fd36a8de640 1 --2- 172.21.15.47:0/2401250107 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd35006b990 0x7fd35006de50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.912+0000 7fd36a8de640 1 --2- 172.21.15.47:0/2401250107 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd364144a80 0x7fd3640a9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.912+0000 7fd36a8de640 1 --2- 172.21.15.47:0/2401250107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3640b33d0 0x7fd36413f1b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.912+0000 7fd36a8de640 1 --2- 172.21.15.47:0/2401250107 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3640b2a70 0x7fd364141800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.912+0000 7fd36a8de640 1 -- 172.21.15.47:0/2401250107 >> 172.21.15.47:0/2401250107 conn(0x7fd36406b200 msgr2=0x7fd3640cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.912+0000 7fd36a8de640 1 -- 172.21.15.47:0/2401250107 shutdown_connections 2024-04-14T23:35:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:40.912+0000 7fd36a8de640 1 -- 172.21.15.47:0/2401250107 wait complete. 2024-04-14T23:35:40.930 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-14T23:35:41.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.076+0000 7ff720f81640 1 Processor -- start 2024-04-14T23:35:41.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.076+0000 7ff720f81640 1 -- start start 2024-04-14T23:35:41.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.076+0000 7ff720f81640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff71c15c170 0x7ff71c0ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.076+0000 7ff720f81640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71c0ce8d0 0x7ff71c0ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.077+0000 7ff720f81640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff71c0cfa10 0x7ff71c0cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.077+0000 7ff720f81640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff71c0cdeb0 con 0x7ff71c15c170 2024-04-14T23:35:41.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.077+0000 7ff720f81640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7ff71c0b1730 con 0x7ff71c0cfa10 2024-04-14T23:35:41.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.077+0000 7ff720f81640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff71c0d2a70 con 0x7ff71c0ce8d0 2024-04-14T23:35:41.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.077+0000 7ff71a59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff71c15c170 0x7ff71c0ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.077+0000 7ff71a59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff71c15c170 0x7ff71c0ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52496/0 (socket says 172.21.15.47:52496) 2024-04-14T23:35:41.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.077+0000 7ff71a59c640 1 -- 172.21.15.47:0/647146995 learned_addr learned my addr 172.21.15.47:0/647146995 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:41.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.077+0000 7ff711d9b640 1 --2- 172.21.15.47:0/647146995 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71c0ce8d0 0x7ff71c0ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.077+0000 7ff71ad9d640 1 --2- 172.21.15.47:0/647146995 >> v2:172.21.15.191:3300/0 conn(0x7ff71c0cfa10 0x7ff71c0cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.077+0000 7ff71a59c640 1 -- 172.21.15.47:0/647146995 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71c0ce8d0 msgr2=0x7ff71c0ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.077+0000 7ff71a59c640 1 --2- 172.21.15.47:0/647146995 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71c0ce8d0 0x7ff71c0ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.077+0000 7ff71a59c640 1 -- 172.21.15.47:0/647146995 >> v2:172.21.15.191:3300/0 conn(0x7ff71c0cfa10 msgr2=0x7ff71c0cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.077+0000 7ff71a59c640 1 --2- 172.21.15.47:0/647146995 >> v2:172.21.15.191:3300/0 conn(0x7ff71c0cfa10 0x7ff71c0cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.077+0000 7ff71a59c640 1 -- 172.21.15.47:0/647146995 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71c0cd610 con 0x7ff71c15c170 2024-04-14T23:35:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.077+0000 7ff711d9b640 1 --2- 172.21.15.47:0/647146995 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71c0ce8d0 0x7ff71c0ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.078+0000 7ff71a59c640 1 --2- 172.21.15.47:0/647146995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff71c15c170 0x7ff71c0ce390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff71c071e00 tx=0x7ff70c02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7988a3780d61a3d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.078+0000 7ff719d9b640 1 -- 172.21.15.47:0/647146995 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0317d0 con 0x7ff71c15c170 2024-04-14T23:35:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.078+0000 7ff719d9b640 1 -- 172.21.15.47:0/647146995 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff70c037070 con 0x7ff71c15c170 2024-04-14T23:35:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.078+0000 7ff719d9b640 1 -- 172.21.15.47:0/647146995 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c031b90 con 0x7ff71c15c170 2024-04-14T23:35:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.078+0000 7ff720f81640 1 -- 172.21.15.47:0/647146995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff71c15c170 msgr2=0x7ff71c0ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.078+0000 7ff720f81640 1 --2- 172.21.15.47:0/647146995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff71c15c170 0x7ff71c0ce390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff71c071e00 tx=0x7ff70c02b870 comp rx=0 tx=0).stop 2024-04-14T23:35:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.078+0000 7ff720f81640 1 -- 172.21.15.47:0/647146995 shutdown_connections 2024-04-14T23:35:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.078+0000 7ff720f81640 1 --2- 172.21.15.47:0/647146995 >> v2:172.21.15.191:3300/0 conn(0x7ff71c0cfa10 0x7ff71c0cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.078+0000 7ff720f81640 1 --2- 172.21.15.47:0/647146995 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71c0ce8d0 0x7ff71c0ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.078+0000 7ff720f81640 1 --2- 172.21.15.47:0/647146995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff71c15c170 0x7ff71c0ce390 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.078+0000 7ff720f81640 1 -- 172.21.15.47:0/647146995 >> 172.21.15.47:0/647146995 conn(0x7ff71c0d1c30 msgr2=0x7ff71c0d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.079+0000 7ff720f81640 1 -- 172.21.15.47:0/647146995 shutdown_connections 2024-04-14T23:35:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.079+0000 7ff720f81640 1 -- 172.21.15.47:0/647146995 wait complete. 2024-04-14T23:35:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.080+0000 7ff720f81640 1 Processor -- start 2024-04-14T23:35:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.080+0000 7ff720f81640 1 -- start start 2024-04-14T23:35:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff720f81640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff71c0ce8d0 0x7ff71c0c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff720f81640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71c0cfa10 0x7ff71c0c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff720f81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff71c15c170 0x7ff71c1f3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff720f81640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c15c550 con 0x7ff71c15c170 2024-04-14T23:35:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff720f81640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff71c0cdbd0 con 0x7ff71c0ce8d0 2024-04-14T23:35:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff720f81640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff71c0caf80 con 0x7ff71c0cfa10 2024-04-14T23:35:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff71ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff71c15c170 0x7ff71c1f3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff71ad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff71c15c170 0x7ff71c1f3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52508/0 (socket says 172.21.15.47:52508) 2024-04-14T23:35:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff71ad9d640 1 -- 172.21.15.47:0/2428569132 learned_addr learned my addr 172.21.15.47:0/2428569132 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff711d9b640 1 --2- 172.21.15.47:0/2428569132 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71c0cfa10 0x7ff71c0c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff71a59c640 1 --2- 172.21.15.47:0/2428569132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff71c0ce8d0 0x7ff71c0c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff71ad9d640 1 -- 172.21.15.47:0/2428569132 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71c0cfa10 msgr2=0x7ff71c0c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff71ad9d640 1 --2- 172.21.15.47:0/2428569132 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71c0cfa10 0x7ff71c0c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff71ad9d640 1 -- 172.21.15.47:0/2428569132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff71c0ce8d0 msgr2=0x7ff71c0c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff71ad9d640 1 --2- 172.21.15.47:0/2428569132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff71c0ce8d0 0x7ff71c0c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff71ad9d640 1 -- 172.21.15.47:0/2428569132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71c152ec0 con 0x7ff71c15c170 2024-04-14T23:35:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.081+0000 7ff71ad9d640 1 --2- 172.21.15.47:0/2428569132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff71c15c170 0x7ff71c1f3b30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff714007e40 tx=0x7ff71400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.082+0000 7ff7137fe640 1 -- 172.21.15.47:0/2428569132 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714014620 con 0x7ff71c15c170 2024-04-14T23:35:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.082+0000 7ff7137fe640 1 -- 172.21.15.47:0/2428569132 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff714019070 con 0x7ff71c15c170 2024-04-14T23:35:41.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.082+0000 7ff720f81640 1 -- 172.21.15.47:0/2428569132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff71c0ca370 con 0x7ff71c15c170 2024-04-14T23:35:41.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.082+0000 7ff7137fe640 1 -- 172.21.15.47:0/2428569132 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714014a20 con 0x7ff71c15c170 2024-04-14T23:35:41.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.082+0000 7ff720f81640 1 -- 172.21.15.47:0/2428569132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff71c0ca930 con 0x7ff71c15c170 2024-04-14T23:35:41.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.083+0000 7ff720f81640 1 -- 172.21.15.47:0/2428569132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff71c0cef70 con 0x7ff71c15c170 2024-04-14T23:35:41.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.083+0000 7ff7137fe640 1 -- 172.21.15.47:0/2428569132 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ff714014bc0 con 0x7ff71c15c170 2024-04-14T23:35:41.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.083+0000 7ff7137fe640 1 --2- 172.21.15.47:0/2428569132 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6fc06b9c0 0x7ff6fc06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.084+0000 7ff7137fe640 1 -- 172.21.15.47:0/2428569132 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7ff71408adc0 con 0x7ff71c15c170 2024-04-14T23:35:41.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.084+0000 7ff71a59c640 1 --2- 172.21.15.47:0/2428569132 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6fc06b9c0 0x7ff6fc06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.084+0000 7ff71a59c640 1 --2- 172.21.15.47:0/2428569132 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6fc06b9c0 0x7ff6fc06de80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff70c036000 tx=0x7ff70c03d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:41.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.088+0000 7ff7137fe640 1 -- 172.21.15.47:0/2428569132 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff71c0cef70 con 0x7ff71c15c170 2024-04-14T23:35:41.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.335+0000 7ff720f81640 1 -- 172.21.15.47:0/2428569132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff71c06bf70 con 0x7ff71c15c170 2024-04-14T23:35:41.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.336+0000 7ff7137fe640 1 -- 172.21.15.47:0/2428569132 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7ff71c06bf70 con 0x7ff71c15c170 2024-04-14T23:35:41.339 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:41.339 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-14T23:35:41.339 INFO:teuthology.orchestra.run.smithi047.stdout: "auth_dump": [ 2024-04-14T23:35:41.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.340 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mds.a", 2024-04-14T23:35:41.340 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDWZxxmIAEODhAAAJ7ut52z2zNaFKmMHZxmkw==", 2024-04-14T23:35:41.340 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.340 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-14T23:35:41.340 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-04-14T23:35:41.340 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-04-14T23:35:41.340 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-14T23:35:41.340 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.340 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mds.b", 2024-04-14T23:35:41.340 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDWZxxmuaNZGhAALbJpai62YAqZS9Zq+pbmZw==", 2024-04-14T23:35:41.340 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.341 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-14T23:35:41.341 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-04-14T23:35:41.341 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-04-14T23:35:41.341 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-14T23:35:41.341 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.341 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mds.c", 2024-04-14T23:35:41.341 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDWZxxmdHxYFRAAovKdQJ+cgMZn/KSzfRz2Ow==", 2024-04-14T23:35:41.341 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.341 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-14T23:35:41.341 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-04-14T23:35:41.341 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-04-14T23:35:41.341 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-14T23:35:41.342 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.342 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mds.d", 2024-04-14T23:35:41.342 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDWZxxmq9m3IRAAQP8PjhXcIgnNpXKBz/sfaQ==", 2024-04-14T23:35:41.342 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.342 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-14T23:35:41.342 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-04-14T23:35:41.342 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-04-14T23:35:41.342 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-14T23:35:41.342 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.343 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.0", 2024-04-14T23:35:41.343 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDYZxxm8RiJDRAAdJFBPX+r5fbuL8t5r3Nw3g==", 2024-04-14T23:35:41.343 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.343 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-14T23:35:41.343 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-14T23:35:41.343 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-14T23:35:41.343 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.343 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.1", 2024-04-14T23:35:41.343 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDbZxxmNhT8CxAAcLDXRk5caiheaLL9StKOAQ==", 2024-04-14T23:35:41.343 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.343 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-14T23:35:41.343 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-14T23:35:41.344 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-14T23:35:41.344 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.344 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.2", 2024-04-14T23:35:41.344 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDeZxxmZC2KChAAyRouhk0xNx7wWCGV7yOFbw==", 2024-04-14T23:35:41.344 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.344 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-14T23:35:41.344 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-14T23:35:41.344 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-14T23:35:41.344 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.344 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.3", 2024-04-14T23:35:41.345 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDhZxxm8aQhDRAAsiW9p0OQxUW4z6EbVD7jAw==", 2024-04-14T23:35:41.345 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.345 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-14T23:35:41.345 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-14T23:35:41.345 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-14T23:35:41.345 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.345 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.4", 2024-04-14T23:35:41.345 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDnZxxmwlyvDxAAbif2xde0Gy1vNEuSm6En+A==", 2024-04-14T23:35:41.345 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.345 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-14T23:35:41.345 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-14T23:35:41.345 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-14T23:35:41.346 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.346 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.5", 2024-04-14T23:35:41.346 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDqZxxmblsFDhAAqtF0YqXtN6wwpxti2krNqw==", 2024-04-14T23:35:41.346 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.346 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-14T23:35:41.346 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-14T23:35:41.346 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-14T23:35:41.346 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.346 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.6", 2024-04-14T23:35:41.346 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDtZxxmtM3zCxAAyGfuAZX8EW8TOM8yiif/3g==", 2024-04-14T23:35:41.347 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.347 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-14T23:35:41.347 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-14T23:35:41.347 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-14T23:35:41.347 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.347 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.7", 2024-04-14T23:35:41.347 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDwZxxmzx7iCRAAhkGucA54qt0BaAKFM607FQ==", 2024-04-14T23:35:41.347 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.347 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-14T23:35:41.347 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-14T23:35:41.347 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-14T23:35:41.347 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.348 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.0", 2024-04-14T23:35:41.348 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDWZxxmvmX2JRAAIQq0oHP9ehuYsHlAvadMIw==", 2024-04-14T23:35:41.348 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.348 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-14T23:35:41.348 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow r", 2024-04-14T23:35:41.348 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow rw", 2024-04-14T23:35:41.348 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow rwx" 2024-04-14T23:35:41.348 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.348 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.1", 2024-04-14T23:35:41.348 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDWZxxmh10rLxAAhPQt4kcMSDmwD+SSnOpnGw==", 2024-04-14T23:35:41.348 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-14T23:35:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow r", 2024-04-14T23:35:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow rw", 2024-04-14T23:35:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow rwx" 2024-04-14T23:35:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.2", 2024-04-14T23:35:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDWZxxmRcLAKxAAZKcKL40+FoLLTr5sF8fb3A==", 2024-04-14T23:35:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-14T23:35:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow r", 2024-04-14T23:35:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow rw", 2024-04-14T23:35:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow rwx" 2024-04-14T23:35:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.350 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.3", 2024-04-14T23:35:41.350 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDWZxxmKHUDNRAAREpHyKZBtVbpmh15Nu2TgQ==", 2024-04-14T23:35:41.350 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.350 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-14T23:35:41.350 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow r", 2024-04-14T23:35:41.350 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow rw", 2024-04-14T23:35:41.350 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow rwx" 2024-04-14T23:35:41.350 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.350 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.admin", 2024-04-14T23:35:41.350 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDVZxxmlukDLRAA+vfrUpmbcC7hEnBKTQSE4g==", 2024-04-14T23:35:41.350 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.350 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow *", 2024-04-14T23:35:41.351 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-04-14T23:35:41.351 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-04-14T23:35:41.351 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-14T23:35:41.351 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.351 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-mds", 2024-04-14T23:35:41.351 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQD2ZxxmvmWqBBAAEtvtZUiuqdO28jStecrcJw==", 2024-04-14T23:35:41.351 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.351 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-mds" 2024-04-14T23:35:41.351 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.351 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-mgr", 2024-04-14T23:35:41.352 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQD2ZxxmNW6qBBAAfRGfCklEfBqKe+bEP9h0Ag==", 2024-04-14T23:35:41.352 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.352 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-14T23:35:41.352 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.352 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-osd", 2024-04-14T23:35:41.352 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQD2Zxxm93SqBBAATKAaUetwKtRbAjxpT1/xMA==", 2024-04-14T23:35:41.352 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.352 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-osd" 2024-04-14T23:35:41.352 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.352 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-rbd", 2024-04-14T23:35:41.352 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQD2ZxxmSXuqBBAAtVTEUrpOwevCDaBujzKa1A==", 2024-04-14T23:35:41.353 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.353 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-14T23:35:41.353 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.353 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-14T23:35:41.353 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQD2ZxxmzYGqBBAAoB8FT4hPsHw3Er1dSiGPZA==", 2024-04-14T23:35:41.353 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.353 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-14T23:35:41.353 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.353 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-rgw", 2024-04-14T23:35:41.353 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQD2Zxxmn4iqBBAA4/15qedTsoWgIIV3mOm9Xg==", 2024-04-14T23:35:41.353 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.353 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-14T23:35:41.354 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.354 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mgr.x", 2024-04-14T23:35:41.354 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDWZxxmv+ioChAA3fthTqbeyofQNPB+DE5jTA==", 2024-04-14T23:35:41.354 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.354 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow *", 2024-04-14T23:35:41.354 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile mgr", 2024-04-14T23:35:41.354 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-14T23:35:41.354 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-14T23:35:41.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:41.354 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mgr.y", 2024-04-14T23:35:41.354 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQDWZxxm75ejBhAAT8GiGRCz7/8g9T/KyXUeIg==", 2024-04-14T23:35:41.354 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-14T23:35:41.355 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow *", 2024-04-14T23:35:41.355 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile mgr", 2024-04-14T23:35:41.355 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-14T23:35:41.355 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.355 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:41.355 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-04-14T23:35:41.355 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-14T23:35:41.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.338+0000 7ff720f81640 1 -- 172.21.15.47:0/2428569132 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6fc06b9c0 msgr2=0x7ff6fc06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:41.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.338+0000 7ff720f81640 1 --2- 172.21.15.47:0/2428569132 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6fc06b9c0 0x7ff6fc06de80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff70c036000 tx=0x7ff70c03d040 comp rx=0 tx=0).stop 2024-04-14T23:35:41.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.338+0000 7ff720f81640 1 -- 172.21.15.47:0/2428569132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff71c15c170 msgr2=0x7ff71c1f3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:41.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.338+0000 7ff720f81640 1 --2- 172.21.15.47:0/2428569132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff71c15c170 0x7ff71c1f3b30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff714007e40 tx=0x7ff71400e4b0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.338+0000 7ff720f81640 1 -- 172.21.15.47:0/2428569132 shutdown_connections 2024-04-14T23:35:41.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.338+0000 7ff720f81640 1 --2- 172.21.15.47:0/2428569132 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6fc06b9c0 0x7ff6fc06de80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.338+0000 7ff720f81640 1 --2- 172.21.15.47:0/2428569132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff71c15c170 0x7ff71c1f3b30 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.338+0000 7ff720f81640 1 --2- 172.21.15.47:0/2428569132 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff71c0cfa10 0x7ff71c0c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.338+0000 7ff720f81640 1 --2- 172.21.15.47:0/2428569132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff71c0ce8d0 0x7ff71c0c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.338+0000 7ff720f81640 1 -- 172.21.15.47:0/2428569132 >> 172.21.15.47:0/2428569132 conn(0x7ff71c0d1c30 msgr2=0x7ff71c06d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:41.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.338+0000 7ff720f81640 1 -- 172.21.15.47:0/2428569132 shutdown_connections 2024-04-14T23:35:41.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.338+0000 7ff720f81640 1 -- 172.21.15.47:0/2428569132 wait complete. 2024-04-14T23:35:41.358 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-14T23:35:41.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.457+0000 7f7202fed640 1 Processor -- start 2024-04-14T23:35:41.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.457+0000 7f7202fed640 1 -- start start 2024-04-14T23:35:41.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.458+0000 7f7202fed640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f71fc0cca50 0x7f71fc0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.458+0000 7f7202fed640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f71fc0ceab0 0x7f71fc161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.458+0000 7f7202fed640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71fc0d16d0 0x7f71fc1622b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.458+0000 7f7202fed640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f71fc15f5b0 con 0x7f71fc0cca50 2024-04-14T23:35:41.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.458+0000 7f7202fed640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f71fc15e9a0 con 0x7f71fc0ceab0 2024-04-14T23:35:41.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.458+0000 7f7202fed640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f71fc15ec80 con 0x7f71fc0d16d0 2024-04-14T23:35:41.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.458+0000 7f7200d89640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f71fc0cca50 0x7f71fc0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.458+0000 7f7200d89640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f71fc0cca50 0x7f71fc0cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52516/0 (socket says 172.21.15.47:52516) 2024-04-14T23:35:41.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.458+0000 7f7200d89640 1 -- 172.21.15.47:0/1066215571 learned_addr learned my addr 172.21.15.47:0/1066215571 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:41.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.458+0000 7f71fbfff640 1 --2- 172.21.15.47:0/1066215571 >> v2:172.21.15.191:3300/0 conn(0x7f71fc0ceab0 0x7f71fc161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.458+0000 7f720158a640 1 --2- 172.21.15.47:0/1066215571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71fc0d16d0 0x7f71fc1622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.458+0000 7f7200d89640 1 -- 172.21.15.47:0/1066215571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71fc0d16d0 msgr2=0x7f71fc1622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:41.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.458+0000 7f7200d89640 1 --2- 172.21.15.47:0/1066215571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71fc0d16d0 0x7f71fc1622b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.458+0000 7f7200d89640 1 -- 172.21.15.47:0/1066215571 >> v2:172.21.15.191:3300/0 conn(0x7f71fc0ceab0 msgr2=0x7f71fc161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:41.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.458+0000 7f7200d89640 1 --2- 172.21.15.47:0/1066215571 >> v2:172.21.15.191:3300/0 conn(0x7f71fc0ceab0 0x7f71fc161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.458+0000 7f7200d89640 1 -- 172.21.15.47:0/1066215571 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71fc15ef60 con 0x7f71fc0cca50 2024-04-14T23:35:41.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.459+0000 7f7200d89640 1 --2- 172.21.15.47:0/1066215571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71fc0cca50 0x7f71fc0cce30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f71fc073e60 tx=0x7f71f002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ef837335808dbc server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:41.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.459+0000 7f71fb7fe640 1 -- 172.21.15.47:0/1066215571 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f0038070 con 0x7f71fc0cca50 2024-04-14T23:35:41.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.459+0000 7f71fb7fe640 1 -- 172.21.15.47:0/1066215571 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f002f050 con 0x7f71fc0cca50 2024-04-14T23:35:41.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.459+0000 7f71fb7fe640 1 -- 172.21.15.47:0/1066215571 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f0031970 con 0x7f71fc0cca50 2024-04-14T23:35:41.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.459+0000 7f7202fed640 1 -- 172.21.15.47:0/1066215571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71fc0cca50 msgr2=0x7f71fc0cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:41.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.459+0000 7f7202fed640 1 --2- 172.21.15.47:0/1066215571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71fc0cca50 0x7f71fc0cce30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f71fc073e60 tx=0x7f71f002b7f0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.459+0000 7f7202fed640 1 -- 172.21.15.47:0/1066215571 shutdown_connections 2024-04-14T23:35:41.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.459+0000 7f7202fed640 1 --2- 172.21.15.47:0/1066215571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71fc0d16d0 0x7f71fc1622b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.459+0000 7f7202fed640 1 --2- 172.21.15.47:0/1066215571 >> v2:172.21.15.191:3300/0 conn(0x7f71fc0ceab0 0x7f71fc161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.459+0000 7f7202fed640 1 --2- 172.21.15.47:0/1066215571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71fc0cca50 0x7f71fc0cce30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.459+0000 7f7202fed640 1 -- 172.21.15.47:0/1066215571 >> 172.21.15.47:0/1066215571 conn(0x7f71fc0d0bb0 msgr2=0x7f71fc0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:41.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.460+0000 7f7202fed640 1 -- 172.21.15.47:0/1066215571 shutdown_connections 2024-04-14T23:35:41.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.460+0000 7f7202fed640 1 -- 172.21.15.47:0/1066215571 wait complete. 2024-04-14T23:35:41.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.461+0000 7f7202fed640 1 Processor -- start 2024-04-14T23:35:41.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.461+0000 7f7202fed640 1 -- start start 2024-04-14T23:35:41.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7202fed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71fc0cca50 0x7f71fc0c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7202fed640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71fc0ceab0 0x7f71fc161b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7202fed640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71fc0d16d0 0x7f71fc162070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7202fed640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc15e660 con 0x7f71fc0cca50 2024-04-14T23:35:41.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7202fed640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc0cd370 con 0x7f71fc0ceab0 2024-04-14T23:35:41.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7202fed640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f71fc0cb3c0 con 0x7f71fc0d16d0 2024-04-14T23:35:41.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7200d89640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71fc0cca50 0x7f71fc0c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7200d89640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71fc0cca50 0x7f71fc0c6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52530/0 (socket says 172.21.15.47:52530) 2024-04-14T23:35:41.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7200d89640 1 -- 172.21.15.47:0/1071085615 learned_addr learned my addr 172.21.15.47:0/1071085615 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:41.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f71fbfff640 1 --2- 172.21.15.47:0/1071085615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71fc0ceab0 0x7f71fc161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f720158a640 1 --2- 172.21.15.47:0/1071085615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71fc0d16d0 0x7f71fc162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7200d89640 1 -- 172.21.15.47:0/1071085615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71fc0d16d0 msgr2=0x7f71fc162070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:41.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7200d89640 1 --2- 172.21.15.47:0/1071085615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71fc0d16d0 0x7f71fc162070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7200d89640 1 -- 172.21.15.47:0/1071085615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71fc0ceab0 msgr2=0x7f71fc161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:41.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7200d89640 1 --2- 172.21.15.47:0/1071085615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71fc0ceab0 0x7f71fc161b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7200d89640 1 -- 172.21.15.47:0/1071085615 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71fc0c6150 con 0x7f71fc0cca50 2024-04-14T23:35:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7200d89640 1 --2- 172.21.15.47:0/1071085615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71fc0cca50 0x7f71fc0c6f20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f71f002b830 tx=0x7f71f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f71f97fa640 1 -- 172.21.15.47:0/1071085615 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f0042070 con 0x7f71fc0cca50 2024-04-14T23:35:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f71f97fa640 1 -- 172.21.15.47:0/1071085615 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f003d870 con 0x7f71fc0cca50 2024-04-14T23:35:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f71f97fa640 1 -- 172.21.15.47:0/1071085615 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f0038040 con 0x7f71fc0cca50 2024-04-14T23:35:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7202fed640 1 -- 172.21.15.47:0/1071085615 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71fc0c6430 con 0x7f71fc0cca50 2024-04-14T23:35:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.462+0000 7f7202fed640 1 -- 172.21.15.47:0/1071085615 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71fc0b0510 con 0x7f71fc0cca50 2024-04-14T23:35:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.463+0000 7f7202fed640 1 -- 172.21.15.47:0/1071085615 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71fc075430 con 0x7f71fc0cca50 2024-04-14T23:35:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.464+0000 7f71f97fa640 1 -- 172.21.15.47:0/1071085615 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f71f0045070 con 0x7f71fc0cca50 2024-04-14T23:35:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.464+0000 7f71f97fa640 1 --2- 172.21.15.47:0/1071085615 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f71e006b9c0 0x7f71e006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.464+0000 7f71f97fa640 1 -- 172.21.15.47:0/1071085615 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f71f00ac3a0 con 0x7f71fc0cca50 2024-04-14T23:35:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.464+0000 7f71fbfff640 1 --2- 172.21.15.47:0/1071085615 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f71e006b9c0 0x7f71e006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.465+0000 7f71fbfff640 1 --2- 172.21.15.47:0/1071085615 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f71e006b9c0 0x7f71e006de80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0c58b0 tx=0x7f71e8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:41.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.469+0000 7f71f97fa640 1 -- 172.21.15.47:0/1071085615 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f71f007b320 con 0x7f71fc0cca50 2024-04-14T23:35:41.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.722+0000 7f7202fed640 1 -- 172.21.15.47:0/1071085615 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f71fc0b6b30 con 0x7f71fc0cca50 2024-04-14T23:35:41.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.724+0000 7f71f97fa640 1 -- 172.21.15.47:0/1071085615 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f71f007ac20 con 0x7f71fc0cca50 2024-04-14T23:35:41.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.726+0000 7f7202fed640 1 -- 172.21.15.47:0/1071085615 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f71e006b9c0 msgr2=0x7f71e006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:41.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.726+0000 7f7202fed640 1 --2- 172.21.15.47:0/1071085615 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f71e006b9c0 0x7f71e006de80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0c58b0 tx=0x7f71e8008040 comp rx=0 tx=0).stop 2024-04-14T23:35:41.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.726+0000 7f7202fed640 1 -- 172.21.15.47:0/1071085615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71fc0cca50 msgr2=0x7f71fc0c6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:41.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.726+0000 7f7202fed640 1 --2- 172.21.15.47:0/1071085615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71fc0cca50 0x7f71fc0c6f20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f71f002b830 tx=0x7f71f00046c0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.726+0000 7f7202fed640 1 -- 172.21.15.47:0/1071085615 shutdown_connections 2024-04-14T23:35:41.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.726+0000 7f7202fed640 1 --2- 172.21.15.47:0/1071085615 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f71e006b9c0 0x7f71e006de80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.726+0000 7f7202fed640 1 --2- 172.21.15.47:0/1071085615 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71fc0d16d0 0x7f71fc162070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.726+0000 7f7202fed640 1 --2- 172.21.15.47:0/1071085615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71fc0ceab0 0x7f71fc161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.726+0000 7f7202fed640 1 --2- 172.21.15.47:0/1071085615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71fc0cca50 0x7f71fc0c6f20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.726+0000 7f7202fed640 1 -- 172.21.15.47:0/1071085615 >> 172.21.15.47:0/1071085615 conn(0x7f71fc0d0bb0 msgr2=0x7f71fc09f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:41.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.726+0000 7f7202fed640 1 -- 172.21.15.47:0/1071085615 shutdown_connections 2024-04-14T23:35:41.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.726+0000 7f7202fed640 1 -- 172.21.15.47:0/1071085615 wait complete. 2024-04-14T23:35:41.740 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-14T23:35:41.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.839+0000 7f7511036640 1 Processor -- start 2024-04-14T23:35:41.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.840+0000 7f7511036640 1 -- start start 2024-04-14T23:35:41.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.840+0000 7f7511036640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f750c15e420 0x7f750c0d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.840+0000 7f7511036640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f750c0cf050 0x7f750c0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.840+0000 7f7511036640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f750c0d1040 con 0x7f750c0ce4b0 2024-04-14T23:35:41.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.840+0000 7f7511036640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f750c0cc280 con 0x7f750c15e420 2024-04-14T23:35:41.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.840+0000 7f7511036640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f750c06d750 con 0x7f750c0cf050 2024-04-14T23:35:41.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.840+0000 7f7503fff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f750c0ce4b0 0x7f750c0ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:38628/0 (socket says 172.21.15.47:38628) 2024-04-14T23:35:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.840+0000 7f7503fff640 1 -- 172.21.15.47:0/1226571076 learned_addr learned my addr 172.21.15.47:0/1226571076 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.841+0000 7f750ad9d640 1 --2- 172.21.15.47:0/1226571076 >> v2:172.21.15.191:3300/0 conn(0x7f750c15e420 0x7f750c0d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.841+0000 7f750b59e640 1 --2- 172.21.15.47:0/1226571076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f750c0cf050 0x7f750c0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.841+0000 7f750a59c640 1 -- 172.21.15.47:0/1226571076 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3609513254 0 0) 0x7f750c0d1040 con 0x7f750c0ce4b0 2024-04-14T23:35:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.841+0000 7f750a59c640 1 -- 172.21.15.47:0/1226571076 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74f8003520 con 0x7f750c0ce4b0 2024-04-14T23:35:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.841+0000 7f750ad9d640 1 -- 172.21.15.47:0/1226571076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f750c0cf050 msgr2=0x7f750c0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.841+0000 7f750ad9d640 1 --2- 172.21.15.47:0/1226571076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f750c0cf050 0x7f750c0cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.841+0000 7f750ad9d640 1 -- 172.21.15.47:0/1226571076 >> v1:172.21.15.47:6789/0 conn(0x7f750c0ce4b0 legacy=0x7f750c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.841+0000 7f750ad9d640 1 -- 172.21.15.47:0/1226571076 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750c0d1320 con 0x7f750c15e420 2024-04-14T23:35:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.841+0000 7f750b59e640 1 --2- 172.21.15.47:0/1226571076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f750c0cf050 0x7f750c0cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.842+0000 7f750ad9d640 1 --2- 172.21.15.47:0/1226571076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f750c15e420 0x7f750c0d0980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0097a0 tx=0x7f74fc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d1c369d5a1cceba server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.842+0000 7f750a59c640 1 -- 172.21.15.47:0/1226571076 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74fc034070 con 0x7f750c15e420 2024-04-14T23:35:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.842+0000 7f750a59c640 1 -- 172.21.15.47:0/1226571076 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74fc030610 con 0x7f750c15e420 2024-04-14T23:35:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.842+0000 7f750a59c640 1 -- 172.21.15.47:0/1226571076 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74fc0309e0 con 0x7f750c15e420 2024-04-14T23:35:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.842+0000 7f7511036640 1 -- 172.21.15.47:0/1226571076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f750c15e420 msgr2=0x7f750c0d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.842+0000 7f7511036640 1 --2- 172.21.15.47:0/1226571076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f750c15e420 0x7f750c0d0980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0097a0 tx=0x7f74fc02b960 comp rx=0 tx=0).stop 2024-04-14T23:35:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.842+0000 7f7511036640 1 -- 172.21.15.47:0/1226571076 shutdown_connections 2024-04-14T23:35:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.842+0000 7f7511036640 1 --2- 172.21.15.47:0/1226571076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f750c0cf050 0x7f750c0cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.842+0000 7f7511036640 1 --2- 172.21.15.47:0/1226571076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f750c15e420 0x7f750c0d0980 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.842+0000 7f7511036640 1 -- 172.21.15.47:0/1226571076 >> 172.21.15.47:0/1226571076 conn(0x7f750c0d1c30 msgr2=0x7f750c0d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.842+0000 7f7511036640 1 -- 172.21.15.47:0/1226571076 shutdown_connections 2024-04-14T23:35:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.842+0000 7f7511036640 1 -- 172.21.15.47:0/1226571076 wait complete. 2024-04-14T23:35:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.844+0000 7f7511036640 1 Processor -- start 2024-04-14T23:35:41.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.844+0000 7f7511036640 1 -- start start 2024-04-14T23:35:41.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.844+0000 7f7511036640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f750c0ce4b0 0x7f750c0cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.844+0000 7f7511036640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f750c0cf050 0x7f750c0c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.844+0000 7f7511036640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f750c15e420 0x7f750c1f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.844+0000 7f7511036640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f750c15e800 con 0x7f750c0cf050 2024-04-14T23:35:41.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.844+0000 7f7511036640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f750c0cc7b0 con 0x7f750c0ce4b0 2024-04-14T23:35:41.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.844+0000 7f7511036640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f750c0cd210 con 0x7f750c15e420 2024-04-14T23:35:41.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f7503fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f750c0cf050 0x7f750c0c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f7503fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f750c0cf050 0x7f750c0c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52532/0 (socket says 172.21.15.47:52532) 2024-04-14T23:35:41.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f750b59e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f750c15e420 0x7f750c1f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f7503fff640 1 -- 172.21.15.47:0/1164916807 learned_addr learned my addr 172.21.15.47:0/1164916807 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:41.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f750ad9d640 1 --2- 172.21.15.47:0/1164916807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f750c0ce4b0 0x7f750c0cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f7503fff640 1 -- 172.21.15.47:0/1164916807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f750c15e420 msgr2=0x7f750c1f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:41.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f7503fff640 1 --2- 172.21.15.47:0/1164916807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f750c15e420 0x7f750c1f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f7503fff640 1 -- 172.21.15.47:0/1164916807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f750c0ce4b0 msgr2=0x7f750c0cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:41.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f7503fff640 1 --2- 172.21.15.47:0/1164916807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f750c0ce4b0 0x7f750c0cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:41.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f7503fff640 1 -- 172.21.15.47:0/1164916807 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750c0ca160 con 0x7f750c0cf050 2024-04-14T23:35:41.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f750b59e640 1 --2- 172.21.15.47:0/1164916807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f750c15e420 0x7f750c1f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:41.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f750ad9d640 1 --2- 172.21.15.47:0/1164916807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f750c0ce4b0 0x7f750c0cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:41.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f7503fff640 1 --2- 172.21.15.47:0/1164916807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f750c0cf050 0x7f750c0c9710 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f74f400c460 tx=0x7f74f400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:41.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f75037fe640 1 -- 172.21.15.47:0/1164916807 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4017070 con 0x7f750c0cf050 2024-04-14T23:35:41.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f75037fe640 1 -- 172.21.15.47:0/1164916807 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f4005ce0 con 0x7f750c0cf050 2024-04-14T23:35:41.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f7511036640 1 -- 172.21.15.47:0/1164916807 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f750c0ca440 con 0x7f750c0cf050 2024-04-14T23:35:41.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f75037fe640 1 -- 172.21.15.47:0/1164916807 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4007290 con 0x7f750c0cf050 2024-04-14T23:35:41.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.845+0000 7f7511036640 1 -- 172.21.15.47:0/1164916807 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f750c0caa00 con 0x7f750c0cf050 2024-04-14T23:35:41.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.846+0000 7f7511036640 1 -- 172.21.15.47:0/1164916807 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f750c075430 con 0x7f750c0cf050 2024-04-14T23:35:41.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.847+0000 7f75037fe640 1 -- 172.21.15.47:0/1164916807 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f74f401a070 con 0x7f750c0cf050 2024-04-14T23:35:41.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.847+0000 7f75037fe640 1 --2- 172.21.15.47:0/1164916807 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f74ec06b990 0x7f74ec06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:41.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.847+0000 7f75037fe640 1 -- 172.21.15.47:0/1164916807 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f74f40898a0 con 0x7f750c0cf050 2024-04-14T23:35:41.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.847+0000 7f750ad9d640 1 --2- 172.21.15.47:0/1164916807 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f74ec06b990 0x7f74ec06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:41.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.848+0000 7f750ad9d640 1 --2- 172.21.15.47:0/1164916807 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f74ec06b990 0x7f74ec06de50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f74fc036000 tx=0x7f74fc03b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:41.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:41.852+0000 7f75037fe640 1 -- 172.21.15.47:0/1164916807 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f74f40580b0 con 0x7f750c0cf050 2024-04-14T23:35:42.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.101+0000 7f7511036640 1 -- 172.21.15.47:0/1164916807 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f750c06c310 con 0x7f750c0cf050 2024-04-14T23:35:42.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.103+0000 7f75037fe640 1 -- 172.21.15.47:0/1164916807 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f74f405c150 con 0x7f750c0cf050 2024-04-14T23:35:42.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.105+0000 7f7511036640 1 -- 172.21.15.47:0/1164916807 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f74ec06b990 msgr2=0x7f74ec06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.105+0000 7f7511036640 1 --2- 172.21.15.47:0/1164916807 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f74ec06b990 0x7f74ec06de50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f74fc036000 tx=0x7f74fc03b040 comp rx=0 tx=0).stop 2024-04-14T23:35:42.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.105+0000 7f7511036640 1 -- 172.21.15.47:0/1164916807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f750c0cf050 msgr2=0x7f750c0c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.105+0000 7f7511036640 1 --2- 172.21.15.47:0/1164916807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f750c0cf050 0x7f750c0c9710 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f74f400c460 tx=0x7f74f400c920 comp rx=0 tx=0).stop 2024-04-14T23:35:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.105+0000 7f7511036640 1 -- 172.21.15.47:0/1164916807 shutdown_connections 2024-04-14T23:35:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.105+0000 7f7511036640 1 --2- 172.21.15.47:0/1164916807 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f74ec06b990 0x7f74ec06de50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.105+0000 7f7511036640 1 --2- 172.21.15.47:0/1164916807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f750c15e420 0x7f750c1f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.105+0000 7f7511036640 1 --2- 172.21.15.47:0/1164916807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f750c0cf050 0x7f750c0c9710 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.105+0000 7f7511036640 1 --2- 172.21.15.47:0/1164916807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f750c0ce4b0 0x7f750c0cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.105+0000 7f7511036640 1 -- 172.21.15.47:0/1164916807 >> 172.21.15.47:0/1164916807 conn(0x7f750c0d1c30 msgr2=0x7f750c070580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.106+0000 7f7511036640 1 -- 172.21.15.47:0/1164916807 shutdown_connections 2024-04-14T23:35:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.106+0000 7f7511036640 1 -- 172.21.15.47:0/1164916807 wait complete. 2024-04-14T23:35:42.119 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-14T23:35:42.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.219+0000 7fa78fbcc640 1 Processor -- start 2024-04-14T23:35:42.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.219+0000 7fa78fbcc640 1 -- start start 2024-04-14T23:35:42.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.220+0000 7fa78fbcc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa78815e420 0x7fa7880d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:42.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.220+0000 7fa78fbcc640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7880d1040 con 0x7fa7880cf020 2024-04-14T23:35:42.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.220+0000 7fa78fbcc640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7880d1320 con 0x7fa7880ce4b0 2024-04-14T23:35:42.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.220+0000 7fa78fbcc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa7880cc280 con 0x7fa78815e420 2024-04-14T23:35:42.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.220+0000 7fa78e169640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa7880cf020 0x7fa7880cccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:38630/0 (socket says 172.21.15.47:38630) 2024-04-14T23:35:42.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.220+0000 7fa78e169640 1 -- 172.21.15.47:0/1214621575 learned_addr learned my addr 172.21.15.47:0/1214621575 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:42.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.220+0000 7fa78d968640 1 --2- 172.21.15.47:0/1214621575 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa78815e420 0x7fa7880d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:42.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.220+0000 7fa78c966640 1 -- 172.21.15.47:0/1214621575 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435649451 0 0) 0x7fa7880d1040 con 0x7fa7880cf020 2024-04-14T23:35:42.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.220+0000 7fa78c966640 1 -- 172.21.15.47:0/1214621575 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa770003520 con 0x7fa7880cf020 2024-04-14T23:35:42.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.221+0000 7fa78c966640 1 -- 172.21.15.47:0/1214621575 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3114350396 0 0) 0x7fa7880d1320 con 0x7fa7880ce4b0 2024-04-14T23:35:42.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.221+0000 7fa78d968640 1 -- 172.21.15.47:0/1214621575 >> v1:172.21.15.191:6789/0 conn(0x7fa7880ce4b0 legacy=0x7fa7880ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.221+0000 7fa78d968640 1 -- 172.21.15.47:0/1214621575 >> v1:172.21.15.47:6789/0 conn(0x7fa7880cf020 legacy=0x7fa7880cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.221+0000 7fa78d968640 1 -- 172.21.15.47:0/1214621575 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7880cc4d0 con 0x7fa78815e420 2024-04-14T23:35:42.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.221+0000 7fa78d968640 1 --2- 172.21.15.47:0/1214621575 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa78815e420 0x7fa7880d0980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa7800097d0 tx=0x7fa78002b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b1a329a1d79c8be server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:42.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.222+0000 7fa78c966640 1 -- 172.21.15.47:0/1214621575 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa780037070 con 0x7fa78815e420 2024-04-14T23:35:42.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.222+0000 7fa78c966640 1 -- 172.21.15.47:0/1214621575 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa780030510 con 0x7fa78815e420 2024-04-14T23:35:42.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.222+0000 7fa78c966640 1 -- 172.21.15.47:0/1214621575 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778001970 con 0x7fa78815e420 2024-04-14T23:35:42.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.222+0000 7fa78fbcc640 1 -- 172.21.15.47:0/1214621575 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa78815e420 msgr2=0x7fa7880d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.222+0000 7fa78fbcc640 1 --2- 172.21.15.47:0/1214621575 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa78815e420 0x7fa7880d0980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa7800097d0 tx=0x7fa78002b7b0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.222+0000 7fa78fbcc640 1 -- 172.21.15.47:0/1214621575 shutdown_connections 2024-04-14T23:35:42.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.222+0000 7fa78fbcc640 1 --2- 172.21.15.47:0/1214621575 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa78815e420 0x7fa7880d0980 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.222+0000 7fa78fbcc640 1 -- 172.21.15.47:0/1214621575 >> 172.21.15.47:0/1214621575 conn(0x7fa7880d1c30 msgr2=0x7fa7880d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:42.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.222+0000 7fa78fbcc640 1 -- 172.21.15.47:0/1214621575 shutdown_connections 2024-04-14T23:35:42.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.222+0000 7fa78fbcc640 1 -- 172.21.15.47:0/1214621575 wait complete. 2024-04-14T23:35:42.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.223+0000 7fa78fbcc640 1 Processor -- start 2024-04-14T23:35:42.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.223+0000 7fa78fbcc640 1 -- start start 2024-04-14T23:35:42.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.224+0000 7fa78fbcc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7880ce4b0 0x7fa7881511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:42.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.224+0000 7fa78fbcc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa7880cf020 0x7fa788160b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:42.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.224+0000 7fa78fbcc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78815e420 0x7fa7881f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:42.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.224+0000 7fa78fbcc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa78815e800 con 0x7fa78815e420 2024-04-14T23:35:42.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.224+0000 7fa78fbcc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa78806d750 con 0x7fa7880ce4b0 2024-04-14T23:35:42.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.224+0000 7fa78fbcc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa7880cd3e0 con 0x7fa7880cf020 2024-04-14T23:35:42.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.224+0000 7fa78e169640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78815e420 0x7fa7881f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:42.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.224+0000 7fa78e169640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78815e420 0x7fa7881f4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52542/0 (socket says 172.21.15.47:52542) 2024-04-14T23:35:42.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.224+0000 7fa78e169640 1 -- 172.21.15.47:0/3180854214 learned_addr learned my addr 172.21.15.47:0/3180854214 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:42.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.224+0000 7fa78d167640 1 --2- 172.21.15.47:0/3180854214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa7880cf020 0x7fa788160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:42.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.224+0000 7fa78d968640 1 --2- 172.21.15.47:0/3180854214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7880ce4b0 0x7fa7881511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:42.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.224+0000 7fa78e169640 1 -- 172.21.15.47:0/3180854214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa7880cf020 msgr2=0x7fa788160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.224+0000 7fa78e169640 1 --2- 172.21.15.47:0/3180854214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa7880cf020 0x7fa788160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.224+0000 7fa78e169640 1 -- 172.21.15.47:0/3180854214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7880ce4b0 msgr2=0x7fa7881511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.224+0000 7fa78e169640 1 --2- 172.21.15.47:0/3180854214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7880ce4b0 0x7fa7881511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.224+0000 7fa78e169640 1 -- 172.21.15.47:0/3180854214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7880c8e30 con 0x7fa78815e420 2024-04-14T23:35:42.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.225+0000 7fa78e169640 1 --2- 172.21.15.47:0/3180854214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78815e420 0x7fa7881f4210 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa7780012e0 tx=0x7fa77800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:42.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.225+0000 7fa7867fc640 1 -- 172.21.15.47:0/3180854214 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778018070 con 0x7fa78815e420 2024-04-14T23:35:42.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.225+0000 7fa7867fc640 1 -- 172.21.15.47:0/3180854214 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77800a790 con 0x7fa78815e420 2024-04-14T23:35:42.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.225+0000 7fa7867fc640 1 -- 172.21.15.47:0/3180854214 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77800ab60 con 0x7fa78815e420 2024-04-14T23:35:42.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.225+0000 7fa78fbcc640 1 -- 172.21.15.47:0/3180854214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7880c9110 con 0x7fa78815e420 2024-04-14T23:35:42.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.225+0000 7fa78fbcc640 1 -- 172.21.15.47:0/3180854214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7880c96d0 con 0x7fa78815e420 2024-04-14T23:35:42.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.226+0000 7fa78fbcc640 1 -- 172.21.15.47:0/3180854214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa788075430 con 0x7fa78815e420 2024-04-14T23:35:42.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.226+0000 7fa7867fc640 1 -- 172.21.15.47:0/3180854214 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fa77800ad00 con 0x7fa78815e420 2024-04-14T23:35:42.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.227+0000 7fa7867fc640 1 --2- 172.21.15.47:0/3180854214 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa77406b990 0x7fa77406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:42.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.227+0000 7fa7867fc640 1 -- 172.21.15.47:0/3180854214 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fa778089df0 con 0x7fa78815e420 2024-04-14T23:35:42.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.227+0000 7fa78d968640 1 --2- 172.21.15.47:0/3180854214 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa77406b990 0x7fa77406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:42.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.227+0000 7fa78d968640 1 --2- 172.21.15.47:0/3180854214 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa77406b990 0x7fa77406de50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa780034000 tx=0x7fa780008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:42.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.231+0000 7fa7867fc640 1 -- 172.21.15.47:0/3180854214 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa778058600 con 0x7fa78815e420 2024-04-14T23:35:42.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.482+0000 7fa78fbcc640 1 -- 172.21.15.47:0/3180854214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fa7880d10d0 con 0x7fa78815e420 2024-04-14T23:35:42.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.484+0000 7fa7867fc640 1 -- 172.21.15.47:0/3180854214 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7fa77805c6a0 con 0x7fa78815e420 2024-04-14T23:35:42.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.486+0000 7fa78fbcc640 1 -- 172.21.15.47:0/3180854214 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa77406b990 msgr2=0x7fa77406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.486+0000 7fa78fbcc640 1 --2- 172.21.15.47:0/3180854214 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa77406b990 0x7fa77406de50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa780034000 tx=0x7fa780008030 comp rx=0 tx=0).stop 2024-04-14T23:35:42.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.486+0000 7fa78fbcc640 1 -- 172.21.15.47:0/3180854214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78815e420 msgr2=0x7fa7881f4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.486+0000 7fa78fbcc640 1 --2- 172.21.15.47:0/3180854214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78815e420 0x7fa7881f4210 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa7780012e0 tx=0x7fa77800cf50 comp rx=0 tx=0).stop 2024-04-14T23:35:42.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.486+0000 7fa78fbcc640 1 -- 172.21.15.47:0/3180854214 shutdown_connections 2024-04-14T23:35:42.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.486+0000 7fa78fbcc640 1 --2- 172.21.15.47:0/3180854214 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa77406b990 0x7fa77406de50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.486+0000 7fa78fbcc640 1 --2- 172.21.15.47:0/3180854214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78815e420 0x7fa7881f4210 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.486+0000 7fa78fbcc640 1 --2- 172.21.15.47:0/3180854214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa7880cf020 0x7fa788160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.486+0000 7fa78fbcc640 1 --2- 172.21.15.47:0/3180854214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7880ce4b0 0x7fa7881511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.486+0000 7fa78fbcc640 1 -- 172.21.15.47:0/3180854214 >> 172.21.15.47:0/3180854214 conn(0x7fa7880d1c30 msgr2=0x7fa7880cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:42.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.487+0000 7fa78fbcc640 1 -- 172.21.15.47:0/3180854214 shutdown_connections 2024-04-14T23:35:42.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.487+0000 7fa78fbcc640 1 -- 172.21.15.47:0/3180854214 wait complete. 2024-04-14T23:35:42.500 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-14T23:35:42.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.600+0000 7f23ace2d640 1 Processor -- start 2024-04-14T23:35:42.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.600+0000 7f23ace2d640 1 -- start start 2024-04-14T23:35:42.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.600+0000 7f23ace2d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f23a815c010 0x7f23a80d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:42.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.600+0000 7f23ace2d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f23a80d0220 0x7f23a80cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:42.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.601+0000 7f23ace2d640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23a80cc7a0 con 0x7f23a80cda60 2024-04-14T23:35:42.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.601+0000 7f23ace2d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f23a80d0cc0 con 0x7f23a80d0220 2024-04-14T23:35:42.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.601+0000 7f23ace2d640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f23a80d09e0 con 0x7f23a815c010 2024-04-14T23:35:42.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.601+0000 7f23a5d9b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f23a80d0220 0x7f23a80cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:42.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.601+0000 7f23a5d9b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f23a80d0220 0x7f23a80cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52556/0 (socket says 172.21.15.47:52556) 2024-04-14T23:35:42.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.601+0000 7f23a5d9b640 1 -- 172.21.15.47:0/1101866536 learned_addr learned my addr 172.21.15.47:0/1101866536 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:42.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.601+0000 7f23a5d9b640 1 -- 172.21.15.47:0/1101866536 >> v2:172.21.15.191:3300/0 conn(0x7f23a815c010 msgr2=0x7f23a80d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:42.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.601+0000 7f23a5d9b640 1 --2- 172.21.15.47:0/1101866536 >> v2:172.21.15.191:3300/0 conn(0x7f23a815c010 0x7f23a80d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.601+0000 7f23a5d9b640 1 -- 172.21.15.47:0/1101866536 >> v1:172.21.15.191:6789/0 conn(0x7f23a80cda60 legacy=0x7f23a815fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:42.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.601+0000 7f23a5d9b640 1 -- 172.21.15.47:0/1101866536 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a80cca40 con 0x7f23a80d0220 2024-04-14T23:35:42.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.602+0000 7f23a5d9b640 1 --2- 172.21.15.47:0/1101866536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23a80d0220 0x7f23a80cd520 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f23a8072540 tx=0x7f239002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d124a2e4341a99a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:42.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.602+0000 7f23a559a640 1 -- 172.21.15.47:0/1101866536 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239002e070 con 0x7f23a80d0220 2024-04-14T23:35:42.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.602+0000 7f23a559a640 1 -- 172.21.15.47:0/1101866536 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2390037070 con 0x7f23a80d0220 2024-04-14T23:35:42.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.602+0000 7f23a559a640 1 -- 172.21.15.47:0/1101866536 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2390031a00 con 0x7f23a80d0220 2024-04-14T23:35:42.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.602+0000 7f23ace2d640 1 -- 172.21.15.47:0/1101866536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23a80d0220 msgr2=0x7f23a80cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.602+0000 7f23ace2d640 1 --2- 172.21.15.47:0/1101866536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23a80d0220 0x7f23a80cd520 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f23a8072540 tx=0x7f239002b880 comp rx=0 tx=0).stop 2024-04-14T23:35:42.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.602+0000 7f23ace2d640 1 -- 172.21.15.47:0/1101866536 shutdown_connections 2024-04-14T23:35:42.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.602+0000 7f23ace2d640 1 --2- 172.21.15.47:0/1101866536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23a80d0220 0x7f23a80cd520 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.602+0000 7f23ace2d640 1 --2- 172.21.15.47:0/1101866536 >> v2:172.21.15.191:3300/0 conn(0x7f23a815c010 0x7f23a80d27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.602+0000 7f23ace2d640 1 -- 172.21.15.47:0/1101866536 >> 172.21.15.47:0/1101866536 conn(0x7f23a80d1c90 msgr2=0x7f23a80d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:42.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.602+0000 7f23ace2d640 1 -- 172.21.15.47:0/1101866536 shutdown_connections 2024-04-14T23:35:42.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.602+0000 7f23ace2d640 1 -- 172.21.15.47:0/1101866536 wait complete. 2024-04-14T23:35:42.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.604+0000 7f23ace2d640 1 Processor -- start 2024-04-14T23:35:42.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.604+0000 7f23ace2d640 1 -- start start 2024-04-14T23:35:42.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.604+0000 7f23ace2d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23a80cda60 0x7f23a806c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:42.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.604+0000 7f23ace2d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23a80d0220 0x7f23a8141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:42.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.604+0000 7f23ace2d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23a815c010 0x7f23a8154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.604+0000 7f23ace2d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f23a80d06a0 con 0x7f23a815c010 2024-04-14T23:35:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.604+0000 7f23ace2d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f23a80cd000 con 0x7f23a80cda60 2024-04-14T23:35:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.604+0000 7f23ace2d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f23a815c3f0 con 0x7f23a80d0220 2024-04-14T23:35:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.605+0000 7f23a6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23a815c010 0x7f23a8154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.605+0000 7f23a6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23a815c010 0x7f23a8154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52564/0 (socket says 172.21.15.47:52564) 2024-04-14T23:35:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.605+0000 7f23a6d9d640 1 -- 172.21.15.47:0/115887095 learned_addr learned my addr 172.21.15.47:0/115887095 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.605+0000 7f23a5d9b640 1 --2- 172.21.15.47:0/115887095 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23a80d0220 0x7f23a8141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.605+0000 7f23a659c640 1 --2- 172.21.15.47:0/115887095 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23a80cda60 0x7f23a806c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.605+0000 7f23a6d9d640 1 -- 172.21.15.47:0/115887095 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23a80d0220 msgr2=0x7f23a8141ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.605+0000 7f23a6d9d640 1 --2- 172.21.15.47:0/115887095 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23a80d0220 0x7f23a8141ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.605+0000 7f23a6d9d640 1 -- 172.21.15.47:0/115887095 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23a80cda60 msgr2=0x7f23a806c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.605+0000 7f23a6d9d640 1 --2- 172.21.15.47:0/115887095 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23a80cda60 0x7f23a806c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.605+0000 7f23a6d9d640 1 -- 172.21.15.47:0/115887095 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a806e060 con 0x7f23a815c010 2024-04-14T23:35:42.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.605+0000 7f23a6d9d640 1 --2- 172.21.15.47:0/115887095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23a815c010 0x7f23a8154ea0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f239800b9c0 tx=0x7f239800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:42.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.605+0000 7f239effd640 1 -- 172.21.15.47:0/115887095 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398019070 con 0x7f23a815c010 2024-04-14T23:35:42.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.605+0000 7f239effd640 1 -- 172.21.15.47:0/115887095 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f239800cba0 con 0x7f23a815c010 2024-04-14T23:35:42.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.605+0000 7f23ace2d640 1 -- 172.21.15.47:0/115887095 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a806c980 con 0x7f23a815c010 2024-04-14T23:35:42.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.605+0000 7f239effd640 1 -- 172.21.15.47:0/115887095 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398014440 con 0x7f23a815c010 2024-04-14T23:35:42.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.605+0000 7f23ace2d640 1 -- 172.21.15.47:0/115887095 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a806cf40 con 0x7f23a815c010 2024-04-14T23:35:42.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.606+0000 7f23ace2d640 1 -- 172.21.15.47:0/115887095 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a8075430 con 0x7f23a815c010 2024-04-14T23:35:42.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.607+0000 7f239effd640 1 -- 172.21.15.47:0/115887095 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f239801c070 con 0x7f23a815c010 2024-04-14T23:35:42.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.607+0000 7f239effd640 1 --2- 172.21.15.47:0/115887095 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f238806b990 0x7f238806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:42.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.607+0000 7f239effd640 1 -- 172.21.15.47:0/115887095 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f239808a380 con 0x7f23a815c010 2024-04-14T23:35:42.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.607+0000 7f23a659c640 1 --2- 172.21.15.47:0/115887095 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f238806b990 0x7f238806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:42.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.608+0000 7f23a659c640 1 --2- 172.21.15.47:0/115887095 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f238806b990 0x7f238806de50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009890 tx=0x7f23a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:42.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.612+0000 7f239effd640 1 -- 172.21.15.47:0/115887095 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f23980591e0 con 0x7f23a815c010 2024-04-14T23:35:42.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.865+0000 7f23ace2d640 1 -- 172.21.15.47:0/115887095 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f23a815ac80 con 0x7f23a815c010 2024-04-14T23:35:42.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.867+0000 7f239effd640 1 -- 172.21.15.47:0/115887095 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f2398058ae0 con 0x7f23a815c010 2024-04-14T23:35:42.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.869+0000 7f23ace2d640 1 -- 172.21.15.47:0/115887095 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f238806b990 msgr2=0x7f238806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.869+0000 7f23ace2d640 1 --2- 172.21.15.47:0/115887095 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f238806b990 0x7f238806de50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009890 tx=0x7f23a0008040 comp rx=0 tx=0).stop 2024-04-14T23:35:42.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.869+0000 7f23ace2d640 1 -- 172.21.15.47:0/115887095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23a815c010 msgr2=0x7f23a8154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.869+0000 7f23ace2d640 1 --2- 172.21.15.47:0/115887095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23a815c010 0x7f23a8154ea0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f239800b9c0 tx=0x7f239800be80 comp rx=0 tx=0).stop 2024-04-14T23:35:42.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.869+0000 7f23ace2d640 1 -- 172.21.15.47:0/115887095 shutdown_connections 2024-04-14T23:35:42.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.869+0000 7f23ace2d640 1 --2- 172.21.15.47:0/115887095 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f238806b990 0x7f238806de50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.869+0000 7f23ace2d640 1 --2- 172.21.15.47:0/115887095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23a815c010 0x7f23a8154ea0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.869+0000 7f23ace2d640 1 --2- 172.21.15.47:0/115887095 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23a80d0220 0x7f23a8141ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.869+0000 7f23ace2d640 1 --2- 172.21.15.47:0/115887095 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23a80cda60 0x7f23a806c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.869+0000 7f23ace2d640 1 -- 172.21.15.47:0/115887095 >> 172.21.15.47:0/115887095 conn(0x7f23a80d1c90 msgr2=0x7f23a815dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:42.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.869+0000 7f23ace2d640 1 -- 172.21.15.47:0/115887095 shutdown_connections 2024-04-14T23:35:42.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.869+0000 7f23ace2d640 1 -- 172.21.15.47:0/115887095 wait complete. 2024-04-14T23:35:42.883 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-14T23:35:42.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.983+0000 7f4dac2de640 1 Processor -- start 2024-04-14T23:35:42.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.983+0000 7f4dac2de640 1 -- start start 2024-04-14T23:35:42.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.984+0000 7f4dac2de640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4da40b18a0 0x7f4da4166f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:42.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.984+0000 7f4dac2de640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4da406c050 con 0x7f4da40cc2d0 2024-04-14T23:35:42.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.984+0000 7f4dac2de640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4da40cd110 con 0x7f4da40c39c0 2024-04-14T23:35:42.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.984+0000 7f4dac2de640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4da40cd720 con 0x7f4da40b18a0 2024-04-14T23:35:42.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.984+0000 7f4daa87b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4da40b18a0 0x7f4da4166f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:42.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.984+0000 7f4daa87b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4da40b18a0 0x7f4da4166f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52580/0 (socket says 172.21.15.47:52580) 2024-04-14T23:35:42.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.984+0000 7f4daa87b640 1 -- 172.21.15.47:0/3125327279 learned_addr learned my addr 172.21.15.47:0/3125327279 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:42.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.984+0000 7f4daa07a640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4da40cc2d0 0x7f4da40cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:38642/0 (socket says 172.21.15.47:38642) 2024-04-14T23:35:42.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.984+0000 7f4daa87b640 1 -- 172.21.15.47:0/3125327279 >> v1:172.21.15.191:6789/0 conn(0x7f4da40c39c0 legacy=0x7f4da4163840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:42.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.984+0000 7f4daa87b640 1 -- 172.21.15.47:0/3125327279 >> v1:172.21.15.47:6789/0 conn(0x7f4da40cc2d0 legacy=0x7f4da40cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.984+0000 7f4daa87b640 1 -- 172.21.15.47:0/3125327279 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da4074900 con 0x7f4da40b18a0 2024-04-14T23:35:42.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.984+0000 7f4da9078640 1 -- 172.21.15.47:0/3125327279 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1944788995 0 0) 0x7f4da406c050 con 0x7f4da40cc2d0 2024-04-14T23:35:42.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.985+0000 7f4daa87b640 1 --2- 172.21.15.47:0/3125327279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4da40b18a0 0x7f4da4166f70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009e50 tx=0x7f4d9c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb40f8fa606a17a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:42.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.985+0000 7f4da9078640 1 -- 172.21.15.47:0/3125327279 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c02ca80 con 0x7f4da40b18a0 2024-04-14T23:35:42.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.985+0000 7f4da9078640 1 -- 172.21.15.47:0/3125327279 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9c02cc20 con 0x7f4da40b18a0 2024-04-14T23:35:42.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.985+0000 7f4da9078640 1 -- 172.21.15.47:0/3125327279 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c0343f0 con 0x7f4da40b18a0 2024-04-14T23:35:42.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.986+0000 7f4dac2de640 1 -- 172.21.15.47:0/3125327279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4da40b18a0 msgr2=0x7f4da4166f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.986+0000 7f4dac2de640 1 --2- 172.21.15.47:0/3125327279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4da40b18a0 0x7f4da4166f70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009e50 tx=0x7f4d9c02bee0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.986+0000 7f4dac2de640 1 -- 172.21.15.47:0/3125327279 shutdown_connections 2024-04-14T23:35:42.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.986+0000 7f4dac2de640 1 --2- 172.21.15.47:0/3125327279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4da40b18a0 0x7f4da4166f70 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.986+0000 7f4dac2de640 1 -- 172.21.15.47:0/3125327279 >> 172.21.15.47:0/3125327279 conn(0x7f4da40d0330 msgr2=0x7f4da40d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:42.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.986+0000 7f4dac2de640 1 -- 172.21.15.47:0/3125327279 shutdown_connections 2024-04-14T23:35:42.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.986+0000 7f4dac2de640 1 -- 172.21.15.47:0/3125327279 wait complete. 2024-04-14T23:35:42.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.987+0000 7f4dac2de640 1 Processor -- start 2024-04-14T23:35:42.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.987+0000 7f4dac2de640 1 -- start start 2024-04-14T23:35:42.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4dac2de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4da40b18a0 0x7f4da41f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:42.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4dac2de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da40c39c0 0x7f4da40c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:42.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4dac2de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4da40cc2d0 0x7f4da40b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:42.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4dac2de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4da40745b0 con 0x7f4da40cc2d0 2024-04-14T23:35:42.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4dac2de640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4da4074be0 con 0x7f4da40c39c0 2024-04-14T23:35:42.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4dac2de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4da40ccdc0 con 0x7f4da40b18a0 2024-04-14T23:35:42.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4daa87b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4da40cc2d0 0x7f4da40b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:42.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4daa87b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4da40cc2d0 0x7f4da40b5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52596/0 (socket says 172.21.15.47:52596) 2024-04-14T23:35:42.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4daa87b640 1 -- 172.21.15.47:0/2748009567 learned_addr learned my addr 172.21.15.47:0/2748009567 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:42.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4daa07a640 1 --2- 172.21.15.47:0/2748009567 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4da40b18a0 0x7f4da41f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:42.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4da9879640 1 --2- 172.21.15.47:0/2748009567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da40c39c0 0x7f4da40c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:42.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4daa87b640 1 -- 172.21.15.47:0/2748009567 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4da40b18a0 msgr2=0x7f4da41f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4daa87b640 1 --2- 172.21.15.47:0/2748009567 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4da40b18a0 0x7f4da41f1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4daa87b640 1 -- 172.21.15.47:0/2748009567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da40c39c0 msgr2=0x7f4da40c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:42.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4daa87b640 1 --2- 172.21.15.47:0/2748009567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da40c39c0 0x7f4da40c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:42.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4daa87b640 1 -- 172.21.15.47:0/2748009567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da41f3700 con 0x7f4da40cc2d0 2024-04-14T23:35:42.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4da9879640 1 --2- 172.21.15.47:0/2748009567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da40c39c0 0x7f4da40c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:42.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4daa87b640 1 --2- 172.21.15.47:0/2748009567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4da40cc2d0 0x7f4da40b5710 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009e50 tx=0x7f4d9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:42.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4d9affd640 1 -- 172.21.15.47:0/2748009567 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c043020 con 0x7f4da40cc2d0 2024-04-14T23:35:42.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4d9affd640 1 -- 172.21.15.47:0/2748009567 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9c03e450 con 0x7f4da40cc2d0 2024-04-14T23:35:42.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.988+0000 7f4d9affd640 1 -- 172.21.15.47:0/2748009567 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c03e820 con 0x7f4da40cc2d0 2024-04-14T23:35:42.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.989+0000 7f4dac2de640 1 -- 172.21.15.47:0/2748009567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da41f39e0 con 0x7f4da40cc2d0 2024-04-14T23:35:42.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.989+0000 7f4dac2de640 1 -- 172.21.15.47:0/2748009567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da41f3fa0 con 0x7f4da40cc2d0 2024-04-14T23:35:42.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.989+0000 7f4dac2de640 1 -- 172.21.15.47:0/2748009567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da40cdaa0 con 0x7f4da40cc2d0 2024-04-14T23:35:42.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.990+0000 7f4d9affd640 1 -- 172.21.15.47:0/2748009567 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4d9c046020 con 0x7f4da40cc2d0 2024-04-14T23:35:42.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.990+0000 7f4d9affd640 1 --2- 172.21.15.47:0/2748009567 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4d8806b990 0x7f4d8806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:42.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.990+0000 7f4d9affd640 1 -- 172.21.15.47:0/2748009567 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f4d9c0acee0 con 0x7f4da40cc2d0 2024-04-14T23:35:42.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.991+0000 7f4daa07a640 1 --2- 172.21.15.47:0/2748009567 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4d8806b990 0x7f4d8806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:42.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.991+0000 7f4daa07a640 1 --2- 172.21.15.47:0/2748009567 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4d8806b990 0x7f4d8806de50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4da0000f60 tx=0x7f4da0007c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:42.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:42.995+0000 7f4d9affd640 1 -- 172.21.15.47:0/2748009567 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4da40cdaa0 con 0x7f4da40cc2d0 2024-04-14T23:35:43.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.247+0000 7f4dac2de640 1 -- 172.21.15.47:0/2748009567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f4da4075430 con 0x7f4da40cc2d0 2024-04-14T23:35:43.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.249+0000 7f4d9affd640 1 -- 172.21.15.47:0/2748009567 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f4d9c04d030 con 0x7f4da40cc2d0 2024-04-14T23:35:43.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.251+0000 7f4dac2de640 1 -- 172.21.15.47:0/2748009567 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4d8806b990 msgr2=0x7f4d8806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:43.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.251+0000 7f4dac2de640 1 --2- 172.21.15.47:0/2748009567 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4d8806b990 0x7f4d8806de50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4da0000f60 tx=0x7f4da0007c00 comp rx=0 tx=0).stop 2024-04-14T23:35:43.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.251+0000 7f4dac2de640 1 -- 172.21.15.47:0/2748009567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4da40cc2d0 msgr2=0x7f4da40b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:43.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.251+0000 7f4dac2de640 1 --2- 172.21.15.47:0/2748009567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4da40cc2d0 0x7f4da40b5710 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009e50 tx=0x7f4d9c004a40 comp rx=0 tx=0).stop 2024-04-14T23:35:43.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.251+0000 7f4dac2de640 1 -- 172.21.15.47:0/2748009567 shutdown_connections 2024-04-14T23:35:43.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.251+0000 7f4dac2de640 1 --2- 172.21.15.47:0/2748009567 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4d8806b990 0x7f4d8806de50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.251+0000 7f4dac2de640 1 --2- 172.21.15.47:0/2748009567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4da40cc2d0 0x7f4da40b5710 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.251+0000 7f4dac2de640 1 --2- 172.21.15.47:0/2748009567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da40c39c0 0x7f4da40c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.251+0000 7f4dac2de640 1 --2- 172.21.15.47:0/2748009567 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4da40b18a0 0x7f4da41f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.251+0000 7f4dac2de640 1 -- 172.21.15.47:0/2748009567 >> 172.21.15.47:0/2748009567 conn(0x7f4da40d0330 msgr2=0x7f4da40ad6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:43.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.251+0000 7f4dac2de640 1 -- 172.21.15.47:0/2748009567 shutdown_connections 2024-04-14T23:35:43.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.251+0000 7f4dac2de640 1 -- 172.21.15.47:0/2748009567 wait complete. 2024-04-14T23:35:43.264 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-14T23:35:43.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.364+0000 7fc21131e640 1 Processor -- start 2024-04-14T23:35:43.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.364+0000 7fc21131e640 1 -- start start 2024-04-14T23:35:43.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.365+0000 7fc21131e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc20c15e420 0x7fc20c0d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:43.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.365+0000 7fc21131e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc20c0d1040 con 0x7fc20c0cf050 2024-04-14T23:35:43.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.365+0000 7fc21131e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc20c0d1320 con 0x7fc20c0ce4b0 2024-04-14T23:35:43.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.365+0000 7fc21131e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc20c0cc280 con 0x7fc20c15e420 2024-04-14T23:35:43.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.365+0000 7fc20affd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc20c15e420 0x7fc20c0d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:43.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.365+0000 7fc20affd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc20c15e420 0x7fc20c0d0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52600/0 (socket says 172.21.15.47:52600) 2024-04-14T23:35:43.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.365+0000 7fc20affd640 1 -- 172.21.15.47:0/3429453514 learned_addr learned my addr 172.21.15.47:0/3429453514 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:43.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.365+0000 7fc20b7fe640 1 --1- 172.21.15.47:0/3429453514 >> v1:172.21.15.47:6789/0 conn(0x7fc20c0cf050 0x7fc20c0cccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:38650/0 (socket says 172.21.15.47:38650) 2024-04-14T23:35:43.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.365+0000 7fc20affd640 1 -- 172.21.15.47:0/3429453514 >> v1:172.21.15.191:6789/0 conn(0x7fc20c0ce4b0 legacy=0x7fc20c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:43.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.365+0000 7fc20affd640 1 -- 172.21.15.47:0/3429453514 >> v1:172.21.15.47:6789/0 conn(0x7fc20c0cf050 legacy=0x7fc20c0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:43.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.365+0000 7fc20affd640 1 -- 172.21.15.47:0/3429453514 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20c0cc4d0 con 0x7fc20c15e420 2024-04-14T23:35:43.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.366+0000 7fc20affd640 1 --2- 172.21.15.47:0/3429453514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc20c15e420 0x7fc20c0d0980 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc009870 tx=0x7fc1fc02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c536d7a61237a2c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:43.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.366+0000 7fc20a7fc640 1 -- 172.21.15.47:0/3429453514 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc02f850 con 0x7fc20c15e420 2024-04-14T23:35:43.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.366+0000 7fc20a7fc640 1 -- 172.21.15.47:0/3429453514 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1fc02f9f0 con 0x7fc20c15e420 2024-04-14T23:35:43.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.366+0000 7fc20a7fc640 1 -- 172.21.15.47:0/3429453514 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc02fdc0 con 0x7fc20c15e420 2024-04-14T23:35:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.367+0000 7fc21131e640 1 -- 172.21.15.47:0/3429453514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc20c15e420 msgr2=0x7fc20c0d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.367+0000 7fc21131e640 1 --2- 172.21.15.47:0/3429453514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc20c15e420 0x7fc20c0d0980 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc009870 tx=0x7fc1fc02ba30 comp rx=0 tx=0).stop 2024-04-14T23:35:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.367+0000 7fc21131e640 1 -- 172.21.15.47:0/3429453514 shutdown_connections 2024-04-14T23:35:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.367+0000 7fc21131e640 1 --2- 172.21.15.47:0/3429453514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc20c15e420 0x7fc20c0d0980 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.367+0000 7fc21131e640 1 -- 172.21.15.47:0/3429453514 >> 172.21.15.47:0/3429453514 conn(0x7fc20c0d1c30 msgr2=0x7fc20c0d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.367+0000 7fc21131e640 1 -- 172.21.15.47:0/3429453514 shutdown_connections 2024-04-14T23:35:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.367+0000 7fc21131e640 1 -- 172.21.15.47:0/3429453514 wait complete. 2024-04-14T23:35:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.368+0000 7fc21131e640 1 Processor -- start 2024-04-14T23:35:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.368+0000 7fc21131e640 1 -- start start 2024-04-14T23:35:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.368+0000 7fc21131e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc20c0ce4b0 0x7fc20c155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.368+0000 7fc21131e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc20c0cf050 0x7fc20c148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.368+0000 7fc21131e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc20c15e420 0x7fc20c159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.368+0000 7fc21131e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c15e800 con 0x7fc20c15e420 2024-04-14T23:35:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.368+0000 7fc21131e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c06d750 con 0x7fc20c0ce4b0 2024-04-14T23:35:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.368+0000 7fc21131e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc20c0cd3e0 con 0x7fc20c0cf050 2024-04-14T23:35:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.369+0000 7fc20b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc20c15e420 0x7fc20c159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.369+0000 7fc20b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc20c15e420 0x7fc20c159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52602/0 (socket says 172.21.15.47:52602) 2024-04-14T23:35:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.369+0000 7fc20b7fe640 1 -- 172.21.15.47:0/283560037 learned_addr learned my addr 172.21.15.47:0/283560037 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.369+0000 7fc203fff640 1 --2- 172.21.15.47:0/283560037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc20c0cf050 0x7fc20c148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.369+0000 7fc20affd640 1 --2- 172.21.15.47:0/283560037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc20c0ce4b0 0x7fc20c155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.369+0000 7fc20b7fe640 1 -- 172.21.15.47:0/283560037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc20c0cf050 msgr2=0x7fc20c148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.369+0000 7fc20b7fe640 1 --2- 172.21.15.47:0/283560037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc20c0cf050 0x7fc20c148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.369+0000 7fc20b7fe640 1 -- 172.21.15.47:0/283560037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc20c0ce4b0 msgr2=0x7fc20c155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.369+0000 7fc20b7fe640 1 --2- 172.21.15.47:0/283560037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc20c0ce4b0 0x7fc20c155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.369+0000 7fc20b7fe640 1 -- 172.21.15.47:0/283560037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20c1490c0 con 0x7fc20c15e420 2024-04-14T23:35:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.369+0000 7fc20b7fe640 1 --2- 172.21.15.47:0/283560037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc20c15e420 0x7fc20c159160 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc20400c780 tx=0x7fc20400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.369+0000 7fc2037fe640 1 -- 172.21.15.47:0/283560037 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc204017070 con 0x7fc20c15e420 2024-04-14T23:35:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.369+0000 7fc2037fe640 1 -- 172.21.15.47:0/283560037 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20400a640 con 0x7fc20c15e420 2024-04-14T23:35:43.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.369+0000 7fc21131e640 1 -- 172.21.15.47:0/283560037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc20c15c4b0 con 0x7fc20c15e420 2024-04-14T23:35:43.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.369+0000 7fc2037fe640 1 -- 172.21.15.47:0/283560037 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20400aa30 con 0x7fc20c15e420 2024-04-14T23:35:43.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.369+0000 7fc21131e640 1 -- 172.21.15.47:0/283560037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc20c15b6f0 con 0x7fc20c15e420 2024-04-14T23:35:43.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.370+0000 7fc21131e640 1 -- 172.21.15.47:0/283560037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc20c15dc40 con 0x7fc20c15e420 2024-04-14T23:35:43.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.371+0000 7fc2037fe640 1 -- 172.21.15.47:0/283560037 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc20401a070 con 0x7fc20c15e420 2024-04-14T23:35:43.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.371+0000 7fc2037fe640 1 --2- 172.21.15.47:0/283560037 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc1ec06b9c0 0x7fc1ec06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:43.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.371+0000 7fc2037fe640 1 -- 172.21.15.47:0/283560037 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fc204089ae0 con 0x7fc20c15e420 2024-04-14T23:35:43.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.371+0000 7fc20affd640 1 --2- 172.21.15.47:0/283560037 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc1ec06b9c0 0x7fc1ec06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:43.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.372+0000 7fc20affd640 1 --2- 172.21.15.47:0/283560037 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc1ec06b9c0 0x7fc1ec06de80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc036000 tx=0x7fc1fc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:43.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.375+0000 7fc2037fe640 1 -- 172.21.15.47:0/283560037 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc20c1490c0 con 0x7fc20c15e420 2024-04-14T23:35:43.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.625+0000 7fc21131e640 1 -- 172.21.15.47:0/283560037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fc20c068a60 con 0x7fc20c15e420 2024-04-14T23:35:43.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.627+0000 7fc2037fe640 1 -- 172.21.15.47:0/283560037 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fc2040582f0 con 0x7fc20c15e420 2024-04-14T23:35:43.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.629+0000 7fc21131e640 1 -- 172.21.15.47:0/283560037 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc1ec06b9c0 msgr2=0x7fc1ec06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:43.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.629+0000 7fc21131e640 1 --2- 172.21.15.47:0/283560037 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc1ec06b9c0 0x7fc1ec06de80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc036000 tx=0x7fc1fc008030 comp rx=0 tx=0).stop 2024-04-14T23:35:43.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.629+0000 7fc21131e640 1 -- 172.21.15.47:0/283560037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc20c15e420 msgr2=0x7fc20c159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:43.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.629+0000 7fc21131e640 1 --2- 172.21.15.47:0/283560037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc20c15e420 0x7fc20c159160 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc20400c780 tx=0x7fc20400cc40 comp rx=0 tx=0).stop 2024-04-14T23:35:43.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.629+0000 7fc21131e640 1 -- 172.21.15.47:0/283560037 shutdown_connections 2024-04-14T23:35:43.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.629+0000 7fc21131e640 1 --2- 172.21.15.47:0/283560037 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc1ec06b9c0 0x7fc1ec06de80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.629+0000 7fc21131e640 1 --2- 172.21.15.47:0/283560037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc20c15e420 0x7fc20c159160 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.629+0000 7fc21131e640 1 --2- 172.21.15.47:0/283560037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc20c0cf050 0x7fc20c148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.629+0000 7fc21131e640 1 --2- 172.21.15.47:0/283560037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc20c0ce4b0 0x7fc20c155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.629+0000 7fc21131e640 1 -- 172.21.15.47:0/283560037 >> 172.21.15.47:0/283560037 conn(0x7fc20c0d1c30 msgr2=0x7fc20c0cfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:43.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.629+0000 7fc21131e640 1 -- 172.21.15.47:0/283560037 shutdown_connections 2024-04-14T23:35:43.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.629+0000 7fc21131e640 1 -- 172.21.15.47:0/283560037 wait complete. 2024-04-14T23:35:43.643 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:43.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.741+0000 7f03704b0640 1 Processor -- start 2024-04-14T23:35:43.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.741+0000 7f03704b0640 1 -- start start 2024-04-14T23:35:43.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f03704b0640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f03680d0140 0x7f036815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:43.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f03704b0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f036815baf0 0x7f0368071a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:43.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f03704b0640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f036815c370 con 0x7f036806e340 2024-04-14T23:35:43.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f03704b0640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f036815ead0 con 0x7f03680d0140 2024-04-14T23:35:43.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f03704b0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f036815edb0 con 0x7f036815baf0 2024-04-14T23:35:43.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f036e24c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f036806e340 0x7f03680cfa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:53812/0 (socket says 172.21.15.47:53812) 2024-04-14T23:35:43.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f036e24c640 1 -- 172.21.15.47:0/3393286242 learned_addr learned my addr 172.21.15.47:0/3393286242 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:43.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f036d24a640 1 -- 172.21.15.47:0/3393286242 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3245990561 0 0) 0x7f036815c370 con 0x7f036806e340 2024-04-14T23:35:43.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f036d24a640 1 -- 172.21.15.47:0/3393286242 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0354003520 con 0x7f036806e340 2024-04-14T23:35:43.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f036ea4d640 1 --2- 172.21.15.47:0/3393286242 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f036815baf0 0x7f0368071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:43.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f036da4b640 1 --2- 172.21.15.47:0/3393286242 >> v2:172.21.15.191:3300/0 conn(0x7f03680d0140 0x7f036815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:43.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f036d24a640 1 -- 172.21.15.47:0/3393286242 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1506687554 0 0) 0x7f0354003520 con 0x7f036806e340 2024-04-14T23:35:43.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f036d24a640 1 -- 172.21.15.47:0/3393286242 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f036815baf0 msgr2=0x7f0368071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:43.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f036d24a640 1 --2- 172.21.15.47:0/3393286242 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f036815baf0 0x7f0368071a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f036d24a640 1 -- 172.21.15.47:0/3393286242 >> v2:172.21.15.191:3300/0 conn(0x7f03680d0140 msgr2=0x7f036815b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:43.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f036d24a640 1 --2- 172.21.15.47:0/3393286242 >> v2:172.21.15.191:3300/0 conn(0x7f03680d0140 0x7f036815b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f036d24a640 1 -- 172.21.15.47:0/3393286242 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036815f090 con 0x7f036806e340 2024-04-14T23:35:43.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f036d24a640 1 -- 172.21.15.47:0/3393286242 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f0364001670 con 0x7f036806e340 2024-04-14T23:35:43.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.742+0000 7f036d24a640 1 -- 172.21.15.47:0/3393286242 >> v1:172.21.15.47:6789/0 conn(0x7f036806e340 legacy=0x7f03680cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:43.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.743+0000 7f036d24a640 1 --2- 172.21.15.47:0/3393286242 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f036815baf0 0x7f03540039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:43.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.743+0000 7f036d24a640 1 --2- 172.21.15.47:0/3393286242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0354003f80 0x7f0354004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:43.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.743+0000 7f036d24a640 1 --2- 172.21.15.47:0/3393286242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0354004d40 0x7f03540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:43.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.743+0000 7f036d24a640 1 -- 172.21.15.47:0/3393286242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f036815ead0 con 0x7f0354004d40 2024-04-14T23:35:43.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.743+0000 7f036d24a640 1 -- 172.21.15.47:0/3393286242 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f036815edb0 con 0x7f0354003f80 2024-04-14T23:35:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.743+0000 7f036d24a640 1 -- 172.21.15.47:0/3393286242 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f035400ba70 con 0x7f036815baf0 2024-04-14T23:35:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.743+0000 7f036ea4d640 1 --2- 172.21.15.47:0/3393286242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0354004d40 0x7f03540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.743+0000 7f036e24c640 1 --2- 172.21.15.47:0/3393286242 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f036815baf0 0x7f03540039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.743+0000 7f036da4b640 1 --2- 172.21.15.47:0/3393286242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0354003f80 0x7f0354004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.743+0000 7f036ea4d640 1 -- 172.21.15.47:0/3393286242 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f036815baf0 msgr2=0x7f03540039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.743+0000 7f036ea4d640 1 --2- 172.21.15.47:0/3393286242 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f036815baf0 0x7f03540039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.743+0000 7f036ea4d640 1 -- 172.21.15.47:0/3393286242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0354003f80 msgr2=0x7f0354004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.743+0000 7f036ea4d640 1 --2- 172.21.15.47:0/3393286242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0354003f80 0x7f0354004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.743+0000 7f036ea4d640 1 -- 172.21.15.47:0/3393286242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0354003520 con 0x7f0354004d40 2024-04-14T23:35:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.744+0000 7f036ea4d640 1 --2- 172.21.15.47:0/3393286242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0354004d40 0x7f03540051c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0360009fc0 tx=0x7f0354005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b531cefcdd63f97 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.744+0000 7f036d24a640 1 -- 172.21.15.47:0/3393286242 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360039070 con 0x7f0354004d40 2024-04-14T23:35:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.744+0000 7f036d24a640 1 -- 172.21.15.47:0/3393286242 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036002cc20 con 0x7f0354004d40 2024-04-14T23:35:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.744+0000 7f036d24a640 1 -- 172.21.15.47:0/3393286242 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360009c10 con 0x7f0354004d40 2024-04-14T23:35:43.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.744+0000 7f03704b0640 1 -- 172.21.15.47:0/3393286242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0354004d40 msgr2=0x7f03540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:43.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.744+0000 7f03704b0640 1 --2- 172.21.15.47:0/3393286242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0354004d40 0x7f03540051c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0360009fc0 tx=0x7f0354005830 comp rx=0 tx=0).stop 2024-04-14T23:35:43.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.744+0000 7f036ea4d640 1 -- 172.21.15.47:0/3393286242 reap_dead start 2024-04-14T23:35:43.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.744+0000 7f03704b0640 1 -- 172.21.15.47:0/3393286242 shutdown_connections 2024-04-14T23:35:43.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.744+0000 7f03704b0640 1 -- 172.21.15.47:0/3393286242 >> 172.21.15.47:0/3393286242 conn(0x7f036806b200 msgr2=0x7f036806b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:43.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.744+0000 7f03704b0640 1 -- 172.21.15.47:0/3393286242 shutdown_connections 2024-04-14T23:35:43.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.744+0000 7f03704b0640 1 -- 172.21.15.47:0/3393286242 wait complete. 2024-04-14T23:35:43.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.746+0000 7f03704b0640 1 Processor -- start 2024-04-14T23:35:43.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.746+0000 7f03704b0640 1 -- start start 2024-04-14T23:35:43.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.746+0000 7f03704b0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0354004d40 0x7f0368145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:43.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.746+0000 7f03704b0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0368143e60 0x7f0368143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:43.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.746+0000 7f03704b0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0368159e70 0x7f036815a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:43.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.746+0000 7f03704b0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f036815bf80 con 0x7f0368143e60 2024-04-14T23:35:43.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.746+0000 7f03704b0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f036815f890 con 0x7f0354004d40 2024-04-14T23:35:43.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.746+0000 7f03704b0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f036815c100 con 0x7f0368159e70 2024-04-14T23:35:43.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.746+0000 7f036da4b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0368143e60 0x7f0368143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:43.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.746+0000 7f036da4b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0368143e60 0x7f0368143620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52334/0 (socket says 172.21.15.47:52334) 2024-04-14T23:35:43.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.746+0000 7f036da4b640 1 -- 172.21.15.47:0/4074090523 learned_addr learned my addr 172.21.15.47:0/4074090523 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:43.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.747+0000 7f036e24c640 1 --2- 172.21.15.47:0/4074090523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0354004d40 0x7f0368145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:43.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.747+0000 7f036ea4d640 1 --2- 172.21.15.47:0/4074090523 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0368159e70 0x7f036815a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:43.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.747+0000 7f036da4b640 1 -- 172.21.15.47:0/4074090523 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0368159e70 msgr2=0x7f036815a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:43.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.747+0000 7f036da4b640 1 --2- 172.21.15.47:0/4074090523 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0368159e70 0x7f036815a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.747+0000 7f036da4b640 1 -- 172.21.15.47:0/4074090523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0354004d40 msgr2=0x7f0368145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:43.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.747+0000 7f036da4b640 1 --2- 172.21.15.47:0/4074090523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0354004d40 0x7f0368145d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.747+0000 7f036da4b640 1 -- 172.21.15.47:0/4074090523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03681444f0 con 0x7f0368143e60 2024-04-14T23:35:43.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.747+0000 7f036da4b640 1 --2- 172.21.15.47:0/4074090523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0368143e60 0x7f0368143620 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0358011960 tx=0x7f0358011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:43.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.747+0000 7f035effd640 1 -- 172.21.15.47:0/4074090523 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035800fa90 con 0x7f0368143e60 2024-04-14T23:35:43.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.747+0000 7f035effd640 1 -- 172.21.15.47:0/4074090523 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f035800fc30 con 0x7f0368143e60 2024-04-14T23:35:43.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.747+0000 7f03704b0640 1 -- 172.21.15.47:0/4074090523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03681447d0 con 0x7f0368143e60 2024-04-14T23:35:43.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.747+0000 7f035effd640 1 -- 172.21.15.47:0/4074090523 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358014440 con 0x7f0368143e60 2024-04-14T23:35:43.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.747+0000 7f03704b0640 1 -- 172.21.15.47:0/4074090523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0368144d90 con 0x7f0368143e60 2024-04-14T23:35:43.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.748+0000 7f03704b0640 1 -- 172.21.15.47:0/4074090523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0368075430 con 0x7f0368143e60 2024-04-14T23:35:43.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.749+0000 7f035effd640 1 -- 172.21.15.47:0/4074090523 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0358012040 con 0x7f0368143e60 2024-04-14T23:35:43.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.749+0000 7f035effd640 1 --2- 172.21.15.47:0/4074090523 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f034c06b9c0 0x7f034c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:43.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.749+0000 7f035effd640 1 -- 172.21.15.47:0/4074090523 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f035808aaf0 con 0x7f0368143e60 2024-04-14T23:35:43.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.749+0000 7f036e24c640 1 --2- 172.21.15.47:0/4074090523 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f034c06b9c0 0x7f034c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:43.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.750+0000 7f036e24c640 1 --2- 172.21.15.47:0/4074090523 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f034c06b9c0 0x7f034c06de80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0364001840 tx=0x7f0364001e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:43.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.753+0000 7f035effd640 1 -- 172.21.15.47:0/4074090523 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0358019030 con 0x7f0368143e60 2024-04-14T23:35:43.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.935+0000 7f03704b0640 1 -- 172.21.15.47:0/4074090523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0368071820 con 0x7f0368143e60 2024-04-14T23:35:43.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.936+0000 7f035effd640 1 -- 172.21.15.47:0/4074090523 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13152 (secure 0 0 0) 0x7f0358059300 con 0x7f0368143e60 2024-04-14T23:35:43.939 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:43.939 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":35,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:35:40.917021+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:43.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.937+0000 7f03704b0640 1 -- 172.21.15.47:0/4074090523 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f034c06b9c0 msgr2=0x7f034c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:43.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.937+0000 7f03704b0640 1 --2- 172.21.15.47:0/4074090523 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f034c06b9c0 0x7f034c06de80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0364001840 tx=0x7f0364001e30 comp rx=0 tx=0).stop 2024-04-14T23:35:43.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.937+0000 7f03704b0640 1 -- 172.21.15.47:0/4074090523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0368143e60 msgr2=0x7f0368143620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:43.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.937+0000 7f03704b0640 1 --2- 172.21.15.47:0/4074090523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0368143e60 0x7f0368143620 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0358011960 tx=0x7f0358011e20 comp rx=0 tx=0).stop 2024-04-14T23:35:43.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.937+0000 7f03704b0640 1 -- 172.21.15.47:0/4074090523 shutdown_connections 2024-04-14T23:35:43.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.937+0000 7f03704b0640 1 --2- 172.21.15.47:0/4074090523 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f034c06b9c0 0x7f034c06de80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.937+0000 7f03704b0640 1 --2- 172.21.15.47:0/4074090523 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0368159e70 0x7f036815a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.937+0000 7f03704b0640 1 --2- 172.21.15.47:0/4074090523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0368143e60 0x7f0368143620 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.937+0000 7f03704b0640 1 --2- 172.21.15.47:0/4074090523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0354004d40 0x7f0368145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:43.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.937+0000 7f03704b0640 1 -- 172.21.15.47:0/4074090523 >> 172.21.15.47:0/4074090523 conn(0x7f036806b200 msgr2=0x7f03680cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:43.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.938+0000 7f03704b0640 1 -- 172.21.15.47:0/4074090523 shutdown_connections 2024-04-14T23:35:43.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:43.938+0000 7f03704b0640 1 -- 172.21.15.47:0/4074090523 wait complete. 2024-04-14T23:35:43.951 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T23:35:43.952 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:35:44.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.053+0000 7f319b0d1640 1 Processor -- start 2024-04-14T23:35:44.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.053+0000 7f319b0d1640 1 -- start start 2024-04-14T23:35:44.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.053+0000 7f319b0d1640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f31940c8410 0x7f31940ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.054+0000 7f319b0d1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31940cdee0 0x7f31940ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.054+0000 7f319b0d1640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31940d1090 con 0x7f31940d0b40 2024-04-14T23:35:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.054+0000 7f319b0d1640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f31940cc3f0 con 0x7f31940cdee0 2024-04-14T23:35:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.054+0000 7f319b0d1640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f31940cc6d0 con 0x7f31940c8410 2024-04-14T23:35:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.054+0000 7f319966e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31940cdee0 0x7f31940ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.054+0000 7f319966e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31940cdee0 0x7f31940ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52340/0 (socket says 172.21.15.47:52340) 2024-04-14T23:35:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.054+0000 7f319966e640 1 -- 172.21.15.47:0/3784299695 learned_addr learned my addr 172.21.15.47:0/3784299695 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.054+0000 7f3198e6d640 1 --2- 172.21.15.47:0/3784299695 >> v2:172.21.15.191:3300/0 conn(0x7f31940c8410 0x7f31940ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.054+0000 7f319966e640 1 -- 172.21.15.47:0/3784299695 >> v2:172.21.15.191:3300/0 conn(0x7f31940c8410 msgr2=0x7f31940ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.054+0000 7f319966e640 1 --2- 172.21.15.47:0/3784299695 >> v2:172.21.15.191:3300/0 conn(0x7f31940c8410 0x7f31940ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.054+0000 7f319966e640 1 -- 172.21.15.47:0/3784299695 >> v1:172.21.15.191:6789/0 conn(0x7f31940d0b40 legacy=0x7f319406c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.054+0000 7f319966e640 1 -- 172.21.15.47:0/3784299695 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31940cc9b0 con 0x7f31940cdee0 2024-04-14T23:35:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.054+0000 7f3198e6d640 1 --2- 172.21.15.47:0/3784299695 >> v2:172.21.15.191:3300/0 conn(0x7f31940c8410 0x7f31940ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:44.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.055+0000 7f319966e640 1 --2- 172.21.15.47:0/3784299695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31940cdee0 0x7f31940ceac0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f31940cfb40 tx=0x7f318c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b168c4fde52e328 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:44.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.055+0000 7f31937fe640 1 -- 172.21.15.47:0/3784299695 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c02c9f0 con 0x7f31940cdee0 2024-04-14T23:35:44.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.055+0000 7f31937fe640 1 -- 172.21.15.47:0/3784299695 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318c02cb90 con 0x7f31940cdee0 2024-04-14T23:35:44.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.055+0000 7f31937fe640 1 -- 172.21.15.47:0/3784299695 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c0343f0 con 0x7f31940cdee0 2024-04-14T23:35:44.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.055+0000 7f319b0d1640 1 -- 172.21.15.47:0/3784299695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31940cdee0 msgr2=0x7f31940ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:44.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.055+0000 7f319b0d1640 1 --2- 172.21.15.47:0/3784299695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31940cdee0 0x7f31940ceac0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f31940cfb40 tx=0x7f318c02be50 comp rx=0 tx=0).stop 2024-04-14T23:35:44.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.055+0000 7f319b0d1640 1 -- 172.21.15.47:0/3784299695 shutdown_connections 2024-04-14T23:35:44.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.055+0000 7f319b0d1640 1 --2- 172.21.15.47:0/3784299695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31940cdee0 0x7f31940ceac0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.055+0000 7f319b0d1640 1 --2- 172.21.15.47:0/3784299695 >> v2:172.21.15.191:3300/0 conn(0x7f31940c8410 0x7f31940ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.055+0000 7f319b0d1640 1 -- 172.21.15.47:0/3784299695 >> 172.21.15.47:0/3784299695 conn(0x7f31940d1d00 msgr2=0x7f31940d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:44.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.056+0000 7f319b0d1640 1 -- 172.21.15.47:0/3784299695 shutdown_connections 2024-04-14T23:35:44.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.056+0000 7f319b0d1640 1 -- 172.21.15.47:0/3784299695 wait complete. 2024-04-14T23:35:44.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.057+0000 7f319b0d1640 1 Processor -- start 2024-04-14T23:35:44.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.057+0000 7f319b0d1640 1 -- start start 2024-04-14T23:35:44.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f319b0d1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31940c8410 0x7f31941d7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f319b0d1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31940cdee0 0x7f31940c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f319b0d1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31940d0b40 0x7f31940b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f319b0d1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f31940cf6b0 con 0x7f31940d0b40 2024-04-14T23:35:44.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f319b0d1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f31940cf530 con 0x7f31940cdee0 2024-04-14T23:35:44.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f319b0d1640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f31940d2820 con 0x7f31940c8410 2024-04-14T23:35:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f319966e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31940d0b40 0x7f31940b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f319966e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31940d0b40 0x7f31940b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52352/0 (socket says 172.21.15.47:52352) 2024-04-14T23:35:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f319966e640 1 -- 172.21.15.47:0/4271261537 learned_addr learned my addr 172.21.15.47:0/4271261537 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f3193fff640 1 --2- 172.21.15.47:0/4271261537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31940cdee0 0x7f31940c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f3198e6d640 1 --2- 172.21.15.47:0/4271261537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31940c8410 0x7f31941d7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f319966e640 1 -- 172.21.15.47:0/4271261537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31940c8410 msgr2=0x7f31941d7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f319966e640 1 --2- 172.21.15.47:0/4271261537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31940c8410 0x7f31941d7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f319966e640 1 -- 172.21.15.47:0/4271261537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31940cdee0 msgr2=0x7f31940c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f319966e640 1 --2- 172.21.15.47:0/4271261537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31940cdee0 0x7f31940c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f319966e640 1 -- 172.21.15.47:0/4271261537 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31941d8470 con 0x7f31940d0b40 2024-04-14T23:35:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f319966e640 1 --2- 172.21.15.47:0/4271261537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31940d0b40 0x7f31940b5080 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f318c036040 tx=0x7f318c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f31917fa640 1 -- 172.21.15.47:0/4271261537 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c043020 con 0x7f31940d0b40 2024-04-14T23:35:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f31917fa640 1 -- 172.21.15.47:0/4271261537 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318c03e450 con 0x7f31940d0b40 2024-04-14T23:35:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f31917fa640 1 -- 172.21.15.47:0/4271261537 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c009510 con 0x7f31940d0b40 2024-04-14T23:35:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.058+0000 7f319b0d1640 1 -- 172.21.15.47:0/4271261537 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31940cb410 con 0x7f31940d0b40 2024-04-14T23:35:44.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.059+0000 7f319b0d1640 1 -- 172.21.15.47:0/4271261537 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31940cb9d0 con 0x7f31940d0b40 2024-04-14T23:35:44.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.059+0000 7f319b0d1640 1 -- 172.21.15.47:0/4271261537 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3194073f50 con 0x7f31940d0b40 2024-04-14T23:35:44.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.060+0000 7f31917fa640 1 -- 172.21.15.47:0/4271261537 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f318c046020 con 0x7f31940d0b40 2024-04-14T23:35:44.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.060+0000 7f31917fa640 1 --2- 172.21.15.47:0/4271261537 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f317806b9c0 0x7f317806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.060+0000 7f31917fa640 1 -- 172.21.15.47:0/4271261537 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f318c0acd80 con 0x7f31940d0b40 2024-04-14T23:35:44.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.060+0000 7f3198e6d640 1 --2- 172.21.15.47:0/4271261537 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f317806b9c0 0x7f317806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:44.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.061+0000 7f3198e6d640 1 --2- 172.21.15.47:0/4271261537 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f317806b9c0 0x7f317806de80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f318800ab60 tx=0x7f3188008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:44.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.065+0000 7f31917fa640 1 -- 172.21.15.47:0/4271261537 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f318c04d030 con 0x7f31940d0b40 2024-04-14T23:35:44.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.245+0000 7f319b0d1640 1 -- 172.21.15.47:0/4271261537 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3194070b80 con 0x7f31940d0b40 2024-04-14T23:35:44.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.245+0000 7f31917fa640 1 -- 172.21.15.47:0/4271261537 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7f31941d8470 con 0x7f31940d0b40 2024-04-14T23:35:44.249 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:35:44.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.247+0000 7f319b0d1640 1 -- 172.21.15.47:0/4271261537 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f317806b9c0 msgr2=0x7f317806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:44.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.247+0000 7f319b0d1640 1 --2- 172.21.15.47:0/4271261537 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f317806b9c0 0x7f317806de80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f318800ab60 tx=0x7f3188008040 comp rx=0 tx=0).stop 2024-04-14T23:35:44.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.247+0000 7f319b0d1640 1 -- 172.21.15.47:0/4271261537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31940d0b40 msgr2=0x7f31940b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:44.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.247+0000 7f319b0d1640 1 --2- 172.21.15.47:0/4271261537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31940d0b40 0x7f31940b5080 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f318c036040 tx=0x7f318c004a40 comp rx=0 tx=0).stop 2024-04-14T23:35:44.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.247+0000 7f319b0d1640 1 -- 172.21.15.47:0/4271261537 shutdown_connections 2024-04-14T23:35:44.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.247+0000 7f319b0d1640 1 --2- 172.21.15.47:0/4271261537 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f317806b9c0 0x7f317806de80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.247+0000 7f319b0d1640 1 --2- 172.21.15.47:0/4271261537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31940d0b40 0x7f31940b5080 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.247+0000 7f319b0d1640 1 --2- 172.21.15.47:0/4271261537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31940cdee0 0x7f31940c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.247+0000 7f319b0d1640 1 --2- 172.21.15.47:0/4271261537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f31940c8410 0x7f31941d7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.247+0000 7f319b0d1640 1 -- 172.21.15.47:0/4271261537 >> 172.21.15.47:0/4271261537 conn(0x7f31940d1d00 msgr2=0x7f31940ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:44.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.247+0000 7f319b0d1640 1 -- 172.21.15.47:0/4271261537 shutdown_connections 2024-04-14T23:35:44.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.247+0000 7f319b0d1640 1 -- 172.21.15.47:0/4271261537 wait complete. 2024-04-14T23:35:44.261 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-14T23:35:44.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.359+0000 7fe1dc155640 1 Processor -- start 2024-04-14T23:35:44.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.360+0000 7fe1dc155640 1 -- start start 2024-04-14T23:35:44.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.360+0000 7fe1dc155640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe1d415e270 0x7fe1d40d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.360+0000 7fe1dc155640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe1d40d1e00 0x7fe1d40d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.360+0000 7fe1dc155640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d40b57a0 con 0x7fe1d40d1450 2024-04-14T23:35:44.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.360+0000 7fe1dc155640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d40b4300 con 0x7fe1d40d1e00 2024-04-14T23:35:44.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.360+0000 7fe1dc155640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d40b39d0 con 0x7fe1d415e270 2024-04-14T23:35:44.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.361+0000 7fe1d96f0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe1d40d1e00 0x7fe1d40d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:44.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.361+0000 7fe1d96f0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe1d40d1e00 0x7fe1d40d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52362/0 (socket says 172.21.15.47:52362) 2024-04-14T23:35:44.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.361+0000 7fe1d96f0640 1 -- 172.21.15.47:0/392165958 learned_addr learned my addr 172.21.15.47:0/392165958 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:44.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.361+0000 7fe1d96f0640 1 -- 172.21.15.47:0/392165958 >> v2:172.21.15.191:3300/0 conn(0x7fe1d415e270 msgr2=0x7fe1d40d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:44.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.361+0000 7fe1d96f0640 1 --2- 172.21.15.47:0/392165958 >> v2:172.21.15.191:3300/0 conn(0x7fe1d415e270 0x7fe1d40d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.361+0000 7fe1d96f0640 1 -- 172.21.15.47:0/392165958 >> v1:172.21.15.191:6789/0 conn(0x7fe1d40d1450 legacy=0x7fe1d40ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:44.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.361+0000 7fe1d96f0640 1 -- 172.21.15.47:0/392165958 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d40b3cb0 con 0x7fe1d40d1e00 2024-04-14T23:35:44.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.362+0000 7fe1d96f0640 1 --2- 172.21.15.47:0/392165958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d40d1e00 0x7fe1d40d2200 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40b4480 tx=0x7fe1c402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52156552ad3dead server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:44.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.362+0000 7fe1d8eef640 1 -- 172.21.15.47:0/392165958 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4034070 con 0x7fe1d40d1e00 2024-04-14T23:35:44.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.362+0000 7fe1d8eef640 1 -- 172.21.15.47:0/392165958 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c4030860 con 0x7fe1d40d1e00 2024-04-14T23:35:44.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.362+0000 7fe1d8eef640 1 -- 172.21.15.47:0/392165958 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4030c30 con 0x7fe1d40d1e00 2024-04-14T23:35:44.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.362+0000 7fe1dc155640 1 -- 172.21.15.47:0/392165958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d40d1e00 msgr2=0x7fe1d40d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:44.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.362+0000 7fe1dc155640 1 --2- 172.21.15.47:0/392165958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d40d1e00 0x7fe1d40d2200 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40b4480 tx=0x7fe1c402b9a0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.362+0000 7fe1dc155640 1 -- 172.21.15.47:0/392165958 shutdown_connections 2024-04-14T23:35:44.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.362+0000 7fe1dc155640 1 --2- 172.21.15.47:0/392165958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d40d1e00 0x7fe1d40d2200 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.362+0000 7fe1dc155640 1 --2- 172.21.15.47:0/392165958 >> v2:172.21.15.191:3300/0 conn(0x7fe1d415e270 0x7fe1d40d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.362+0000 7fe1dc155640 1 -- 172.21.15.47:0/392165958 >> 172.21.15.47:0/392165958 conn(0x7fe1d40d3ed0 msgr2=0x7fe1d40d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:44.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.362+0000 7fe1dc155640 1 -- 172.21.15.47:0/392165958 shutdown_connections 2024-04-14T23:35:44.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.362+0000 7fe1dc155640 1 -- 172.21.15.47:0/392165958 wait complete. 2024-04-14T23:35:44.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.363+0000 7fe1dc155640 1 Processor -- start 2024-04-14T23:35:44.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.364+0000 7fe1dc155640 1 -- start start 2024-04-14T23:35:44.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.364+0000 7fe1dc155640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1d40d1450 0x7fe1d40cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.364+0000 7fe1dc155640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1d40d1e00 0x7fe1d414a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.364+0000 7fe1dc155640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d415e270 0x7fe1d41f7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.364+0000 7fe1dc155640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d415e650 con 0x7fe1d415e270 2024-04-14T23:35:44.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.364+0000 7fe1dc155640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d40b0c60 con 0x7fe1d40d1450 2024-04-14T23:35:44.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.364+0000 7fe1dc155640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d415e7d0 con 0x7fe1d40d1e00 2024-04-14T23:35:44.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.364+0000 7fe1da6f2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d415e270 0x7fe1d41f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.364+0000 7fe1da6f2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d415e270 0x7fe1d41f7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52364/0 (socket says 172.21.15.47:52364) 2024-04-14T23:35:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.364+0000 7fe1da6f2640 1 -- 172.21.15.47:0/2728350616 learned_addr learned my addr 172.21.15.47:0/2728350616 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.365+0000 7fe1d9ef1640 1 --2- 172.21.15.47:0/2728350616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1d40d1450 0x7fe1d40cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.365+0000 7fe1da6f2640 1 -- 172.21.15.47:0/2728350616 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1d40d1e00 msgr2=0x7fe1d414a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.365+0000 7fe1da6f2640 1 --2- 172.21.15.47:0/2728350616 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1d40d1e00 0x7fe1d414a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.365+0000 7fe1da6f2640 1 -- 172.21.15.47:0/2728350616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1d40d1450 msgr2=0x7fe1d40cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.365+0000 7fe1da6f2640 1 --2- 172.21.15.47:0/2728350616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1d40d1450 0x7fe1d40cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.365+0000 7fe1da6f2640 1 -- 172.21.15.47:0/2728350616 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d40cd9f0 con 0x7fe1d415e270 2024-04-14T23:35:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.365+0000 7fe1da6f2640 1 --2- 172.21.15.47:0/2728350616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d415e270 0x7fe1d41f7680 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00c780 tx=0x7fe1cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.365+0000 7fe1ca7fc640 1 -- 172.21.15.47:0/2728350616 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc017070 con 0x7fe1d415e270 2024-04-14T23:35:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.365+0000 7fe1ca7fc640 1 -- 172.21.15.47:0/2728350616 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1cc003da0 con 0x7fe1d415e270 2024-04-14T23:35:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.365+0000 7fe1dc155640 1 -- 172.21.15.47:0/2728350616 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d40cdcd0 con 0x7fe1d415e270 2024-04-14T23:35:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.365+0000 7fe1ca7fc640 1 -- 172.21.15.47:0/2728350616 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0052b0 con 0x7fe1d415e270 2024-04-14T23:35:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.365+0000 7fe1dc155640 1 -- 172.21.15.47:0/2728350616 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d40cbe30 con 0x7fe1d415e270 2024-04-14T23:35:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.366+0000 7fe1dc155640 1 -- 172.21.15.47:0/2728350616 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d40ca9b0 con 0x7fe1d415e270 2024-04-14T23:35:44.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.366+0000 7fe1ca7fc640 1 -- 172.21.15.47:0/2728350616 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fe1cc01a070 con 0x7fe1d415e270 2024-04-14T23:35:44.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.367+0000 7fe1ca7fc640 1 --2- 172.21.15.47:0/2728350616 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe1b806b990 0x7fe1b806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.367+0000 7fe1ca7fc640 1 -- 172.21.15.47:0/2728350616 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fe1cc089d10 con 0x7fe1d415e270 2024-04-14T23:35:44.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.367+0000 7fe1d9ef1640 1 --2- 172.21.15.47:0/2728350616 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe1b806b990 0x7fe1b806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:44.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.368+0000 7fe1d9ef1640 1 --2- 172.21.15.47:0/2728350616 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe1b806b990 0x7fe1b806de50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000a770 tx=0x7fe1d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:44.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.371+0000 7fe1ca7fc640 1 -- 172.21.15.47:0/2728350616 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe1d40ca9b0 con 0x7fe1d415e270 2024-04-14T23:35:44.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.553+0000 7fe1dc155640 1 -- 172.21.15.47:0/2728350616 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe1d40cb960 con 0x7fe1d415e270 2024-04-14T23:35:44.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.554+0000 7fe1ca7fc640 1 -- 172.21.15.47:0/2728350616 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7fe1cc058ae0 con 0x7fe1d415e270 2024-04-14T23:35:44.557 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:44.557 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-04-14T23:35:44.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-14T23:35:44.557 INFO:teuthology.orchestra.run.smithi047.stdout: "poolnum": 1, 2024-04-14T23:35:44.558 INFO:teuthology.orchestra.run.smithi047.stdout: "poolname": ".mgr" 2024-04-14T23:35:44.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-14T23:35:44.558 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-04-14T23:35:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.556+0000 7fe1dc155640 1 -- 172.21.15.47:0/2728350616 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe1b806b990 msgr2=0x7fe1b806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.556+0000 7fe1dc155640 1 --2- 172.21.15.47:0/2728350616 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe1b806b990 0x7fe1b806de50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000a770 tx=0x7fe1d0008040 comp rx=0 tx=0).stop 2024-04-14T23:35:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.556+0000 7fe1dc155640 1 -- 172.21.15.47:0/2728350616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d415e270 msgr2=0x7fe1d41f7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.556+0000 7fe1dc155640 1 --2- 172.21.15.47:0/2728350616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d415e270 0x7fe1d41f7680 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00c780 tx=0x7fe1cc00cc40 comp rx=0 tx=0).stop 2024-04-14T23:35:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.556+0000 7fe1dc155640 1 -- 172.21.15.47:0/2728350616 shutdown_connections 2024-04-14T23:35:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.556+0000 7fe1dc155640 1 --2- 172.21.15.47:0/2728350616 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fe1b806b990 0x7fe1b806de50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.556+0000 7fe1dc155640 1 --2- 172.21.15.47:0/2728350616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1d415e270 0x7fe1d41f7680 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.556+0000 7fe1dc155640 1 --2- 172.21.15.47:0/2728350616 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1d40d1e00 0x7fe1d414a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.556+0000 7fe1dc155640 1 --2- 172.21.15.47:0/2728350616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1d40d1450 0x7fe1d40cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.556+0000 7fe1dc155640 1 -- 172.21.15.47:0/2728350616 >> 172.21.15.47:0/2728350616 conn(0x7fe1d40d3ed0 msgr2=0x7fe1d406ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:44.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.556+0000 7fe1dc155640 1 -- 172.21.15.47:0/2728350616 shutdown_connections 2024-04-14T23:35:44.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.556+0000 7fe1dc155640 1 -- 172.21.15.47:0/2728350616 wait complete. 2024-04-14T23:35:44.569 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-14T23:35:44.569 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-14T23:35:44.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.671+0000 7f56d4174640 1 Processor -- start 2024-04-14T23:35:44.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.672+0000 7f56d4174640 1 -- start start 2024-04-14T23:35:44.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.672+0000 7f56d4174640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f56cc144640 0x7f56cc06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.672+0000 7f56d4174640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f56cc0cd720 0x7f56cc0ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.672+0000 7f56d4174640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56cc0cdbb0 con 0x7f56cc0b2ba0 2024-04-14T23:35:44.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.672+0000 7f56d4174640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f56cc0cde20 con 0x7f56cc144640 2024-04-14T23:35:44.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.672+0000 7f56d4174640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f56cc0ce100 con 0x7f56cc0cd720 2024-04-14T23:35:44.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.673+0000 7f56d1f10640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f56cc144640 0x7f56cc06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:44.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.673+0000 7f56d2711640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f56cc0b2ba0 0x7f56cc070c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:53824/0 (socket says 172.21.15.47:53824) 2024-04-14T23:35:44.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.673+0000 7f56d2711640 1 -- 172.21.15.47:0/3194636674 learned_addr learned my addr 172.21.15.47:0/3194636674 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:44.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.673+0000 7f56d170f640 1 --2- 172.21.15.47:0/3194636674 >> v2:172.21.15.191:3300/0 conn(0x7f56cc0cd720 0x7f56cc0ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:44.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.673+0000 7f56d1f10640 1 -- 172.21.15.47:0/3194636674 >> v2:172.21.15.191:3300/0 conn(0x7f56cc0cd720 msgr2=0x7f56cc0ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:44.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.673+0000 7f56d1f10640 1 --2- 172.21.15.47:0/3194636674 >> v2:172.21.15.191:3300/0 conn(0x7f56cc0cd720 0x7f56cc0ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.673+0000 7f56d1f10640 1 -- 172.21.15.47:0/3194636674 >> v1:172.21.15.47:6789/0 conn(0x7f56cc0b2ba0 legacy=0x7f56cc070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:44.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.673+0000 7f56d1f10640 1 -- 172.21.15.47:0/3194636674 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56cc0ce3e0 con 0x7f56cc144640 2024-04-14T23:35:44.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.673+0000 7f56d0f0e640 1 -- 172.21.15.47:0/3194636674 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3826057777 0 0) 0x7f56cc0cdbb0 con 0x7f56cc0b2ba0 2024-04-14T23:35:44.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.673+0000 7f56d170f640 1 --2- 172.21.15.47:0/3194636674 >> v2:172.21.15.191:3300/0 conn(0x7f56cc0cd720 0x7f56cc0ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:44.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.674+0000 7f56d1f10640 1 --2- 172.21.15.47:0/3194636674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56cc144640 0x7f56cc06e2d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f56cc15b3c0 tx=0x7f56c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338439728d9eeabd server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:44.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.674+0000 7f56d0f0e640 1 -- 172.21.15.47:0/3194636674 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8035020 con 0x7f56cc144640 2024-04-14T23:35:44.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.674+0000 7f56d0f0e640 1 -- 172.21.15.47:0/3194636674 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c8031830 con 0x7f56cc144640 2024-04-14T23:35:44.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.674+0000 7f56d0f0e640 1 -- 172.21.15.47:0/3194636674 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8031c00 con 0x7f56cc144640 2024-04-14T23:35:44.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.674+0000 7f56d4174640 1 -- 172.21.15.47:0/3194636674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56cc144640 msgr2=0x7f56cc06e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:44.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.674+0000 7f56d4174640 1 --2- 172.21.15.47:0/3194636674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56cc144640 0x7f56cc06e2d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f56cc15b3c0 tx=0x7f56c802b8d0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.674+0000 7f56d4174640 1 -- 172.21.15.47:0/3194636674 shutdown_connections 2024-04-14T23:35:44.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.674+0000 7f56d4174640 1 --2- 172.21.15.47:0/3194636674 >> v2:172.21.15.191:3300/0 conn(0x7f56cc0cd720 0x7f56cc0ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.674+0000 7f56d4174640 1 --2- 172.21.15.47:0/3194636674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56cc144640 0x7f56cc06e2d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.674+0000 7f56d4174640 1 -- 172.21.15.47:0/3194636674 >> 172.21.15.47:0/3194636674 conn(0x7f56cc06b200 msgr2=0x7f56cc06b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:44.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.674+0000 7f56d4174640 1 -- 172.21.15.47:0/3194636674 shutdown_connections 2024-04-14T23:35:44.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.674+0000 7f56d4174640 1 -- 172.21.15.47:0/3194636674 wait complete. 2024-04-14T23:35:44.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.675+0000 7f56d4174640 1 Processor -- start 2024-04-14T23:35:44.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.676+0000 7f56d4174640 1 -- start start 2024-04-14T23:35:44.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.676+0000 7f56d4174640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56cc0b2ba0 0x7f56cc0c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.676+0000 7f56d4174640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56cc0cd720 0x7f56cc142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.676+0000 7f56d4174640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56cc144640 0x7f56cc15a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.676+0000 7f56d4174640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc144a20 con 0x7f56cc0b2ba0 2024-04-14T23:35:44.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.676+0000 7f56d4174640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc0ce9a0 con 0x7f56cc0cd720 2024-04-14T23:35:44.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.676+0000 7f56d4174640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f56cc0cf400 con 0x7f56cc144640 2024-04-14T23:35:44.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.676+0000 7f56d1f10640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56cc0b2ba0 0x7f56cc0c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:44.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.676+0000 7f56d1f10640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56cc0b2ba0 0x7f56cc0c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52390/0 (socket says 172.21.15.47:52390) 2024-04-14T23:35:44.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.676+0000 7f56d1f10640 1 -- 172.21.15.47:0/172749489 learned_addr learned my addr 172.21.15.47:0/172749489 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:44.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.676+0000 7f56d2711640 1 --2- 172.21.15.47:0/172749489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56cc144640 0x7f56cc15a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.676+0000 7f56d170f640 1 --2- 172.21.15.47:0/172749489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56cc0cd720 0x7f56cc142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.677+0000 7f56d1f10640 1 -- 172.21.15.47:0/172749489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56cc144640 msgr2=0x7f56cc15a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.677+0000 7f56d1f10640 1 --2- 172.21.15.47:0/172749489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56cc144640 0x7f56cc15a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.677+0000 7f56d1f10640 1 -- 172.21.15.47:0/172749489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56cc0cd720 msgr2=0x7f56cc142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.677+0000 7f56d1f10640 1 --2- 172.21.15.47:0/172749489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56cc0cd720 0x7f56cc142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.677+0000 7f56d1f10640 1 -- 172.21.15.47:0/172749489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56cc0ca1f0 con 0x7f56cc0b2ba0 2024-04-14T23:35:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.677+0000 7f56d2711640 1 --2- 172.21.15.47:0/172749489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56cc144640 0x7f56cc15a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.677+0000 7f56d1f10640 1 --2- 172.21.15.47:0/172749489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56cc0b2ba0 0x7f56cc0c9930 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f56c8000c00 tx=0x7f56c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.677+0000 7f56c27fc640 1 -- 172.21.15.47:0/172749489 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8040070 con 0x7f56cc0b2ba0 2024-04-14T23:35:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.677+0000 7f56c27fc640 1 -- 172.21.15.47:0/172749489 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c8039a20 con 0x7f56cc0b2ba0 2024-04-14T23:35:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.677+0000 7f56c27fc640 1 -- 172.21.15.47:0/172749489 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8035040 con 0x7f56cc0b2ba0 2024-04-14T23:35:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.677+0000 7f56d4174640 1 -- 172.21.15.47:0/172749489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56cc0ca4d0 con 0x7f56cc0b2ba0 2024-04-14T23:35:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.677+0000 7f56d4174640 1 -- 172.21.15.47:0/172749489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56cc0cad70 con 0x7f56cc0b2ba0 2024-04-14T23:35:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.678+0000 7f56d4174640 1 -- 172.21.15.47:0/172749489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56cc0cbe20 con 0x7f56cc0b2ba0 2024-04-14T23:35:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.679+0000 7f56c27fc640 1 -- 172.21.15.47:0/172749489 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f56c804b060 con 0x7f56cc0b2ba0 2024-04-14T23:35:44.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.679+0000 7f56c27fc640 1 --2- 172.21.15.47:0/172749489 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f56b006b9c0 0x7f56b006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:44.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.679+0000 7f56c27fc640 1 -- 172.21.15.47:0/172749489 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f56c80abf50 con 0x7f56cc0b2ba0 2024-04-14T23:35:44.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.679+0000 7f56d170f640 1 --2- 172.21.15.47:0/172749489 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f56b006b9c0 0x7f56b006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:44.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.680+0000 7f56d170f640 1 --2- 172.21.15.47:0/172749489 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f56b006b9c0 0x7f56b006de80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f56cc06b960 tx=0x7f56bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.683+0000 7f56c27fc640 1 -- 172.21.15.47:0/172749489 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f56cc0cbe20 con 0x7f56cc0b2ba0 2024-04-14T23:35:44.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:44.862+0000 7f56d4174640 1 -- 172.21.15.47:0/172749489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f56cc0754a0 con 0x7f56cc0b2ba0 2024-04-14T23:35:45.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.110+0000 7f56c27fc640 1 -- 172.21.15.47:0/172749489 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7f56c807ad20 con 0x7f56cc0b2ba0 2024-04-14T23:35:45.114 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' created 2024-04-14T23:35:45.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.112+0000 7f56d4174640 1 -- 172.21.15.47:0/172749489 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f56b006b9c0 msgr2=0x7f56b006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:45.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.112+0000 7f56d4174640 1 --2- 172.21.15.47:0/172749489 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f56b006b9c0 0x7f56b006de80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f56cc06b960 tx=0x7f56bc008040 comp rx=0 tx=0).stop 2024-04-14T23:35:45.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.112+0000 7f56d4174640 1 -- 172.21.15.47:0/172749489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56cc0b2ba0 msgr2=0x7f56cc0c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:45.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.112+0000 7f56d4174640 1 --2- 172.21.15.47:0/172749489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56cc0b2ba0 0x7f56cc0c9930 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f56c8000c00 tx=0x7f56c80046c0 comp rx=0 tx=0).stop 2024-04-14T23:35:45.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.112+0000 7f56d4174640 1 -- 172.21.15.47:0/172749489 shutdown_connections 2024-04-14T23:35:45.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.112+0000 7f56d4174640 1 --2- 172.21.15.47:0/172749489 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f56b006b9c0 0x7f56b006de80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:45.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.112+0000 7f56d4174640 1 --2- 172.21.15.47:0/172749489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56cc144640 0x7f56cc15a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:45.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.112+0000 7f56d4174640 1 --2- 172.21.15.47:0/172749489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56cc0cd720 0x7f56cc142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:45.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.112+0000 7f56d4174640 1 --2- 172.21.15.47:0/172749489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56cc0b2ba0 0x7f56cc0c9930 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:45.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.112+0000 7f56d4174640 1 -- 172.21.15.47:0/172749489 >> 172.21.15.47:0/172749489 conn(0x7f56cc06b200 msgr2=0x7f56cc0aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:45.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.113+0000 7f56d4174640 1 -- 172.21.15.47:0/172749489 shutdown_connections 2024-04-14T23:35:45.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.113+0000 7f56d4174640 1 -- 172.21.15.47:0/172749489 wait complete. 2024-04-14T23:35:45.131 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-14T23:35:45.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.236+0000 7f680d11e640 1 Processor -- start 2024-04-14T23:35:45.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.236+0000 7f680d11e640 1 -- start start 2024-04-14T23:35:45.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.237+0000 7f680d11e640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f68080b78f0 0x7f680806c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:45.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.237+0000 7f680d11e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68080cd0d0 con 0x7f68080d2880 2024-04-14T23:35:45.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.237+0000 7f680d11e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68080cd390 con 0x7f68080cffc0 2024-04-14T23:35:45.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.237+0000 7f680d11e640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f68080cd670 con 0x7f68080b78f0 2024-04-14T23:35:45.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.237+0000 7f680659c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f68080d2880 0x7f680806ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:53826/0 (socket says 172.21.15.47:53826) 2024-04-14T23:35:45.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.237+0000 7f680659c640 1 -- 172.21.15.47:0/2988790191 learned_addr learned my addr 172.21.15.47:0/2988790191 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:45.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.237+0000 7f6805d9b640 1 -- 172.21.15.47:0/2988790191 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1417127337 0 0) 0x7f68080cd0d0 con 0x7f68080d2880 2024-04-14T23:35:45.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.237+0000 7f6806d9d640 1 --2- 172.21.15.47:0/2988790191 >> v2:172.21.15.191:3300/0 conn(0x7f68080b78f0 0x7f680806c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:45.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.237+0000 7f6805d9b640 1 -- 172.21.15.47:0/2988790191 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67f0003520 con 0x7f68080d2880 2024-04-14T23:35:45.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6805d9b640 1 -- 172.21.15.47:0/2988790191 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 656499724 0 0) 0x7f67f0003520 con 0x7f68080d2880 2024-04-14T23:35:45.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6805d9b640 1 -- 172.21.15.47:0/2988790191 >> v2:172.21.15.191:3300/0 conn(0x7f68080b78f0 msgr2=0x7f680806c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:45.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6805d9b640 1 --2- 172.21.15.47:0/2988790191 >> v2:172.21.15.191:3300/0 conn(0x7f68080b78f0 0x7f680806c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:45.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6805d9b640 1 -- 172.21.15.47:0/2988790191 >> v1:172.21.15.191:6789/0 conn(0x7f68080cffc0 legacy=0x7f68080d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:45.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6805d9b640 1 -- 172.21.15.47:0/2988790191 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68080cd950 con 0x7f68080d2880 2024-04-14T23:35:45.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6805d9b640 1 -- 172.21.15.47:0/2988790191 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f67fc001670 con 0x7f68080d2880 2024-04-14T23:35:45.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6805d9b640 1 -- 172.21.15.47:0/2988790191 >> v1:172.21.15.47:6789/0 conn(0x7f68080d2880 legacy=0x7f680806ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:45.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6805d9b640 1 --2- 172.21.15.47:0/2988790191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67f00039b0 0x7f67f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:45.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6805d9b640 1 --2- 172.21.15.47:0/2988790191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67f0004800 0x7f67f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:45.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6805d9b640 1 --2- 172.21.15.47:0/2988790191 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67f00051c0 0x7f67f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:45.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6805d9b640 1 -- 172.21.15.47:0/2988790191 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68080cd670 con 0x7f67f00039b0 2024-04-14T23:35:45.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6805d9b640 1 -- 172.21.15.47:0/2988790191 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f67f000c060 con 0x7f67f0004800 2024-04-14T23:35:45.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6805d9b640 1 -- 172.21.15.47:0/2988790191 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f67f000c260 con 0x7f67f00051c0 2024-04-14T23:35:45.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6806d9d640 1 --2- 172.21.15.47:0/2988790191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67f00039b0 0x7f67f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:45.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f680659c640 1 --2- 172.21.15.47:0/2988790191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67f0004800 0x7f67f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f680759e640 1 --2- 172.21.15.47:0/2988790191 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67f00051c0 0x7f67f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6806d9d640 1 -- 172.21.15.47:0/2988790191 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67f00051c0 msgr2=0x7f67f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6806d9d640 1 --2- 172.21.15.47:0/2988790191 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67f00051c0 0x7f67f000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6806d9d640 1 -- 172.21.15.47:0/2988790191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67f0004800 msgr2=0x7f67f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6806d9d640 1 --2- 172.21.15.47:0/2988790191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67f0004800 0x7f67f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f6806d9d640 1 -- 172.21.15.47:0/2988790191 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f0003520 con 0x7f67f00039b0 2024-04-14T23:35:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.238+0000 7f680759e640 1 -- 172.21.15.47:0/2988790191 reap_dead start 2024-04-14T23:35:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.239+0000 7f6806d9d640 1 --2- 172.21.15.47:0/2988790191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67f00039b0 0x7f67f0003dd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6800009ac0 tx=0x7f67f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=decff26ad12c48f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.239+0000 7f6805d9b640 1 -- 172.21.15.47:0/2988790191 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6800039070 con 0x7f67f00039b0 2024-04-14T23:35:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.239+0000 7f6805d9b640 1 -- 172.21.15.47:0/2988790191 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f680002c6b0 con 0x7f67f00039b0 2024-04-14T23:35:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.239+0000 7f6805d9b640 1 -- 172.21.15.47:0/2988790191 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6800009690 con 0x7f67f00039b0 2024-04-14T23:35:45.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.240+0000 7f680d11e640 1 -- 172.21.15.47:0/2988790191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67f00039b0 msgr2=0x7f67f0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.240+0000 7f680d11e640 1 --2- 172.21.15.47:0/2988790191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67f00039b0 0x7f67f0003dd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6800009ac0 tx=0x7f67f0005830 comp rx=0 tx=0).stop 2024-04-14T23:35:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.240+0000 7f680d11e640 1 -- 172.21.15.47:0/2988790191 shutdown_connections 2024-04-14T23:35:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.240+0000 7f680d11e640 1 --2- 172.21.15.47:0/2988790191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67f00039b0 0x7f67f0003dd0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.240+0000 7f680d11e640 1 -- 172.21.15.47:0/2988790191 >> 172.21.15.47:0/2988790191 conn(0x7f68080d1cf0 msgr2=0x7f68080d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.240+0000 7f680d11e640 1 -- 172.21.15.47:0/2988790191 shutdown_connections 2024-04-14T23:35:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.240+0000 7f680d11e640 1 -- 172.21.15.47:0/2988790191 wait complete. 2024-04-14T23:35:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.241+0000 7f680d11e640 1 Processor -- start 2024-04-14T23:35:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.241+0000 7f680d11e640 1 -- start start 2024-04-14T23:35:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f680d11e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67f00039b0 0x7f680815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f680d11e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68080c5820 0x7f68080c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:45.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f680d11e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68080c7010 0x7f68080c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:45.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f680d11e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68080b4b40 con 0x7f68080c7010 2024-04-14T23:35:45.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f680d11e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f68080ccd50 con 0x7f67f00039b0 2024-04-14T23:35:45.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f680d11e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f68080b4cc0 con 0x7f68080c5820 2024-04-14T23:35:45.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f680759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68080c7010 0x7f68080c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:45.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f680759e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68080c7010 0x7f68080c7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52408/0 (socket says 172.21.15.47:52408) 2024-04-14T23:35:45.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f680759e640 1 -- 172.21.15.47:0/2623126830 learned_addr learned my addr 172.21.15.47:0/2623126830 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:45.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f6806d9d640 1 --2- 172.21.15.47:0/2623126830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67f00039b0 0x7f680815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:45.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f680659c640 1 --2- 172.21.15.47:0/2623126830 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68080c5820 0x7f68080c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:45.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f680759e640 1 -- 172.21.15.47:0/2623126830 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68080c5820 msgr2=0x7f68080c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:45.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f680759e640 1 --2- 172.21.15.47:0/2623126830 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68080c5820 0x7f68080c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:45.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f680759e640 1 -- 172.21.15.47:0/2623126830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67f00039b0 msgr2=0x7f680815aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:45.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f680759e640 1 --2- 172.21.15.47:0/2623126830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67f00039b0 0x7f680815aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:45.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f680759e640 1 -- 172.21.15.47:0/2623126830 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680815eb10 con 0x7f68080c7010 2024-04-14T23:35:45.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.242+0000 7f680759e640 1 --2- 172.21.15.47:0/2623126830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68080c7010 0x7f68080c7490 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f68080d2c60 tx=0x7f67f800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:45.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.243+0000 7f67ef7fe640 1 -- 172.21.15.47:0/2623126830 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f8003970 con 0x7f68080c7010 2024-04-14T23:35:45.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.243+0000 7f67ef7fe640 1 -- 172.21.15.47:0/2623126830 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f8018070 con 0x7f68080c7010 2024-04-14T23:35:45.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.243+0000 7f680d11e640 1 -- 172.21.15.47:0/2623126830 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68080c62c0 con 0x7f68080c7010 2024-04-14T23:35:45.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.243+0000 7f67ef7fe640 1 -- 172.21.15.47:0/2623126830 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f8003d70 con 0x7f68080c7010 2024-04-14T23:35:45.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.243+0000 7f680d11e640 1 -- 172.21.15.47:0/2623126830 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68080c6880 con 0x7f68080c7010 2024-04-14T23:35:45.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.244+0000 7f680d11e640 1 -- 172.21.15.47:0/2623126830 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6808073f50 con 0x7f68080c7010 2024-04-14T23:35:45.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.244+0000 7f67ef7fe640 1 -- 172.21.15.47:0/2623126830 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f67f80050d0 con 0x7f68080c7010 2024-04-14T23:35:45.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.245+0000 7f67ef7fe640 1 --2- 172.21.15.47:0/2623126830 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67f406b9c0 0x7f67f406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:45.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.245+0000 7f67ef7fe640 1 -- 172.21.15.47:0/2623126830 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7f67f808acf0 con 0x7f68080c7010 2024-04-14T23:35:45.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.245+0000 7f6806d9d640 1 --2- 172.21.15.47:0/2623126830 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67f406b9c0 0x7f67f406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:45.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.245+0000 7f6806d9d640 1 --2- 172.21.15.47:0/2623126830 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67f406b9c0 0x7f67f406de80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6800036000 tx=0x7f6800030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:45.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.249+0000 7f67ef7fe640 1 -- 172.21.15.47:0/2623126830 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f67f8059a30 con 0x7f68080c7010 2024-04-14T23:35:45.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:45.430+0000 7f680d11e640 1 -- 172.21.15.47:0/2623126830 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f680815ece0 con 0x7f68080c7010 2024-04-14T23:35:46.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.113+0000 7f67ef7fe640 1 -- 172.21.15.47:0/2623126830 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7f67f8059330 con 0x7f68080c7010 2024-04-14T23:35:46.116 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' created 2024-04-14T23:35:46.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.116+0000 7f680d11e640 1 -- 172.21.15.47:0/2623126830 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67f406b9c0 msgr2=0x7f67f406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:46.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.116+0000 7f680d11e640 1 --2- 172.21.15.47:0/2623126830 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67f406b9c0 0x7f67f406de80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6800036000 tx=0x7f6800030000 comp rx=0 tx=0).stop 2024-04-14T23:35:46.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.116+0000 7f680d11e640 1 -- 172.21.15.47:0/2623126830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68080c7010 msgr2=0x7f68080c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:46.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.116+0000 7f680d11e640 1 --2- 172.21.15.47:0/2623126830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68080c7010 0x7f68080c7490 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f68080d2c60 tx=0x7f67f800eb90 comp rx=0 tx=0).stop 2024-04-14T23:35:46.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.116+0000 7f680d11e640 1 -- 172.21.15.47:0/2623126830 shutdown_connections 2024-04-14T23:35:46.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.116+0000 7f680d11e640 1 --2- 172.21.15.47:0/2623126830 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f67f406b9c0 0x7f67f406de80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:46.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.116+0000 7f680d11e640 1 --2- 172.21.15.47:0/2623126830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68080c7010 0x7f68080c7490 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:46.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.116+0000 7f680d11e640 1 --2- 172.21.15.47:0/2623126830 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68080c5820 0x7f68080c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:46.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.116+0000 7f680d11e640 1 --2- 172.21.15.47:0/2623126830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67f00039b0 0x7f680815aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:46.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.116+0000 7f680d11e640 1 -- 172.21.15.47:0/2623126830 >> 172.21.15.47:0/2623126830 conn(0x7f68080d1cf0 msgr2=0x7f68080ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:46.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.116+0000 7f680d11e640 1 -- 172.21.15.47:0/2623126830 shutdown_connections 2024-04-14T23:35:46.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.117+0000 7f680d11e640 1 -- 172.21.15.47:0/2623126830 wait complete. 2024-04-14T23:35:46.147 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-14T23:35:46.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.254+0000 7f3392836640 1 Processor -- start 2024-04-14T23:35:46.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.254+0000 7f3392836640 1 -- start start 2024-04-14T23:35:46.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.255+0000 7f3392836640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f338c15e420 0x7f338c0d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:46.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.255+0000 7f3392836640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f338c0aeab0 0x7f338c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:46.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.255+0000 7f3392836640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f338c06f3c0 con 0x7f338c06f920 2024-04-14T23:35:46.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.255+0000 7f3392836640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f338c06cfc0 con 0x7f338c0aeab0 2024-04-14T23:35:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.255+0000 7f3392836640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f338c06c3b0 con 0x7f338c15e420 2024-04-14T23:35:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.255+0000 7f338bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f338c06f920 0x7f338c06fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:53828/0 (socket says 172.21.15.47:53828) 2024-04-14T23:35:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.255+0000 7f338bfff640 1 -- 172.21.15.47:0/3942833245 learned_addr learned my addr 172.21.15.47:0/3942833245 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.255+0000 7f338b7fe640 1 --2- 172.21.15.47:0/3942833245 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f338c15e420 0x7f338c0d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.255+0000 7f3390dd3640 1 --2- 172.21.15.47:0/3942833245 >> v2:172.21.15.191:3300/0 conn(0x7f338c0aeab0 0x7f338c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.255+0000 7f338affd640 1 -- 172.21.15.47:0/3942833245 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 456086609 0 0) 0x7f338c06f3c0 con 0x7f338c06f920 2024-04-14T23:35:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.255+0000 7f338affd640 1 -- 172.21.15.47:0/3942833245 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3378003520 con 0x7f338c06f920 2024-04-14T23:35:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.255+0000 7f3390dd3640 1 -- 172.21.15.47:0/3942833245 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f338c15e420 msgr2=0x7f338c0d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.255+0000 7f3390dd3640 1 --2- 172.21.15.47:0/3942833245 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f338c15e420 0x7f338c0d0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.255+0000 7f3390dd3640 1 -- 172.21.15.47:0/3942833245 >> v1:172.21.15.47:6789/0 conn(0x7f338c06f920 legacy=0x7f338c06fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.255+0000 7f3390dd3640 1 -- 172.21.15.47:0/3942833245 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338c06c690 con 0x7f338c0aeab0 2024-04-14T23:35:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.255+0000 7f338b7fe640 1 --2- 172.21.15.47:0/3942833245 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f338c15e420 0x7f338c0d0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.256+0000 7f3390dd3640 1 --2- 172.21.15.47:0/3942833245 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f338c0aeab0 0x7f338c06d450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3384009d90 tx=0x7f338402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b0da7972eb710d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.256+0000 7f338affd640 1 -- 172.21.15.47:0/3942833245 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3384039070 con 0x7f338c0aeab0 2024-04-14T23:35:46.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.256+0000 7f338affd640 1 -- 172.21.15.47:0/3942833245 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f338402cc50 con 0x7f338c0aeab0 2024-04-14T23:35:46.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.256+0000 7f338affd640 1 -- 172.21.15.47:0/3942833245 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3384034440 con 0x7f338c0aeab0 2024-04-14T23:35:46.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.257+0000 7f3392836640 1 -- 172.21.15.47:0/3942833245 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f338c0aeab0 msgr2=0x7f338c06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:46.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.257+0000 7f3392836640 1 --2- 172.21.15.47:0/3942833245 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f338c0aeab0 0x7f338c06d450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3384009d90 tx=0x7f338402bea0 comp rx=0 tx=0).stop 2024-04-14T23:35:46.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.257+0000 7f3392836640 1 -- 172.21.15.47:0/3942833245 shutdown_connections 2024-04-14T23:35:46.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.257+0000 7f3392836640 1 --2- 172.21.15.47:0/3942833245 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f338c15e420 0x7f338c0d0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:46.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.257+0000 7f3392836640 1 --2- 172.21.15.47:0/3942833245 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f338c0aeab0 0x7f338c06d450 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:46.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.257+0000 7f3392836640 1 -- 172.21.15.47:0/3942833245 >> 172.21.15.47:0/3942833245 conn(0x7f338c0b37d0 msgr2=0x7f338c0b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:46.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.257+0000 7f3392836640 1 -- 172.21.15.47:0/3942833245 shutdown_connections 2024-04-14T23:35:46.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.257+0000 7f3392836640 1 -- 172.21.15.47:0/3942833245 wait complete. 2024-04-14T23:35:46.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.258+0000 7f3392836640 1 Processor -- start 2024-04-14T23:35:46.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.258+0000 7f3392836640 1 -- start start 2024-04-14T23:35:46.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.259+0000 7f3392836640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f338c06f920 0x7f338c1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:46.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.259+0000 7f3392836640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f338c0aeab0 0x7f338c15fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:46.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.259+0000 7f3392836640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f338c15e420 0x7f338c155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:46.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.259+0000 7f3392836640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f338c0d1040 con 0x7f338c0aeab0 2024-04-14T23:35:46.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.259+0000 7f3392836640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f338c06cc50 con 0x7f338c06f920 2024-04-14T23:35:46.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.259+0000 7f3392836640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f338c0d11c0 con 0x7f338c15e420 2024-04-14T23:35:46.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.259+0000 7f338b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f338c0aeab0 0x7f338c15fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:46.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.259+0000 7f338b7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f338c0aeab0 0x7f338c15fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52414/0 (socket says 172.21.15.47:52414) 2024-04-14T23:35:46.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.259+0000 7f338b7fe640 1 -- 172.21.15.47:0/2128656182 learned_addr learned my addr 172.21.15.47:0/2128656182 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:46.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.259+0000 7f338bfff640 1 --2- 172.21.15.47:0/2128656182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f338c06f920 0x7f338c1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:46.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.259+0000 7f3390dd3640 1 --2- 172.21.15.47:0/2128656182 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f338c15e420 0x7f338c155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:46.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.259+0000 7f338b7fe640 1 -- 172.21.15.47:0/2128656182 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f338c15e420 msgr2=0x7f338c155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:46.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.259+0000 7f338b7fe640 1 --2- 172.21.15.47:0/2128656182 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f338c15e420 0x7f338c155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:46.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.259+0000 7f338b7fe640 1 -- 172.21.15.47:0/2128656182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f338c06f920 msgr2=0x7f338c1561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:46.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.260+0000 7f338b7fe640 1 --2- 172.21.15.47:0/2128656182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f338c06f920 0x7f338c1561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:46.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.260+0000 7f338b7fe640 1 -- 172.21.15.47:0/2128656182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338c160290 con 0x7f338c0aeab0 2024-04-14T23:35:46.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.260+0000 7f338b7fe640 1 --2- 172.21.15.47:0/2128656182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f338c0aeab0 0x7f338c15fc40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f337c00ebe0 tx=0x7f337c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:46.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.260+0000 7f3388ff9640 1 -- 172.21.15.47:0/2128656182 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c017070 con 0x7f338c0aeab0 2024-04-14T23:35:46.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.260+0000 7f3388ff9640 1 -- 172.21.15.47:0/2128656182 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337c00cc30 con 0x7f338c0aeab0 2024-04-14T23:35:46.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.260+0000 7f3392836640 1 -- 172.21.15.47:0/2128656182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f338c160570 con 0x7f338c0aeab0 2024-04-14T23:35:46.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.260+0000 7f3388ff9640 1 -- 172.21.15.47:0/2128656182 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c013470 con 0x7f338c0aeab0 2024-04-14T23:35:46.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.260+0000 7f3392836640 1 -- 172.21.15.47:0/2128656182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f338c160b30 con 0x7f338c0aeab0 2024-04-14T23:35:46.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.261+0000 7f3392836640 1 -- 172.21.15.47:0/2128656182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f338c073f50 con 0x7f338c0aeab0 2024-04-14T23:35:46.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.262+0000 7f3388ff9640 1 -- 172.21.15.47:0/2128656182 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f337c01a070 con 0x7f338c0aeab0 2024-04-14T23:35:46.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.262+0000 7f3388ff9640 1 --2- 172.21.15.47:0/2128656182 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f336c06b9c0 0x7f336c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:46.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.262+0000 7f3388ff9640 1 -- 172.21.15.47:0/2128656182 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7f337c08af70 con 0x7f338c0aeab0 2024-04-14T23:35:46.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.262+0000 7f338bfff640 1 --2- 172.21.15.47:0/2128656182 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f336c06b9c0 0x7f336c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:46.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.263+0000 7f338bfff640 1 --2- 172.21.15.47:0/2128656182 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f336c06b9c0 0x7f336c06de80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3374005880 tx=0x7f3374009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:46.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.266+0000 7f3388ff9640 1 -- 172.21.15.47:0/2128656182 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f337c0594e0 con 0x7f338c0aeab0 2024-04-14T23:35:46.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:46.486+0000 7f3392836640 1 -- 172.21.15.47:0/2128656182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f338c15c270 con 0x7f338c0aeab0 2024-04-14T23:35:47.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.124+0000 7f3388ff9640 1 -- 172.21.15.47:0/2128656182 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7f337c05d580 con 0x7f338c0aeab0 2024-04-14T23:35:47.127 INFO:teuthology.orchestra.run.smithi047.stderr:new fs with metadata pool 5 and data pool 6 2024-04-14T23:35:47.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.130+0000 7f3392836640 1 -- 172.21.15.47:0/2128656182 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f336c06b9c0 msgr2=0x7f336c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:47.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.130+0000 7f3392836640 1 --2- 172.21.15.47:0/2128656182 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f336c06b9c0 0x7f336c06de80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3374005880 tx=0x7f3374009040 comp rx=0 tx=0).stop 2024-04-14T23:35:47.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.130+0000 7f3392836640 1 -- 172.21.15.47:0/2128656182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f338c0aeab0 msgr2=0x7f338c15fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:47.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.130+0000 7f3392836640 1 --2- 172.21.15.47:0/2128656182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f338c0aeab0 0x7f338c15fc40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f337c00ebe0 tx=0x7f337c00c520 comp rx=0 tx=0).stop 2024-04-14T23:35:47.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.130+0000 7f3392836640 1 -- 172.21.15.47:0/2128656182 shutdown_connections 2024-04-14T23:35:47.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.130+0000 7f3392836640 1 --2- 172.21.15.47:0/2128656182 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f336c06b9c0 0x7f336c06de80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.130+0000 7f3392836640 1 --2- 172.21.15.47:0/2128656182 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f338c15e420 0x7f338c155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.130+0000 7f3392836640 1 --2- 172.21.15.47:0/2128656182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f338c0aeab0 0x7f338c15fc40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.130+0000 7f3392836640 1 --2- 172.21.15.47:0/2128656182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f338c06f920 0x7f338c1561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.130+0000 7f3392836640 1 -- 172.21.15.47:0/2128656182 >> 172.21.15.47:0/2128656182 conn(0x7f338c0b37d0 msgr2=0x7f338c0d07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:47.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.133+0000 7f3392836640 1 -- 172.21.15.47:0/2128656182 shutdown_connections 2024-04-14T23:35:47.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.133+0000 7f3392836640 1 -- 172.21.15.47:0/2128656182 wait complete. 2024-04-14T23:35:47.164 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:47.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.264+0000 7fa2abade640 1 Processor -- start 2024-04-14T23:35:47.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.264+0000 7fa2abade640 1 -- start start 2024-04-14T23:35:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2abade640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2a40cca50 0x7fa2a40cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2abade640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa2a40ceab0 0x7fa2a4161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2abade640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa2a40d16d0 0x7fa2a41622b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2abade640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a415f5b0 con 0x7fa2a40d16d0 2024-04-14T23:35:47.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2abade640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a415e9a0 con 0x7fa2a40ceab0 2024-04-14T23:35:47.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2abade640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a415ec80 con 0x7fa2a40cca50 2024-04-14T23:35:47.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2aa07b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa2a40d16d0 0x7fa2a41622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:47.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2aa07b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa2a40d16d0 0x7fa2a41622b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52424/0 (socket says 172.21.15.47:52424) 2024-04-14T23:35:47.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2aa07b640 1 -- 172.21.15.47:0/1160937149 learned_addr learned my addr 172.21.15.47:0/1160937149 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:47.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2aa07b640 1 -- 172.21.15.47:0/1160937149 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2a40cca50 msgr2=0x7fa2a40cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:47.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2a987a640 1 --2- 172.21.15.47:0/1160937149 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2a40cca50 0x7fa2a40cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:47.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2aa07b640 1 --2- 172.21.15.47:0/1160937149 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2a40cca50 0x7fa2a40cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2aa07b640 1 -- 172.21.15.47:0/1160937149 >> v2:172.21.15.191:3300/0 conn(0x7fa2a40ceab0 msgr2=0x7fa2a4161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:47.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2a9079640 1 --2- 172.21.15.47:0/1160937149 >> v2:172.21.15.191:3300/0 conn(0x7fa2a40ceab0 0x7fa2a4161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:47.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2aa07b640 1 --2- 172.21.15.47:0/1160937149 >> v2:172.21.15.191:3300/0 conn(0x7fa2a40ceab0 0x7fa2a4161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2aa07b640 1 -- 172.21.15.47:0/1160937149 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a415ef60 con 0x7fa2a40d16d0 2024-04-14T23:35:47.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.265+0000 7fa2a9079640 1 --2- 172.21.15.47:0/1160937149 >> v2:172.21.15.191:3300/0 conn(0x7fa2a40ceab0 0x7fa2a4161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:47.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.266+0000 7fa2aa07b640 1 --2- 172.21.15.47:0/1160937149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2a40d16d0 0x7fa2a41622b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4074e30 tx=0x7fa2a002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2978145d6f22695d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:47.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.266+0000 7fa2a8878640 1 -- 172.21.15.47:0/1160937149 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a002c950 con 0x7fa2a40d16d0 2024-04-14T23:35:47.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.266+0000 7fa2a8878640 1 -- 172.21.15.47:0/1160937149 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2a002caf0 con 0x7fa2a40d16d0 2024-04-14T23:35:47.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.266+0000 7fa2a8878640 1 -- 172.21.15.47:0/1160937149 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a00343f0 con 0x7fa2a40d16d0 2024-04-14T23:35:47.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.267+0000 7fa2abade640 1 -- 172.21.15.47:0/1160937149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2a40d16d0 msgr2=0x7fa2a41622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:47.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.267+0000 7fa2abade640 1 --2- 172.21.15.47:0/1160937149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2a40d16d0 0x7fa2a41622b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4074e30 tx=0x7fa2a002bdb0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.267+0000 7fa2abade640 1 -- 172.21.15.47:0/1160937149 shutdown_connections 2024-04-14T23:35:47.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.267+0000 7fa2abade640 1 --2- 172.21.15.47:0/1160937149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2a40d16d0 0x7fa2a41622b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.267+0000 7fa2abade640 1 --2- 172.21.15.47:0/1160937149 >> v2:172.21.15.191:3300/0 conn(0x7fa2a40ceab0 0x7fa2a4161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.267+0000 7fa2abade640 1 --2- 172.21.15.47:0/1160937149 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2a40cca50 0x7fa2a40cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.267+0000 7fa2abade640 1 -- 172.21.15.47:0/1160937149 >> 172.21.15.47:0/1160937149 conn(0x7fa2a40d0bb0 msgr2=0x7fa2a40d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:47.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.267+0000 7fa2abade640 1 -- 172.21.15.47:0/1160937149 shutdown_connections 2024-04-14T23:35:47.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.267+0000 7fa2abade640 1 -- 172.21.15.47:0/1160937149 wait complete. 2024-04-14T23:35:47.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.268+0000 7fa2abade640 1 Processor -- start 2024-04-14T23:35:47.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.268+0000 7fa2abade640 1 -- start start 2024-04-14T23:35:47.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.269+0000 7fa2abade640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2a40cca50 0x7fa2a40b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.269+0000 7fa2abade640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2a40ceab0 0x7fa2a41f7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.269+0000 7fa2abade640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2a40d16d0 0x7fa2a40b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.269+0000 7fa2abade640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a415e660 con 0x7fa2a40d16d0 2024-04-14T23:35:47.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.269+0000 7fa2abade640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a40cd370 con 0x7fa2a40ceab0 2024-04-14T23:35:47.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.269+0000 7fa2abade640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a40cb3c0 con 0x7fa2a40cca50 2024-04-14T23:35:47.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.269+0000 7fa2aa07b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2a40d16d0 0x7fa2a40b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:47.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.269+0000 7fa2aa07b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2a40d16d0 0x7fa2a40b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52440/0 (socket says 172.21.15.47:52440) 2024-04-14T23:35:47.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.269+0000 7fa2aa07b640 1 -- 172.21.15.47:0/2162768695 learned_addr learned my addr 172.21.15.47:0/2162768695 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:47.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.269+0000 7fa2a987a640 1 --2- 172.21.15.47:0/2162768695 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2a40cca50 0x7fa2a40b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:47.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.269+0000 7fa2a9079640 1 --2- 172.21.15.47:0/2162768695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2a40ceab0 0x7fa2a41f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:47.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.269+0000 7fa2aa07b640 1 -- 172.21.15.47:0/2162768695 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2a40cca50 msgr2=0x7fa2a40b6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:47.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.269+0000 7fa2aa07b640 1 --2- 172.21.15.47:0/2162768695 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2a40cca50 0x7fa2a40b6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.269+0000 7fa2aa07b640 1 -- 172.21.15.47:0/2162768695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2a40ceab0 msgr2=0x7fa2a41f7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:47.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.269+0000 7fa2aa07b640 1 --2- 172.21.15.47:0/2162768695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2a40ceab0 0x7fa2a41f7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.269+0000 7fa2aa07b640 1 -- 172.21.15.47:0/2162768695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a40c7ed0 con 0x7fa2a40d16d0 2024-04-14T23:35:47.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.270+0000 7fa2aa07b640 1 --2- 172.21.15.47:0/2162768695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2a40d16d0 0x7fa2a40b59c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009f40 tx=0x7fa2a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:47.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.270+0000 7fa29a7fc640 1 -- 172.21.15.47:0/2162768695 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0044020 con 0x7fa2a40d16d0 2024-04-14T23:35:47.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.270+0000 7fa29a7fc640 1 -- 172.21.15.47:0/2162768695 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2a0040690 con 0x7fa2a40d16d0 2024-04-14T23:35:47.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.270+0000 7fa29a7fc640 1 -- 172.21.15.47:0/2162768695 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0009510 con 0x7fa2a40d16d0 2024-04-14T23:35:47.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.270+0000 7fa2abade640 1 -- 172.21.15.47:0/2162768695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a40c81b0 con 0x7fa2a40d16d0 2024-04-14T23:35:47.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.270+0000 7fa2abade640 1 -- 172.21.15.47:0/2162768695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a40c8c90 con 0x7fa2a40d16d0 2024-04-14T23:35:47.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.271+0000 7fa2abade640 1 -- 172.21.15.47:0/2162768695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a40b6130 con 0x7fa2a40d16d0 2024-04-14T23:35:47.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.271+0000 7fa29a7fc640 1 -- 172.21.15.47:0/2162768695 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fa2a0005d10 con 0x7fa2a40d16d0 2024-04-14T23:35:47.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.272+0000 7fa29a7fc640 1 --2- 172.21.15.47:0/2162768695 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa28806b990 0x7fa28806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.272+0000 7fa29a7fc640 1 -- 172.21.15.47:0/2162768695 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fa2a00ad7e0 con 0x7fa2a40d16d0 2024-04-14T23:35:47.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.272+0000 7fa2a987a640 1 --2- 172.21.15.47:0/2162768695 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa28806b990 0x7fa28806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:47.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.273+0000 7fa2a987a640 1 --2- 172.21.15.47:0/2162768695 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa28806b990 0x7fa28806de50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00a990 tx=0x7fa29c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:47.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.276+0000 7fa29a7fc640 1 -- 172.21.15.47:0/2162768695 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa2a007c2f0 con 0x7fa2a40d16d0 2024-04-14T23:35:47.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.458+0000 7fa2abade640 1 -- 172.21.15.47:0/2162768695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2a4075430 con 0x7fa2a40d16d0 2024-04-14T23:35:47.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.459+0000 7fa29a7fc640 1 -- 172.21.15.47:0/2162768695 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16943 (secure 0 0 0) 0x7fa2a007bbf0 con 0x7fa2a40d16d0 2024-04-14T23:35:47.463 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:47.463 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":38,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:35:46.488135+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:35:44.881683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-14T23:35:45.449906+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:47.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.461+0000 7fa2abade640 1 -- 172.21.15.47:0/2162768695 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa28806b990 msgr2=0x7fa28806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:47.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.461+0000 7fa2abade640 1 --2- 172.21.15.47:0/2162768695 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa28806b990 0x7fa28806de50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00a990 tx=0x7fa29c008040 comp rx=0 tx=0).stop 2024-04-14T23:35:47.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.461+0000 7fa2abade640 1 -- 172.21.15.47:0/2162768695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2a40d16d0 msgr2=0x7fa2a40b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:47.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.461+0000 7fa2abade640 1 --2- 172.21.15.47:0/2162768695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2a40d16d0 0x7fa2a40b59c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009f40 tx=0x7fa2a0004a40 comp rx=0 tx=0).stop 2024-04-14T23:35:47.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.461+0000 7fa2abade640 1 -- 172.21.15.47:0/2162768695 shutdown_connections 2024-04-14T23:35:47.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.461+0000 7fa2abade640 1 --2- 172.21.15.47:0/2162768695 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fa28806b990 0x7fa28806de50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.461+0000 7fa2abade640 1 --2- 172.21.15.47:0/2162768695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2a40d16d0 0x7fa2a40b59c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.461+0000 7fa2abade640 1 --2- 172.21.15.47:0/2162768695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2a40ceab0 0x7fa2a41f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.461+0000 7fa2abade640 1 --2- 172.21.15.47:0/2162768695 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2a40cca50 0x7fa2a40b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.461+0000 7fa2abade640 1 -- 172.21.15.47:0/2162768695 >> 172.21.15.47:0/2162768695 conn(0x7fa2a40d0bb0 msgr2=0x7fa2a409f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:47.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.461+0000 7fa2abade640 1 -- 172.21.15.47:0/2162768695 shutdown_connections 2024-04-14T23:35:47.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.461+0000 7fa2abade640 1 -- 172.21.15.47:0/2162768695 wait complete. 2024-04-14T23:35:47.475 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:47.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.574+0000 7fd02ea84640 1 Processor -- start 2024-04-14T23:35:47.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.574+0000 7fd02ea84640 1 -- start start 2024-04-14T23:35:47.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.574+0000 7fd02ea84640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd0280d1e00 0x7fd0280d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.574+0000 7fd02ea84640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0280d1620 con 0x7fd02815e270 2024-04-14T23:35:47.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.574+0000 7fd02ea84640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0280b39d0 con 0x7fd0280d2740 2024-04-14T23:35:47.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.574+0000 7fd02ea84640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd0280d2bb0 con 0x7fd0280d1e00 2024-04-14T23:35:47.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.574+0000 7fd027fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd0280d1e00 0x7fd0280d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:47.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.575+0000 7fd02c820640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd02815e270 0x7fd0280d0f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:53838/0 (socket says 172.21.15.47:53838) 2024-04-14T23:35:47.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.575+0000 7fd02c820640 1 -- 172.21.15.47:0/3788225855 learned_addr learned my addr 172.21.15.47:0/3788225855 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:47.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.575+0000 7fd027fff640 1 -- 172.21.15.47:0/3788225855 >> v1:172.21.15.191:6789/0 conn(0x7fd0280d2740 legacy=0x7fd0280b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:47.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.575+0000 7fd027fff640 1 -- 172.21.15.47:0/3788225855 >> v1:172.21.15.47:6789/0 conn(0x7fd02815e270 legacy=0x7fd0280d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:47.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.575+0000 7fd0277fe640 1 -- 172.21.15.47:0/3788225855 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1439030891 0 0) 0x7fd0280d1620 con 0x7fd02815e270 2024-04-14T23:35:47.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.575+0000 7fd027fff640 1 -- 172.21.15.47:0/3788225855 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0280b3cb0 con 0x7fd0280d1e00 2024-04-14T23:35:47.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.576+0000 7fd027fff640 1 --2- 172.21.15.47:0/3788225855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0280d1e00 0x7fd0280d2200 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd0140097a0 tx=0x7fd01402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d329a12b5b34b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:47.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.576+0000 7fd0277fe640 1 -- 172.21.15.47:0/3788225855 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014034070 con 0x7fd0280d1e00 2024-04-14T23:35:47.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.576+0000 7fd0277fe640 1 -- 172.21.15.47:0/3788225855 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd014030610 con 0x7fd0280d1e00 2024-04-14T23:35:47.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.576+0000 7fd0277fe640 1 -- 172.21.15.47:0/3788225855 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0140309e0 con 0x7fd0280d1e00 2024-04-14T23:35:47.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.576+0000 7fd02ea84640 1 -- 172.21.15.47:0/3788225855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0280d1e00 msgr2=0x7fd0280d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:47.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.576+0000 7fd02ea84640 1 --2- 172.21.15.47:0/3788225855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0280d1e00 0x7fd0280d2200 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd0140097a0 tx=0x7fd01402b960 comp rx=0 tx=0).stop 2024-04-14T23:35:47.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.576+0000 7fd02ea84640 1 -- 172.21.15.47:0/3788225855 shutdown_connections 2024-04-14T23:35:47.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.576+0000 7fd02ea84640 1 --2- 172.21.15.47:0/3788225855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0280d1e00 0x7fd0280d2200 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.576+0000 7fd02ea84640 1 -- 172.21.15.47:0/3788225855 >> 172.21.15.47:0/3788225855 conn(0x7fd0280d3ed0 msgr2=0x7fd0280d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:47.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.576+0000 7fd02ea84640 1 -- 172.21.15.47:0/3788225855 shutdown_connections 2024-04-14T23:35:47.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.576+0000 7fd02ea84640 1 -- 172.21.15.47:0/3788225855 wait complete. 2024-04-14T23:35:47.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.577+0000 7fd02ea84640 1 Processor -- start 2024-04-14T23:35:47.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.578+0000 7fd02ea84640 1 -- start start 2024-04-14T23:35:47.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.578+0000 7fd02ea84640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0280d1e00 0x7fd028161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.578+0000 7fd02ea84640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0280d2740 0x7fd0280cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.578+0000 7fd02ea84640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd02815e270 0x7fd0280ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.578+0000 7fd02ea84640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd0280b0c60 con 0x7fd0280d2740 2024-04-14T23:35:47.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.578+0000 7fd02ea84640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd0280b4300 con 0x7fd02815e270 2024-04-14T23:35:47.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.578+0000 7fd02ea84640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd02815e650 con 0x7fd0280d1e00 2024-04-14T23:35:47.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.578+0000 7fd027fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0280d2740 0x7fd0280cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:47.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.579+0000 7fd027fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0280d2740 0x7fd0280cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52450/0 (socket says 172.21.15.47:52450) 2024-04-14T23:35:47.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.579+0000 7fd027fff640 1 -- 172.21.15.47:0/1009734302 learned_addr learned my addr 172.21.15.47:0/1009734302 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:47.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.579+0000 7fd02c820640 1 --2- 172.21.15.47:0/1009734302 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0280d1e00 0x7fd028161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:47.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.579+0000 7fd02d021640 1 --2- 172.21.15.47:0/1009734302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd02815e270 0x7fd0280ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:47.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.579+0000 7fd027fff640 1 -- 172.21.15.47:0/1009734302 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0280d1e00 msgr2=0x7fd028161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:47.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.579+0000 7fd027fff640 1 --2- 172.21.15.47:0/1009734302 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0280d1e00 0x7fd028161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.579+0000 7fd027fff640 1 -- 172.21.15.47:0/1009734302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd02815e270 msgr2=0x7fd0280ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:47.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.579+0000 7fd027fff640 1 --2- 172.21.15.47:0/1009734302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd02815e270 0x7fd0280ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.579+0000 7fd027fff640 1 -- 172.21.15.47:0/1009734302 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd028161960 con 0x7fd0280d2740 2024-04-14T23:35:47.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.579+0000 7fd027fff640 1 --2- 172.21.15.47:0/1009734302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0280d2740 0x7fd0280cca00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd01402bf70 tx=0x7fd0140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:47.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.579+0000 7fd0257fa640 1 -- 172.21.15.47:0/1009734302 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014034040 con 0x7fd0280d2740 2024-04-14T23:35:47.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.579+0000 7fd0257fa640 1 -- 172.21.15.47:0/1009734302 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd014039a10 con 0x7fd0280d2740 2024-04-14T23:35:47.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.579+0000 7fd02ea84640 1 -- 172.21.15.47:0/1009734302 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0280b7000 con 0x7fd0280d2740 2024-04-14T23:35:47.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.579+0000 7fd0257fa640 1 -- 172.21.15.47:0/1009734302 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014039e00 con 0x7fd0280d2740 2024-04-14T23:35:47.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.579+0000 7fd02ea84640 1 -- 172.21.15.47:0/1009734302 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd02815ef40 con 0x7fd0280d2740 2024-04-14T23:35:47.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.580+0000 7fd02ea84640 1 -- 172.21.15.47:0/1009734302 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd028075430 con 0x7fd0280d2740 2024-04-14T23:35:47.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.581+0000 7fd0257fa640 1 -- 172.21.15.47:0/1009734302 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd014037070 con 0x7fd0280d2740 2024-04-14T23:35:47.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.581+0000 7fd0257fa640 1 --2- 172.21.15.47:0/1009734302 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd00c06b990 0x7fd00c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.581+0000 7fd0257fa640 1 -- 172.21.15.47:0/1009734302 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fd0140acb60 con 0x7fd0280d2740 2024-04-14T23:35:47.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.581+0000 7fd02c820640 1 --2- 172.21.15.47:0/1009734302 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd00c06b990 0x7fd00c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:47.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.582+0000 7fd02c820640 1 --2- 172.21.15.47:0/1009734302 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd00c06b990 0x7fd00c06de50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd01c000f60 tx=0x7fd01c007c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:47.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.585+0000 7fd0257fa640 1 -- 172.21.15.47:0/1009734302 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd01407b5d0 con 0x7fd0280d2740 2024-04-14T23:35:47.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.767+0000 7fd02ea84640 1 -- 172.21.15.47:0/1009734302 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd02815da70 con 0x7fd0280d2740 2024-04-14T23:35:47.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.768+0000 7fd0257fa640 1 -- 172.21.15.47:0/1009734302 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16943 (secure 0 0 0) 0x7fd014081030 con 0x7fd0280d2740 2024-04-14T23:35:47.772 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:47.772 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":38,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:35:46.488135+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:35:44.881683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-14T23:35:45.449906+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:47.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.770+0000 7fd02ea84640 1 -- 172.21.15.47:0/1009734302 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd00c06b990 msgr2=0x7fd00c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:47.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.770+0000 7fd02ea84640 1 --2- 172.21.15.47:0/1009734302 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd00c06b990 0x7fd00c06de50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd01c000f60 tx=0x7fd01c007c00 comp rx=0 tx=0).stop 2024-04-14T23:35:47.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.770+0000 7fd02ea84640 1 -- 172.21.15.47:0/1009734302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0280d2740 msgr2=0x7fd0280cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:47.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.770+0000 7fd02ea84640 1 --2- 172.21.15.47:0/1009734302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0280d2740 0x7fd0280cca00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd01402bf70 tx=0x7fd0140046c0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.770+0000 7fd02ea84640 1 -- 172.21.15.47:0/1009734302 shutdown_connections 2024-04-14T23:35:47.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.770+0000 7fd02ea84640 1 --2- 172.21.15.47:0/1009734302 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd00c06b990 0x7fd00c06de50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.770+0000 7fd02ea84640 1 --2- 172.21.15.47:0/1009734302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd02815e270 0x7fd0280ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.770+0000 7fd02ea84640 1 --2- 172.21.15.47:0/1009734302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0280d2740 0x7fd0280cca00 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.770+0000 7fd02ea84640 1 --2- 172.21.15.47:0/1009734302 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0280d1e00 0x7fd028161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.770+0000 7fd02ea84640 1 -- 172.21.15.47:0/1009734302 >> 172.21.15.47:0/1009734302 conn(0x7fd0280d3ed0 msgr2=0x7fd0280cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:47.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.770+0000 7fd02ea84640 1 -- 172.21.15.47:0/1009734302 shutdown_connections 2024-04-14T23:35:47.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.770+0000 7fd02ea84640 1 -- 172.21.15.47:0/1009734302 wait complete. 2024-04-14T23:35:47.785 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-14T23:35:47.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.886+0000 7fc727a36640 1 Processor -- start 2024-04-14T23:35:47.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.886+0000 7fc727a36640 1 -- start start 2024-04-14T23:35:47.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.887+0000 7fc727a36640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc7200c7050 0x7fc7200ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.887+0000 7fc727a36640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc72006b910 0x7fc72015f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.887+0000 7fc727a36640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc72015e7b0 con 0x7fc7200d02c0 2024-04-14T23:35:47.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.887+0000 7fc727a36640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc72015f7b0 con 0x7fc7200c7050 2024-04-14T23:35:47.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.887+0000 7fc727a36640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc72006f810 con 0x7fc72006b910 2024-04-14T23:35:47.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.887+0000 7fc7257d2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc7200c7050 0x7fc7200ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:47.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.887+0000 7fc7257d2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc7200c7050 0x7fc7200ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52462/0 (socket says 172.21.15.47:52462) 2024-04-14T23:35:47.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.887+0000 7fc7257d2640 1 -- 172.21.15.47:0/3213831549 learned_addr learned my addr 172.21.15.47:0/3213831549 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:47.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.888+0000 7fc7257d2640 1 -- 172.21.15.47:0/3213831549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc72006b910 msgr2=0x7fc72015f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:47.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.888+0000 7fc725fd3640 1 --2- 172.21.15.47:0/3213831549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc72006b910 0x7fc72015f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:47.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.888+0000 7fc7257d2640 1 --2- 172.21.15.47:0/3213831549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc72006b910 0x7fc72015f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.888+0000 7fc7257d2640 1 -- 172.21.15.47:0/3213831549 >> v1:172.21.15.191:6789/0 conn(0x7fc7200d02c0 legacy=0x7fc72006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:47.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.888+0000 7fc7257d2640 1 -- 172.21.15.47:0/3213831549 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72006faf0 con 0x7fc7200c7050 2024-04-14T23:35:47.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.888+0000 7fc7257d2640 1 --2- 172.21.15.47:0/3213831549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7200c7050 0x7fc7200ceae0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc718009870 tx=0x7fc71802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b961b4f098f4ed server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:47.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.888+0000 7fc71ffff640 1 -- 172.21.15.47:0/3213831549 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718035020 con 0x7fc7200c7050 2024-04-14T23:35:47.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.888+0000 7fc71ffff640 1 -- 172.21.15.47:0/3213831549 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc718031640 con 0x7fc7200c7050 2024-04-14T23:35:47.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.888+0000 7fc71ffff640 1 -- 172.21.15.47:0/3213831549 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71802d040 con 0x7fc7200c7050 2024-04-14T23:35:47.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.889+0000 7fc727a36640 1 -- 172.21.15.47:0/3213831549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7200c7050 msgr2=0x7fc7200ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:47.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.889+0000 7fc727a36640 1 --2- 172.21.15.47:0/3213831549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7200c7050 0x7fc7200ceae0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc718009870 tx=0x7fc71802b8f0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.889+0000 7fc727a36640 1 -- 172.21.15.47:0/3213831549 shutdown_connections 2024-04-14T23:35:47.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.889+0000 7fc727a36640 1 --2- 172.21.15.47:0/3213831549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc72006b910 0x7fc72015f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.889+0000 7fc727a36640 1 --2- 172.21.15.47:0/3213831549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7200c7050 0x7fc7200ceae0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.889+0000 7fc727a36640 1 -- 172.21.15.47:0/3213831549 >> 172.21.15.47:0/3213831549 conn(0x7fc7200b2810 msgr2=0x7fc7200b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:47.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.889+0000 7fc727a36640 1 -- 172.21.15.47:0/3213831549 shutdown_connections 2024-04-14T23:35:47.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.889+0000 7fc727a36640 1 -- 172.21.15.47:0/3213831549 wait complete. 2024-04-14T23:35:47.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.890+0000 7fc727a36640 1 Processor -- start 2024-04-14T23:35:47.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.890+0000 7fc727a36640 1 -- start start 2024-04-14T23:35:47.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.891+0000 7fc727a36640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc72006b910 0x7fc720161440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.891+0000 7fc727a36640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7200c7050 0x7fc720161df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.891+0000 7fc727a36640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7200d02c0 0x7fc7200aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.891+0000 7fc727a36640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc72006f4e0 con 0x7fc72006b910 2024-04-14T23:35:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.891+0000 7fc727a36640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc72015ed50 con 0x7fc7200c7050 2024-04-14T23:35:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.891+0000 7fc727a36640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc7200c7430 con 0x7fc7200d02c0 2024-04-14T23:35:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.891+0000 7fc7257d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc72006b910 0x7fc720161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.891+0000 7fc7257d2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc72006b910 0x7fc720161440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52478/0 (socket says 172.21.15.47:52478) 2024-04-14T23:35:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.891+0000 7fc7257d2640 1 -- 172.21.15.47:0/1184330946 learned_addr learned my addr 172.21.15.47:0/1184330946 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.891+0000 7fc7257d2640 1 -- 172.21.15.47:0/1184330946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7200d02c0 msgr2=0x7fc7200aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.891+0000 7fc7257d2640 1 --2- 172.21.15.47:0/1184330946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7200d02c0 0x7fc7200aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.891+0000 7fc7257d2640 1 -- 172.21.15.47:0/1184330946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7200c7050 msgr2=0x7fc720161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.891+0000 7fc7257d2640 1 --2- 172.21.15.47:0/1184330946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7200c7050 0x7fc720161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.891+0000 7fc7257d2640 1 -- 172.21.15.47:0/1184330946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc720162760 con 0x7fc72006b910 2024-04-14T23:35:47.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.891+0000 7fc7257d2640 1 --2- 172.21.15.47:0/1184330946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc72006b910 0x7fc720161440 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc718000c00 tx=0x7fc7180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:47.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.892+0000 7fc71dffb640 1 -- 172.21.15.47:0/1184330946 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718040070 con 0x7fc72006b910 2024-04-14T23:35:47.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.892+0000 7fc71dffb640 1 -- 172.21.15.47:0/1184330946 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc718039c10 con 0x7fc72006b910 2024-04-14T23:35:47.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.892+0000 7fc727a36640 1 -- 172.21.15.47:0/1184330946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc720160960 con 0x7fc72006b910 2024-04-14T23:35:47.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.892+0000 7fc71dffb640 1 -- 172.21.15.47:0/1184330946 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718035040 con 0x7fc72006b910 2024-04-14T23:35:47.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.892+0000 7fc727a36640 1 -- 172.21.15.47:0/1184330946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc720161980 con 0x7fc72006b910 2024-04-14T23:35:47.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.893+0000 7fc727a36640 1 -- 172.21.15.47:0/1184330946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc720073f50 con 0x7fc72006b910 2024-04-14T23:35:47.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.893+0000 7fc71dffb640 1 -- 172.21.15.47:0/1184330946 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc718038020 con 0x7fc72006b910 2024-04-14T23:35:47.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.894+0000 7fc71dffb640 1 --2- 172.21.15.47:0/1184330946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc70c06b9c0 0x7fc70c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:47.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.894+0000 7fc71dffb640 1 -- 172.21.15.47:0/1184330946 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fc7180ac5a0 con 0x7fc72006b910 2024-04-14T23:35:47.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.894+0000 7fc724fd1640 1 --2- 172.21.15.47:0/1184330946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc70c06b9c0 0x7fc70c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:47.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.895+0000 7fc724fd1640 1 --2- 172.21.15.47:0/1184330946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc70c06b9c0 0x7fc70c06de80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc72015d840 tx=0x7fc714006ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:47.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:47.898+0000 7fc71dffb640 1 -- 172.21.15.47:0/1184330946 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc71807b020 con 0x7fc72006b910 2024-04-14T23:35:48.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.120+0000 7fc727a36640 1 -- 172.21.15.47:0/1184330946 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc7200b0400 con 0x7fc72006b910 2024-04-14T23:35:48.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.135+0000 7fc71dffb640 1 -- 172.21.15.47:0/1184330946 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7fc71807a920 con 0x7fc72006b910 2024-04-14T23:35:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.137+0000 7fc727a36640 1 -- 172.21.15.47:0/1184330946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc70c06b9c0 msgr2=0x7fc70c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.137+0000 7fc727a36640 1 --2- 172.21.15.47:0/1184330946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc70c06b9c0 0x7fc70c06de80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc72015d840 tx=0x7fc714006ba0 comp rx=0 tx=0).stop 2024-04-14T23:35:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.137+0000 7fc727a36640 1 -- 172.21.15.47:0/1184330946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc72006b910 msgr2=0x7fc720161440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.137+0000 7fc727a36640 1 --2- 172.21.15.47:0/1184330946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc72006b910 0x7fc720161440 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc718000c00 tx=0x7fc7180046c0 comp rx=0 tx=0).stop 2024-04-14T23:35:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.137+0000 7fc727a36640 1 -- 172.21.15.47:0/1184330946 shutdown_connections 2024-04-14T23:35:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.137+0000 7fc727a36640 1 --2- 172.21.15.47:0/1184330946 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc70c06b9c0 0x7fc70c06de80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.137+0000 7fc727a36640 1 --2- 172.21.15.47:0/1184330946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7200d02c0 0x7fc7200aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.137+0000 7fc727a36640 1 --2- 172.21.15.47:0/1184330946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7200c7050 0x7fc720161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.137+0000 7fc727a36640 1 --2- 172.21.15.47:0/1184330946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc72006b910 0x7fc720161440 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.137+0000 7fc727a36640 1 -- 172.21.15.47:0/1184330946 >> 172.21.15.47:0/1184330946 conn(0x7fc7200b2810 msgr2=0x7fc7200cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:48.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.138+0000 7fc727a36640 1 -- 172.21.15.47:0/1184330946 shutdown_connections 2024-04-14T23:35:48.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.138+0000 7fc727a36640 1 -- 172.21.15.47:0/1184330946 wait complete. 2024-04-14T23:35:48.151 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-14T23:35:48.152 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-14T23:35:48.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.253+0000 7f12f02de640 1 Processor -- start 2024-04-14T23:35:48.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.253+0000 7f12f02de640 1 -- start start 2024-04-14T23:35:48.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.253+0000 7f12f02de640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f12e80c7050 0x7f12e80ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:48.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.254+0000 7f12f02de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12e80d02c0 0x7f12e815f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:48.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.254+0000 7f12f02de640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12e815e7b0 con 0x7f12e806b200 2024-04-14T23:35:48.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.254+0000 7f12f02de640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f12e80d0700 con 0x7f12e80c7050 2024-04-14T23:35:48.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.254+0000 7f12f02de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f12e815f7b0 con 0x7f12e80d02c0 2024-04-14T23:35:48.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.254+0000 7f12ed879640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12e80d02c0 0x7f12e815f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:48.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.254+0000 7f12ee07a640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f12e80c7050 0x7f12e80ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:48.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.254+0000 7f12ed879640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12e80d02c0 0x7f12e815f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:57524/0 (socket says 172.21.15.47:57524) 2024-04-14T23:35:48.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.254+0000 7f12ee87b640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f12e806b200 0x7f12e8161da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.47:36422/0 (socket says 172.21.15.47:36422) 2024-04-14T23:35:48.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.254+0000 7f12ed879640 1 -- 172.21.15.47:0/97363513 learned_addr learned my addr 172.21.15.47:0/97363513 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:48.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.254+0000 7f12ed879640 1 -- 172.21.15.47:0/97363513 >> v2:172.21.15.191:3300/0 conn(0x7f12e80c7050 msgr2=0x7f12e80ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:48.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.254+0000 7f12ed879640 1 --2- 172.21.15.47:0/97363513 >> v2:172.21.15.191:3300/0 conn(0x7f12e80c7050 0x7f12e80ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:48.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.254+0000 7f12ed879640 1 -- 172.21.15.47:0/97363513 >> v1:172.21.15.191:6789/0 conn(0x7f12e806b200 legacy=0x7f12e8161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:48.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.254+0000 7f12ed879640 1 -- 172.21.15.47:0/97363513 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e806f810 con 0x7f12e80d02c0 2024-04-14T23:35:48.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.254+0000 7f12ee07a640 1 --2- 172.21.15.47:0/97363513 >> v2:172.21.15.191:3300/0 conn(0x7f12e80c7050 0x7f12e80ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:48.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.255+0000 7f12ed879640 1 --2- 172.21.15.47:0/97363513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12e80d02c0 0x7f12e815f270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009870 tx=0x7f12d802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b0ec250dfb3fbd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:48.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.255+0000 7f12ed078640 1 -- 172.21.15.47:0/97363513 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8034070 con 0x7f12e80d02c0 2024-04-14T23:35:48.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.255+0000 7f12ed078640 1 -- 172.21.15.47:0/97363513 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d8030840 con 0x7f12e80d02c0 2024-04-14T23:35:48.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.255+0000 7f12ed078640 1 -- 172.21.15.47:0/97363513 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8030c10 con 0x7f12e80d02c0 2024-04-14T23:35:48.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.256+0000 7f12f02de640 1 -- 172.21.15.47:0/97363513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12e80d02c0 msgr2=0x7f12e815f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:48.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.256+0000 7f12f02de640 1 --2- 172.21.15.47:0/97363513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12e80d02c0 0x7f12e815f270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009870 tx=0x7f12d802b980 comp rx=0 tx=0).stop 2024-04-14T23:35:48.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.256+0000 7f12f02de640 1 -- 172.21.15.47:0/97363513 shutdown_connections 2024-04-14T23:35:48.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.256+0000 7f12f02de640 1 --2- 172.21.15.47:0/97363513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12e80d02c0 0x7f12e815f270 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:48.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.256+0000 7f12f02de640 1 --2- 172.21.15.47:0/97363513 >> v2:172.21.15.191:3300/0 conn(0x7f12e80c7050 0x7f12e80ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:48.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.256+0000 7f12f02de640 1 -- 172.21.15.47:0/97363513 >> 172.21.15.47:0/97363513 conn(0x7f12e80b2810 msgr2=0x7f12e80b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:48.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.256+0000 7f12f02de640 1 -- 172.21.15.47:0/97363513 shutdown_connections 2024-04-14T23:35:48.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.256+0000 7f12f02de640 1 -- 172.21.15.47:0/97363513 wait complete. 2024-04-14T23:35:48.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.257+0000 7f12f02de640 1 Processor -- start 2024-04-14T23:35:48.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.257+0000 7f12f02de640 1 -- start start 2024-04-14T23:35:48.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12f02de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12e806b200 0x7f12e80ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:48.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12f02de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12e80c7050 0x7f12e81585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:48.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12f02de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12e80d02c0 0x7f12e8159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:48.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12f02de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f12e815ed50 con 0x7f12e806b200 2024-04-14T23:35:48.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12f02de640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f12e815ea70 con 0x7f12e80c7050 2024-04-14T23:35:48.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12f02de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f12e806f4e0 con 0x7f12e80d02c0 2024-04-14T23:35:48.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12ee07a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12e806b200 0x7f12e80ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:48.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12ee07a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12e806b200 0x7f12e80ca830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52488/0 (socket says 172.21.15.47:52488) 2024-04-14T23:35:48.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12ee07a640 1 -- 172.21.15.47:0/3983152641 learned_addr learned my addr 172.21.15.47:0/3983152641 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:48.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12ee87b640 1 --2- 172.21.15.47:0/3983152641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12e80d02c0 0x7f12e8159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:48.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12ed879640 1 --2- 172.21.15.47:0/3983152641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12e80c7050 0x7f12e81585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:48.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12ee07a640 1 -- 172.21.15.47:0/3983152641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12e80d02c0 msgr2=0x7f12e8159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:48.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12ee07a640 1 --2- 172.21.15.47:0/3983152641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12e80d02c0 0x7f12e8159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:48.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12ee07a640 1 -- 172.21.15.47:0/3983152641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12e80c7050 msgr2=0x7f12e81585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:48.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12ee07a640 1 --2- 172.21.15.47:0/3983152641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12e80c7050 0x7f12e81585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:48.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12ee07a640 1 -- 172.21.15.47:0/3983152641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e8158e40 con 0x7f12e806b200 2024-04-14T23:35:48.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.258+0000 7f12ee07a640 1 --2- 172.21.15.47:0/3983152641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12e806b200 0x7f12e80ca830 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f12e400ebe0 tx=0x7f12e400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:48.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.259+0000 7f12deffd640 1 -- 172.21.15.47:0/3983152641 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4017070 con 0x7f12e806b200 2024-04-14T23:35:48.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.259+0000 7f12deffd640 1 -- 172.21.15.47:0/3983152641 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e400cc30 con 0x7f12e806b200 2024-04-14T23:35:48.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.259+0000 7f12f02de640 1 -- 172.21.15.47:0/3983152641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e8159120 con 0x7f12e806b200 2024-04-14T23:35:48.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.259+0000 7f12deffd640 1 -- 172.21.15.47:0/3983152641 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4013470 con 0x7f12e806b200 2024-04-14T23:35:48.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.259+0000 7f12f02de640 1 -- 172.21.15.47:0/3983152641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e81596e0 con 0x7f12e806b200 2024-04-14T23:35:48.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.260+0000 7f12f02de640 1 -- 172.21.15.47:0/3983152641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12e8073f50 con 0x7f12e806b200 2024-04-14T23:35:48.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.260+0000 7f12deffd640 1 -- 172.21.15.47:0/3983152641 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f12e401a070 con 0x7f12e806b200 2024-04-14T23:35:48.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.261+0000 7f12deffd640 1 --2- 172.21.15.47:0/3983152641 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f12cc06b990 0x7f12cc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:48.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.261+0000 7f12deffd640 1 -- 172.21.15.47:0/3983152641 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f12e408acc0 con 0x7f12e806b200 2024-04-14T23:35:48.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.261+0000 7f12ed879640 1 --2- 172.21.15.47:0/3983152641 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f12cc06b990 0x7f12cc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:48.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.261+0000 7f12ed879640 1 --2- 172.21.15.47:0/3983152641 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f12cc06b990 0x7f12cc06de50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f12d8036000 tx=0x7f12d803b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:48.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.265+0000 7f12deffd640 1 -- 172.21.15.47:0/3983152641 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f12e4059060 con 0x7f12e806b200 2024-04-14T23:35:48.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:48.488+0000 7f12f02de640 1 -- 172.21.15.47:0/3983152641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f12e80721f0 con 0x7f12e806b200 2024-04-14T23:35:49.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.144+0000 7f12deffd640 1 -- 172.21.15.47:0/3983152641 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7f12e405d100 con 0x7f12e806b200 2024-04-14T23:35:49.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.147+0000 7f12f02de640 1 -- 172.21.15.47:0/3983152641 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f12cc06b990 msgr2=0x7f12cc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.147+0000 7f12f02de640 1 --2- 172.21.15.47:0/3983152641 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f12cc06b990 0x7f12cc06de50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f12d8036000 tx=0x7f12d803b040 comp rx=0 tx=0).stop 2024-04-14T23:35:49.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.147+0000 7f12f02de640 1 -- 172.21.15.47:0/3983152641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12e806b200 msgr2=0x7f12e80ca830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.147+0000 7f12f02de640 1 --2- 172.21.15.47:0/3983152641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12e806b200 0x7f12e80ca830 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f12e400ebe0 tx=0x7f12e400c520 comp rx=0 tx=0).stop 2024-04-14T23:35:49.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.147+0000 7f12f02de640 1 -- 172.21.15.47:0/3983152641 shutdown_connections 2024-04-14T23:35:49.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.147+0000 7f12f02de640 1 --2- 172.21.15.47:0/3983152641 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f12cc06b990 0x7f12cc06de50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.147+0000 7f12f02de640 1 --2- 172.21.15.47:0/3983152641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12e80d02c0 0x7f12e8159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.147+0000 7f12f02de640 1 --2- 172.21.15.47:0/3983152641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12e80c7050 0x7f12e81585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.147+0000 7f12f02de640 1 --2- 172.21.15.47:0/3983152641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12e806b200 0x7f12e80ca830 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.147+0000 7f12f02de640 1 -- 172.21.15.47:0/3983152641 >> 172.21.15.47:0/3983152641 conn(0x7f12e80b2810 msgr2=0x7f12e80b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:49.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.147+0000 7f12f02de640 1 -- 172.21.15.47:0/3983152641 shutdown_connections 2024-04-14T23:35:49.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.147+0000 7f12f02de640 1 -- 172.21.15.47:0/3983152641 wait complete. 2024-04-14T23:35:49.163 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-14T23:35:49.163 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T23:35:49.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.267+0000 7f35a3029640 1 Processor -- start 2024-04-14T23:35:49.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.267+0000 7f35a3029640 1 -- start start 2024-04-14T23:35:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.268+0000 7f35a3029640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f359c06e340 0x7f359c0cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.268+0000 7f35a3029640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f359c15bcc0 0x7f359c071a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.268+0000 7f35a3029640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f359c15c370 con 0x7f359c0cff70 2024-04-14T23:35:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.268+0000 7f35a3029640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f359c15c130 con 0x7f359c06e340 2024-04-14T23:35:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.268+0000 7f35a3029640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f359c15ead0 con 0x7f359c15bcc0 2024-04-14T23:35:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.268+0000 7f35a0dc5640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f359c06e340 0x7f359c0cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.268+0000 7f35a0dc5640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f359c06e340 0x7f359c0cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52494/0 (socket says 172.21.15.47:52494) 2024-04-14T23:35:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.268+0000 7f359bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f359c0cff70 0x7f359c15b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:53852/0 (socket says 172.21.15.47:53852) 2024-04-14T23:35:49.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.268+0000 7f35a0dc5640 1 -- 172.21.15.47:0/840002793 learned_addr learned my addr 172.21.15.47:0/840002793 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.269+0000 7f35a0dc5640 1 -- 172.21.15.47:0/840002793 >> v2:172.21.15.191:3300/0 conn(0x7f359c15bcc0 msgr2=0x7f359c071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.269+0000 7f35a15c6640 1 --2- 172.21.15.47:0/840002793 >> v2:172.21.15.191:3300/0 conn(0x7f359c15bcc0 0x7f359c071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.269+0000 7f35a0dc5640 1 --2- 172.21.15.47:0/840002793 >> v2:172.21.15.191:3300/0 conn(0x7f359c15bcc0 0x7f359c071a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.269+0000 7f359b7fe640 1 -- 172.21.15.47:0/840002793 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1900559492 0 0) 0x7f359c15c370 con 0x7f359c0cff70 2024-04-14T23:35:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.269+0000 7f35a0dc5640 1 -- 172.21.15.47:0/840002793 >> v1:172.21.15.47:6789/0 conn(0x7f359c0cff70 legacy=0x7f359c15b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.269+0000 7f35a0dc5640 1 -- 172.21.15.47:0/840002793 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359c15edb0 con 0x7f359c06e340 2024-04-14T23:35:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.269+0000 7f35a0dc5640 1 --2- 172.21.15.47:0/840002793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c06e340 0x7f359c0cfa30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f359c0cf980 tx=0x7f359402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b36a1c07290f2c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.270+0000 7f359b7fe640 1 -- 172.21.15.47:0/840002793 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359402ca80 con 0x7f359c06e340 2024-04-14T23:35:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.270+0000 7f359b7fe640 1 -- 172.21.15.47:0/840002793 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f359402cc20 con 0x7f359c06e340 2024-04-14T23:35:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.270+0000 7f359b7fe640 1 -- 172.21.15.47:0/840002793 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35940343f0 con 0x7f359c06e340 2024-04-14T23:35:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.270+0000 7f35a3029640 1 -- 172.21.15.47:0/840002793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c06e340 msgr2=0x7f359c0cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.270+0000 7f35a3029640 1 --2- 172.21.15.47:0/840002793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c06e340 0x7f359c0cfa30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f359c0cf980 tx=0x7f359402bee0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.270+0000 7f35a3029640 1 -- 172.21.15.47:0/840002793 shutdown_connections 2024-04-14T23:35:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.270+0000 7f35a3029640 1 --2- 172.21.15.47:0/840002793 >> v2:172.21.15.191:3300/0 conn(0x7f359c15bcc0 0x7f359c071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.270+0000 7f35a3029640 1 --2- 172.21.15.47:0/840002793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c06e340 0x7f359c0cfa30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.270+0000 7f35a3029640 1 -- 172.21.15.47:0/840002793 >> 172.21.15.47:0/840002793 conn(0x7f359c06b200 msgr2=0x7f359c06b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.270+0000 7f35a3029640 1 -- 172.21.15.47:0/840002793 shutdown_connections 2024-04-14T23:35:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.270+0000 7f35a3029640 1 -- 172.21.15.47:0/840002793 wait complete. 2024-04-14T23:35:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.271+0000 7f35a3029640 1 Processor -- start 2024-04-14T23:35:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.271+0000 7f35a3029640 1 -- start start 2024-04-14T23:35:49.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.272+0000 7f35a3029640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f359c06e340 0x7f359c14a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.272+0000 7f35a3029640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f359c0cff70 0x7f359c0ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.272+0000 7f35a3029640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c15bcc0 0x7f359c0aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.272+0000 7f35a3029640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f359c15f890 con 0x7f359c15bcc0 2024-04-14T23:35:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.272+0000 7f35a3029640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f359c06e720 con 0x7f359c0cff70 2024-04-14T23:35:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.272+0000 7f35a3029640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f359c071f80 con 0x7f359c06e340 2024-04-14T23:35:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.272+0000 7f35a15c6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c15bcc0 0x7f359c0aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.272+0000 7f35a15c6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c15bcc0 0x7f359c0aadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52498/0 (socket says 172.21.15.47:52498) 2024-04-14T23:35:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.272+0000 7f35a15c6640 1 -- 172.21.15.47:0/4106738208 learned_addr learned my addr 172.21.15.47:0/4106738208 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.273+0000 7f359bfff640 1 --2- 172.21.15.47:0/4106738208 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f359c0cff70 0x7f359c0ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.273+0000 7f35a0dc5640 1 --2- 172.21.15.47:0/4106738208 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f359c06e340 0x7f359c14a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.273+0000 7f35a15c6640 1 -- 172.21.15.47:0/4106738208 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f359c06e340 msgr2=0x7f359c14a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.273+0000 7f35a15c6640 1 --2- 172.21.15.47:0/4106738208 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f359c06e340 0x7f359c14a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.273+0000 7f35a15c6640 1 -- 172.21.15.47:0/4106738208 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f359c0cff70 msgr2=0x7f359c0ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.273+0000 7f35a15c6640 1 --2- 172.21.15.47:0/4106738208 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f359c0cff70 0x7f359c0ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.273+0000 7f35a15c6640 1 -- 172.21.15.47:0/4106738208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359c14aad0 con 0x7f359c15bcc0 2024-04-14T23:35:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.273+0000 7f35a15c6640 1 --2- 172.21.15.47:0/4106738208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c15bcc0 0x7f359c0aadd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f358c00c550 tx=0x7f358c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:49.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.273+0000 7f35997fa640 1 -- 172.21.15.47:0/4106738208 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c015070 con 0x7f359c15bcc0 2024-04-14T23:35:49.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.273+0000 7f35997fa640 1 -- 172.21.15.47:0/4106738208 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f358c004220 con 0x7f359c15bcc0 2024-04-14T23:35:49.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.273+0000 7f35a3029640 1 -- 172.21.15.47:0/4106738208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359c0b17f0 con 0x7f359c15bcc0 2024-04-14T23:35:49.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.273+0000 7f35997fa640 1 -- 172.21.15.47:0/4106738208 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c003610 con 0x7f359c15bcc0 2024-04-14T23:35:49.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.273+0000 7f35a3029640 1 -- 172.21.15.47:0/4106738208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f359c0b2090 con 0x7f359c15bcc0 2024-04-14T23:35:49.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.274+0000 7f35a3029640 1 -- 172.21.15.47:0/4106738208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f359c075430 con 0x7f359c15bcc0 2024-04-14T23:35:49.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.275+0000 7f35997fa640 1 -- 172.21.15.47:0/4106738208 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f358c0037b0 con 0x7f359c15bcc0 2024-04-14T23:35:49.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.275+0000 7f35997fa640 1 --2- 172.21.15.47:0/4106738208 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f358806b990 0x7f358806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.275+0000 7f35997fa640 1 -- 172.21.15.47:0/4106738208 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f358c08a6d0 con 0x7f359c15bcc0 2024-04-14T23:35:49.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.275+0000 7f35a0dc5640 1 --2- 172.21.15.47:0/4106738208 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f358806b990 0x7f358806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.276+0000 7f35a0dc5640 1 --2- 172.21.15.47:0/4106738208 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f358806b990 0x7f358806de50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3594035000 tx=0x7f3594030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:49.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.280+0000 7f35997fa640 1 -- 172.21.15.47:0/4106738208 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f359c14aad0 con 0x7f359c15bcc0 2024-04-14T23:35:49.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.499+0000 7f35a3029640 1 -- 172.21.15.47:0/4106738208 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f359c071820 con 0x7f359c15bcc0 2024-04-14T23:35:49.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.499+0000 7f35997fa640 1 -- 172.21.15.47:0/4106738208 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5187 (secure 0 0 0) 0x7f358c058b00 con 0x7f359c15bcc0 2024-04-14T23:35:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:49.503 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5098,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/1048029655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1048029655},{"type":"v1","addr":"172.21.15.191:6836","nonce":1048029655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5101,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3689956959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":3689956959},{"type":"v1","addr":"172.21.15.191:6837","nonce":3689956959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/3726899017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3726899017},{"type":"v1","addr":"172.21.15.47:6834","nonce":3726899017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T23:35:46.488445+0000","modified":"2024-04-14T23:35:48.489599+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/1026300185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":1026300185},{"type":"v1","addr":"172.21.15.47:6835","nonce":1026300185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-04-14T23:35:49.503 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 15 2024-04-14T23:35:49.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.501+0000 7f35a3029640 1 -- 172.21.15.47:0/4106738208 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f358806b990 msgr2=0x7f358806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.501+0000 7f35a3029640 1 --2- 172.21.15.47:0/4106738208 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f358806b990 0x7f358806de50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3594035000 tx=0x7f3594030000 comp rx=0 tx=0).stop 2024-04-14T23:35:49.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.501+0000 7f35a3029640 1 -- 172.21.15.47:0/4106738208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c15bcc0 msgr2=0x7f359c0aadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.501+0000 7f35a3029640 1 --2- 172.21.15.47:0/4106738208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c15bcc0 0x7f359c0aadd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f358c00c550 tx=0x7f358c00ca10 comp rx=0 tx=0).stop 2024-04-14T23:35:49.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.501+0000 7f35a3029640 1 -- 172.21.15.47:0/4106738208 shutdown_connections 2024-04-14T23:35:49.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.502+0000 7f35a3029640 1 --2- 172.21.15.47:0/4106738208 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f358806b990 0x7f358806de50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.502+0000 7f35a3029640 1 --2- 172.21.15.47:0/4106738208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f359c15bcc0 0x7f359c0aadd0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.502+0000 7f35a3029640 1 --2- 172.21.15.47:0/4106738208 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f359c0cff70 0x7f359c0ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.502+0000 7f35a3029640 1 --2- 172.21.15.47:0/4106738208 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f359c06e340 0x7f359c14a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.502+0000 7f35a3029640 1 -- 172.21.15.47:0/4106738208 >> 172.21.15.47:0/4106738208 conn(0x7f359c06b200 msgr2=0x7f359c1588b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:49.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.502+0000 7f35a3029640 1 -- 172.21.15.47:0/4106738208 shutdown_connections 2024-04-14T23:35:49.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.502+0000 7f35a3029640 1 -- 172.21.15.47:0/4106738208 wait complete. 2024-04-14T23:35:49.516 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:35:49.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.613+0000 7f62b0b9c640 1 Processor -- start 2024-04-14T23:35:49.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.613+0000 7f62b0b9c640 1 -- start start 2024-04-14T23:35:49.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.614+0000 7f62b0b9c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f62ac0d0980 0x7f62ac0cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.614+0000 7f62b0b9c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f62ac0cccd0 0x7f62ac0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.614+0000 7f62b0b9c640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62ac0d1040 con 0x7f62ac15e420 2024-04-14T23:35:49.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.614+0000 7f62b0b9c640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f62ac0d0e10 con 0x7f62ac0d0980 2024-04-14T23:35:49.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.614+0000 7f62b0b9c640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f62ac0cc280 con 0x7f62ac0cccd0 2024-04-14T23:35:49.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.614+0000 7f62a9d9b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f62ac0d0980 0x7f62ac0cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.614+0000 7f62a9d9b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f62ac0d0980 0x7f62ac0cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52512/0 (socket says 172.21.15.47:52512) 2024-04-14T23:35:49.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.614+0000 7f62a9d9b640 1 -- 172.21.15.47:0/2094341274 learned_addr learned my addr 172.21.15.47:0/2094341274 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:49.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.614+0000 7f62aad9d640 1 --2- 172.21.15.47:0/2094341274 >> v2:172.21.15.191:3300/0 conn(0x7f62ac0cccd0 0x7f62ac0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.615+0000 7f62a9d9b640 1 -- 172.21.15.47:0/2094341274 >> v2:172.21.15.191:3300/0 conn(0x7f62ac0cccd0 msgr2=0x7f62ac0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:49.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.615+0000 7f62a9d9b640 1 --2- 172.21.15.47:0/2094341274 >> v2:172.21.15.191:3300/0 conn(0x7f62ac0cccd0 0x7f62ac0cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.615+0000 7f62a9d9b640 1 -- 172.21.15.47:0/2094341274 >> v1:172.21.15.191:6789/0 conn(0x7f62ac15e420 legacy=0x7f62ac0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.615+0000 7f62a9d9b640 1 -- 172.21.15.47:0/2094341274 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ac0d1320 con 0x7f62ac0d0980 2024-04-14T23:35:49.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.615+0000 7f62a9d9b640 1 --2- 172.21.15.47:0/2094341274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62ac0d0980 0x7f62ac0cebc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f62ac072240 tx=0x7f629402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb89968f9dd4032f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:49.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.615+0000 7f62a959a640 1 -- 172.21.15.47:0/2094341274 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629402f850 con 0x7f62ac0d0980 2024-04-14T23:35:49.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.615+0000 7f62a959a640 1 -- 172.21.15.47:0/2094341274 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f629402f9f0 con 0x7f62ac0d0980 2024-04-14T23:35:49.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.615+0000 7f62a959a640 1 -- 172.21.15.47:0/2094341274 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629402fdc0 con 0x7f62ac0d0980 2024-04-14T23:35:49.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.616+0000 7f62b0b9c640 1 -- 172.21.15.47:0/2094341274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62ac0d0980 msgr2=0x7f62ac0cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.616+0000 7f62b0b9c640 1 --2- 172.21.15.47:0/2094341274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62ac0d0980 0x7f62ac0cebc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f62ac072240 tx=0x7f629402ba30 comp rx=0 tx=0).stop 2024-04-14T23:35:49.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.616+0000 7f62b0b9c640 1 -- 172.21.15.47:0/2094341274 shutdown_connections 2024-04-14T23:35:49.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.616+0000 7f62b0b9c640 1 --2- 172.21.15.47:0/2094341274 >> v2:172.21.15.191:3300/0 conn(0x7f62ac0cccd0 0x7f62ac0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.616+0000 7f62b0b9c640 1 --2- 172.21.15.47:0/2094341274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62ac0d0980 0x7f62ac0cebc0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.616+0000 7f62b0b9c640 1 -- 172.21.15.47:0/2094341274 >> 172.21.15.47:0/2094341274 conn(0x7f62ac0d1c30 msgr2=0x7f62ac0d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:49.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.616+0000 7f62b0b9c640 1 -- 172.21.15.47:0/2094341274 shutdown_connections 2024-04-14T23:35:49.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.616+0000 7f62b0b9c640 1 -- 172.21.15.47:0/2094341274 wait complete. 2024-04-14T23:35:49.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.617+0000 7f62b0b9c640 1 Processor -- start 2024-04-14T23:35:49.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.617+0000 7f62b0b9c640 1 -- start start 2024-04-14T23:35:49.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.618+0000 7f62b0b9c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62ac0cccd0 0x7f62ac1511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.618+0000 7f62b0b9c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62ac0d0980 0x7f62ac0c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.618+0000 7f62b0b9c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62ac15e420 0x7f62ac1587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.618+0000 7f62b0b9c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac0cc7b0 con 0x7f62ac15e420 2024-04-14T23:35:49.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.618+0000 7f62b0b9c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac06d750 con 0x7f62ac0cccd0 2024-04-14T23:35:49.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.618+0000 7f62b0b9c640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f62ac15e800 con 0x7f62ac0d0980 2024-04-14T23:35:49.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.618+0000 7f62aad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62ac15e420 0x7f62ac1587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.618+0000 7f62aad9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62ac15e420 0x7f62ac1587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52526/0 (socket says 172.21.15.47:52526) 2024-04-14T23:35:49.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.618+0000 7f62aad9d640 1 -- 172.21.15.47:0/1751203813 learned_addr learned my addr 172.21.15.47:0/1751203813 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:49.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.618+0000 7f62a9d9b640 1 --2- 172.21.15.47:0/1751203813 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62ac0d0980 0x7f62ac0c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.619+0000 7f62aa59c640 1 --2- 172.21.15.47:0/1751203813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62ac0cccd0 0x7f62ac1511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.619+0000 7f62aad9d640 1 -- 172.21.15.47:0/1751203813 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62ac0d0980 msgr2=0x7f62ac0c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.619+0000 7f62aad9d640 1 --2- 172.21.15.47:0/1751203813 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62ac0d0980 0x7f62ac0c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.619+0000 7f62aad9d640 1 -- 172.21.15.47:0/1751203813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62ac0cccd0 msgr2=0x7f62ac1511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.619+0000 7f62aad9d640 1 --2- 172.21.15.47:0/1751203813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62ac0cccd0 0x7f62ac1511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.619+0000 7f62aad9d640 1 -- 172.21.15.47:0/1751203813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ac0c8e80 con 0x7f62ac15e420 2024-04-14T23:35:49.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.619+0000 7f62a9d9b640 1 --2- 172.21.15.47:0/1751203813 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62ac0d0980 0x7f62ac0c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:49.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.619+0000 7f62aa59c640 1 --2- 172.21.15.47:0/1751203813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62ac0cccd0 0x7f62ac1511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:49.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.619+0000 7f62aad9d640 1 --2- 172.21.15.47:0/1751203813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62ac15e420 0x7f62ac1587a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f629c007e70 tx=0x7f629c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:49.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.619+0000 7f62a2ffd640 1 -- 172.21.15.47:0/1751203813 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629c014620 con 0x7f62ac15e420 2024-04-14T23:35:49.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.619+0000 7f62a2ffd640 1 -- 172.21.15.47:0/1751203813 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f629c019070 con 0x7f62ac15e420 2024-04-14T23:35:49.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.619+0000 7f62b0b9c640 1 -- 172.21.15.47:0/1751203813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62ac159260 con 0x7f62ac15e420 2024-04-14T23:35:49.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.619+0000 7f62a2ffd640 1 -- 172.21.15.47:0/1751203813 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629c014a20 con 0x7f62ac15e420 2024-04-14T23:35:49.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.619+0000 7f62b0b9c640 1 -- 172.21.15.47:0/1751203813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62ac0c9140 con 0x7f62ac15e420 2024-04-14T23:35:49.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.620+0000 7f62b0b9c640 1 -- 172.21.15.47:0/1751203813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62ac075430 con 0x7f62ac15e420 2024-04-14T23:35:49.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.620+0000 7f62a2ffd640 1 -- 172.21.15.47:0/1751203813 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f629c014bc0 con 0x7f62ac15e420 2024-04-14T23:35:49.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.621+0000 7f62a2ffd640 1 --2- 172.21.15.47:0/1751203813 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f628c06b990 0x7f628c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.621+0000 7f62a2ffd640 1 -- 172.21.15.47:0/1751203813 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f629c08b280 con 0x7f62ac15e420 2024-04-14T23:35:49.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.621+0000 7f62aa59c640 1 --2- 172.21.15.47:0/1751203813 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f628c06b990 0x7f628c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.622+0000 7f62aa59c640 1 --2- 172.21.15.47:0/1751203813 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f628c06b990 0x7f628c06de50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f62a40015e0 tx=0x7f62a4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:49.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.625+0000 7f62a2ffd640 1 -- 172.21.15.47:0/1751203813 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f629c059d90 con 0x7f62ac15e420 2024-04-14T23:35:49.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.808+0000 7f62b0b9c640 1 -- 172.21.15.47:0/1751203813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62ac0d1850 con 0x7f62ac15e420 2024-04-14T23:35:49.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.809+0000 7f62a2ffd640 1 -- 172.21.15.47:0/1751203813 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16930 (secure 0 0 0) 0x7f629c059690 con 0x7f62ac15e420 2024-04-14T23:35:49.812 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:49.812 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":39,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:35:48.125365+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:35:44.881683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-14T23:35:45.449906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:35:49.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.811+0000 7f62b0b9c640 1 -- 172.21.15.47:0/1751203813 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f628c06b990 msgr2=0x7f628c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.811+0000 7f62b0b9c640 1 --2- 172.21.15.47:0/1751203813 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f628c06b990 0x7f628c06de50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f62a40015e0 tx=0x7f62a4009040 comp rx=0 tx=0).stop 2024-04-14T23:35:49.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.811+0000 7f62b0b9c640 1 -- 172.21.15.47:0/1751203813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62ac15e420 msgr2=0x7f62ac1587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.811+0000 7f62b0b9c640 1 --2- 172.21.15.47:0/1751203813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62ac15e420 0x7f62ac1587a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f629c007e70 tx=0x7f629c00e4b0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.811+0000 7f62b0b9c640 1 -- 172.21.15.47:0/1751203813 shutdown_connections 2024-04-14T23:35:49.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.811+0000 7f62b0b9c640 1 --2- 172.21.15.47:0/1751203813 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f628c06b990 0x7f628c06de50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.811+0000 7f62b0b9c640 1 --2- 172.21.15.47:0/1751203813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62ac15e420 0x7f62ac1587a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.811+0000 7f62b0b9c640 1 --2- 172.21.15.47:0/1751203813 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62ac0d0980 0x7f62ac0c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.811+0000 7f62b0b9c640 1 --2- 172.21.15.47:0/1751203813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62ac0cccd0 0x7f62ac1511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.811+0000 7f62b0b9c640 1 -- 172.21.15.47:0/1751203813 >> 172.21.15.47:0/1751203813 conn(0x7f62ac0d1c30 msgr2=0x7f62ac15ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:49.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.811+0000 7f62b0b9c640 1 -- 172.21.15.47:0/1751203813 shutdown_connections 2024-04-14T23:35:49.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.811+0000 7f62b0b9c640 1 -- 172.21.15.47:0/1751203813 wait complete. 2024-04-14T23:35:49.825 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-14T23:35:49.825 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T23:35:49.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.924+0000 7f273f26d640 1 Processor -- start 2024-04-14T23:35:49.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.924+0000 7f273f26d640 1 -- start start 2024-04-14T23:35:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.925+0000 7f273f26d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f273815e420 0x7f27380d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.925+0000 7f273f26d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f27380cf050 0x7f27380cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.925+0000 7f273f26d640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27380d1040 con 0x7f27380ce4b0 2024-04-14T23:35:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.925+0000 7f273f26d640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f27380cc280 con 0x7f273815e420 2024-04-14T23:35:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.925+0000 7f273f26d640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f273806d750 con 0x7f27380cf050 2024-04-14T23:35:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.925+0000 7f273d009640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f273815e420 0x7f27380d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.925+0000 7f273d009640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f273815e420 0x7f27380d0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52534/0 (socket says 172.21.15.47:52534) 2024-04-14T23:35:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.925+0000 7f273c808640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f27380ce4b0 0x7f27380ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:53862/0 (socket says 172.21.15.47:53862) 2024-04-14T23:35:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.925+0000 7f273d009640 1 -- 172.21.15.47:0/3719141860 learned_addr learned my addr 172.21.15.47:0/3719141860 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.925+0000 7f273d80a640 1 --2- 172.21.15.47:0/3719141860 >> v2:172.21.15.191:3300/0 conn(0x7f27380cf050 0x7f27380cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.925+0000 7f273d009640 1 -- 172.21.15.47:0/3719141860 >> v2:172.21.15.191:3300/0 conn(0x7f27380cf050 msgr2=0x7f27380cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.925+0000 7f273d009640 1 --2- 172.21.15.47:0/3719141860 >> v2:172.21.15.191:3300/0 conn(0x7f27380cf050 0x7f27380cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.925+0000 7f273d009640 1 -- 172.21.15.47:0/3719141860 >> v1:172.21.15.47:6789/0 conn(0x7f27380ce4b0 legacy=0x7f27380ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.925+0000 7f272ffff640 1 -- 172.21.15.47:0/3719141860 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371336230 0 0) 0x7f27380d1040 con 0x7f27380ce4b0 2024-04-14T23:35:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.925+0000 7f273d009640 1 -- 172.21.15.47:0/3719141860 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27380d1320 con 0x7f273815e420 2024-04-14T23:35:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.925+0000 7f273d80a640 1 --2- 172.21.15.47:0/3719141860 >> v2:172.21.15.191:3300/0 conn(0x7f27380cf050 0x7f27380cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.926+0000 7f273d009640 1 --2- 172.21.15.47:0/3719141860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f273815e420 0x7f27380d0980 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2738072240 tx=0x7f273402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8b48e09a90a236 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:49.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.926+0000 7f272ffff640 1 -- 172.21.15.47:0/3719141860 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273402f850 con 0x7f273815e420 2024-04-14T23:35:49.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.926+0000 7f272ffff640 1 -- 172.21.15.47:0/3719141860 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f273402f9f0 con 0x7f273815e420 2024-04-14T23:35:49.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.926+0000 7f272ffff640 1 -- 172.21.15.47:0/3719141860 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273402fdc0 con 0x7f273815e420 2024-04-14T23:35:49.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.927+0000 7f273f26d640 1 -- 172.21.15.47:0/3719141860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f273815e420 msgr2=0x7f27380d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.927+0000 7f273f26d640 1 --2- 172.21.15.47:0/3719141860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f273815e420 0x7f27380d0980 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2738072240 tx=0x7f273402ba30 comp rx=0 tx=0).stop 2024-04-14T23:35:49.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.927+0000 7f273f26d640 1 -- 172.21.15.47:0/3719141860 shutdown_connections 2024-04-14T23:35:49.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.927+0000 7f273f26d640 1 --2- 172.21.15.47:0/3719141860 >> v2:172.21.15.191:3300/0 conn(0x7f27380cf050 0x7f27380cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.927+0000 7f273f26d640 1 --2- 172.21.15.47:0/3719141860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f273815e420 0x7f27380d0980 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.927+0000 7f273f26d640 1 -- 172.21.15.47:0/3719141860 >> 172.21.15.47:0/3719141860 conn(0x7f27380d1c30 msgr2=0x7f27380d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:49.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.927+0000 7f273f26d640 1 -- 172.21.15.47:0/3719141860 shutdown_connections 2024-04-14T23:35:49.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.927+0000 7f273f26d640 1 -- 172.21.15.47:0/3719141860 wait complete. 2024-04-14T23:35:49.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.928+0000 7f273f26d640 1 Processor -- start 2024-04-14T23:35:49.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.928+0000 7f273f26d640 1 -- start start 2024-04-14T23:35:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273f26d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27380ce4b0 0x7f2738148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273f26d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27380cf050 0x7f273815c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273f26d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f273815e420 0x7f27380c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273f26d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f273815e800 con 0x7f27380cf050 2024-04-14T23:35:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273f26d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f27380cc7b0 con 0x7f273815e420 2024-04-14T23:35:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273f26d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f27380cd210 con 0x7f27380ce4b0 2024-04-14T23:35:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273c808640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27380cf050 0x7f273815c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273c808640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27380cf050 0x7f273815c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52538/0 (socket says 172.21.15.47:52538) 2024-04-14T23:35:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273c808640 1 -- 172.21.15.47:0/697180588 learned_addr learned my addr 172.21.15.47:0/697180588 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273d009640 1 --2- 172.21.15.47:0/697180588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27380ce4b0 0x7f2738148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273d80a640 1 --2- 172.21.15.47:0/697180588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f273815e420 0x7f27380c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273c808640 1 -- 172.21.15.47:0/697180588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27380ce4b0 msgr2=0x7f2738148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273c808640 1 --2- 172.21.15.47:0/697180588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27380ce4b0 0x7f2738148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273c808640 1 -- 172.21.15.47:0/697180588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f273815e420 msgr2=0x7f27380c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273c808640 1 --2- 172.21.15.47:0/697180588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f273815e420 0x7f27380c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273c808640 1 -- 172.21.15.47:0/697180588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273815c710 con 0x7f27380cf050 2024-04-14T23:35:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273c808640 1 --2- 172.21.15.47:0/697180588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27380cf050 0x7f273815c1d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f272800c500 tx=0x7f272800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f272dffb640 1 -- 172.21.15.47:0/697180588 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728018070 con 0x7f27380cf050 2024-04-14T23:35:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f272dffb640 1 -- 172.21.15.47:0/697180588 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2728007580 con 0x7f27380cf050 2024-04-14T23:35:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f273f26d640 1 -- 172.21.15.47:0/697180588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273815c990 con 0x7f27380cf050 2024-04-14T23:35:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.929+0000 7f272dffb640 1 -- 172.21.15.47:0/697180588 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728004a20 con 0x7f27380cf050 2024-04-14T23:35:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.930+0000 7f273f26d640 1 -- 172.21.15.47:0/697180588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f273815cf50 con 0x7f27380cf050 2024-04-14T23:35:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.931+0000 7f273f26d640 1 -- 172.21.15.47:0/697180588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f273806d540 con 0x7f27380cf050 2024-04-14T23:35:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.931+0000 7f272dffb640 1 -- 172.21.15.47:0/697180588 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f272801b070 con 0x7f27380cf050 2024-04-14T23:35:49.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.931+0000 7f272dffb640 1 --2- 172.21.15.47:0/697180588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f271c06b990 0x7f271c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:49.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.931+0000 7f272dffb640 1 -- 172.21.15.47:0/697180588 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f2728089bb0 con 0x7f27380cf050 2024-04-14T23:35:49.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.931+0000 7f273d009640 1 --2- 172.21.15.47:0/697180588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f271c06b990 0x7f271c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:49.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.932+0000 7f273d009640 1 --2- 172.21.15.47:0/697180588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f271c06b990 0x7f271c06de50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2734036000 tx=0x7f2734008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:49.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:49.936+0000 7f272dffb640 1 -- 172.21.15.47:0/697180588 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f273806d540 con 0x7f27380cf050 2024-04-14T23:35:50.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.111+0000 7f273f26d640 1 -- 172.21.15.47:0/697180588 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f273806c310 con 0x7f271c06b990 2024-04-14T23:35:50.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.118+0000 7f272dffb640 1 -- 172.21.15.47:0/697180588 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240045 (secure 0 0 0) 0x7f273806c310 con 0x7f271c06b990 2024-04-14T23:35:50.126 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:50.127 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-14T23:35:50.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.120+0000 7f273f26d640 1 -- 172.21.15.47:0/697180588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f271c06b990 msgr2=0x7f271c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.120+0000 7f273f26d640 1 --2- 172.21.15.47:0/697180588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f271c06b990 0x7f271c06de50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2734036000 tx=0x7f2734008030 comp rx=0 tx=0).stop 2024-04-14T23:35:50.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.120+0000 7f273f26d640 1 -- 172.21.15.47:0/697180588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27380cf050 msgr2=0x7f273815c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.120+0000 7f273f26d640 1 --2- 172.21.15.47:0/697180588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27380cf050 0x7f273815c1d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f272800c500 tx=0x7f272800c9c0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.120+0000 7f273f26d640 1 -- 172.21.15.47:0/697180588 shutdown_connections 2024-04-14T23:35:50.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.120+0000 7f273f26d640 1 --2- 172.21.15.47:0/697180588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f271c06b990 0x7f271c06de50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.120+0000 7f273f26d640 1 --2- 172.21.15.47:0/697180588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f273815e420 0x7f27380c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.120+0000 7f273f26d640 1 --2- 172.21.15.47:0/697180588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27380cf050 0x7f273815c1d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.120+0000 7f273f26d640 1 --2- 172.21.15.47:0/697180588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27380ce4b0 0x7f2738148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.120+0000 7f273f26d640 1 -- 172.21.15.47:0/697180588 >> 172.21.15.47:0/697180588 conn(0x7f27380d1c30 msgr2=0x7f27380b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:50.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.120+0000 7f273f26d640 1 -- 172.21.15.47:0/697180588 shutdown_connections 2024-04-14T23:35:50.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.120+0000 7f273f26d640 1 -- 172.21.15.47:0/697180588 wait complete. 2024-04-14T23:35:50.135 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-04-14T23:35:48.374473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237184,"kb_used_data":4320,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737536,"statfs":{"total":773094113280,"available":772851236864,"internally_reserved":0,"allocated":4423680,"data_stored":2556658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000650"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118635+0000","last_change":"2024-04-14T23:35:45.118635+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118635+0000","last_undegraded":"2024-04-14T23:35:45.118635+0000","last_fullsized":"2024-04-14T23:35:45.118635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117658+0000","last_change":"2024-04-14T23:35:45.117658+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117658+0000","last_undegraded":"2024-04-14T23:35:45.117658+0000","last_fullsized":"2024-04-14T23:35:45.117658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.120078+0000","last_change":"2024-04-14T23:35:45.120078+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.120078+0000","last_undegraded":"2024-04-14T23:35:45.120078+0000","last_fullsized":"2024-04-14T23:35:45.120078+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114466+0000","last_change":"2024-04-14T23:35:45.114466+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114466+0000","last_undegraded":"2024-04-14T23:35:45.114466+0000","last_fullsized":"2024-04-14T23:35:45.114466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117529+0000","last_change":"2024-04-14T23:35:45.117529+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117529+0000","last_undegraded":"2024-04-14T23:35:45.117529+0000","last_fullsized":"2024-04-14T23:35:45.117529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115171+0000","last_change":"2024-04-14T23:35:45.115171+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115171+0000","last_undegraded":"2024-04-14T23:35:45.115171+0000","last_fullsized":"2024-04-14T23:35:45.115171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.119750+0000","last_change":"2024-04-14T23:35:45.119750+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.119750+0000","last_undegraded":"2024-04-14T23:35:45.119750+0000","last_fullsized":"2024-04-14T23:35:45.119750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114490+0000","last_change":"2024-04-14T23:35:45.114490+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114490+0000","last_undegraded":"2024-04-14T23:35:45.114490+0000","last_fullsized":"2024-04-14T23:35:45.114490+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117164+0000","last_change":"2024-04-14T23:35:45.117164+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117164+0000","last_undegraded":"2024-04-14T23:35:45.117164+0000","last_fullsized":"2024-04-14T23:35:45.117164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117543+0000","last_change":"2024-04-14T23:35:45.117543+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117543+0000","last_undegraded":"2024-04-14T23:35:45.117543+0000","last_fullsized":"2024-04-14T23:35:45.117543+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117698+0000","last_change":"2024-04-14T23:35:45.117698+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117698+0000","last_undegraded":"2024-04-14T23:35:45.117698+0000","last_fullsized":"2024-04-14T23:35:45.117698+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.116897+0000","last_change":"2024-04-14T23:35:45.116897+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.116897+0000","last_undegraded":"2024-04-14T23:35:45.116897+0000","last_fullsized":"2024-04-14T23:35:45.116897+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.116886+0000","last_change":"2024-04-14T23:35:45.116886+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.116886+0000","last_undegraded":"2024-04-14T23:35:45.116886+0000","last_fullsized":"2024-04-14T23:35:45.116886+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.119918+0000","last_change":"2024-04-14T23:35:45.119918+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.119918+0000","last_undegraded":"2024-04-14T23:35:45.119918+0000","last_fullsized":"2024-04-14T23:35:45.119918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118036+0000","last_change":"2024-04-14T23:35:45.118036+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118036+0000","last_undegraded":"2024-04-14T23:35:45.118036+0000","last_fullsized":"2024-04-14T23:35:45.118036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.116109+0000","last_change":"2024-04-14T23:35:45.116109+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.116109+0000","last_undegraded":"2024-04-14T23:35:45.116109+0000","last_fullsized":"2024-04-14T23:35:45.116109+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118165+0000","last_change":"2024-04-14T23:35:45.118165+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118165+0000","last_undegraded":"2024-04-14T23:35:45.118165+0000","last_fullsized":"2024-04-14T23:35:45.118165+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114831+0000","last_change":"2024-04-14T23:35:45.114831+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114831+0000","last_undegraded":"2024-04-14T23:35:45.114831+0000","last_fullsized":"2024-04-14T23:35:45.114831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115473+0000","last_change":"2024-04-14T23:35:45.115473+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115473+0000","last_undegraded":"2024-04-14T23:35:45.115473+0000","last_fullsized":"2024-04-14T23:35:45.115473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.119708+0000","last_change":"2024-04-14T23:35:45.119708+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.119708+0000","last_undegraded":"2024-04-14T23:35:45.119708+0000","last_fullsized":"2024-04-14T23:35:45.119708+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115276+0000","last_change":"2024-04-14T23:35:45.115276+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115276+0000","last_undegraded":"2024-04-14T23:35:45.115276+0000","last_fullsized":"2024-04-14T23:35:45.115276+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115238+0000","last_change":"2024-04-14T23:35:45.115238+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115238+0000","last_undegraded":"2024-04-14T23:35:45.115238+0000","last_fullsized":"2024-04-14T23:35:45.115238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115200+0000","last_change":"2024-04-14T23:35:45.115200+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115200+0000","last_undegraded":"2024-04-14T23:35:45.115200+0000","last_fullsized":"2024-04-14T23:35:45.115200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115232+0000","last_change":"2024-04-14T23:35:45.115232+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115232+0000","last_undegraded":"2024-04-14T23:35:45.115232+0000","last_fullsized":"2024-04-14T23:35:45.115232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117570+0000","last_change":"2024-04-14T23:35:45.117570+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117570+0000","last_undegraded":"2024-04-14T23:35:45.117570+0000","last_fullsized":"2024-04-14T23:35:45.117570+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115190+0000","last_change":"2024-04-14T23:35:45.115190+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115190+0000","last_undegraded":"2024-04-14T23:35:45.115190+0000","last_fullsized":"2024-04-14T23:35:45.115190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117217+0000","last_change":"2024-04-14T23:35:45.117217+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117217+0000","last_undegraded":"2024-04-14T23:35:45.117217+0000","last_fullsized":"2024-04-14T23:35:45.117217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118099+0000","last_change":"2024-04-14T23:35:45.118099+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118099+0000","last_undegraded":"2024-04-14T23:35:45.118099+0000","last_fullsized":"2024-04-14T23:35:45.118099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118170+0000","last_change":"2024-04-14T23:35:45.118170+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118170+0000","last_undegraded":"2024-04-14T23:35:45.118170+0000","last_fullsized":"2024-04-14T23:35:45.118170+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114466+0000","last_change":"2024-04-14T23:35:45.114466+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114466+0000","last_undegraded":"2024-04-14T23:35:45.114466+0000","last_fullsized":"2024-04-14T23:35:45.114466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117034+0000","last_change":"2024-04-14T23:35:45.117034+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117034+0000","last_undegraded":"2024-04-14T23:35:45.117034+0000","last_fullsized":"2024-04-14T23:35:45.117034+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114634+0000","last_change":"2024-04-14T23:35:45.114634+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114634+0000","last_undegraded":"2024-04-14T23:35:45.114634+0000","last_fullsized":"2024-04-14T23:35:45.114634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-14T23:35:45.116498+0000","last_change":"2024-04-14T23:34:27.438796+0000","last_active":"2024-04-14T23:35:45.116498+0000","last_peered":"2024-04-14T23:35:45.116498+0000","last_clean":"2024-04-14T23:35:45.116498+0000","last_became_active":"2024-04-14T23:34:27.437932+0000","last_became_peered":"2024-04-14T23:34:27.437932+0000","last_unstale":"2024-04-14T23:35:45.116498+0000","last_undegraded":"2024-04-14T23:35:45.116498+0000","last_fullsized":"2024-04-14T23:35:45.116498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_clean_scrub_stamp":"2024-04-14T23:34:26.390323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:11:13.484245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":760806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":176647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":413696,"data_stored":176647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":995328,"data_stored":760806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T23:35:50.139 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T23:35:50.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.273+0000 7f421ae88640 1 Processor -- start 2024-04-14T23:35:50.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.273+0000 7f421ae88640 1 -- start start 2024-04-14T23:35:50.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.274+0000 7f421ae88640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f421415e420 0x7f42140d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.274+0000 7f421ae88640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42140cf050 0x7f42140cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.274+0000 7f421ae88640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42140d1040 con 0x7f42140ce4b0 2024-04-14T23:35:50.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.274+0000 7f421ae88640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f42140cc280 con 0x7f421415e420 2024-04-14T23:35:50.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.274+0000 7f421ae88640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f421406d750 con 0x7f42140cf050 2024-04-14T23:35:50.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.274+0000 7f4218c24640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f421415e420 0x7f42140d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.274+0000 7f4213fff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f42140ce4b0 0x7f42140ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:53878/0 (socket says 172.21.15.47:53878) 2024-04-14T23:35:50.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.274+0000 7f4213fff640 1 -- 172.21.15.47:0/2824483413 learned_addr learned my addr 172.21.15.47:0/2824483413 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:50.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.274+0000 7f4219425640 1 --2- 172.21.15.47:0/2824483413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42140cf050 0x7f42140cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.274+0000 7f4218c24640 1 -- 172.21.15.47:0/2824483413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42140cf050 msgr2=0x7f42140cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:50.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.274+0000 7f4218c24640 1 --2- 172.21.15.47:0/2824483413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42140cf050 0x7f42140cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.274+0000 7f4218c24640 1 -- 172.21.15.47:0/2824483413 >> v1:172.21.15.47:6789/0 conn(0x7f42140ce4b0 legacy=0x7f42140ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.274+0000 7f4218c24640 1 -- 172.21.15.47:0/2824483413 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42140d1320 con 0x7f421415e420 2024-04-14T23:35:50.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.275+0000 7f4218c24640 1 --2- 172.21.15.47:0/2824483413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f421415e420 0x7f42140d0980 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f420c0097a0 tx=0x7f420c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b8e2ea9990f4c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:50.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.275+0000 7f42137fe640 1 -- 172.21.15.47:0/2824483413 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c034070 con 0x7f421415e420 2024-04-14T23:35:50.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.275+0000 7f42137fe640 1 -- 172.21.15.47:0/2824483413 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f420c030610 con 0x7f421415e420 2024-04-14T23:35:50.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.275+0000 7f42137fe640 1 -- 172.21.15.47:0/2824483413 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c0309e0 con 0x7f421415e420 2024-04-14T23:35:50.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.276+0000 7f421ae88640 1 -- 172.21.15.47:0/2824483413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f421415e420 msgr2=0x7f42140d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.276+0000 7f421ae88640 1 --2- 172.21.15.47:0/2824483413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f421415e420 0x7f42140d0980 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f420c0097a0 tx=0x7f420c02b960 comp rx=0 tx=0).stop 2024-04-14T23:35:50.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.276+0000 7f421ae88640 1 -- 172.21.15.47:0/2824483413 shutdown_connections 2024-04-14T23:35:50.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.276+0000 7f421ae88640 1 --2- 172.21.15.47:0/2824483413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42140cf050 0x7f42140cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.276+0000 7f421ae88640 1 --2- 172.21.15.47:0/2824483413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f421415e420 0x7f42140d0980 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.276+0000 7f421ae88640 1 -- 172.21.15.47:0/2824483413 >> 172.21.15.47:0/2824483413 conn(0x7f42140d1c30 msgr2=0x7f42140d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.276+0000 7f421ae88640 1 -- 172.21.15.47:0/2824483413 shutdown_connections 2024-04-14T23:35:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.276+0000 7f421ae88640 1 -- 172.21.15.47:0/2824483413 wait complete. 2024-04-14T23:35:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.277+0000 7f421ae88640 1 Processor -- start 2024-04-14T23:35:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.277+0000 7f421ae88640 1 -- start start 2024-04-14T23:35:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f421ae88640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42140ce4b0 0x7f42140b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f421ae88640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42140cf050 0x7f4214159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f421ae88640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f421415e420 0x7f42141604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f421ae88640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f421415e800 con 0x7f42140cf050 2024-04-14T23:35:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f421ae88640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f42140cc7b0 con 0x7f421415e420 2024-04-14T23:35:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f421ae88640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f42140cd210 con 0x7f42140ce4b0 2024-04-14T23:35:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f4213fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42140cf050 0x7f4214159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f4213fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42140cf050 0x7f4214159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52558/0 (socket says 172.21.15.47:52558) 2024-04-14T23:35:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f4213fff640 1 -- 172.21.15.47:0/3727854646 learned_addr learned my addr 172.21.15.47:0/3727854646 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f4218c24640 1 --2- 172.21.15.47:0/3727854646 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42140ce4b0 0x7f42140b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f4219425640 1 --2- 172.21.15.47:0/3727854646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f421415e420 0x7f42141604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f4213fff640 1 -- 172.21.15.47:0/3727854646 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42140ce4b0 msgr2=0x7f42140b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f4213fff640 1 --2- 172.21.15.47:0/3727854646 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42140ce4b0 0x7f42140b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f4213fff640 1 -- 172.21.15.47:0/3727854646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f421415e420 msgr2=0x7f42141604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f4213fff640 1 --2- 172.21.15.47:0/3727854646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f421415e420 0x7f42141604d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f4213fff640 1 -- 172.21.15.47:0/3727854646 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421406fa50 con 0x7f42140cf050 2024-04-14T23:35:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.278+0000 7f4219425640 1 --2- 172.21.15.47:0/3727854646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f421415e420 0x7f42141604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.279+0000 7f4213fff640 1 --2- 172.21.15.47:0/3727854646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42140cf050 0x7f4214159d00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f420400cb10 tx=0x7f420400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.279+0000 7f42117fa640 1 -- 172.21.15.47:0/3727854646 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4204017070 con 0x7f42140cf050 2024-04-14T23:35:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.279+0000 7f42117fa640 1 -- 172.21.15.47:0/3727854646 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f420400ac70 con 0x7f42140cf050 2024-04-14T23:35:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.279+0000 7f421ae88640 1 -- 172.21.15.47:0/3727854646 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f421406fd30 con 0x7f42140cf050 2024-04-14T23:35:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.279+0000 7f42117fa640 1 -- 172.21.15.47:0/3727854646 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4204012620 con 0x7f42140cf050 2024-04-14T23:35:50.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.279+0000 7f421ae88640 1 -- 172.21.15.47:0/3727854646 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42140ca0d0 con 0x7f42140cf050 2024-04-14T23:35:50.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.280+0000 7f421ae88640 1 -- 172.21.15.47:0/3727854646 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f421415aca0 con 0x7f42140cf050 2024-04-14T23:35:50.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.280+0000 7f42117fa640 1 -- 172.21.15.47:0/3727854646 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f420401a070 con 0x7f42140cf050 2024-04-14T23:35:50.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.281+0000 7f42117fa640 1 --2- 172.21.15.47:0/3727854646 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f41f406b990 0x7f41f406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.281+0000 7f42117fa640 1 -- 172.21.15.47:0/3727854646 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f420408a720 con 0x7f42140cf050 2024-04-14T23:35:50.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.281+0000 7f4218c24640 1 --2- 172.21.15.47:0/3727854646 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f41f406b990 0x7f41f406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.281+0000 7f4218c24640 1 --2- 172.21.15.47:0/3727854646 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f41f406b990 0x7f41f406de50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f420c036000 tx=0x7f420c03b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:50.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.285+0000 7f42117fa640 1 -- 172.21.15.47:0/3727854646 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4204058b50 con 0x7f42140cf050 2024-04-14T23:35:50.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.463+0000 7f421ae88640 1 -- 172.21.15.47:0/3727854646 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42140b31a0 con 0x7f41f406b990 2024-04-14T23:35:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.469+0000 7f42117fa640 1 -- 172.21.15.47:0/3727854646 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240045 (secure 0 0 0) 0x7f42140b31a0 con 0x7f41f406b990 2024-04-14T23:35:50.475 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:50.476 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-14T23:35:50.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.472+0000 7f421ae88640 1 -- 172.21.15.47:0/3727854646 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f41f406b990 msgr2=0x7f41f406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.472+0000 7f421ae88640 1 --2- 172.21.15.47:0/3727854646 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f41f406b990 0x7f41f406de50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f420c036000 tx=0x7f420c03b040 comp rx=0 tx=0).stop 2024-04-14T23:35:50.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.472+0000 7f421ae88640 1 -- 172.21.15.47:0/3727854646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42140cf050 msgr2=0x7f4214159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.472+0000 7f421ae88640 1 --2- 172.21.15.47:0/3727854646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42140cf050 0x7f4214159d00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f420400cb10 tx=0x7f420400a060 comp rx=0 tx=0).stop 2024-04-14T23:35:50.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.472+0000 7f421ae88640 1 -- 172.21.15.47:0/3727854646 shutdown_connections 2024-04-14T23:35:50.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.472+0000 7f421ae88640 1 --2- 172.21.15.47:0/3727854646 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f41f406b990 0x7f41f406de50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.472+0000 7f421ae88640 1 --2- 172.21.15.47:0/3727854646 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f421415e420 0x7f42141604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.472+0000 7f421ae88640 1 --2- 172.21.15.47:0/3727854646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42140cf050 0x7f4214159d00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.472+0000 7f421ae88640 1 --2- 172.21.15.47:0/3727854646 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42140ce4b0 0x7f42140b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.472+0000 7f421ae88640 1 -- 172.21.15.47:0/3727854646 >> 172.21.15.47:0/3727854646 conn(0x7f42140d1c30 msgr2=0x7f42140d2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:50.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.472+0000 7f421ae88640 1 -- 172.21.15.47:0/3727854646 shutdown_connections 2024-04-14T23:35:50.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.472+0000 7f421ae88640 1 -- 172.21.15.47:0/3727854646 wait complete. 2024-04-14T23:35:50.486 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-04-14T23:35:50.374791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237184,"kb_used_data":4320,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737536,"statfs":{"total":773094113280,"available":772851236864,"internally_reserved":0,"allocated":4423680,"data_stored":2556658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.262125"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118635+0000","last_change":"2024-04-14T23:35:45.118635+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118635+0000","last_undegraded":"2024-04-14T23:35:45.118635+0000","last_fullsized":"2024-04-14T23:35:45.118635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117658+0000","last_change":"2024-04-14T23:35:45.117658+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117658+0000","last_undegraded":"2024-04-14T23:35:45.117658+0000","last_fullsized":"2024-04-14T23:35:45.117658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.120078+0000","last_change":"2024-04-14T23:35:45.120078+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.120078+0000","last_undegraded":"2024-04-14T23:35:45.120078+0000","last_fullsized":"2024-04-14T23:35:45.120078+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114466+0000","last_change":"2024-04-14T23:35:45.114466+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114466+0000","last_undegraded":"2024-04-14T23:35:45.114466+0000","last_fullsized":"2024-04-14T23:35:45.114466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117529+0000","last_change":"2024-04-14T23:35:45.117529+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117529+0000","last_undegraded":"2024-04-14T23:35:45.117529+0000","last_fullsized":"2024-04-14T23:35:45.117529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115171+0000","last_change":"2024-04-14T23:35:45.115171+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115171+0000","last_undegraded":"2024-04-14T23:35:45.115171+0000","last_fullsized":"2024-04-14T23:35:45.115171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.119750+0000","last_change":"2024-04-14T23:35:45.119750+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.119750+0000","last_undegraded":"2024-04-14T23:35:45.119750+0000","last_fullsized":"2024-04-14T23:35:45.119750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114490+0000","last_change":"2024-04-14T23:35:45.114490+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114490+0000","last_undegraded":"2024-04-14T23:35:45.114490+0000","last_fullsized":"2024-04-14T23:35:45.114490+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117164+0000","last_change":"2024-04-14T23:35:45.117164+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117164+0000","last_undegraded":"2024-04-14T23:35:45.117164+0000","last_fullsized":"2024-04-14T23:35:45.117164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117543+0000","last_change":"2024-04-14T23:35:45.117543+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117543+0000","last_undegraded":"2024-04-14T23:35:45.117543+0000","last_fullsized":"2024-04-14T23:35:45.117543+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117698+0000","last_change":"2024-04-14T23:35:45.117698+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117698+0000","last_undegraded":"2024-04-14T23:35:45.117698+0000","last_fullsized":"2024-04-14T23:35:45.117698+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.116897+0000","last_change":"2024-04-14T23:35:45.116897+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.116897+0000","last_undegraded":"2024-04-14T23:35:45.116897+0000","last_fullsized":"2024-04-14T23:35:45.116897+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.116886+0000","last_change":"2024-04-14T23:35:45.116886+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.116886+0000","last_undegraded":"2024-04-14T23:35:45.116886+0000","last_fullsized":"2024-04-14T23:35:45.116886+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.119918+0000","last_change":"2024-04-14T23:35:45.119918+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.119918+0000","last_undegraded":"2024-04-14T23:35:45.119918+0000","last_fullsized":"2024-04-14T23:35:45.119918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118036+0000","last_change":"2024-04-14T23:35:45.118036+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118036+0000","last_undegraded":"2024-04-14T23:35:45.118036+0000","last_fullsized":"2024-04-14T23:35:45.118036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.116109+0000","last_change":"2024-04-14T23:35:45.116109+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.116109+0000","last_undegraded":"2024-04-14T23:35:45.116109+0000","last_fullsized":"2024-04-14T23:35:45.116109+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118165+0000","last_change":"2024-04-14T23:35:45.118165+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118165+0000","last_undegraded":"2024-04-14T23:35:45.118165+0000","last_fullsized":"2024-04-14T23:35:45.118165+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114831+0000","last_change":"2024-04-14T23:35:45.114831+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114831+0000","last_undegraded":"2024-04-14T23:35:45.114831+0000","last_fullsized":"2024-04-14T23:35:45.114831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115473+0000","last_change":"2024-04-14T23:35:45.115473+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115473+0000","last_undegraded":"2024-04-14T23:35:45.115473+0000","last_fullsized":"2024-04-14T23:35:45.115473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.119708+0000","last_change":"2024-04-14T23:35:45.119708+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.119708+0000","last_undegraded":"2024-04-14T23:35:45.119708+0000","last_fullsized":"2024-04-14T23:35:45.119708+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115276+0000","last_change":"2024-04-14T23:35:45.115276+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115276+0000","last_undegraded":"2024-04-14T23:35:45.115276+0000","last_fullsized":"2024-04-14T23:35:45.115276+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115238+0000","last_change":"2024-04-14T23:35:45.115238+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115238+0000","last_undegraded":"2024-04-14T23:35:45.115238+0000","last_fullsized":"2024-04-14T23:35:45.115238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115200+0000","last_change":"2024-04-14T23:35:45.115200+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115200+0000","last_undegraded":"2024-04-14T23:35:45.115200+0000","last_fullsized":"2024-04-14T23:35:45.115200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115232+0000","last_change":"2024-04-14T23:35:45.115232+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115232+0000","last_undegraded":"2024-04-14T23:35:45.115232+0000","last_fullsized":"2024-04-14T23:35:45.115232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117570+0000","last_change":"2024-04-14T23:35:45.117570+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117570+0000","last_undegraded":"2024-04-14T23:35:45.117570+0000","last_fullsized":"2024-04-14T23:35:45.117570+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115190+0000","last_change":"2024-04-14T23:35:45.115190+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115190+0000","last_undegraded":"2024-04-14T23:35:45.115190+0000","last_fullsized":"2024-04-14T23:35:45.115190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117217+0000","last_change":"2024-04-14T23:35:45.117217+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117217+0000","last_undegraded":"2024-04-14T23:35:45.117217+0000","last_fullsized":"2024-04-14T23:35:45.117217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118099+0000","last_change":"2024-04-14T23:35:45.118099+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118099+0000","last_undegraded":"2024-04-14T23:35:45.118099+0000","last_fullsized":"2024-04-14T23:35:45.118099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118170+0000","last_change":"2024-04-14T23:35:45.118170+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118170+0000","last_undegraded":"2024-04-14T23:35:45.118170+0000","last_fullsized":"2024-04-14T23:35:45.118170+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114466+0000","last_change":"2024-04-14T23:35:45.114466+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114466+0000","last_undegraded":"2024-04-14T23:35:45.114466+0000","last_fullsized":"2024-04-14T23:35:45.114466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117034+0000","last_change":"2024-04-14T23:35:45.117034+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117034+0000","last_undegraded":"2024-04-14T23:35:45.117034+0000","last_fullsized":"2024-04-14T23:35:45.117034+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114634+0000","last_change":"2024-04-14T23:35:45.114634+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114634+0000","last_undegraded":"2024-04-14T23:35:45.114634+0000","last_fullsized":"2024-04-14T23:35:45.114634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-14T23:35:45.116498+0000","last_change":"2024-04-14T23:34:27.438796+0000","last_active":"2024-04-14T23:35:45.116498+0000","last_peered":"2024-04-14T23:35:45.116498+0000","last_clean":"2024-04-14T23:35:45.116498+0000","last_became_active":"2024-04-14T23:34:27.437932+0000","last_became_peered":"2024-04-14T23:34:27.437932+0000","last_unstale":"2024-04-14T23:35:45.116498+0000","last_undegraded":"2024-04-14T23:35:45.116498+0000","last_fullsized":"2024-04-14T23:35:45.116498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_clean_scrub_stamp":"2024-04-14T23:34:26.390323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:11:13.484245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":760806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":176647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":413696,"data_stored":176647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":995328,"data_stored":760806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T23:35:50.489 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T23:35:50.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.625+0000 7f48ecb99640 1 Processor -- start 2024-04-14T23:35:50.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.625+0000 7f48ecb99640 1 -- start start 2024-04-14T23:35:50.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.626+0000 7f48ecb99640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f48e80ceab0 0x7f48e8071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.626+0000 7f48ecb99640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f48e80d16d0 0x7f48e8072390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.626+0000 7f48ecb99640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48e815e9a0 con 0x7f48e80cca50 2024-04-14T23:35:50.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.626+0000 7f48ecb99640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f48e815f5b0 con 0x7f48e80d16d0 2024-04-14T23:35:50.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.626+0000 7f48ecb99640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f48e815ec80 con 0x7f48e80ceab0 2024-04-14T23:35:50.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.626+0000 7f48e6d9d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f48e80d16d0 0x7f48e8072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.626+0000 7f48e659c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f48e80cca50 0x7f48e80cce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:53890/0 (socket says 172.21.15.47:53890) 2024-04-14T23:35:50.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.626+0000 7f48e6d9d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f48e80d16d0 0x7f48e8072390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52568/0 (socket says 172.21.15.47:52568) 2024-04-14T23:35:50.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.626+0000 7f48e659c640 1 -- 172.21.15.47:0/1433935336 learned_addr learned my addr 172.21.15.47:0/1433935336 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:50.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.626+0000 7f48dffff640 1 --2- 172.21.15.47:0/1433935336 >> v2:172.21.15.191:3300/0 conn(0x7f48e80ceab0 0x7f48e8071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.626+0000 7f48e6d9d640 1 -- 172.21.15.47:0/1433935336 >> v2:172.21.15.191:3300/0 conn(0x7f48e80ceab0 msgr2=0x7f48e8071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:50.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.626+0000 7f48e6d9d640 1 --2- 172.21.15.47:0/1433935336 >> v2:172.21.15.191:3300/0 conn(0x7f48e80ceab0 0x7f48e8071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.626+0000 7f48e6d9d640 1 -- 172.21.15.47:0/1433935336 >> v1:172.21.15.47:6789/0 conn(0x7f48e80cca50 legacy=0x7f48e80cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.626+0000 7f48e5d9b640 1 -- 172.21.15.47:0/1433935336 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2843820310 0 0) 0x7f48e815e9a0 con 0x7f48e80cca50 2024-04-14T23:35:50.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.626+0000 7f48e6d9d640 1 -- 172.21.15.47:0/1433935336 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e815ef60 con 0x7f48e80d16d0 2024-04-14T23:35:50.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.627+0000 7f48e6d9d640 1 --2- 172.21.15.47:0/1433935336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e80d16d0 0x7f48e8072390 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f48e8073e60 tx=0x7f48e002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7817179907c1e0a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:50.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.627+0000 7f48e5d9b640 1 -- 172.21.15.47:0/1433935336 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0039070 con 0x7f48e80d16d0 2024-04-14T23:35:50.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.627+0000 7f48e5d9b640 1 -- 172.21.15.47:0/1433935336 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e002cb60 con 0x7f48e80d16d0 2024-04-14T23:35:50.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.627+0000 7f48e5d9b640 1 -- 172.21.15.47:0/1433935336 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0034440 con 0x7f48e80d16d0 2024-04-14T23:35:50.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.627+0000 7f48ecb99640 1 -- 172.21.15.47:0/1433935336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e80d16d0 msgr2=0x7f48e8072390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.627+0000 7f48ecb99640 1 --2- 172.21.15.47:0/1433935336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e80d16d0 0x7f48e8072390 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f48e8073e60 tx=0x7f48e002bdb0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.628+0000 7f48ecb99640 1 -- 172.21.15.47:0/1433935336 shutdown_connections 2024-04-14T23:35:50.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.628+0000 7f48ecb99640 1 --2- 172.21.15.47:0/1433935336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e80d16d0 0x7f48e8072390 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.628+0000 7f48ecb99640 1 --2- 172.21.15.47:0/1433935336 >> v2:172.21.15.191:3300/0 conn(0x7f48e80ceab0 0x7f48e8071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.628+0000 7f48ecb99640 1 -- 172.21.15.47:0/1433935336 >> 172.21.15.47:0/1433935336 conn(0x7f48e80d0bb0 msgr2=0x7f48e80d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.628+0000 7f48ecb99640 1 -- 172.21.15.47:0/1433935336 shutdown_connections 2024-04-14T23:35:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.628+0000 7f48ecb99640 1 -- 172.21.15.47:0/1433935336 wait complete. 2024-04-14T23:35:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.629+0000 7f48ecb99640 1 Processor -- start 2024-04-14T23:35:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.629+0000 7f48ecb99640 1 -- start start 2024-04-14T23:35:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48ecb99640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48e80cca50 0x7f48e80b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48ecb99640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48e80ceab0 0x7f48e80c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48ecb99640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e80d16d0 0x7f48e81576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48ecb99640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f48e80cb3c0 con 0x7f48e80d16d0 2024-04-14T23:35:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48ecb99640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f48e815e660 con 0x7f48e80cca50 2024-04-14T23:35:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48ecb99640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f48e80cb540 con 0x7f48e80ceab0 2024-04-14T23:35:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48e6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e80d16d0 0x7f48e81576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48e6d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e80d16d0 0x7f48e81576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52582/0 (socket says 172.21.15.47:52582) 2024-04-14T23:35:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48e6d9d640 1 -- 172.21.15.47:0/559931181 learned_addr learned my addr 172.21.15.47:0/559931181 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48e659c640 1 --2- 172.21.15.47:0/559931181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48e80cca50 0x7f48e80b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48dffff640 1 --2- 172.21.15.47:0/559931181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48e80ceab0 0x7f48e80c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48e6d9d640 1 -- 172.21.15.47:0/559931181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48e80ceab0 msgr2=0x7f48e80c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48e6d9d640 1 --2- 172.21.15.47:0/559931181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48e80ceab0 0x7f48e80c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48e6d9d640 1 -- 172.21.15.47:0/559931181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48e80cca50 msgr2=0x7f48e80b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48e6d9d640 1 --2- 172.21.15.47:0/559931181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48e80cca50 0x7f48e80b3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48e6d9d640 1 -- 172.21.15.47:0/559931181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e8158140 con 0x7f48e80d16d0 2024-04-14T23:35:50.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48dffff640 1 --2- 172.21.15.47:0/559931181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48e80ceab0 0x7f48e80c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:50.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48e6d9d640 1 --2- 172.21.15.47:0/559931181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e80d16d0 0x7f48e81576f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f48e0009e80 tx=0x7f48e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:50.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48deffd640 1 -- 172.21.15.47:0/559931181 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0039050 con 0x7f48e80d16d0 2024-04-14T23:35:50.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48deffd640 1 -- 172.21.15.47:0/559931181 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e003a040 con 0x7f48e80d16d0 2024-04-14T23:35:50.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48ecb99640 1 -- 172.21.15.47:0/559931181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48e8157c30 con 0x7f48e80d16d0 2024-04-14T23:35:50.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48deffd640 1 -- 172.21.15.47:0/559931181 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e003e610 con 0x7f48e80d16d0 2024-04-14T23:35:50.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.630+0000 7f48ecb99640 1 -- 172.21.15.47:0/559931181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48e80b13a0 con 0x7f48e80d16d0 2024-04-14T23:35:50.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.631+0000 7f48ecb99640 1 -- 172.21.15.47:0/559931181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48e8075430 con 0x7f48e80d16d0 2024-04-14T23:35:50.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.632+0000 7f48deffd640 1 -- 172.21.15.47:0/559931181 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f48e0047020 con 0x7f48e80d16d0 2024-04-14T23:35:50.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.632+0000 7f48deffd640 1 --2- 172.21.15.47:0/559931181 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f48c806b9c0 0x7f48c806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.632+0000 7f48deffd640 1 -- 172.21.15.47:0/559931181 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f48e00acd20 con 0x7f48e80d16d0 2024-04-14T23:35:50.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.632+0000 7f48e659c640 1 --2- 172.21.15.47:0/559931181 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f48c806b9c0 0x7f48c806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.633+0000 7f48e659c640 1 --2- 172.21.15.47:0/559931181 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f48c806b9c0 0x7f48c806de80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f48d8000f60 tx=0x7f48d8007b70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:50.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.636+0000 7f48deffd640 1 -- 172.21.15.47:0/559931181 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f48e004e020 con 0x7f48e80d16d0 2024-04-14T23:35:50.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.815+0000 7f48ecb99640 1 -- 172.21.15.47:0/559931181 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f48e80b6b30 con 0x7f48c806b9c0 2024-04-14T23:35:50.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.821+0000 7f48deffd640 1 -- 172.21.15.47:0/559931181 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240045 (secure 0 0 0) 0x7f48e80b6b30 con 0x7f48c806b9c0 2024-04-14T23:35:50.826 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:50.827 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-14T23:35:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.823+0000 7f48ecb99640 1 -- 172.21.15.47:0/559931181 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f48c806b9c0 msgr2=0x7f48c806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.823+0000 7f48ecb99640 1 --2- 172.21.15.47:0/559931181 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f48c806b9c0 0x7f48c806de80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f48d8000f60 tx=0x7f48d8007b70 comp rx=0 tx=0).stop 2024-04-14T23:35:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.823+0000 7f48ecb99640 1 -- 172.21.15.47:0/559931181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e80d16d0 msgr2=0x7f48e81576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.823+0000 7f48ecb99640 1 --2- 172.21.15.47:0/559931181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e80d16d0 0x7f48e81576f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f48e0009e80 tx=0x7f48e0004a40 comp rx=0 tx=0).stop 2024-04-14T23:35:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.823+0000 7f48ecb99640 1 -- 172.21.15.47:0/559931181 shutdown_connections 2024-04-14T23:35:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.824+0000 7f48ecb99640 1 --2- 172.21.15.47:0/559931181 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f48c806b9c0 0x7f48c806de80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.824+0000 7f48ecb99640 1 --2- 172.21.15.47:0/559931181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e80d16d0 0x7f48e81576f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.824+0000 7f48ecb99640 1 --2- 172.21.15.47:0/559931181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48e80ceab0 0x7f48e80c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.824+0000 7f48ecb99640 1 --2- 172.21.15.47:0/559931181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48e80cca50 0x7f48e80b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.824+0000 7f48ecb99640 1 -- 172.21.15.47:0/559931181 >> 172.21.15.47:0/559931181 conn(0x7f48e80d0bb0 msgr2=0x7f48e80a1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.824+0000 7f48ecb99640 1 -- 172.21.15.47:0/559931181 shutdown_connections 2024-04-14T23:35:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.824+0000 7f48ecb99640 1 -- 172.21.15.47:0/559931181 wait complete. 2024-04-14T23:35:50.837 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-04-14T23:35:50.374791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237184,"kb_used_data":4320,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737536,"statfs":{"total":773094113280,"available":772851236864,"internally_reserved":0,"allocated":4423680,"data_stored":2556658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.262125"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118635+0000","last_change":"2024-04-14T23:35:45.118635+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118635+0000","last_undegraded":"2024-04-14T23:35:45.118635+0000","last_fullsized":"2024-04-14T23:35:45.118635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117658+0000","last_change":"2024-04-14T23:35:45.117658+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117658+0000","last_undegraded":"2024-04-14T23:35:45.117658+0000","last_fullsized":"2024-04-14T23:35:45.117658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.120078+0000","last_change":"2024-04-14T23:35:45.120078+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.120078+0000","last_undegraded":"2024-04-14T23:35:45.120078+0000","last_fullsized":"2024-04-14T23:35:45.120078+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114466+0000","last_change":"2024-04-14T23:35:45.114466+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114466+0000","last_undegraded":"2024-04-14T23:35:45.114466+0000","last_fullsized":"2024-04-14T23:35:45.114466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117529+0000","last_change":"2024-04-14T23:35:45.117529+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117529+0000","last_undegraded":"2024-04-14T23:35:45.117529+0000","last_fullsized":"2024-04-14T23:35:45.117529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115171+0000","last_change":"2024-04-14T23:35:45.115171+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115171+0000","last_undegraded":"2024-04-14T23:35:45.115171+0000","last_fullsized":"2024-04-14T23:35:45.115171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.119750+0000","last_change":"2024-04-14T23:35:45.119750+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.119750+0000","last_undegraded":"2024-04-14T23:35:45.119750+0000","last_fullsized":"2024-04-14T23:35:45.119750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114490+0000","last_change":"2024-04-14T23:35:45.114490+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114490+0000","last_undegraded":"2024-04-14T23:35:45.114490+0000","last_fullsized":"2024-04-14T23:35:45.114490+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117164+0000","last_change":"2024-04-14T23:35:45.117164+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117164+0000","last_undegraded":"2024-04-14T23:35:45.117164+0000","last_fullsized":"2024-04-14T23:35:45.117164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117543+0000","last_change":"2024-04-14T23:35:45.117543+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117543+0000","last_undegraded":"2024-04-14T23:35:45.117543+0000","last_fullsized":"2024-04-14T23:35:45.117543+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117698+0000","last_change":"2024-04-14T23:35:45.117698+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117698+0000","last_undegraded":"2024-04-14T23:35:45.117698+0000","last_fullsized":"2024-04-14T23:35:45.117698+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.116897+0000","last_change":"2024-04-14T23:35:45.116897+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.116897+0000","last_undegraded":"2024-04-14T23:35:45.116897+0000","last_fullsized":"2024-04-14T23:35:45.116897+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.116886+0000","last_change":"2024-04-14T23:35:45.116886+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.116886+0000","last_undegraded":"2024-04-14T23:35:45.116886+0000","last_fullsized":"2024-04-14T23:35:45.116886+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.119918+0000","last_change":"2024-04-14T23:35:45.119918+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.119918+0000","last_undegraded":"2024-04-14T23:35:45.119918+0000","last_fullsized":"2024-04-14T23:35:45.119918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118036+0000","last_change":"2024-04-14T23:35:45.118036+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118036+0000","last_undegraded":"2024-04-14T23:35:45.118036+0000","last_fullsized":"2024-04-14T23:35:45.118036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.116109+0000","last_change":"2024-04-14T23:35:45.116109+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.116109+0000","last_undegraded":"2024-04-14T23:35:45.116109+0000","last_fullsized":"2024-04-14T23:35:45.116109+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118165+0000","last_change":"2024-04-14T23:35:45.118165+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118165+0000","last_undegraded":"2024-04-14T23:35:45.118165+0000","last_fullsized":"2024-04-14T23:35:45.118165+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114831+0000","last_change":"2024-04-14T23:35:45.114831+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114831+0000","last_undegraded":"2024-04-14T23:35:45.114831+0000","last_fullsized":"2024-04-14T23:35:45.114831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115473+0000","last_change":"2024-04-14T23:35:45.115473+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115473+0000","last_undegraded":"2024-04-14T23:35:45.115473+0000","last_fullsized":"2024-04-14T23:35:45.115473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.119708+0000","last_change":"2024-04-14T23:35:45.119708+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.119708+0000","last_undegraded":"2024-04-14T23:35:45.119708+0000","last_fullsized":"2024-04-14T23:35:45.119708+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115276+0000","last_change":"2024-04-14T23:35:45.115276+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115276+0000","last_undegraded":"2024-04-14T23:35:45.115276+0000","last_fullsized":"2024-04-14T23:35:45.115276+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115238+0000","last_change":"2024-04-14T23:35:45.115238+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115238+0000","last_undegraded":"2024-04-14T23:35:45.115238+0000","last_fullsized":"2024-04-14T23:35:45.115238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115200+0000","last_change":"2024-04-14T23:35:45.115200+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115200+0000","last_undegraded":"2024-04-14T23:35:45.115200+0000","last_fullsized":"2024-04-14T23:35:45.115200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115232+0000","last_change":"2024-04-14T23:35:45.115232+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115232+0000","last_undegraded":"2024-04-14T23:35:45.115232+0000","last_fullsized":"2024-04-14T23:35:45.115232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117570+0000","last_change":"2024-04-14T23:35:45.117570+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117570+0000","last_undegraded":"2024-04-14T23:35:45.117570+0000","last_fullsized":"2024-04-14T23:35:45.117570+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115190+0000","last_change":"2024-04-14T23:35:45.115190+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115190+0000","last_undegraded":"2024-04-14T23:35:45.115190+0000","last_fullsized":"2024-04-14T23:35:45.115190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117217+0000","last_change":"2024-04-14T23:35:45.117217+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117217+0000","last_undegraded":"2024-04-14T23:35:45.117217+0000","last_fullsized":"2024-04-14T23:35:45.117217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118099+0000","last_change":"2024-04-14T23:35:45.118099+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118099+0000","last_undegraded":"2024-04-14T23:35:45.118099+0000","last_fullsized":"2024-04-14T23:35:45.118099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118170+0000","last_change":"2024-04-14T23:35:45.118170+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118170+0000","last_undegraded":"2024-04-14T23:35:45.118170+0000","last_fullsized":"2024-04-14T23:35:45.118170+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114466+0000","last_change":"2024-04-14T23:35:45.114466+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114466+0000","last_undegraded":"2024-04-14T23:35:45.114466+0000","last_fullsized":"2024-04-14T23:35:45.114466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117034+0000","last_change":"2024-04-14T23:35:45.117034+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117034+0000","last_undegraded":"2024-04-14T23:35:45.117034+0000","last_fullsized":"2024-04-14T23:35:45.117034+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114634+0000","last_change":"2024-04-14T23:35:45.114634+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114634+0000","last_undegraded":"2024-04-14T23:35:45.114634+0000","last_fullsized":"2024-04-14T23:35:45.114634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-14T23:35:45.116498+0000","last_change":"2024-04-14T23:34:27.438796+0000","last_active":"2024-04-14T23:35:45.116498+0000","last_peered":"2024-04-14T23:35:45.116498+0000","last_clean":"2024-04-14T23:35:45.116498+0000","last_became_active":"2024-04-14T23:34:27.437932+0000","last_became_peered":"2024-04-14T23:34:27.437932+0000","last_unstale":"2024-04-14T23:35:45.116498+0000","last_undegraded":"2024-04-14T23:35:45.116498+0000","last_fullsized":"2024-04-14T23:35:45.116498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_clean_scrub_stamp":"2024-04-14T23:34:26.390323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:11:13.484245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":760806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":176647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":413696,"data_stored":176647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":995328,"data_stored":760806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T23:35:50.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2024-04-14T23:35:50.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2024-04-14T23:35:50.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2024-04-14T23:35:50.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2024-04-14T23:35:50.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2024-04-14T23:35:50.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2024-04-14T23:35:50.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2024-04-14T23:35:50.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2024-04-14T23:35:50.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2024-04-14T23:35:50.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2024-04-14T23:35:50.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2024-04-14T23:35:50.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2024-04-14T23:35:50.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2024-04-14T23:35:50.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2024-04-14T23:35:50.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2024-04-14T23:35:50.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2024-04-14T23:35:50.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2024-04-14T23:35:50.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2024-04-14T23:35:50.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2024-04-14T23:35:50.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2024-04-14T23:35:50.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2024-04-14T23:35:50.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2024-04-14T23:35:50.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2024-04-14T23:35:50.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2024-04-14T23:35:50.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2024-04-14T23:35:50.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2024-04-14T23:35:50.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2024-04-14T23:35:50.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2024-04-14T23:35:50.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2024-04-14T23:35:50.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2024-04-14T23:35:50.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2024-04-14T23:35:50.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2024-04-14T23:35:50.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-04-14T23:35:50.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-04-14T23:35:50.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.118635+0000', 'last_change': '2024-04-14T23:35:45.118635+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.118635+0000', 'last_undegraded': '2024-04-14T23:35:45.118635+0000', 'last_fullsized': '2024-04-14T23:35:45.118635+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-14T23:35:50.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-04-14T23:35:50.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-04-14T23:35:50.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.117658+0000', 'last_change': '2024-04-14T23:35:45.117658+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.117658+0000', 'last_undegraded': '2024-04-14T23:35:45.117658+0000', 'last_fullsized': '2024-04-14T23:35:45.117658+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-14T23:35:50.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-04-14T23:35:50.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-04-14T23:35:50.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.120078+0000', 'last_change': '2024-04-14T23:35:45.120078+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.120078+0000', 'last_undegraded': '2024-04-14T23:35:45.120078+0000', 'last_fullsized': '2024-04-14T23:35:45.120078+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-14T23:35:50.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-04-14T23:35:50.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-04-14T23:35:50.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.114466+0000', 'last_change': '2024-04-14T23:35:45.114466+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.114466+0000', 'last_undegraded': '2024-04-14T23:35:45.114466+0000', 'last_fullsized': '2024-04-14T23:35:45.114466+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-14T23:35:50.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-04-14T23:35:50.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-04-14T23:35:50.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.117529+0000', 'last_change': '2024-04-14T23:35:45.117529+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.117529+0000', 'last_undegraded': '2024-04-14T23:35:45.117529+0000', 'last_fullsized': '2024-04-14T23:35:45.117529+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-14T23:35:50.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-04-14T23:35:50.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-04-14T23:35:50.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.115171+0000', 'last_change': '2024-04-14T23:35:45.115171+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.115171+0000', 'last_undegraded': '2024-04-14T23:35:45.115171+0000', 'last_fullsized': '2024-04-14T23:35:45.115171+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-14T23:35:50.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-04-14T23:35:50.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-04-14T23:35:50.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.119750+0000', 'last_change': '2024-04-14T23:35:45.119750+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.119750+0000', 'last_undegraded': '2024-04-14T23:35:45.119750+0000', 'last_fullsized': '2024-04-14T23:35:45.119750+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-14T23:35:50.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-04-14T23:35:50.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-04-14T23:35:50.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.114490+0000', 'last_change': '2024-04-14T23:35:45.114490+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.114490+0000', 'last_undegraded': '2024-04-14T23:35:45.114490+0000', 'last_fullsized': '2024-04-14T23:35:45.114490+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-14T23:35:50.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-04-14T23:35:50.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-04-14T23:35:50.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.117164+0000', 'last_change': '2024-04-14T23:35:45.117164+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.117164+0000', 'last_undegraded': '2024-04-14T23:35:45.117164+0000', 'last_fullsized': '2024-04-14T23:35:45.117164+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-14T23:35:50.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-04-14T23:35:50.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-04-14T23:35:50.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.117543+0000', 'last_change': '2024-04-14T23:35:45.117543+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.117543+0000', 'last_undegraded': '2024-04-14T23:35:45.117543+0000', 'last_fullsized': '2024-04-14T23:35:45.117543+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-14T23:35:50.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-04-14T23:35:50.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-04-14T23:35:50.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.117698+0000', 'last_change': '2024-04-14T23:35:45.117698+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.117698+0000', 'last_undegraded': '2024-04-14T23:35:45.117698+0000', 'last_fullsized': '2024-04-14T23:35:45.117698+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-14T23:35:50.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-04-14T23:35:50.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-04-14T23:35:50.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.116897+0000', 'last_change': '2024-04-14T23:35:45.116897+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.116897+0000', 'last_undegraded': '2024-04-14T23:35:45.116897+0000', 'last_fullsized': '2024-04-14T23:35:45.116897+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-14T23:35:50.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-04-14T23:35:50.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-04-14T23:35:50.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.116886+0000', 'last_change': '2024-04-14T23:35:45.116886+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.116886+0000', 'last_undegraded': '2024-04-14T23:35:45.116886+0000', 'last_fullsized': '2024-04-14T23:35:45.116886+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-14T23:35:50.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-04-14T23:35:50.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-04-14T23:35:50.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.119918+0000', 'last_change': '2024-04-14T23:35:45.119918+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.119918+0000', 'last_undegraded': '2024-04-14T23:35:45.119918+0000', 'last_fullsized': '2024-04-14T23:35:45.119918+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-14T23:35:50.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-04-14T23:35:50.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-04-14T23:35:50.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.118036+0000', 'last_change': '2024-04-14T23:35:45.118036+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.118036+0000', 'last_undegraded': '2024-04-14T23:35:45.118036+0000', 'last_fullsized': '2024-04-14T23:35:45.118036+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-14T23:35:50.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-04-14T23:35:50.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-04-14T23:35:50.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.116109+0000', 'last_change': '2024-04-14T23:35:45.116109+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.116109+0000', 'last_undegraded': '2024-04-14T23:35:45.116109+0000', 'last_fullsized': '2024-04-14T23:35:45.116109+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-14T23:35:50.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-04-14T23:35:50.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-04-14T23:35:50.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.118165+0000', 'last_change': '2024-04-14T23:35:45.118165+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.118165+0000', 'last_undegraded': '2024-04-14T23:35:45.118165+0000', 'last_fullsized': '2024-04-14T23:35:45.118165+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-14T23:35:50.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-04-14T23:35:50.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-04-14T23:35:50.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.114831+0000', 'last_change': '2024-04-14T23:35:45.114831+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.114831+0000', 'last_undegraded': '2024-04-14T23:35:45.114831+0000', 'last_fullsized': '2024-04-14T23:35:45.114831+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-14T23:35:50.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-04-14T23:35:50.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-04-14T23:35:50.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.115473+0000', 'last_change': '2024-04-14T23:35:45.115473+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.115473+0000', 'last_undegraded': '2024-04-14T23:35:45.115473+0000', 'last_fullsized': '2024-04-14T23:35:45.115473+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-14T23:35:50.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-04-14T23:35:50.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-04-14T23:35:50.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.119708+0000', 'last_change': '2024-04-14T23:35:45.119708+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.119708+0000', 'last_undegraded': '2024-04-14T23:35:45.119708+0000', 'last_fullsized': '2024-04-14T23:35:45.119708+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-14T23:35:50.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-04-14T23:35:50.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-04-14T23:35:50.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.115276+0000', 'last_change': '2024-04-14T23:35:45.115276+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.115276+0000', 'last_undegraded': '2024-04-14T23:35:45.115276+0000', 'last_fullsized': '2024-04-14T23:35:45.115276+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-14T23:35:50.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-04-14T23:35:50.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-04-14T23:35:50.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.115238+0000', 'last_change': '2024-04-14T23:35:45.115238+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.115238+0000', 'last_undegraded': '2024-04-14T23:35:45.115238+0000', 'last_fullsized': '2024-04-14T23:35:45.115238+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-14T23:35:50.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-04-14T23:35:50.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-04-14T23:35:50.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.115200+0000', 'last_change': '2024-04-14T23:35:45.115200+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.115200+0000', 'last_undegraded': '2024-04-14T23:35:45.115200+0000', 'last_fullsized': '2024-04-14T23:35:45.115200+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-14T23:35:50.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-04-14T23:35:50.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-04-14T23:35:50.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.115232+0000', 'last_change': '2024-04-14T23:35:45.115232+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.115232+0000', 'last_undegraded': '2024-04-14T23:35:45.115232+0000', 'last_fullsized': '2024-04-14T23:35:45.115232+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-14T23:35:50.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-04-14T23:35:50.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-04-14T23:35:50.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.117570+0000', 'last_change': '2024-04-14T23:35:45.117570+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.117570+0000', 'last_undegraded': '2024-04-14T23:35:45.117570+0000', 'last_fullsized': '2024-04-14T23:35:45.117570+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-14T23:35:50.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-04-14T23:35:50.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-04-14T23:35:50.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.115190+0000', 'last_change': '2024-04-14T23:35:45.115190+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.115190+0000', 'last_undegraded': '2024-04-14T23:35:45.115190+0000', 'last_fullsized': '2024-04-14T23:35:45.115190+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-14T23:35:50.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-04-14T23:35:50.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-04-14T23:35:50.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.117217+0000', 'last_change': '2024-04-14T23:35:45.117217+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.117217+0000', 'last_undegraded': '2024-04-14T23:35:45.117217+0000', 'last_fullsized': '2024-04-14T23:35:45.117217+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-14T23:35:50.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-04-14T23:35:50.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-04-14T23:35:50.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.118099+0000', 'last_change': '2024-04-14T23:35:45.118099+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.118099+0000', 'last_undegraded': '2024-04-14T23:35:45.118099+0000', 'last_fullsized': '2024-04-14T23:35:45.118099+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-14T23:35:50.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-04-14T23:35:50.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-04-14T23:35:50.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.118170+0000', 'last_change': '2024-04-14T23:35:45.118170+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.118170+0000', 'last_undegraded': '2024-04-14T23:35:45.118170+0000', 'last_fullsized': '2024-04-14T23:35:45.118170+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-14T23:35:50.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-04-14T23:35:50.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-04-14T23:35:50.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.114466+0000', 'last_change': '2024-04-14T23:35:45.114466+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.114466+0000', 'last_undegraded': '2024-04-14T23:35:45.114466+0000', 'last_fullsized': '2024-04-14T23:35:45.114466+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-14T23:35:50.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-04-14T23:35:50.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-04-14T23:35:50.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.117034+0000', 'last_change': '2024-04-14T23:35:45.117034+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.117034+0000', 'last_undegraded': '2024-04-14T23:35:45.117034+0000', 'last_fullsized': '2024-04-14T23:35:45.117034+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-14T23:35:50.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-04-14T23:35:50.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T23:35:46.111685+0000', 'last_change': '2024-04-14T23:35:46.111685+0000', 'last_active': '2024-04-14T23:35:46.111685+0000', 'last_peered': '2024-04-14T23:35:46.111685+0000', 'last_clean': '2024-04-14T23:35:46.111685+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:46.111685+0000', 'last_undegraded': '2024-04-14T23:35:46.111685+0000', 'last_fullsized': '2024-04-14T23:35:46.111685+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:46.111685+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T23:35:50.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-04-14T23:35:50.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-14T23:35:45.114634+0000', 'last_change': '2024-04-14T23:35:45.114634+0000', 'last_active': '2024-04-14T23:35:45.107388+0000', 'last_peered': '2024-04-14T23:35:45.107388+0000', 'last_clean': '2024-04-14T23:35:45.107388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T23:35:45.114634+0000', 'last_undegraded': '2024-04-14T23:35:45.114634+0000', 'last_fullsized': '2024-04-14T23:35:45.114634+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'last_clean_scrub_stamp': '2024-04-14T23:35:45.107388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-14T23:35:50.857 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-14T23:35:50.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.975+0000 7f9b4a4d5640 1 Processor -- start 2024-04-14T23:35:50.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.975+0000 7f9b4a4d5640 1 -- start start 2024-04-14T23:35:50.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.976+0000 7f9b4a4d5640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b440d1c40 0x7f9b440cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.976+0000 7f9b4a4d5640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b440c83c0 con 0x7f9b4415e4a0 2024-04-14T23:35:50.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.976+0000 7f9b4a4d5640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b440c86a0 con 0x7f9b440d2b30 2024-04-14T23:35:50.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.976+0000 7f9b4a4d5640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f9b4415e880 con 0x7f9b440d1c40 2024-04-14T23:35:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.976+0000 7f9b43fff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9b4415e4a0 0x7f9b440d2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:53900/0 (socket says 172.21.15.47:53900) 2024-04-14T23:35:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.976+0000 7f9b43fff640 1 -- 172.21.15.47:0/1069374430 learned_addr learned my addr 172.21.15.47:0/1069374430 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.976+0000 7f9b48a72640 1 --2- 172.21.15.47:0/1069374430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b440d1c40 0x7f9b440cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 -- 172.21.15.47:0/1069374430 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190644737 0 0) 0x7f9b440c83c0 con 0x7f9b4415e4a0 2024-04-14T23:35:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 -- 172.21.15.47:0/1069374430 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b2c003520 con 0x7f9b4415e4a0 2024-04-14T23:35:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 -- 172.21.15.47:0/1069374430 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1331262887 0 0) 0x7f9b440c86a0 con 0x7f9b440d2b30 2024-04-14T23:35:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 -- 172.21.15.47:0/1069374430 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b440c83c0 con 0x7f9b440d2b30 2024-04-14T23:35:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 -- 172.21.15.47:0/1069374430 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1220982241 0 0) 0x7f9b2c003520 con 0x7f9b4415e4a0 2024-04-14T23:35:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 -- 172.21.15.47:0/1069374430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b440d1c40 msgr2=0x7f9b440cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 --2- 172.21.15.47:0/1069374430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b440d1c40 0x7f9b440cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 -- 172.21.15.47:0/1069374430 >> v1:172.21.15.191:6789/0 conn(0x7f9b440d2b30 legacy=0x7f9b440cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 -- 172.21.15.47:0/1069374430 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b440c8980 con 0x7f9b4415e4a0 2024-04-14T23:35:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 -- 172.21.15.47:0/1069374430 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f9b34001670 con 0x7f9b4415e4a0 2024-04-14T23:35:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b48a72640 1 --2- 172.21.15.47:0/1069374430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b440d1c40 0x7f9b440cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:50.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 -- 172.21.15.47:0/1069374430 >> v1:172.21.15.47:6789/0 conn(0x7f9b4415e4a0 legacy=0x7f9b440d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 --2- 172.21.15.47:0/1069374430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b2c003b70 0x7f9b2c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 --2- 172.21.15.47:0/1069374430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b2c004800 0x7f9b2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 --2- 172.21.15.47:0/1069374430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b440d1c40 0x7f9b2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 -- 172.21.15.47:0/1069374430 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4415e880 con 0x7f9b2c003b70 2024-04-14T23:35:50.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 -- 172.21.15.47:0/1069374430 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c00ba70 con 0x7f9b2c004800 2024-04-14T23:35:50.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b42ffd640 1 -- 172.21.15.47:0/1069374430 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f9b2c00bc40 con 0x7f9b440d1c40 2024-04-14T23:35:50.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b43fff640 1 --2- 172.21.15.47:0/1069374430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b2c003b70 0x7f9b2c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b437fe640 1 --2- 172.21.15.47:0/1069374430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b2c004800 0x7f9b2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b48a72640 1 --2- 172.21.15.47:0/1069374430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b440d1c40 0x7f9b2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b43fff640 1 -- 172.21.15.47:0/1069374430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b440d1c40 msgr2=0x7f9b2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:50.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b43fff640 1 --2- 172.21.15.47:0/1069374430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b440d1c40 0x7f9b2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b43fff640 1 -- 172.21.15.47:0/1069374430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b2c004800 msgr2=0x7f9b2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:50.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b43fff640 1 --2- 172.21.15.47:0/1069374430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b2c004800 0x7f9b2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b43fff640 1 -- 172.21.15.47:0/1069374430 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2c003520 con 0x7f9b2c003b70 2024-04-14T23:35:50.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b437fe640 1 --2- 172.21.15.47:0/1069374430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b2c004800 0x7f9b2c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:50.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.977+0000 7f9b48a72640 1 --2- 172.21.15.47:0/1069374430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b440d1c40 0x7f9b2c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:50.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.978+0000 7f9b43fff640 1 --2- 172.21.15.47:0/1069374430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b2c003b70 0x7f9b2c003f70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9b34001eb0 tx=0x7f9b2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709474358262b3b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:50.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.978+0000 7f9b42ffd640 1 -- 172.21.15.47:0/1069374430 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34007c40 con 0x7f9b2c003b70 2024-04-14T23:35:50.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.978+0000 7f9b42ffd640 1 -- 172.21.15.47:0/1069374430 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b34030070 con 0x7f9b2c003b70 2024-04-14T23:35:50.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.978+0000 7f9b42ffd640 1 -- 172.21.15.47:0/1069374430 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34005d50 con 0x7f9b2c003b70 2024-04-14T23:35:50.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.979+0000 7f9b4a4d5640 1 -- 172.21.15.47:0/1069374430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b2c003b70 msgr2=0x7f9b2c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.979+0000 7f9b4a4d5640 1 --2- 172.21.15.47:0/1069374430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b2c003b70 0x7f9b2c003f70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9b34001eb0 tx=0x7f9b2c005830 comp rx=0 tx=0).stop 2024-04-14T23:35:50.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.979+0000 7f9b48a72640 1 -- 172.21.15.47:0/1069374430 reap_dead start 2024-04-14T23:35:50.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.979+0000 7f9b4a4d5640 1 -- 172.21.15.47:0/1069374430 shutdown_connections 2024-04-14T23:35:50.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.979+0000 7f9b4a4d5640 1 -- 172.21.15.47:0/1069374430 >> 172.21.15.47:0/1069374430 conn(0x7f9b440d3ef0 msgr2=0x7f9b440d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:50.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.979+0000 7f9b4a4d5640 1 -- 172.21.15.47:0/1069374430 shutdown_connections 2024-04-14T23:35:50.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.979+0000 7f9b4a4d5640 1 -- 172.21.15.47:0/1069374430 wait complete. 2024-04-14T23:35:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.980+0000 7f9b4a4d5640 1 Processor -- start 2024-04-14T23:35:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.980+0000 7f9b4a4d5640 1 -- start start 2024-04-14T23:35:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b4a4d5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b2c003b70 0x7f9b4414da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b4a4d5640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b4409dbf0 0x7f9b4409e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b4a4d5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b4409f860 0x7f9b4409fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b4a4d5640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9b44067bb0 con 0x7f9b2c003b70 2024-04-14T23:35:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b4a4d5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9b440c8f40 con 0x7f9b4409f860 2024-04-14T23:35:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b4a4d5640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f9b44067d30 con 0x7f9b4409dbf0 2024-04-14T23:35:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b43fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b2c003b70 0x7f9b4414da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b43fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b2c003b70 0x7f9b4414da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52598/0 (socket says 172.21.15.47:52598) 2024-04-14T23:35:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b43fff640 1 -- 172.21.15.47:0/797944390 learned_addr learned my addr 172.21.15.47:0/797944390 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b437fe640 1 --2- 172.21.15.47:0/797944390 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b4409dbf0 0x7f9b4409e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b48a72640 1 --2- 172.21.15.47:0/797944390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b4409f860 0x7f9b4409fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b43fff640 1 -- 172.21.15.47:0/797944390 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b4409dbf0 msgr2=0x7f9b4409e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b43fff640 1 --2- 172.21.15.47:0/797944390 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b4409dbf0 0x7f9b4409e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b43fff640 1 -- 172.21.15.47:0/797944390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b4409f860 msgr2=0x7f9b4409fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b43fff640 1 --2- 172.21.15.47:0/797944390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b4409f860 0x7f9b4409fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b43fff640 1 -- 172.21.15.47:0/797944390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4414bb70 con 0x7f9b2c003b70 2024-04-14T23:35:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b437fe640 1 --2- 172.21.15.47:0/797944390 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b4409dbf0 0x7f9b4409e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b48a72640 1 --2- 172.21.15.47:0/797944390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b4409f860 0x7f9b4409fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:35:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b43fff640 1 --2- 172.21.15.47:0/797944390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b2c003b70 0x7f9b4414da90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9b34001400 tx=0x7f9b34001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b40ff9640 1 -- 172.21.15.47:0/797944390 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34007c40 con 0x7f9b2c003b70 2024-04-14T23:35:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.981+0000 7f9b40ff9640 1 -- 172.21.15.47:0/797944390 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b3402cba0 con 0x7f9b2c003b70 2024-04-14T23:35:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.982+0000 7f9b4a4d5640 1 -- 172.21.15.47:0/797944390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4414be50 con 0x7f9b2c003b70 2024-04-14T23:35:50.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.982+0000 7f9b40ff9640 1 -- 172.21.15.47:0/797944390 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34007070 con 0x7f9b2c003b70 2024-04-14T23:35:50.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.982+0000 7f9b4a4d5640 1 -- 172.21.15.47:0/797944390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4414c410 con 0x7f9b2c003b70 2024-04-14T23:35:50.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.983+0000 7f9b4a4d5640 1 -- 172.21.15.47:0/797944390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b44075430 con 0x7f9b2c003b70 2024-04-14T23:35:50.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.983+0000 7f9b40ff9640 1 -- 172.21.15.47:0/797944390 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9b34007210 con 0x7f9b2c003b70 2024-04-14T23:35:50.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.983+0000 7f9b40ff9640 1 --2- 172.21.15.47:0/797944390 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9b3006b990 0x7f9b3006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:50.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.983+0000 7f9b40ff9640 1 -- 172.21.15.47:0/797944390 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f9b340abd60 con 0x7f9b2c003b70 2024-04-14T23:35:50.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.984+0000 7f9b437fe640 1 --2- 172.21.15.47:0/797944390 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9b3006b990 0x7f9b3006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:50.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.984+0000 7f9b437fe640 1 --2- 172.21.15.47:0/797944390 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9b3006b990 0x7f9b3006de50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9b38007fd0 tx=0x7f9b38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:50.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:50.988+0000 7f9b40ff9640 1 -- 172.21.15.47:0/797944390 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9b3407a870 con 0x7f9b2c003b70 2024-04-14T23:35:51.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.246+0000 7f9b4a4d5640 1 -- 172.21.15.47:0/797944390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f9b440d21e0 con 0x7f9b2c003b70 2024-04-14T23:35:51.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.246+0000 7f9b40ff9640 1 -- 172.21.15.47:0/797944390 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1108 (secure 0 0 0) 0x7f9b3407a170 con 0x7f9b2c003b70 2024-04-14T23:35:51.249 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:51.249 INFO:teuthology.orchestra.run.smithi047.stdout:{"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":97,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1713137664,"num_in_osds":8,"osd_in_since":1713137656,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":242876416,"bytes_avail":772851236864,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5334}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-14T23:35:36.372466+0000","services":{}},"progress_events":{}} 2024-04-14T23:35:51.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.248+0000 7f9b4a4d5640 1 -- 172.21.15.47:0/797944390 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9b3006b990 msgr2=0x7f9b3006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:51.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.248+0000 7f9b4a4d5640 1 --2- 172.21.15.47:0/797944390 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9b3006b990 0x7f9b3006de50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9b38007fd0 tx=0x7f9b38009040 comp rx=0 tx=0).stop 2024-04-14T23:35:51.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.248+0000 7f9b4a4d5640 1 -- 172.21.15.47:0/797944390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b2c003b70 msgr2=0x7f9b4414da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:51.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.248+0000 7f9b4a4d5640 1 --2- 172.21.15.47:0/797944390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b2c003b70 0x7f9b4414da90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9b34001400 tx=0x7f9b34001970 comp rx=0 tx=0).stop 2024-04-14T23:35:51.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.248+0000 7f9b4a4d5640 1 -- 172.21.15.47:0/797944390 shutdown_connections 2024-04-14T23:35:51.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.248+0000 7f9b4a4d5640 1 --2- 172.21.15.47:0/797944390 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9b3006b990 0x7f9b3006de50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:51.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.248+0000 7f9b4a4d5640 1 --2- 172.21.15.47:0/797944390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b4409f860 0x7f9b4409fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:51.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.248+0000 7f9b4a4d5640 1 --2- 172.21.15.47:0/797944390 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9b4409dbf0 0x7f9b4409e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:51.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.248+0000 7f9b4a4d5640 1 --2- 172.21.15.47:0/797944390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b2c003b70 0x7f9b4414da90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:51.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.248+0000 7f9b4a4d5640 1 -- 172.21.15.47:0/797944390 >> 172.21.15.47:0/797944390 conn(0x7f9b440d3ef0 msgr2=0x7f9b4406be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:51.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.248+0000 7f9b4a4d5640 1 -- 172.21.15.47:0/797944390 shutdown_connections 2024-04-14T23:35:51.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.248+0000 7f9b4a4d5640 1 -- 172.21.15.47:0/797944390 wait complete. 2024-04-14T23:35:51.262 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-14T23:35:51.262 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T23:35:51.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.360+0000 7f1fa4036640 1 Processor -- start 2024-04-14T23:35:51.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.360+0000 7f1fa4036640 1 -- start start 2024-04-14T23:35:51.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.361+0000 7f1fa4036640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1f9c15e270 0x7f1f9c0d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:51.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.361+0000 7f1fa4036640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f9c0d1e00 0x7f1f9c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:51.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.361+0000 7f1fa4036640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f9c0b57a0 con 0x7f1f9c0d1450 2024-04-14T23:35:51.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.361+0000 7f1fa4036640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f1f9c0b4300 con 0x7f1f9c15e270 2024-04-14T23:35:51.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.361+0000 7f1fa4036640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9c0b39d0 con 0x7f1f9c0d1e00 2024-04-14T23:35:51.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.362+0000 7f1fa1dd2640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1f9c15e270 0x7f1f9c0d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:51.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.362+0000 7f1fa15d1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f9c0d1e00 0x7f1f9c0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:51.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.362+0000 7f1fa1dd2640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1f9c15e270 0x7f1f9c0d0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.47:44708/0 (socket says 172.21.15.47:44708) 2024-04-14T23:35:51.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.362+0000 7f1fa15d1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f9c0d1e00 0x7f1f9c0d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:57622/0 (socket says 172.21.15.47:57622) 2024-04-14T23:35:51.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.362+0000 7f1fa1dd2640 1 -- 172.21.15.47:0/3166580581 learned_addr learned my addr 172.21.15.47:0/3166580581 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:51.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.362+0000 7f1fa25d3640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f1f9c0d1450 0x7f1f9c0ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.47:36458/0 (socket says 172.21.15.47:36458) 2024-04-14T23:35:51.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.362+0000 7f1fa15d1640 1 -- 172.21.15.47:0/3166580581 >> v2:172.21.15.191:3300/0 conn(0x7f1f9c15e270 msgr2=0x7f1f9c0d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:51.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.362+0000 7f1fa15d1640 1 --2- 172.21.15.47:0/3166580581 >> v2:172.21.15.191:3300/0 conn(0x7f1f9c15e270 0x7f1f9c0d0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:51.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.362+0000 7f1fa15d1640 1 -- 172.21.15.47:0/3166580581 >> v1:172.21.15.191:6789/0 conn(0x7f1f9c0d1450 legacy=0x7f1f9c0ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:51.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.362+0000 7f1fa15d1640 1 -- 172.21.15.47:0/3166580581 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c0b3cb0 con 0x7f1f9c0d1e00 2024-04-14T23:35:51.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.362+0000 7f1fa1dd2640 1 --2- 172.21.15.47:0/3166580581 >> v2:172.21.15.191:3300/0 conn(0x7f1f9c15e270 0x7f1f9c0d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:51.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.363+0000 7f1fa15d1640 1 --2- 172.21.15.47:0/3166580581 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f9c0d1e00 0x7f1f9c0d2200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1f900097a0 tx=0x7f1f9002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4029d263f2e9468 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:51.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.363+0000 7f1fa0dd0640 1 -- 172.21.15.47:0/3166580581 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90034070 con 0x7f1f9c0d1e00 2024-04-14T23:35:51.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.363+0000 7f1fa0dd0640 1 -- 172.21.15.47:0/3166580581 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f90030610 con 0x7f1f9c0d1e00 2024-04-14T23:35:51.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.363+0000 7f1fa0dd0640 1 -- 172.21.15.47:0/3166580581 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f900309e0 con 0x7f1f9c0d1e00 2024-04-14T23:35:51.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.363+0000 7f1fa4036640 1 -- 172.21.15.47:0/3166580581 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f9c0d1e00 msgr2=0x7f1f9c0d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:51.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.363+0000 7f1fa4036640 1 --2- 172.21.15.47:0/3166580581 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f9c0d1e00 0x7f1f9c0d2200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1f900097a0 tx=0x7f1f9002b960 comp rx=0 tx=0).stop 2024-04-14T23:35:51.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.364+0000 7f1fa4036640 1 -- 172.21.15.47:0/3166580581 shutdown_connections 2024-04-14T23:35:51.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.364+0000 7f1fa4036640 1 --2- 172.21.15.47:0/3166580581 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f9c0d1e00 0x7f1f9c0d2200 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:51.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.364+0000 7f1fa4036640 1 --2- 172.21.15.47:0/3166580581 >> v2:172.21.15.191:3300/0 conn(0x7f1f9c15e270 0x7f1f9c0d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:51.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.364+0000 7f1fa4036640 1 -- 172.21.15.47:0/3166580581 >> 172.21.15.47:0/3166580581 conn(0x7f1f9c0d3ed0 msgr2=0x7f1f9c0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:51.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.364+0000 7f1fa4036640 1 -- 172.21.15.47:0/3166580581 shutdown_connections 2024-04-14T23:35:51.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.364+0000 7f1fa4036640 1 -- 172.21.15.47:0/3166580581 wait complete. 2024-04-14T23:35:51.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.365+0000 7f1fa4036640 1 Processor -- start 2024-04-14T23:35:51.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.365+0000 7f1fa4036640 1 -- start start 2024-04-14T23:35:51.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.365+0000 7f1fa4036640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f9c0d1450 0x7f1f9c153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:51.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.365+0000 7f1fa4036640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f9c0d1e00 0x7f1f9c0cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:51.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.365+0000 7f1fa4036640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9c15e270 0x7f1f9c15c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:51.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.365+0000 7f1fa4036640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c15e650 con 0x7f1f9c15e270 2024-04-14T23:35:51.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.365+0000 7f1fa4036640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c0b0c60 con 0x7f1f9c0d1e00 2024-04-14T23:35:51.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.365+0000 7f1fa4036640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9c15e7d0 con 0x7f1f9c0d1450 2024-04-14T23:35:51.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.366+0000 7f1fa25d3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9c15e270 0x7f1f9c15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:51.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.366+0000 7f1fa25d3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9c15e270 0x7f1f9c15c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52612/0 (socket says 172.21.15.47:52612) 2024-04-14T23:35:51.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.366+0000 7f1fa25d3640 1 -- 172.21.15.47:0/4072111205 learned_addr learned my addr 172.21.15.47:0/4072111205 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:51.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.366+0000 7f1fa1dd2640 1 --2- 172.21.15.47:0/4072111205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f9c0d1450 0x7f1f9c153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:51.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.366+0000 7f1fa15d1640 1 --2- 172.21.15.47:0/4072111205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f9c0d1e00 0x7f1f9c0cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.366+0000 7f1fa25d3640 1 -- 172.21.15.47:0/4072111205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f9c0d1450 msgr2=0x7f1f9c153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.366+0000 7f1fa25d3640 1 --2- 172.21.15.47:0/4072111205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f9c0d1450 0x7f1f9c153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.366+0000 7f1fa25d3640 1 -- 172.21.15.47:0/4072111205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f9c0d1e00 msgr2=0x7f1f9c0cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.366+0000 7f1fa25d3640 1 --2- 172.21.15.47:0/4072111205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f9c0d1e00 0x7f1f9c0cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.366+0000 7f1fa25d3640 1 -- 172.21.15.47:0/4072111205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c1f7840 con 0x7f1f9c15e270 2024-04-14T23:35:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.366+0000 7f1fa25d3640 1 --2- 172.21.15.47:0/4072111205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9c15e270 0x7f1f9c15c480 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00c730 tx=0x7f1f8c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.366+0000 7f1f9a7fc640 1 -- 172.21.15.47:0/4072111205 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c018070 con 0x7f1f9c15e270 2024-04-14T23:35:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.366+0000 7f1f9a7fc640 1 -- 172.21.15.47:0/4072111205 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f8c004d60 con 0x7f1f9c15e270 2024-04-14T23:35:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.366+0000 7f1fa4036640 1 -- 172.21.15.47:0/4072111205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9c1f7b20 con 0x7f1f9c15e270 2024-04-14T23:35:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.366+0000 7f1f9a7fc640 1 -- 172.21.15.47:0/4072111205 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00a820 con 0x7f1f9c15e270 2024-04-14T23:35:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.366+0000 7f1fa4036640 1 -- 172.21.15.47:0/4072111205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f9c1f80e0 con 0x7f1f9c15e270 2024-04-14T23:35:51.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.367+0000 7f1fa4036640 1 -- 172.21.15.47:0/4072111205 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f9c1f83f0 con 0x7f1f9c15e270 2024-04-14T23:35:51.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.368+0000 7f1f9a7fc640 1 -- 172.21.15.47:0/4072111205 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f1f8c00a9c0 con 0x7f1f9c15e270 2024-04-14T23:35:51.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.368+0000 7f1f9a7fc640 1 --2- 172.21.15.47:0/4072111205 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f1f8806b990 0x7f1f8806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:51.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.368+0000 7f1f9a7fc640 1 -- 172.21.15.47:0/4072111205 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f1f8c089f30 con 0x7f1f9c15e270 2024-04-14T23:35:51.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.368+0000 7f1fa1dd2640 1 --2- 172.21.15.47:0/4072111205 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f1f8806b990 0x7f1f8806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:51.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.369+0000 7f1fa1dd2640 1 --2- 172.21.15.47:0/4072111205 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f1f8806b990 0x7f1f8806de50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1f94006ca0 tx=0x7f1f94009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:51.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.372+0000 7f1f9a7fc640 1 -- 172.21.15.47:0/4072111205 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1f8c0582e0 con 0x7f1f9c15e270 2024-04-14T23:35:51.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.549+0000 7f1fa4036640 1 -- 172.21.15.47:0/4072111205 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1f9c1f75f0 con 0x7f1f8806b990 2024-04-14T23:35:51.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.555+0000 7f1f9a7fc640 1 -- 172.21.15.47:0/4072111205 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240045 (secure 0 0 0) 0x7f1f9c1f75f0 con 0x7f1f8806b990 2024-04-14T23:35:51.561 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:51.563 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-14T23:35:51.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.558+0000 7f1fa4036640 1 -- 172.21.15.47:0/4072111205 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f1f8806b990 msgr2=0x7f1f8806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:51.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.558+0000 7f1fa4036640 1 --2- 172.21.15.47:0/4072111205 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f1f8806b990 0x7f1f8806de50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1f94006ca0 tx=0x7f1f94009240 comp rx=0 tx=0).stop 2024-04-14T23:35:51.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.558+0000 7f1fa4036640 1 -- 172.21.15.47:0/4072111205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9c15e270 msgr2=0x7f1f9c15c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.558+0000 7f1fa4036640 1 --2- 172.21.15.47:0/4072111205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9c15e270 0x7f1f9c15c480 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00c730 tx=0x7f1f8c00cbf0 comp rx=0 tx=0).stop 2024-04-14T23:35:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.558+0000 7f1fa4036640 1 -- 172.21.15.47:0/4072111205 shutdown_connections 2024-04-14T23:35:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.558+0000 7f1fa4036640 1 --2- 172.21.15.47:0/4072111205 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f1f8806b990 0x7f1f8806de50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.558+0000 7f1fa4036640 1 --2- 172.21.15.47:0/4072111205 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f9c15e270 0x7f1f9c15c480 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.558+0000 7f1fa4036640 1 --2- 172.21.15.47:0/4072111205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f9c0d1e00 0x7f1f9c0cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.558+0000 7f1fa4036640 1 --2- 172.21.15.47:0/4072111205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f9c0d1450 0x7f1f9c153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.558+0000 7f1fa4036640 1 -- 172.21.15.47:0/4072111205 >> 172.21.15.47:0/4072111205 conn(0x7f1f9c0d3ed0 msgr2=0x7f1f9c06cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.558+0000 7f1fa4036640 1 -- 172.21.15.47:0/4072111205 shutdown_connections 2024-04-14T23:35:51.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:51.558+0000 7f1fa4036640 1 -- 172.21.15.47:0/4072111205 wait complete. 2024-04-14T23:35:51.572 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-04-14T23:35:50.374791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237184,"kb_used_data":4320,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737536,"statfs":{"total":773094113280,"available":772851236864,"internally_reserved":0,"allocated":4423680,"data_stored":2556658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.262125"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118635+0000","last_change":"2024-04-14T23:35:45.118635+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118635+0000","last_undegraded":"2024-04-14T23:35:45.118635+0000","last_fullsized":"2024-04-14T23:35:45.118635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117658+0000","last_change":"2024-04-14T23:35:45.117658+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117658+0000","last_undegraded":"2024-04-14T23:35:45.117658+0000","last_fullsized":"2024-04-14T23:35:45.117658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.120078+0000","last_change":"2024-04-14T23:35:45.120078+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.120078+0000","last_undegraded":"2024-04-14T23:35:45.120078+0000","last_fullsized":"2024-04-14T23:35:45.120078+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114466+0000","last_change":"2024-04-14T23:35:45.114466+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114466+0000","last_undegraded":"2024-04-14T23:35:45.114466+0000","last_fullsized":"2024-04-14T23:35:45.114466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117529+0000","last_change":"2024-04-14T23:35:45.117529+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117529+0000","last_undegraded":"2024-04-14T23:35:45.117529+0000","last_fullsized":"2024-04-14T23:35:45.117529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115171+0000","last_change":"2024-04-14T23:35:45.115171+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115171+0000","last_undegraded":"2024-04-14T23:35:45.115171+0000","last_fullsized":"2024-04-14T23:35:45.115171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.119750+0000","last_change":"2024-04-14T23:35:45.119750+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.119750+0000","last_undegraded":"2024-04-14T23:35:45.119750+0000","last_fullsized":"2024-04-14T23:35:45.119750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114490+0000","last_change":"2024-04-14T23:35:45.114490+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114490+0000","last_undegraded":"2024-04-14T23:35:45.114490+0000","last_fullsized":"2024-04-14T23:35:45.114490+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117164+0000","last_change":"2024-04-14T23:35:45.117164+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117164+0000","last_undegraded":"2024-04-14T23:35:45.117164+0000","last_fullsized":"2024-04-14T23:35:45.117164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117543+0000","last_change":"2024-04-14T23:35:45.117543+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117543+0000","last_undegraded":"2024-04-14T23:35:45.117543+0000","last_fullsized":"2024-04-14T23:35:45.117543+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117698+0000","last_change":"2024-04-14T23:35:45.117698+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117698+0000","last_undegraded":"2024-04-14T23:35:45.117698+0000","last_fullsized":"2024-04-14T23:35:45.117698+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.116897+0000","last_change":"2024-04-14T23:35:45.116897+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.116897+0000","last_undegraded":"2024-04-14T23:35:45.116897+0000","last_fullsized":"2024-04-14T23:35:45.116897+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.116886+0000","last_change":"2024-04-14T23:35:45.116886+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.116886+0000","last_undegraded":"2024-04-14T23:35:45.116886+0000","last_fullsized":"2024-04-14T23:35:45.116886+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.119918+0000","last_change":"2024-04-14T23:35:45.119918+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.119918+0000","last_undegraded":"2024-04-14T23:35:45.119918+0000","last_fullsized":"2024-04-14T23:35:45.119918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118036+0000","last_change":"2024-04-14T23:35:45.118036+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118036+0000","last_undegraded":"2024-04-14T23:35:45.118036+0000","last_fullsized":"2024-04-14T23:35:45.118036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.116109+0000","last_change":"2024-04-14T23:35:45.116109+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.116109+0000","last_undegraded":"2024-04-14T23:35:45.116109+0000","last_fullsized":"2024-04-14T23:35:45.116109+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118165+0000","last_change":"2024-04-14T23:35:45.118165+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118165+0000","last_undegraded":"2024-04-14T23:35:45.118165+0000","last_fullsized":"2024-04-14T23:35:45.118165+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114831+0000","last_change":"2024-04-14T23:35:45.114831+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114831+0000","last_undegraded":"2024-04-14T23:35:45.114831+0000","last_fullsized":"2024-04-14T23:35:45.114831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115473+0000","last_change":"2024-04-14T23:35:45.115473+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115473+0000","last_undegraded":"2024-04-14T23:35:45.115473+0000","last_fullsized":"2024-04-14T23:35:45.115473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.119708+0000","last_change":"2024-04-14T23:35:45.119708+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.119708+0000","last_undegraded":"2024-04-14T23:35:45.119708+0000","last_fullsized":"2024-04-14T23:35:45.119708+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115276+0000","last_change":"2024-04-14T23:35:45.115276+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115276+0000","last_undegraded":"2024-04-14T23:35:45.115276+0000","last_fullsized":"2024-04-14T23:35:45.115276+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115238+0000","last_change":"2024-04-14T23:35:45.115238+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115238+0000","last_undegraded":"2024-04-14T23:35:45.115238+0000","last_fullsized":"2024-04-14T23:35:45.115238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115200+0000","last_change":"2024-04-14T23:35:45.115200+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115200+0000","last_undegraded":"2024-04-14T23:35:45.115200+0000","last_fullsized":"2024-04-14T23:35:45.115200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115232+0000","last_change":"2024-04-14T23:35:45.115232+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115232+0000","last_undegraded":"2024-04-14T23:35:45.115232+0000","last_fullsized":"2024-04-14T23:35:45.115232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117570+0000","last_change":"2024-04-14T23:35:45.117570+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117570+0000","last_undegraded":"2024-04-14T23:35:45.117570+0000","last_fullsized":"2024-04-14T23:35:45.117570+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.115190+0000","last_change":"2024-04-14T23:35:45.115190+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.115190+0000","last_undegraded":"2024-04-14T23:35:45.115190+0000","last_fullsized":"2024-04-14T23:35:45.115190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117217+0000","last_change":"2024-04-14T23:35:45.117217+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117217+0000","last_undegraded":"2024-04-14T23:35:45.117217+0000","last_fullsized":"2024-04-14T23:35:45.117217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118099+0000","last_change":"2024-04-14T23:35:45.118099+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118099+0000","last_undegraded":"2024-04-14T23:35:45.118099+0000","last_fullsized":"2024-04-14T23:35:45.118099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.118170+0000","last_change":"2024-04-14T23:35:45.118170+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.118170+0000","last_undegraded":"2024-04-14T23:35:45.118170+0000","last_fullsized":"2024-04-14T23:35:45.118170+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114466+0000","last_change":"2024-04-14T23:35:45.114466+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114466+0000","last_undegraded":"2024-04-14T23:35:45.114466+0000","last_fullsized":"2024-04-14T23:35:45.114466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.117034+0000","last_change":"2024-04-14T23:35:45.117034+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.117034+0000","last_undegraded":"2024-04-14T23:35:45.117034+0000","last_fullsized":"2024-04-14T23:35:45.117034+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T23:35:46.111685+0000","last_change":"2024-04-14T23:35:46.111685+0000","last_active":"2024-04-14T23:35:46.111685+0000","last_peered":"2024-04-14T23:35:46.111685+0000","last_clean":"2024-04-14T23:35:46.111685+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:46.111685+0000","last_undegraded":"2024-04-14T23:35:46.111685+0000","last_fullsized":"2024-04-14T23:35:46.111685+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-14T23:35:45.114634+0000","last_change":"2024-04-14T23:35:45.114634+0000","last_active":"2024-04-14T23:35:45.107388+0000","last_peered":"2024-04-14T23:35:45.107388+0000","last_clean":"2024-04-14T23:35:45.107388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T23:35:45.114634+0000","last_undegraded":"2024-04-14T23:35:45.114634+0000","last_fullsized":"2024-04-14T23:35:45.114634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-14T23:35:45.116498+0000","last_change":"2024-04-14T23:34:27.438796+0000","last_active":"2024-04-14T23:35:45.116498+0000","last_peered":"2024-04-14T23:35:45.116498+0000","last_clean":"2024-04-14T23:35:45.116498+0000","last_became_active":"2024-04-14T23:34:27.437932+0000","last_became_peered":"2024-04-14T23:34:27.437932+0000","last_unstale":"2024-04-14T23:35:45.116498+0000","last_undegraded":"2024-04-14T23:35:45.116498+0000","last_fullsized":"2024-04-14T23:35:45.116498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_clean_scrub_stamp":"2024-04-14T23:34:26.390323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:11:13.484245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":760806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":176647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":413696,"data_stored":176647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":995328,"data_stored":760806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T23:35:51.917 INFO:tasks.ceph.mds.c.smithi047.stderr:2024-04-14T23:35:51.914+0000 7f36fa3f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-14T23:35:54.576 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T23:35:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.686+0000 7f0b62cde640 1 Processor -- start 2024-04-14T23:35:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.686+0000 7f0b62cde640 1 -- start start 2024-04-14T23:35:54.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.687+0000 7f0b62cde640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5c0702e0 0x7f0b5c0d16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:54.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.687+0000 7f0b62cde640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0b5c071d70 0x7f0b5c06f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.687+0000 7f0b62cde640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b5c072280 con 0x7f0b5c06f880 2024-04-14T23:35:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.687+0000 7f0b62cde640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f0b5c072560 con 0x7f0b5c071d70 2024-04-14T23:35:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.687+0000 7f0b62cde640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0b5c072840 con 0x7f0b5c0702e0 2024-04-14T23:35:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.687+0000 7f0b5bfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0b5c071d70 0x7f0b5c06f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.687+0000 7f0b5bfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0b5c071d70 0x7f0b5c06f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43526/0 (socket says 172.21.15.47:43526) 2024-04-14T23:35:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.687+0000 7f0b5bfff640 1 -- 172.21.15.47:0/3176205412 learned_addr learned my addr 172.21.15.47:0/3176205412 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.687+0000 7f0b60a7a640 1 --2- 172.21.15.47:0/3176205412 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5c0702e0 0x7f0b5c0d16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.687+0000 7f0b5bfff640 1 -- 172.21.15.47:0/3176205412 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5c0702e0 msgr2=0x7f0b5c0d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.687+0000 7f0b5bfff640 1 --2- 172.21.15.47:0/3176205412 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5c0702e0 0x7f0b5c0d16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.687+0000 7f0b5bfff640 1 -- 172.21.15.47:0/3176205412 >> v1:172.21.15.191:6789/0 conn(0x7f0b5c06f880 legacy=0x7f0b5c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.687+0000 7f0b5bfff640 1 -- 172.21.15.47:0/3176205412 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5c072b20 con 0x7f0b5c071d70 2024-04-14T23:35:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.688+0000 7f0b5bfff640 1 --2- 172.21.15.47:0/3176205412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c071d70 0x7f0b5c06f340 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009870 tx=0x7f0b5002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7780aacd662303 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.688+0000 7f0b5b7fe640 1 -- 172.21.15.47:0/3176205412 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50035020 con 0x7f0b5c071d70 2024-04-14T23:35:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.688+0000 7f0b5b7fe640 1 -- 172.21.15.47:0/3176205412 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b50031640 con 0x7f0b5c071d70 2024-04-14T23:35:54.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.688+0000 7f0b5b7fe640 1 -- 172.21.15.47:0/3176205412 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5002d040 con 0x7f0b5c071d70 2024-04-14T23:35:54.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.689+0000 7f0b62cde640 1 -- 172.21.15.47:0/3176205412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c071d70 msgr2=0x7f0b5c06f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:54.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.689+0000 7f0b62cde640 1 --2- 172.21.15.47:0/3176205412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c071d70 0x7f0b5c06f340 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009870 tx=0x7f0b5002b8f0 comp rx=0 tx=0).stop 2024-04-14T23:35:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.689+0000 7f0b62cde640 1 -- 172.21.15.47:0/3176205412 shutdown_connections 2024-04-14T23:35:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.689+0000 7f0b62cde640 1 --2- 172.21.15.47:0/3176205412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c071d70 0x7f0b5c06f340 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.689+0000 7f0b62cde640 1 --2- 172.21.15.47:0/3176205412 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5c0702e0 0x7f0b5c0d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.689+0000 7f0b62cde640 1 -- 172.21.15.47:0/3176205412 >> 172.21.15.47:0/3176205412 conn(0x7f0b5c0d0bb0 msgr2=0x7f0b5c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.689+0000 7f0b62cde640 1 -- 172.21.15.47:0/3176205412 shutdown_connections 2024-04-14T23:35:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.689+0000 7f0b62cde640 1 -- 172.21.15.47:0/3176205412 wait complete. 2024-04-14T23:35:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.690+0000 7f0b62cde640 1 Processor -- start 2024-04-14T23:35:54.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.690+0000 7f0b62cde640 1 -- start start 2024-04-14T23:35:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.691+0000 7f0b62cde640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b5c06f880 0x7f0b5c0c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.691+0000 7f0b62cde640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5c0702e0 0x7f0b5c0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.691+0000 7f0b62cde640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c071d70 0x7f0b5c0cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.691+0000 7f0b62cde640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c06b910 con 0x7f0b5c071d70 2024-04-14T23:35:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.691+0000 7f0b62cde640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c0706c0 con 0x7f0b5c06f880 2024-04-14T23:35:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.691+0000 7f0b62cde640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0b5c06ba90 con 0x7f0b5c0702e0 2024-04-14T23:35:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.691+0000 7f0b6127b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c071d70 0x7f0b5c0cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:54.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.691+0000 7f0b6127b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c071d70 0x7f0b5c0cc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43530/0 (socket says 172.21.15.47:43530) 2024-04-14T23:35:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.691+0000 7f0b6127b640 1 -- 172.21.15.47:0/3060276494 learned_addr learned my addr 172.21.15.47:0/3060276494 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.691+0000 7f0b5bfff640 1 --2- 172.21.15.47:0/3060276494 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5c0702e0 0x7f0b5c0cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.691+0000 7f0b60a7a640 1 --2- 172.21.15.47:0/3060276494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b5c06f880 0x7f0b5c0c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.691+0000 7f0b6127b640 1 -- 172.21.15.47:0/3060276494 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5c0702e0 msgr2=0x7f0b5c0cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.691+0000 7f0b6127b640 1 --2- 172.21.15.47:0/3060276494 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5c0702e0 0x7f0b5c0cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.691+0000 7f0b6127b640 1 -- 172.21.15.47:0/3060276494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b5c06f880 msgr2=0x7f0b5c0c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.691+0000 7f0b6127b640 1 --2- 172.21.15.47:0/3060276494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b5c06f880 0x7f0b5c0c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.692+0000 7f0b6127b640 1 -- 172.21.15.47:0/3060276494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5c0cb2a0 con 0x7f0b5c071d70 2024-04-14T23:35:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.692+0000 7f0b6127b640 1 --2- 172.21.15.47:0/3060276494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c071d70 0x7f0b5c0cc880 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00b410 tx=0x7f0b4c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.692+0000 7f0b597fa640 1 -- 172.21.15.47:0/3060276494 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c015030 con 0x7f0b5c071d70 2024-04-14T23:35:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.692+0000 7f0b597fa640 1 -- 172.21.15.47:0/3060276494 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b4c004020 con 0x7f0b5c071d70 2024-04-14T23:35:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.692+0000 7f0b62cde640 1 -- 172.21.15.47:0/3060276494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5c0cb580 con 0x7f0b5c071d70 2024-04-14T23:35:54.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.692+0000 7f0b597fa640 1 -- 172.21.15.47:0/3060276494 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c004410 con 0x7f0b5c071d70 2024-04-14T23:35:54.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.692+0000 7f0b62cde640 1 -- 172.21.15.47:0/3060276494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b5c0cbb40 con 0x7f0b5c071d70 2024-04-14T23:35:54.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.693+0000 7f0b62cde640 1 -- 172.21.15.47:0/3060276494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b5c075430 con 0x7f0b5c071d70 2024-04-14T23:35:54.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.693+0000 7f0b597fa640 1 -- 172.21.15.47:0/3060276494 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0b4c018070 con 0x7f0b5c071d70 2024-04-14T23:35:54.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.694+0000 7f0b597fa640 1 --2- 172.21.15.47:0/3060276494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0b4806b990 0x7f0b4806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:54.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.694+0000 7f0b597fa640 1 -- 172.21.15.47:0/3060276494 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f0b4c08a5a0 con 0x7f0b5c071d70 2024-04-14T23:35:54.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.694+0000 7f0b60a7a640 1 --2- 172.21.15.47:0/3060276494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0b4806b990 0x7f0b4806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:54.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.695+0000 7f0b60a7a640 1 --2- 172.21.15.47:0/3060276494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0b4806b990 0x7f0b4806de50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009a60 tx=0x7f0b54003990 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:54.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.698+0000 7f0b597fa640 1 -- 172.21.15.47:0/3060276494 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0b4c058f80 con 0x7f0b5c071d70 2024-04-14T23:35:54.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.877+0000 7f0b62cde640 1 -- 172.21.15.47:0/3060276494 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b5c067800 con 0x7f0b4806b990 2024-04-14T23:35:54.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.884+0000 7f0b597fa640 1 -- 172.21.15.47:0/3060276494 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7f0b5c067800 con 0x7f0b4806b990 2024-04-14T23:35:54.890 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:54.891 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-14T23:35:54.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.887+0000 7f0b62cde640 1 -- 172.21.15.47:0/3060276494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0b4806b990 msgr2=0x7f0b4806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:54.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.887+0000 7f0b62cde640 1 --2- 172.21.15.47:0/3060276494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0b4806b990 0x7f0b4806de50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009a60 tx=0x7f0b54003990 comp rx=0 tx=0).stop 2024-04-14T23:35:54.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.887+0000 7f0b62cde640 1 -- 172.21.15.47:0/3060276494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c071d70 msgr2=0x7f0b5c0cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:54.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.887+0000 7f0b62cde640 1 --2- 172.21.15.47:0/3060276494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c071d70 0x7f0b5c0cc880 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00b410 tx=0x7f0b4c00b8d0 comp rx=0 tx=0).stop 2024-04-14T23:35:54.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.887+0000 7f0b62cde640 1 -- 172.21.15.47:0/3060276494 shutdown_connections 2024-04-14T23:35:54.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.887+0000 7f0b62cde640 1 --2- 172.21.15.47:0/3060276494 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0b4806b990 0x7f0b4806de50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:54.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.887+0000 7f0b62cde640 1 --2- 172.21.15.47:0/3060276494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c071d70 0x7f0b5c0cc880 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:54.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.887+0000 7f0b62cde640 1 --2- 172.21.15.47:0/3060276494 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b5c0702e0 0x7f0b5c0cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:54.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.887+0000 7f0b62cde640 1 --2- 172.21.15.47:0/3060276494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b5c06f880 0x7f0b5c0c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:54.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.887+0000 7f0b62cde640 1 -- 172.21.15.47:0/3060276494 >> 172.21.15.47:0/3060276494 conn(0x7f0b5c0d0bb0 msgr2=0x7f0b5c0b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:54.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.887+0000 7f0b62cde640 1 -- 172.21.15.47:0/3060276494 shutdown_connections 2024-04-14T23:35:54.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:54.887+0000 7f0b62cde640 1 -- 172.21.15.47:0/3060276494 wait complete. 2024-04-14T23:35:54.901 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-04-14T23:35:54.375685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237548,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737172,"statfs":{"total":773094113280,"available":772850864128,"internally_reserved":0,"allocated":4857856,"data_stored":2762940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001572"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128934+0000","last_change":"2024-04-14T23:35:47.145996+0000","last_active":"2024-04-14T23:35:48.128934+0000","last_peered":"2024-04-14T23:35:48.128934+0000","last_clean":"2024-04-14T23:35:48.128934+0000","last_became_active":"2024-04-14T23:35:47.145716+0000","last_became_peered":"2024-04-14T23:35:47.145716+0000","last_unstale":"2024-04-14T23:35:48.128934+0000","last_undegraded":"2024-04-14T23:35:48.128934+0000","last_fullsized":"2024-04-14T23:35:48.128934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:17:32.571374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128951+0000","last_change":"2024-04-14T23:35:47.154551+0000","last_active":"2024-04-14T23:35:48.128951+0000","last_peered":"2024-04-14T23:35:48.128951+0000","last_clean":"2024-04-14T23:35:48.128951+0000","last_became_active":"2024-04-14T23:35:47.154286+0000","last_became_peered":"2024-04-14T23:35:47.154286+0000","last_unstale":"2024-04-14T23:35:48.128951+0000","last_undegraded":"2024-04-14T23:35:48.128951+0000","last_fullsized":"2024-04-14T23:35:48.128951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:07:06.644232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929709+0000","last_change":"2024-04-14T23:35:47.160513+0000","last_active":"2024-04-14T23:35:48.929709+0000","last_peered":"2024-04-14T23:35:48.929709+0000","last_clean":"2024-04-14T23:35:48.929709+0000","last_became_active":"2024-04-14T23:35:47.160208+0000","last_became_peered":"2024-04-14T23:35:47.160208+0000","last_unstale":"2024-04-14T23:35:48.929709+0000","last_undegraded":"2024-04-14T23:35:48.929709+0000","last_fullsized":"2024-04-14T23:35:48.929709+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:38.502135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930879+0000","last_change":"2024-04-14T23:35:47.153454+0000","last_active":"2024-04-14T23:35:48.930879+0000","last_peered":"2024-04-14T23:35:48.930879+0000","last_clean":"2024-04-14T23:35:48.930879+0000","last_became_active":"2024-04-14T23:35:47.153133+0000","last_became_peered":"2024-04-14T23:35:47.153133+0000","last_unstale":"2024-04-14T23:35:48.930879+0000","last_undegraded":"2024-04-14T23:35:48.930879+0000","last_fullsized":"2024-04-14T23:35:48.930879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:58:36.176049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930648+0000","last_change":"2024-04-14T23:35:47.154211+0000","last_active":"2024-04-14T23:35:48.930648+0000","last_peered":"2024-04-14T23:35:48.930648+0000","last_clean":"2024-04-14T23:35:48.930648+0000","last_became_active":"2024-04-14T23:35:47.153936+0000","last_became_peered":"2024-04-14T23:35:47.153936+0000","last_unstale":"2024-04-14T23:35:48.930648+0000","last_undegraded":"2024-04-14T23:35:48.930648+0000","last_fullsized":"2024-04-14T23:35:48.930648+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:07:13.534770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929869+0000","last_change":"2024-04-14T23:35:47.143406+0000","last_active":"2024-04-14T23:35:48.929869+0000","last_peered":"2024-04-14T23:35:48.929869+0000","last_clean":"2024-04-14T23:35:48.929869+0000","last_became_active":"2024-04-14T23:35:47.143142+0000","last_became_peered":"2024-04-14T23:35:47.143142+0000","last_unstale":"2024-04-14T23:35:48.929869+0000","last_undegraded":"2024-04-14T23:35:48.929869+0000","last_fullsized":"2024-04-14T23:35:48.929869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:49.647834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129403+0000","last_change":"2024-04-14T23:35:47.159443+0000","last_active":"2024-04-14T23:35:48.129403+0000","last_peered":"2024-04-14T23:35:48.129403+0000","last_clean":"2024-04-14T23:35:48.129403+0000","last_became_active":"2024-04-14T23:35:47.157644+0000","last_became_peered":"2024-04-14T23:35:47.157644+0000","last_unstale":"2024-04-14T23:35:48.129403+0000","last_undegraded":"2024-04-14T23:35:48.129403+0000","last_fullsized":"2024-04-14T23:35:48.129403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128520+0000","last_change":"2024-04-14T23:35:47.150895+0000","last_active":"2024-04-14T23:35:48.128520+0000","last_peered":"2024-04-14T23:35:48.128520+0000","last_clean":"2024-04-14T23:35:48.128520+0000","last_became_active":"2024-04-14T23:35:47.150520+0000","last_became_peered":"2024-04-14T23:35:47.150520+0000","last_unstale":"2024-04-14T23:35:48.128520+0000","last_undegraded":"2024-04-14T23:35:48.128520+0000","last_fullsized":"2024-04-14T23:35:48.128520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:00.141829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930024+0000","last_change":"2024-04-14T23:35:47.160830+0000","last_active":"2024-04-14T23:35:48.930024+0000","last_peered":"2024-04-14T23:35:48.930024+0000","last_clean":"2024-04-14T23:35:48.930024+0000","last_became_active":"2024-04-14T23:35:47.160554+0000","last_became_peered":"2024-04-14T23:35:47.160554+0000","last_unstale":"2024-04-14T23:35:48.930024+0000","last_undegraded":"2024-04-14T23:35:48.930024+0000","last_fullsized":"2024-04-14T23:35:48.930024+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130272+0000","last_change":"2024-04-14T23:35:47.157661+0000","last_active":"2024-04-14T23:35:48.130272+0000","last_peered":"2024-04-14T23:35:48.130272+0000","last_clean":"2024-04-14T23:35:48.130272+0000","last_became_active":"2024-04-14T23:35:47.157377+0000","last_became_peered":"2024-04-14T23:35:47.157377+0000","last_unstale":"2024-04-14T23:35:48.130272+0000","last_undegraded":"2024-04-14T23:35:48.130272+0000","last_fullsized":"2024-04-14T23:35:48.130272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:54:50.487935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130985+0000","last_change":"2024-04-14T23:35:47.153073+0000","last_active":"2024-04-14T23:35:48.130985+0000","last_peered":"2024-04-14T23:35:48.130985+0000","last_clean":"2024-04-14T23:35:48.130985+0000","last_became_active":"2024-04-14T23:35:47.152649+0000","last_became_peered":"2024-04-14T23:35:47.152649+0000","last_unstale":"2024-04-14T23:35:48.130985+0000","last_undegraded":"2024-04-14T23:35:48.130985+0000","last_fullsized":"2024-04-14T23:35:48.130985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:47:32.718724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930449+0000","last_change":"2024-04-14T23:35:47.149389+0000","last_active":"2024-04-14T23:35:48.930449+0000","last_peered":"2024-04-14T23:35:48.930449+0000","last_clean":"2024-04-14T23:35:48.930449+0000","last_became_active":"2024-04-14T23:35:47.149130+0000","last_became_peered":"2024-04-14T23:35:47.149130+0000","last_unstale":"2024-04-14T23:35:48.930449+0000","last_undegraded":"2024-04-14T23:35:48.930449+0000","last_fullsized":"2024-04-14T23:35:48.930449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129857+0000","last_change":"2024-04-14T23:35:47.153273+0000","last_active":"2024-04-14T23:35:48.129857+0000","last_peered":"2024-04-14T23:35:48.129857+0000","last_clean":"2024-04-14T23:35:48.129857+0000","last_became_active":"2024-04-14T23:35:47.153005+0000","last_became_peered":"2024-04-14T23:35:47.153005+0000","last_unstale":"2024-04-14T23:35:48.129857+0000","last_undegraded":"2024-04-14T23:35:48.129857+0000","last_fullsized":"2024-04-14T23:35:48.129857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:33:25.414410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390635+0000","last_change":"2024-04-14T23:35:47.152798+0000","last_active":"2024-04-14T23:35:48.390635+0000","last_peered":"2024-04-14T23:35:48.390635+0000","last_clean":"2024-04-14T23:35:48.390635+0000","last_became_active":"2024-04-14T23:35:47.152530+0000","last_became_peered":"2024-04-14T23:35:47.152530+0000","last_unstale":"2024-04-14T23:35:48.390635+0000","last_undegraded":"2024-04-14T23:35:48.390635+0000","last_fullsized":"2024-04-14T23:35:48.390635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129640+0000","last_change":"2024-04-14T23:35:47.157364+0000","last_active":"2024-04-14T23:35:48.129640+0000","last_peered":"2024-04-14T23:35:48.129640+0000","last_clean":"2024-04-14T23:35:48.129640+0000","last_became_active":"2024-04-14T23:35:47.157069+0000","last_became_peered":"2024-04-14T23:35:47.157069+0000","last_unstale":"2024-04-14T23:35:48.129640+0000","last_undegraded":"2024-04-14T23:35:48.129640+0000","last_fullsized":"2024-04-14T23:35:48.129640+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929628+0000","last_change":"2024-04-14T23:35:47.157646+0000","last_active":"2024-04-14T23:35:48.929628+0000","last_peered":"2024-04-14T23:35:48.929628+0000","last_clean":"2024-04-14T23:35:48.929628+0000","last_became_active":"2024-04-14T23:35:47.157374+0000","last_became_peered":"2024-04-14T23:35:47.157374+0000","last_unstale":"2024-04-14T23:35:48.929628+0000","last_undegraded":"2024-04-14T23:35:48.929628+0000","last_fullsized":"2024-04-14T23:35:48.929628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:49.647834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930137+0000","last_change":"2024-04-14T23:35:47.160288+0000","last_active":"2024-04-14T23:35:48.930137+0000","last_peered":"2024-04-14T23:35:48.930137+0000","last_clean":"2024-04-14T23:35:48.930137+0000","last_became_active":"2024-04-14T23:35:47.160045+0000","last_became_peered":"2024-04-14T23:35:47.160045+0000","last_unstale":"2024-04-14T23:35:48.930137+0000","last_undegraded":"2024-04-14T23:35:48.930137+0000","last_fullsized":"2024-04-14T23:35:48.930137+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:33:25.414410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130094+0000","last_change":"2024-04-14T23:35:47.150954+0000","last_active":"2024-04-14T23:35:48.130094+0000","last_peered":"2024-04-14T23:35:48.130094+0000","last_clean":"2024-04-14T23:35:48.130094+0000","last_became_active":"2024-04-14T23:35:47.150606+0000","last_became_peered":"2024-04-14T23:35:47.150606+0000","last_unstale":"2024-04-14T23:35:48.130094+0000","last_undegraded":"2024-04-14T23:35:48.130094+0000","last_fullsized":"2024-04-14T23:35:48.130094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:39.427143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930862+0000","last_change":"2024-04-14T23:35:47.137492+0000","last_active":"2024-04-14T23:35:48.930862+0000","last_peered":"2024-04-14T23:35:48.930862+0000","last_clean":"2024-04-14T23:35:48.930862+0000","last_became_active":"2024-04-14T23:35:47.137234+0000","last_became_peered":"2024-04-14T23:35:47.137234+0000","last_unstale":"2024-04-14T23:35:48.930862+0000","last_undegraded":"2024-04-14T23:35:48.930862+0000","last_fullsized":"2024-04-14T23:35:48.930862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:30:05.284391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129997+0000","last_change":"2024-04-14T23:35:47.150013+0000","last_active":"2024-04-14T23:35:48.129997+0000","last_peered":"2024-04-14T23:35:48.129997+0000","last_clean":"2024-04-14T23:35:48.129997+0000","last_became_active":"2024-04-14T23:35:47.149754+0000","last_became_peered":"2024-04-14T23:35:47.149754+0000","last_unstale":"2024-04-14T23:35:48.129997+0000","last_undegraded":"2024-04-14T23:35:48.129997+0000","last_fullsized":"2024-04-14T23:35:48.129997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:12.344810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129783+0000","last_change":"2024-04-14T23:35:47.149073+0000","last_active":"2024-04-14T23:35:48.129783+0000","last_peered":"2024-04-14T23:35:48.129783+0000","last_clean":"2024-04-14T23:35:48.129783+0000","last_became_active":"2024-04-14T23:35:47.148806+0000","last_became_peered":"2024-04-14T23:35:47.148806+0000","last_unstale":"2024-04-14T23:35:48.129783+0000","last_undegraded":"2024-04-14T23:35:48.129783+0000","last_fullsized":"2024-04-14T23:35:48.129783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:18.147979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391033+0000","last_change":"2024-04-14T23:35:47.154397+0000","last_active":"2024-04-14T23:35:48.391033+0000","last_peered":"2024-04-14T23:35:48.391033+0000","last_clean":"2024-04-14T23:35:48.391033+0000","last_became_active":"2024-04-14T23:35:47.154054+0000","last_became_peered":"2024-04-14T23:35:47.154054+0000","last_unstale":"2024-04-14T23:35:48.391033+0000","last_undegraded":"2024-04-14T23:35:48.391033+0000","last_fullsized":"2024-04-14T23:35:48.391033+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:13:37.995199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929730+0000","last_change":"2024-04-14T23:35:47.135157+0000","last_active":"2024-04-14T23:35:48.929730+0000","last_peered":"2024-04-14T23:35:48.929730+0000","last_clean":"2024-04-14T23:35:48.929730+0000","last_became_active":"2024-04-14T23:35:47.134846+0000","last_became_peered":"2024-04-14T23:35:47.134846+0000","last_unstale":"2024-04-14T23:35:48.929730+0000","last_undegraded":"2024-04-14T23:35:48.929730+0000","last_fullsized":"2024-04-14T23:35:48.929730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:38.502135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930226+0000","last_change":"2024-04-14T23:35:47.134176+0000","last_active":"2024-04-14T23:35:48.930226+0000","last_peered":"2024-04-14T23:35:48.930226+0000","last_clean":"2024-04-14T23:35:48.930226+0000","last_became_active":"2024-04-14T23:35:47.133837+0000","last_became_peered":"2024-04-14T23:35:47.133837+0000","last_unstale":"2024-04-14T23:35:48.930226+0000","last_undegraded":"2024-04-14T23:35:48.930226+0000","last_fullsized":"2024-04-14T23:35:48.930226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:13:32.134259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130962+0000","last_change":"2024-04-14T23:35:47.141736+0000","last_active":"2024-04-14T23:35:48.130962+0000","last_peered":"2024-04-14T23:35:48.130962+0000","last_clean":"2024-04-14T23:35:48.130962+0000","last_became_active":"2024-04-14T23:35:47.141474+0000","last_became_peered":"2024-04-14T23:35:47.141474+0000","last_unstale":"2024-04-14T23:35:48.130962+0000","last_undegraded":"2024-04-14T23:35:48.130962+0000","last_fullsized":"2024-04-14T23:35:48.130962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:31:38.223026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930267+0000","last_change":"2024-04-14T23:35:47.151371+0000","last_active":"2024-04-14T23:35:48.930267+0000","last_peered":"2024-04-14T23:35:48.930267+0000","last_clean":"2024-04-14T23:35:48.930267+0000","last_became_active":"2024-04-14T23:35:47.151113+0000","last_became_peered":"2024-04-14T23:35:47.151113+0000","last_unstale":"2024-04-14T23:35:48.930267+0000","last_undegraded":"2024-04-14T23:35:48.930267+0000","last_fullsized":"2024-04-14T23:35:48.930267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:26.044901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130325+0000","last_change":"2024-04-14T23:35:47.144676+0000","last_active":"2024-04-14T23:35:48.130325+0000","last_peered":"2024-04-14T23:35:48.130325+0000","last_clean":"2024-04-14T23:35:48.130325+0000","last_became_active":"2024-04-14T23:35:47.144429+0000","last_became_peered":"2024-04-14T23:35:47.144429+0000","last_unstale":"2024-04-14T23:35:48.130325+0000","last_undegraded":"2024-04-14T23:35:48.130325+0000","last_fullsized":"2024-04-14T23:35:48.130325+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:40.857176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130449+0000","last_change":"2024-04-14T23:35:47.149677+0000","last_active":"2024-04-14T23:35:48.130449+0000","last_peered":"2024-04-14T23:35:48.130449+0000","last_clean":"2024-04-14T23:35:48.130449+0000","last_became_active":"2024-04-14T23:35:47.149370+0000","last_became_peered":"2024-04-14T23:35:47.149370+0000","last_unstale":"2024-04-14T23:35:48.130449+0000","last_undegraded":"2024-04-14T23:35:48.130449+0000","last_fullsized":"2024-04-14T23:35:48.130449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:56:02.290384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130652+0000","last_change":"2024-04-14T23:35:47.138179+0000","last_active":"2024-04-14T23:35:48.130652+0000","last_peered":"2024-04-14T23:35:48.130652+0000","last_clean":"2024-04-14T23:35:48.130652+0000","last_became_active":"2024-04-14T23:35:47.137917+0000","last_became_peered":"2024-04-14T23:35:47.137917+0000","last_unstale":"2024-04-14T23:35:48.130652+0000","last_undegraded":"2024-04-14T23:35:48.130652+0000","last_fullsized":"2024-04-14T23:35:48.130652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:10:16.379713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130246+0000","last_change":"2024-04-14T23:35:47.140281+0000","last_active":"2024-04-14T23:35:48.130246+0000","last_peered":"2024-04-14T23:35:48.130246+0000","last_clean":"2024-04-14T23:35:48.130246+0000","last_became_active":"2024-04-14T23:35:47.140018+0000","last_became_peered":"2024-04-14T23:35:47.140018+0000","last_unstale":"2024-04-14T23:35:48.130246+0000","last_undegraded":"2024-04-14T23:35:48.130246+0000","last_fullsized":"2024-04-14T23:35:48.130246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:12.833964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929754+0000","last_change":"2024-04-14T23:35:47.150510+0000","last_active":"2024-04-14T23:35:48.929754+0000","last_peered":"2024-04-14T23:35:48.929754+0000","last_clean":"2024-04-14T23:35:48.929754+0000","last_became_active":"2024-04-14T23:35:47.150210+0000","last_became_peered":"2024-04-14T23:35:47.150210+0000","last_unstale":"2024-04-14T23:35:48.929754+0000","last_undegraded":"2024-04-14T23:35:48.929754+0000","last_fullsized":"2024-04-14T23:35:48.929754+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:27.967946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929546+0000","last_change":"2024-04-14T23:35:47.154478+0000","last_active":"2024-04-14T23:35:48.929546+0000","last_peered":"2024-04-14T23:35:48.929546+0000","last_clean":"2024-04-14T23:35:48.929546+0000","last_became_active":"2024-04-14T23:35:47.154196+0000","last_became_peered":"2024-04-14T23:35:47.154196+0000","last_unstale":"2024-04-14T23:35:48.929546+0000","last_undegraded":"2024-04-14T23:35:48.929546+0000","last_fullsized":"2024-04-14T23:35:48.929546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:47:00.159204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929959+0000","last_change":"2024-04-14T23:35:47.157634+0000","last_active":"2024-04-14T23:35:48.929959+0000","last_peered":"2024-04-14T23:35:48.929959+0000","last_clean":"2024-04-14T23:35:48.929959+0000","last_became_active":"2024-04-14T23:35:47.157342+0000","last_became_peered":"2024-04-14T23:35:47.157342+0000","last_unstale":"2024-04-14T23:35:48.929959+0000","last_undegraded":"2024-04-14T23:35:48.929959+0000","last_fullsized":"2024-04-14T23:35:48.929959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130857+0000","last_change":"2024-04-14T23:35:46.130076+0000","last_active":"2024-04-14T23:35:48.130857+0000","last_peered":"2024-04-14T23:35:48.130857+0000","last_clean":"2024-04-14T23:35:48.130857+0000","last_became_active":"2024-04-14T23:35:46.129786+0000","last_became_peered":"2024-04-14T23:35:46.129786+0000","last_unstale":"2024-04-14T23:35:48.130857+0000","last_undegraded":"2024-04-14T23:35:48.130857+0000","last_fullsized":"2024-04-14T23:35:48.130857+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:55:49.584788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930680+0000","last_change":"2024-04-14T23:35:47.157788+0000","last_active":"2024-04-14T23:35:48.930680+0000","last_peered":"2024-04-14T23:35:48.930680+0000","last_clean":"2024-04-14T23:35:48.930680+0000","last_became_active":"2024-04-14T23:35:47.157538+0000","last_became_peered":"2024-04-14T23:35:47.157538+0000","last_unstale":"2024-04-14T23:35:48.930680+0000","last_undegraded":"2024-04-14T23:35:48.930680+0000","last_fullsized":"2024-04-14T23:35:48.930680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929932+0000","last_change":"2024-04-14T23:35:46.136432+0000","last_active":"2024-04-14T23:35:48.929932+0000","last_peered":"2024-04-14T23:35:48.929932+0000","last_clean":"2024-04-14T23:35:48.929932+0000","last_became_active":"2024-04-14T23:35:46.136168+0000","last_became_peered":"2024-04-14T23:35:46.136168+0000","last_unstale":"2024-04-14T23:35:48.929932+0000","last_undegraded":"2024-04-14T23:35:48.929932+0000","last_fullsized":"2024-04-14T23:35:48.929932+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:11.340513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391012+0000","last_change":"2024-04-14T23:35:47.149283+0000","last_active":"2024-04-14T23:35:48.391012+0000","last_peered":"2024-04-14T23:35:48.391012+0000","last_clean":"2024-04-14T23:35:48.391012+0000","last_became_active":"2024-04-14T23:35:47.148963+0000","last_became_peered":"2024-04-14T23:35:47.148963+0000","last_unstale":"2024-04-14T23:35:48.391012+0000","last_undegraded":"2024-04-14T23:35:48.391012+0000","last_fullsized":"2024-04-14T23:35:48.391012+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:33:25.414410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930741+0000","last_change":"2024-04-14T23:35:46.137540+0000","last_active":"2024-04-14T23:35:48.930741+0000","last_peered":"2024-04-14T23:35:48.930741+0000","last_clean":"2024-04-14T23:35:48.930741+0000","last_became_active":"2024-04-14T23:35:46.137096+0000","last_became_peered":"2024-04-14T23:35:46.137096+0000","last_unstale":"2024-04-14T23:35:48.930741+0000","last_undegraded":"2024-04-14T23:35:48.930741+0000","last_fullsized":"2024-04-14T23:35:48.930741+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128931+0000","last_change":"2024-04-14T23:35:47.146618+0000","last_active":"2024-04-14T23:35:48.128931+0000","last_peered":"2024-04-14T23:35:48.128931+0000","last_clean":"2024-04-14T23:35:48.128931+0000","last_became_active":"2024-04-14T23:35:47.146329+0000","last_became_peered":"2024-04-14T23:35:47.146329+0000","last_unstale":"2024-04-14T23:35:48.128931+0000","last_undegraded":"2024-04-14T23:35:48.128931+0000","last_fullsized":"2024-04-14T23:35:48.128931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:59:58.258654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390798+0000","last_change":"2024-04-14T23:35:46.133465+0000","last_active":"2024-04-14T23:35:48.390798+0000","last_peered":"2024-04-14T23:35:48.390798+0000","last_clean":"2024-04-14T23:35:48.390798+0000","last_became_active":"2024-04-14T23:35:46.133188+0000","last_became_peered":"2024-04-14T23:35:46.133188+0000","last_unstale":"2024-04-14T23:35:48.390798+0000","last_undegraded":"2024-04-14T23:35:48.390798+0000","last_fullsized":"2024-04-14T23:35:48.390798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:38.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929549+0000","last_change":"2024-04-14T23:35:47.142488+0000","last_active":"2024-04-14T23:35:48.929549+0000","last_peered":"2024-04-14T23:35:48.929549+0000","last_clean":"2024-04-14T23:35:48.929549+0000","last_became_active":"2024-04-14T23:35:47.142140+0000","last_became_peered":"2024-04-14T23:35:47.142140+0000","last_unstale":"2024-04-14T23:35:48.929549+0000","last_undegraded":"2024-04-14T23:35:48.929549+0000","last_fullsized":"2024-04-14T23:35:48.929549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:47:00.159204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129923+0000","last_change":"2024-04-14T23:35:46.135150+0000","last_active":"2024-04-14T23:35:48.129923+0000","last_peered":"2024-04-14T23:35:48.129923+0000","last_clean":"2024-04-14T23:35:48.129923+0000","last_became_active":"2024-04-14T23:35:46.134786+0000","last_became_peered":"2024-04-14T23:35:46.134786+0000","last_unstale":"2024-04-14T23:35:48.129923+0000","last_undegraded":"2024-04-14T23:35:48.129923+0000","last_fullsized":"2024-04-14T23:35:48.129923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:28.026305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130028+0000","last_change":"2024-04-14T23:35:47.159541+0000","last_active":"2024-04-14T23:35:48.130028+0000","last_peered":"2024-04-14T23:35:48.130028+0000","last_clean":"2024-04-14T23:35:48.130028+0000","last_became_active":"2024-04-14T23:35:47.158355+0000","last_became_peered":"2024-04-14T23:35:47.158355+0000","last_unstale":"2024-04-14T23:35:48.130028+0000","last_undegraded":"2024-04-14T23:35:48.130028+0000","last_fullsized":"2024-04-14T23:35:48.130028+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:13:37.995199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929626+0000","last_change":"2024-04-14T23:35:46.139410+0000","last_active":"2024-04-14T23:35:48.929626+0000","last_peered":"2024-04-14T23:35:48.929626+0000","last_clean":"2024-04-14T23:35:48.929626+0000","last_became_active":"2024-04-14T23:35:46.138931+0000","last_became_peered":"2024-04-14T23:35:46.138931+0000","last_unstale":"2024-04-14T23:35:48.929626+0000","last_undegraded":"2024-04-14T23:35:48.929626+0000","last_fullsized":"2024-04-14T23:35:48.929626+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:28.026305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390862+0000","last_change":"2024-04-14T23:35:47.158537+0000","last_active":"2024-04-14T23:35:48.390862+0000","last_peered":"2024-04-14T23:35:48.390862+0000","last_clean":"2024-04-14T23:35:48.390862+0000","last_became_active":"2024-04-14T23:35:47.158238+0000","last_became_peered":"2024-04-14T23:35:47.158238+0000","last_unstale":"2024-04-14T23:35:48.390862+0000","last_undegraded":"2024-04-14T23:35:48.390862+0000","last_fullsized":"2024-04-14T23:35:48.390862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929960+0000","last_change":"2024-04-14T23:35:46.134765+0000","last_active":"2024-04-14T23:35:48.929960+0000","last_peered":"2024-04-14T23:35:48.929960+0000","last_clean":"2024-04-14T23:35:48.929960+0000","last_became_active":"2024-04-14T23:35:46.134477+0000","last_became_peered":"2024-04-14T23:35:46.134477+0000","last_unstale":"2024-04-14T23:35:48.929960+0000","last_undegraded":"2024-04-14T23:35:48.929960+0000","last_fullsized":"2024-04-14T23:35:48.929960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:38.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128703+0000","last_change":"2024-04-14T23:35:47.153332+0000","last_active":"2024-04-14T23:35:48.128703+0000","last_peered":"2024-04-14T23:35:48.128703+0000","last_clean":"2024-04-14T23:35:48.128703+0000","last_became_active":"2024-04-14T23:35:47.152701+0000","last_became_peered":"2024-04-14T23:35:47.152701+0000","last_unstale":"2024-04-14T23:35:48.128703+0000","last_undegraded":"2024-04-14T23:35:48.128703+0000","last_fullsized":"2024-04-14T23:35:48.128703+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:45:43.060746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390464+0000","last_change":"2024-04-14T23:35:46.132189+0000","last_active":"2024-04-14T23:35:48.390464+0000","last_peered":"2024-04-14T23:35:48.390464+0000","last_clean":"2024-04-14T23:35:48.390464+0000","last_became_active":"2024-04-14T23:35:46.131898+0000","last_became_peered":"2024-04-14T23:35:46.131898+0000","last_unstale":"2024-04-14T23:35:48.390464+0000","last_undegraded":"2024-04-14T23:35:48.390464+0000","last_fullsized":"2024-04-14T23:35:48.390464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:39.852879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930999+0000","last_change":"2024-04-14T23:35:47.151785+0000","last_active":"2024-04-14T23:35:48.930999+0000","last_peered":"2024-04-14T23:35:48.930999+0000","last_clean":"2024-04-14T23:35:48.930999+0000","last_became_active":"2024-04-14T23:35:47.151273+0000","last_became_peered":"2024-04-14T23:35:47.151273+0000","last_unstale":"2024-04-14T23:35:48.930999+0000","last_undegraded":"2024-04-14T23:35:48.930999+0000","last_fullsized":"2024-04-14T23:35:48.930999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:51.707591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128964+0000","last_change":"2024-04-14T23:35:46.130128+0000","last_active":"2024-04-14T23:35:48.128964+0000","last_peered":"2024-04-14T23:35:48.128964+0000","last_clean":"2024-04-14T23:35:48.128964+0000","last_became_active":"2024-04-14T23:35:46.129848+0000","last_became_peered":"2024-04-14T23:35:46.129848+0000","last_unstale":"2024-04-14T23:35:48.128964+0000","last_undegraded":"2024-04-14T23:35:48.128964+0000","last_fullsized":"2024-04-14T23:35:48.128964+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:25.040605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930239+0000","last_change":"2024-04-14T23:35:47.135501+0000","last_active":"2024-04-14T23:35:48.930239+0000","last_peered":"2024-04-14T23:35:48.930239+0000","last_clean":"2024-04-14T23:35:48.930239+0000","last_became_active":"2024-04-14T23:35:47.135240+0000","last_became_peered":"2024-04-14T23:35:47.135240+0000","last_unstale":"2024-04-14T23:35:48.930239+0000","last_undegraded":"2024-04-14T23:35:48.930239+0000","last_fullsized":"2024-04-14T23:35:48.930239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130481+0000","last_change":"2024-04-14T23:35:46.132005+0000","last_active":"2024-04-14T23:35:48.130481+0000","last_peered":"2024-04-14T23:35:48.130481+0000","last_clean":"2024-04-14T23:35:48.130481+0000","last_became_active":"2024-04-14T23:35:46.131640+0000","last_became_peered":"2024-04-14T23:35:46.131640+0000","last_unstale":"2024-04-14T23:35:48.130481+0000","last_undegraded":"2024-04-14T23:35:48.130481+0000","last_fullsized":"2024-04-14T23:35:48.130481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:11.340513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929884+0000","last_change":"2024-04-14T23:35:47.153756+0000","last_active":"2024-04-14T23:35:48.929884+0000","last_peered":"2024-04-14T23:35:48.929884+0000","last_clean":"2024-04-14T23:35:48.929884+0000","last_became_active":"2024-04-14T23:35:47.153494+0000","last_became_peered":"2024-04-14T23:35:47.153494+0000","last_unstale":"2024-04-14T23:35:48.929884+0000","last_undegraded":"2024-04-14T23:35:48.929884+0000","last_fullsized":"2024-04-14T23:35:48.929884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:26.044901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.131064+0000","last_change":"2024-04-14T23:35:46.129168+0000","last_active":"2024-04-14T23:35:48.131064+0000","last_peered":"2024-04-14T23:35:48.131064+0000","last_clean":"2024-04-14T23:35:48.131064+0000","last_became_active":"2024-04-14T23:35:46.128883+0000","last_became_peered":"2024-04-14T23:35:46.128883+0000","last_unstale":"2024-04-14T23:35:48.131064+0000","last_undegraded":"2024-04-14T23:35:48.131064+0000","last_fullsized":"2024-04-14T23:35:48.131064+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391075+0000","last_change":"2024-04-14T23:35:47.154541+0000","last_active":"2024-04-14T23:35:48.391075+0000","last_peered":"2024-04-14T23:35:48.391075+0000","last_clean":"2024-04-14T23:35:48.391075+0000","last_became_active":"2024-04-14T23:35:47.154276+0000","last_became_peered":"2024-04-14T23:35:47.154276+0000","last_unstale":"2024-04-14T23:35:48.391075+0000","last_undegraded":"2024-04-14T23:35:48.391075+0000","last_fullsized":"2024-04-14T23:35:48.391075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:54:50.487935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128693+0000","last_change":"2024-04-14T23:35:46.136620+0000","last_active":"2024-04-14T23:35:48.128693+0000","last_peered":"2024-04-14T23:35:48.128693+0000","last_clean":"2024-04-14T23:35:48.128693+0000","last_became_active":"2024-04-14T23:35:46.136185+0000","last_became_peered":"2024-04-14T23:35:46.136185+0000","last_unstale":"2024-04-14T23:35:48.128693+0000","last_undegraded":"2024-04-14T23:35:48.128693+0000","last_fullsized":"2024-04-14T23:35:48.128693+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:26.963649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929540+0000","last_change":"2024-04-14T23:35:47.158305+0000","last_active":"2024-04-14T23:35:48.929540+0000","last_peered":"2024-04-14T23:35:48.929540+0000","last_clean":"2024-04-14T23:35:48.929540+0000","last_became_active":"2024-04-14T23:35:47.157745+0000","last_became_peered":"2024-04-14T23:35:47.157745+0000","last_unstale":"2024-04-14T23:35:48.929540+0000","last_undegraded":"2024-04-14T23:35:48.929540+0000","last_fullsized":"2024-04-14T23:35:48.929540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:49.647834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128763+0000","last_change":"2024-04-14T23:35:46.133651+0000","last_active":"2024-04-14T23:35:48.128763+0000","last_peered":"2024-04-14T23:35:48.128763+0000","last_clean":"2024-04-14T23:35:48.128763+0000","last_became_active":"2024-04-14T23:35:46.133356+0000","last_became_peered":"2024-04-14T23:35:46.133356+0000","last_unstale":"2024-04-14T23:35:48.128763+0000","last_undegraded":"2024-04-14T23:35:48.128763+0000","last_fullsized":"2024-04-14T23:35:48.128763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:39.741647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128618+0000","last_change":"2024-04-14T23:35:47.143315+0000","last_active":"2024-04-14T23:35:48.128618+0000","last_peered":"2024-04-14T23:35:48.128618+0000","last_clean":"2024-04-14T23:35:48.128618+0000","last_became_active":"2024-04-14T23:35:47.143045+0000","last_became_peered":"2024-04-14T23:35:47.143045+0000","last_unstale":"2024-04-14T23:35:48.128618+0000","last_undegraded":"2024-04-14T23:35:48.128618+0000","last_fullsized":"2024-04-14T23:35:48.128618+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:10:25.940509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929923+0000","last_change":"2024-04-14T23:35:46.134679+0000","last_active":"2024-04-14T23:35:48.929923+0000","last_peered":"2024-04-14T23:35:48.929923+0000","last_clean":"2024-04-14T23:35:48.929923+0000","last_became_active":"2024-04-14T23:35:46.134400+0000","last_became_peered":"2024-04-14T23:35:46.134400+0000","last_unstale":"2024-04-14T23:35:48.929923+0000","last_undegraded":"2024-04-14T23:35:48.929923+0000","last_fullsized":"2024-04-14T23:35:48.929923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:11.829667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929760+0000","last_change":"2024-04-14T23:35:47.135899+0000","last_active":"2024-04-14T23:35:48.929760+0000","last_peered":"2024-04-14T23:35:48.929760+0000","last_clean":"2024-04-14T23:35:48.929760+0000","last_became_active":"2024-04-14T23:35:47.134733+0000","last_became_peered":"2024-04-14T23:35:47.134733+0000","last_unstale":"2024-04-14T23:35:48.929760+0000","last_undegraded":"2024-04-14T23:35:48.929760+0000","last_fullsized":"2024-04-14T23:35:48.929760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:26.044901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129540+0000","last_change":"2024-04-14T23:35:46.128127+0000","last_active":"2024-04-14T23:35:48.129540+0000","last_peered":"2024-04-14T23:35:48.129540+0000","last_clean":"2024-04-14T23:35:48.129540+0000","last_became_active":"2024-04-14T23:35:46.127852+0000","last_became_peered":"2024-04-14T23:35:46.127852+0000","last_unstale":"2024-04-14T23:35:48.129540+0000","last_undegraded":"2024-04-14T23:35:48.129540+0000","last_fullsized":"2024-04-14T23:35:48.129540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:28:27.338198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128687+0000","last_change":"2024-04-14T23:35:47.147302+0000","last_active":"2024-04-14T23:35:48.128687+0000","last_peered":"2024-04-14T23:35:48.128687+0000","last_clean":"2024-04-14T23:35:48.128687+0000","last_became_active":"2024-04-14T23:35:47.147022+0000","last_became_peered":"2024-04-14T23:35:47.147022+0000","last_unstale":"2024-04-14T23:35:48.128687+0000","last_undegraded":"2024-04-14T23:35:48.128687+0000","last_fullsized":"2024-04-14T23:35:48.128687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:29:11.592779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929556+0000","last_change":"2024-04-14T23:35:46.139301+0000","last_active":"2024-04-14T23:35:48.929556+0000","last_peered":"2024-04-14T23:35:48.929556+0000","last_clean":"2024-04-14T23:35:48.929556+0000","last_became_active":"2024-04-14T23:35:46.138922+0000","last_became_peered":"2024-04-14T23:35:46.138922+0000","last_unstale":"2024-04-14T23:35:48.929556+0000","last_undegraded":"2024-04-14T23:35:48.929556+0000","last_fullsized":"2024-04-14T23:35:48.929556+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:30:04.280095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128762+0000","last_change":"2024-04-14T23:35:47.143210+0000","last_active":"2024-04-14T23:35:48.128762+0000","last_peered":"2024-04-14T23:35:48.128762+0000","last_clean":"2024-04-14T23:35:48.128762+0000","last_became_active":"2024-04-14T23:35:47.142925+0000","last_became_peered":"2024-04-14T23:35:47.142925+0000","last_unstale":"2024-04-14T23:35:48.128762+0000","last_undegraded":"2024-04-14T23:35:48.128762+0000","last_fullsized":"2024-04-14T23:35:48.128762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:19:31.536395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130578+0000","last_change":"2024-04-14T23:35:46.130896+0000","last_active":"2024-04-14T23:35:48.130578+0000","last_peered":"2024-04-14T23:35:48.130578+0000","last_clean":"2024-04-14T23:35:48.130578+0000","last_became_active":"2024-04-14T23:35:46.130423+0000","last_became_peered":"2024-04-14T23:35:46.130423+0000","last_unstale":"2024-04-14T23:35:48.130578+0000","last_undegraded":"2024-04-14T23:35:48.130578+0000","last_fullsized":"2024-04-14T23:35:48.130578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:38.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.131117+0000","last_change":"2024-04-14T23:35:47.149269+0000","last_active":"2024-04-14T23:35:48.131117+0000","last_peered":"2024-04-14T23:35:48.131117+0000","last_clean":"2024-04-14T23:35:48.131117+0000","last_became_active":"2024-04-14T23:35:47.148964+0000","last_became_peered":"2024-04-14T23:35:47.148964+0000","last_unstale":"2024-04-14T23:35:48.131117+0000","last_undegraded":"2024-04-14T23:35:48.131117+0000","last_fullsized":"2024-04-14T23:35:48.131117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:16:06.767783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391019+0000","last_change":"2024-04-14T23:35:46.137019+0000","last_active":"2024-04-14T23:35:48.391019+0000","last_peered":"2024-04-14T23:35:48.391019+0000","last_clean":"2024-04-14T23:35:48.391019+0000","last_became_active":"2024-04-14T23:35:46.136718+0000","last_became_peered":"2024-04-14T23:35:46.136718+0000","last_unstale":"2024-04-14T23:35:48.391019+0000","last_undegraded":"2024-04-14T23:35:48.391019+0000","last_fullsized":"2024-04-14T23:35:48.391019+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:11.829667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390937+0000","last_change":"2024-04-14T23:35:47.149376+0000","last_active":"2024-04-14T23:35:48.390937+0000","last_peered":"2024-04-14T23:35:48.390937+0000","last_clean":"2024-04-14T23:35:48.390937+0000","last_became_active":"2024-04-14T23:35:47.149067+0000","last_became_peered":"2024-04-14T23:35:47.149067+0000","last_unstale":"2024-04-14T23:35:48.390937+0000","last_undegraded":"2024-04-14T23:35:48.390937+0000","last_fullsized":"2024-04-14T23:35:48.390937+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:18.147979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930844+0000","last_change":"2024-04-14T23:35:46.136557+0000","last_active":"2024-04-14T23:35:48.930844+0000","last_peered":"2024-04-14T23:35:48.930844+0000","last_clean":"2024-04-14T23:35:48.930844+0000","last_became_active":"2024-04-14T23:35:46.136236+0000","last_became_peered":"2024-04-14T23:35:46.136236+0000","last_unstale":"2024-04-14T23:35:48.930844+0000","last_undegraded":"2024-04-14T23:35:48.930844+0000","last_fullsized":"2024-04-14T23:35:48.930844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:08:47.351218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930975+0000","last_change":"2024-04-14T23:35:47.150822+0000","last_active":"2024-04-14T23:35:48.930975+0000","last_peered":"2024-04-14T23:35:48.930975+0000","last_clean":"2024-04-14T23:35:48.930975+0000","last_became_active":"2024-04-14T23:35:47.150517+0000","last_became_peered":"2024-04-14T23:35:47.150517+0000","last_unstale":"2024-04-14T23:35:48.930975+0000","last_undegraded":"2024-04-14T23:35:48.930975+0000","last_fullsized":"2024-04-14T23:35:48.930975+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:29.030602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930275+0000","last_change":"2024-04-14T23:35:46.136475+0000","last_active":"2024-04-14T23:35:48.930275+0000","last_peered":"2024-04-14T23:35:48.930275+0000","last_clean":"2024-04-14T23:35:48.930275+0000","last_became_active":"2024-04-14T23:35:46.136103+0000","last_became_peered":"2024-04-14T23:35:46.136103+0000","last_unstale":"2024-04-14T23:35:48.930275+0000","last_undegraded":"2024-04-14T23:35:48.930275+0000","last_fullsized":"2024-04-14T23:35:48.930275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:11.340513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929988+0000","last_change":"2024-04-14T23:35:47.146919+0000","last_active":"2024-04-14T23:35:48.929988+0000","last_peered":"2024-04-14T23:35:48.929988+0000","last_clean":"2024-04-14T23:35:48.929988+0000","last_became_active":"2024-04-14T23:35:47.146080+0000","last_became_peered":"2024-04-14T23:35:47.146080+0000","last_unstale":"2024-04-14T23:35:48.929988+0000","last_undegraded":"2024-04-14T23:35:48.929988+0000","last_fullsized":"2024-04-14T23:35:48.929988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930583+0000","last_change":"2024-04-14T23:35:46.132858+0000","last_active":"2024-04-14T23:35:48.930583+0000","last_peered":"2024-04-14T23:35:48.930583+0000","last_clean":"2024-04-14T23:35:48.930583+0000","last_became_active":"2024-04-14T23:35:46.132542+0000","last_became_peered":"2024-04-14T23:35:46.132542+0000","last_unstale":"2024-04-14T23:35:48.930583+0000","last_undegraded":"2024-04-14T23:35:48.930583+0000","last_fullsized":"2024-04-14T23:35:48.930583+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:51:12.197819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929957+0000","last_change":"2024-04-14T23:35:47.154850+0000","last_active":"2024-04-14T23:35:48.929957+0000","last_peered":"2024-04-14T23:35:48.929957+0000","last_clean":"2024-04-14T23:35:48.929957+0000","last_became_active":"2024-04-14T23:35:47.154568+0000","last_became_peered":"2024-04-14T23:35:47.154568+0000","last_unstale":"2024-04-14T23:35:48.929957+0000","last_undegraded":"2024-04-14T23:35:48.929957+0000","last_fullsized":"2024-04-14T23:35:48.929957+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930191+0000","last_change":"2024-04-14T23:35:46.131620+0000","last_active":"2024-04-14T23:35:48.930191+0000","last_peered":"2024-04-14T23:35:48.930191+0000","last_clean":"2024-04-14T23:35:48.930191+0000","last_became_active":"2024-04-14T23:35:46.131245+0000","last_became_peered":"2024-04-14T23:35:46.131245+0000","last_unstale":"2024-04-14T23:35:48.930191+0000","last_undegraded":"2024-04-14T23:35:48.930191+0000","last_fullsized":"2024-04-14T23:35:48.930191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:43:31.510170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129762+0000","last_change":"2024-04-14T23:35:47.149519+0000","last_active":"2024-04-14T23:35:48.129762+0000","last_peered":"2024-04-14T23:35:48.129762+0000","last_clean":"2024-04-14T23:35:48.129762+0000","last_became_active":"2024-04-14T23:35:47.149206+0000","last_became_peered":"2024-04-14T23:35:47.149206+0000","last_unstale":"2024-04-14T23:35:48.129762+0000","last_undegraded":"2024-04-14T23:35:48.129762+0000","last_fullsized":"2024-04-14T23:35:48.129762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929811+0000","last_change":"2024-04-14T23:35:46.136409+0000","last_active":"2024-04-14T23:35:48.929811+0000","last_peered":"2024-04-14T23:35:48.929811+0000","last_clean":"2024-04-14T23:35:48.929811+0000","last_became_active":"2024-04-14T23:35:46.136141+0000","last_became_peered":"2024-04-14T23:35:46.136141+0000","last_unstale":"2024-04-14T23:35:48.929811+0000","last_undegraded":"2024-04-14T23:35:48.929811+0000","last_fullsized":"2024-04-14T23:35:48.929811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128851+0000","last_change":"2024-04-14T23:35:47.152792+0000","last_active":"2024-04-14T23:35:48.128851+0000","last_peered":"2024-04-14T23:35:48.128851+0000","last_clean":"2024-04-14T23:35:48.128851+0000","last_became_active":"2024-04-14T23:35:47.152529+0000","last_became_peered":"2024-04-14T23:35:47.152529+0000","last_unstale":"2024-04-14T23:35:48.128851+0000","last_undegraded":"2024-04-14T23:35:48.128851+0000","last_fullsized":"2024-04-14T23:35:48.128851+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:26:37.825904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930189+0000","last_change":"2024-04-14T23:35:46.131128+0000","last_active":"2024-04-14T23:35:48.930189+0000","last_peered":"2024-04-14T23:35:48.930189+0000","last_clean":"2024-04-14T23:35:48.930189+0000","last_became_active":"2024-04-14T23:35:46.130829+0000","last_became_peered":"2024-04-14T23:35:46.130829+0000","last_unstale":"2024-04-14T23:35:48.930189+0000","last_undegraded":"2024-04-14T23:35:48.930189+0000","last_fullsized":"2024-04-14T23:35:48.930189+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:26:22.509424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930226+0000","last_change":"2024-04-14T23:35:47.157604+0000","last_active":"2024-04-14T23:35:48.930226+0000","last_peered":"2024-04-14T23:35:48.930226+0000","last_clean":"2024-04-14T23:35:48.930226+0000","last_became_active":"2024-04-14T23:35:47.157332+0000","last_became_peered":"2024-04-14T23:35:47.157332+0000","last_unstale":"2024-04-14T23:35:48.930226+0000","last_undegraded":"2024-04-14T23:35:48.930226+0000","last_fullsized":"2024-04-14T23:35:48.930226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:27.967946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130676+0000","last_change":"2024-04-14T23:35:46.130670+0000","last_active":"2024-04-14T23:35:48.130676+0000","last_peered":"2024-04-14T23:35:48.130676+0000","last_clean":"2024-04-14T23:35:48.130676+0000","last_became_active":"2024-04-14T23:35:46.130053+0000","last_became_peered":"2024-04-14T23:35:46.130053+0000","last_unstale":"2024-04-14T23:35:48.130676+0000","last_undegraded":"2024-04-14T23:35:48.130676+0000","last_fullsized":"2024-04-14T23:35:48.130676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:11.829667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930021+0000","last_change":"2024-04-14T23:35:47.135664+0000","last_active":"2024-04-14T23:35:48.930021+0000","last_peered":"2024-04-14T23:35:48.930021+0000","last_clean":"2024-04-14T23:35:48.930021+0000","last_became_active":"2024-04-14T23:35:47.135290+0000","last_became_peered":"2024-04-14T23:35:47.135290+0000","last_unstale":"2024-04-14T23:35:48.930021+0000","last_undegraded":"2024-04-14T23:35:48.930021+0000","last_fullsized":"2024-04-14T23:35:48.930021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:18.147979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930941+0000","last_change":"2024-04-14T23:35:46.133201+0000","last_active":"2024-04-14T23:35:48.930941+0000","last_peered":"2024-04-14T23:35:48.930941+0000","last_clean":"2024-04-14T23:35:48.930941+0000","last_became_active":"2024-04-14T23:35:46.132894+0000","last_became_peered":"2024-04-14T23:35:46.132894+0000","last_unstale":"2024-04-14T23:35:48.930941+0000","last_undegraded":"2024-04-14T23:35:48.930941+0000","last_fullsized":"2024-04-14T23:35:48.930941+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:23:21.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128887+0000","last_change":"2024-04-14T23:35:47.153255+0000","last_active":"2024-04-14T23:35:48.128887+0000","last_peered":"2024-04-14T23:35:48.128887+0000","last_clean":"2024-04-14T23:35:48.128887+0000","last_became_active":"2024-04-14T23:35:47.152994+0000","last_became_peered":"2024-04-14T23:35:47.152994+0000","last_unstale":"2024-04-14T23:35:48.128887+0000","last_undegraded":"2024-04-14T23:35:48.128887+0000","last_fullsized":"2024-04-14T23:35:48.128887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:32:36.376204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929974+0000","last_change":"2024-04-14T23:35:46.129019+0000","last_active":"2024-04-14T23:35:48.929974+0000","last_peered":"2024-04-14T23:35:48.929974+0000","last_clean":"2024-04-14T23:35:48.929974+0000","last_became_active":"2024-04-14T23:35:46.128736+0000","last_became_peered":"2024-04-14T23:35:46.128736+0000","last_unstale":"2024-04-14T23:35:48.929974+0000","last_undegraded":"2024-04-14T23:35:48.929974+0000","last_fullsized":"2024-04-14T23:35:48.929974+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:28.026305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929722+0000","last_change":"2024-04-14T23:35:47.146466+0000","last_active":"2024-04-14T23:35:48.929722+0000","last_peered":"2024-04-14T23:35:48.929722+0000","last_clean":"2024-04-14T23:35:48.929722+0000","last_became_active":"2024-04-14T23:35:47.146038+0000","last_became_peered":"2024-04-14T23:35:47.146038+0000","last_unstale":"2024-04-14T23:35:48.929722+0000","last_undegraded":"2024-04-14T23:35:48.929722+0000","last_fullsized":"2024-04-14T23:35:48.929722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:27.967946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929825+0000","last_change":"2024-04-14T23:35:46.137505+0000","last_active":"2024-04-14T23:35:48.929825+0000","last_peered":"2024-04-14T23:35:48.929825+0000","last_clean":"2024-04-14T23:35:48.929825+0000","last_became_active":"2024-04-14T23:35:46.137073+0000","last_became_peered":"2024-04-14T23:35:46.137073+0000","last_unstale":"2024-04-14T23:35:48.929825+0000","last_undegraded":"2024-04-14T23:35:48.929825+0000","last_fullsized":"2024-04-14T23:35:48.929825+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929904+0000","last_change":"2024-04-14T23:35:47.144646+0000","last_active":"2024-04-14T23:35:48.929904+0000","last_peered":"2024-04-14T23:35:48.929904+0000","last_clean":"2024-04-14T23:35:48.929904+0000","last_became_active":"2024-04-14T23:35:47.144302+0000","last_became_peered":"2024-04-14T23:35:47.144302+0000","last_unstale":"2024-04-14T23:35:48.929904+0000","last_undegraded":"2024-04-14T23:35:48.929904+0000","last_fullsized":"2024-04-14T23:35:48.929904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:38.502135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130300+0000","last_change":"2024-04-14T23:35:46.132200+0000","last_active":"2024-04-14T23:35:48.130300+0000","last_peered":"2024-04-14T23:35:48.130300+0000","last_clean":"2024-04-14T23:35:48.130300+0000","last_became_active":"2024-04-14T23:35:46.131951+0000","last_became_peered":"2024-04-14T23:35:46.131951+0000","last_unstale":"2024-04-14T23:35:48.130300+0000","last_undegraded":"2024-04-14T23:35:48.130300+0000","last_fullsized":"2024-04-14T23:35:48.130300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:50:42.618031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390704+0000","last_change":"2024-04-14T23:35:47.152240+0000","last_active":"2024-04-14T23:35:48.390704+0000","last_peered":"2024-04-14T23:35:48.390704+0000","last_clean":"2024-04-14T23:35:48.390704+0000","last_became_active":"2024-04-14T23:35:47.151949+0000","last_became_peered":"2024-04-14T23:35:47.151949+0000","last_unstale":"2024-04-14T23:35:48.390704+0000","last_undegraded":"2024-04-14T23:35:48.390704+0000","last_fullsized":"2024-04-14T23:35:48.390704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390467+0000","last_change":"2024-04-14T23:35:46.133774+0000","last_active":"2024-04-14T23:35:48.390467+0000","last_peered":"2024-04-14T23:35:48.390467+0000","last_clean":"2024-04-14T23:35:48.390467+0000","last_became_active":"2024-04-14T23:35:46.133248+0000","last_became_peered":"2024-04-14T23:35:46.133248+0000","last_unstale":"2024-04-14T23:35:48.390467+0000","last_undegraded":"2024-04-14T23:35:48.390467+0000","last_fullsized":"2024-04-14T23:35:48.390467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:10:15.375417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930207+0000","last_change":"2024-04-14T23:35:47.137101+0000","last_active":"2024-04-14T23:35:48.930207+0000","last_peered":"2024-04-14T23:35:48.930207+0000","last_clean":"2024-04-14T23:35:48.930207+0000","last_became_active":"2024-04-14T23:35:47.135299+0000","last_became_peered":"2024-04-14T23:35:47.135299+0000","last_unstale":"2024-04-14T23:35:48.930207+0000","last_undegraded":"2024-04-14T23:35:48.930207+0000","last_fullsized":"2024-04-14T23:35:48.930207+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:13:37.995199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128481+0000","last_change":"2024-04-14T23:35:46.130340+0000","last_active":"2024-04-14T23:35:48.128481+0000","last_peered":"2024-04-14T23:35:48.128481+0000","last_clean":"2024-04-14T23:35:48.128481+0000","last_became_active":"2024-04-14T23:35:46.129730+0000","last_became_peered":"2024-04-14T23:35:46.129730+0000","last_unstale":"2024-04-14T23:35:48.128481+0000","last_undegraded":"2024-04-14T23:35:48.128481+0000","last_fullsized":"2024-04-14T23:35:48.128481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:37.497838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130505+0000","last_change":"2024-04-14T23:35:47.158482+0000","last_active":"2024-04-14T23:35:48.130505+0000","last_peered":"2024-04-14T23:35:48.130505+0000","last_clean":"2024-04-14T23:35:48.130505+0000","last_became_active":"2024-04-14T23:35:47.158231+0000","last_became_peered":"2024-04-14T23:35:47.158231+0000","last_unstale":"2024-04-14T23:35:48.130505+0000","last_undegraded":"2024-04-14T23:35:48.130505+0000","last_fullsized":"2024-04-14T23:35:48.130505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:28:35.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929927+0000","last_change":"2024-04-14T23:35:46.136429+0000","last_active":"2024-04-14T23:35:48.929927+0000","last_peered":"2024-04-14T23:35:48.929927+0000","last_clean":"2024-04-14T23:35:48.929927+0000","last_became_active":"2024-04-14T23:35:46.136181+0000","last_became_peered":"2024-04-14T23:35:46.136181+0000","last_unstale":"2024-04-14T23:35:48.929927+0000","last_undegraded":"2024-04-14T23:35:48.929927+0000","last_fullsized":"2024-04-14T23:35:48.929927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:58:35.171753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929803+0000","last_change":"2024-04-14T23:34:27.438796+0000","last_active":"2024-04-14T23:35:48.929803+0000","last_peered":"2024-04-14T23:35:48.929803+0000","last_clean":"2024-04-14T23:35:48.929803+0000","last_became_active":"2024-04-14T23:34:27.437932+0000","last_became_peered":"2024-04-14T23:34:27.437932+0000","last_unstale":"2024-04-14T23:35:48.929803+0000","last_undegraded":"2024-04-14T23:35:48.929803+0000","last_fullsized":"2024-04-14T23:35:48.929803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_clean_scrub_stamp":"2024-04-14T23:34:26.390323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:11:13.484245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1060864,"data_stored":789223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":466944,"data_stored":198819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":197243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":197263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":787575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T23:35:54.904 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-14T23:35:54.905 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-14T23:35:55.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.047+0000 7fd1a66de640 1 Processor -- start 2024-04-14T23:35:55.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.047+0000 7fd1a66de640 1 -- start start 2024-04-14T23:35:55.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd1a66de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a00c7050 0x7fd1a00ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:55.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd1a66de640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd1a006b910 0x7fd1a015f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:55.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd1a66de640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a015e7b0 con 0x7fd1a00d02c0 2024-04-14T23:35:55.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd1a66de640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fd1a00d0700 con 0x7fd1a006b910 2024-04-14T23:35:55.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd1a66de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd1a015f7b0 con 0x7fd1a00c7050 2024-04-14T23:35:55.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19f7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd1a00d02c0 0x7fd1a006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49860/0 (socket says 172.21.15.47:49860) 2024-04-14T23:35:55.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19f7fe640 1 -- 172.21.15.47:0/2649899717 learned_addr learned my addr 172.21.15.47:0/2649899717 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:55.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19effd640 1 -- 172.21.15.47:0/2649899717 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3936464447 0 0) 0x7fd1a015e7b0 con 0x7fd1a00d02c0 2024-04-14T23:35:55.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19effd640 1 -- 172.21.15.47:0/2649899717 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd188003520 con 0x7fd1a00d02c0 2024-04-14T23:35:55.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19ffff640 1 --2- 172.21.15.47:0/2649899717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a00c7050 0x7fd1a00ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:55.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd1a4c7b640 1 --2- 172.21.15.47:0/2649899717 >> v2:172.21.15.191:3300/0 conn(0x7fd1a006b910 0x7fd1a015f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:55.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19effd640 1 -- 172.21.15.47:0/2649899717 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4096543 0 0) 0x7fd188003520 con 0x7fd1a00d02c0 2024-04-14T23:35:55.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19effd640 1 -- 172.21.15.47:0/2649899717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a00c7050 msgr2=0x7fd1a00ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:55.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19effd640 1 --2- 172.21.15.47:0/2649899717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a00c7050 0x7fd1a00ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19effd640 1 -- 172.21.15.47:0/2649899717 >> v2:172.21.15.191:3300/0 conn(0x7fd1a006b910 msgr2=0x7fd1a015f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:55.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19effd640 1 --2- 172.21.15.47:0/2649899717 >> v2:172.21.15.191:3300/0 conn(0x7fd1a006b910 0x7fd1a015f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19effd640 1 -- 172.21.15.47:0/2649899717 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a006f810 con 0x7fd1a00d02c0 2024-04-14T23:35:55.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19effd640 1 -- 172.21.15.47:0/2649899717 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7fd194001670 con 0x7fd1a00d02c0 2024-04-14T23:35:55.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19effd640 1 -- 172.21.15.47:0/2649899717 >> v1:172.21.15.47:6789/0 conn(0x7fd1a00d02c0 legacy=0x7fd1a006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:55.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19effd640 1 --2- 172.21.15.47:0/2649899717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1880039b0 0x7fd188003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:55.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19effd640 1 --2- 172.21.15.47:0/2649899717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a00c7050 0x7fd188004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:55.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19effd640 1 --2- 172.21.15.47:0/2649899717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd188004d40 0x7fd1880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:55.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19effd640 1 -- 172.21.15.47:0/2649899717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a00d0700 con 0x7fd188004d40 2024-04-14T23:35:55.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19effd640 1 -- 172.21.15.47:0/2649899717 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a015f7b0 con 0x7fd1880039b0 2024-04-14T23:35:55.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.048+0000 7fd19effd640 1 -- 172.21.15.47:0/2649899717 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd18800b9c0 con 0x7fd1a00c7050 2024-04-14T23:35:55.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.049+0000 7fd1a4c7b640 1 --2- 172.21.15.47:0/2649899717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd188004d40 0x7fd1880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:55.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.049+0000 7fd19f7fe640 1 --2- 172.21.15.47:0/2649899717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a00c7050 0x7fd188004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:55.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.049+0000 7fd19ffff640 1 --2- 172.21.15.47:0/2649899717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1880039b0 0x7fd188003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:55.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.049+0000 7fd1a4c7b640 1 -- 172.21.15.47:0/2649899717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a00c7050 msgr2=0x7fd188004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:55.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.049+0000 7fd1a4c7b640 1 --2- 172.21.15.47:0/2649899717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a00c7050 0x7fd188004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.049+0000 7fd1a4c7b640 1 -- 172.21.15.47:0/2649899717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1880039b0 msgr2=0x7fd188003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:55.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.049+0000 7fd1a4c7b640 1 --2- 172.21.15.47:0/2649899717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1880039b0 0x7fd188003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.049+0000 7fd1a4c7b640 1 -- 172.21.15.47:0/2649899717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd188003520 con 0x7fd188004d40 2024-04-14T23:35:55.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.049+0000 7fd1a4c7b640 1 --2- 172.21.15.47:0/2649899717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd188004d40 0x7fd1880051c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd198009f90 tx=0x7fd188005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d179011578af5d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:55.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.050+0000 7fd19effd640 1 -- 172.21.15.47:0/2649899717 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd198039070 con 0x7fd188004d40 2024-04-14T23:35:55.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.050+0000 7fd19effd640 1 -- 172.21.15.47:0/2649899717 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19802cc20 con 0x7fd188004d40 2024-04-14T23:35:55.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.050+0000 7fd19effd640 1 -- 172.21.15.47:0/2649899717 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd198009c10 con 0x7fd188004d40 2024-04-14T23:35:55.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.050+0000 7fd1a66de640 1 -- 172.21.15.47:0/2649899717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd188004d40 msgr2=0x7fd1880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:55.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.050+0000 7fd1a66de640 1 --2- 172.21.15.47:0/2649899717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd188004d40 0x7fd1880051c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd198009f90 tx=0x7fd188005830 comp rx=0 tx=0).stop 2024-04-14T23:35:55.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.050+0000 7fd1a4c7b640 1 -- 172.21.15.47:0/2649899717 reap_dead start 2024-04-14T23:35:55.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.050+0000 7fd1a66de640 1 -- 172.21.15.47:0/2649899717 shutdown_connections 2024-04-14T23:35:55.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.050+0000 7fd1a66de640 1 -- 172.21.15.47:0/2649899717 >> 172.21.15.47:0/2649899717 conn(0x7fd1a00b2810 msgr2=0x7fd1a00b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:55.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.050+0000 7fd1a66de640 1 -- 172.21.15.47:0/2649899717 shutdown_connections 2024-04-14T23:35:55.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.050+0000 7fd1a66de640 1 -- 172.21.15.47:0/2649899717 wait complete. 2024-04-14T23:35:55.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.051+0000 7fd1a66de640 1 Processor -- start 2024-04-14T23:35:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.052+0000 7fd1a66de640 1 -- start start 2024-04-14T23:35:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.052+0000 7fd1a66de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd188004d40 0x7fd1a00c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.052+0000 7fd1a66de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a00b4ec0 0x7fd1a00b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.052+0000 7fd1a66de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a00cc000 0x7fd1a00cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.052+0000 7fd1a66de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a015ed50 con 0x7fd1a00b4ec0 2024-04-14T23:35:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.052+0000 7fd1a66de640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a015ea70 con 0x7fd188004d40 2024-04-14T23:35:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.052+0000 7fd1a66de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd1a006f4e0 con 0x7fd1a00cc000 2024-04-14T23:35:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.052+0000 7fd19f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a00b4ec0 0x7fd1a00b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.052+0000 7fd19f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a00b4ec0 0x7fd1a00b5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43536/0 (socket says 172.21.15.47:43536) 2024-04-14T23:35:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.052+0000 7fd19f7fe640 1 -- 172.21.15.47:0/818295436 learned_addr learned my addr 172.21.15.47:0/818295436 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.053+0000 7fd1a4c7b640 1 --2- 172.21.15.47:0/818295436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a00cc000 0x7fd1a00cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.053+0000 7fd19ffff640 1 --2- 172.21.15.47:0/818295436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd188004d40 0x7fd1a00c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.053+0000 7fd19f7fe640 1 -- 172.21.15.47:0/818295436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a00cc000 msgr2=0x7fd1a00cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.053+0000 7fd19f7fe640 1 --2- 172.21.15.47:0/818295436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a00cc000 0x7fd1a00cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.053+0000 7fd19f7fe640 1 -- 172.21.15.47:0/818295436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd188004d40 msgr2=0x7fd1a00c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.053+0000 7fd19f7fe640 1 --2- 172.21.15.47:0/818295436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd188004d40 0x7fd1a00c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.053+0000 7fd19f7fe640 1 -- 172.21.15.47:0/818295436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a00b5860 con 0x7fd1a00b4ec0 2024-04-14T23:35:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.053+0000 7fd19f7fe640 1 --2- 172.21.15.47:0/818295436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a00b4ec0 0x7fd1a00b5320 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd194007340 tx=0x7fd194007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.053+0000 7fd19cff9640 1 -- 172.21.15.47:0/818295436 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19401a070 con 0x7fd1a00b4ec0 2024-04-14T23:35:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.053+0000 7fd19cff9640 1 -- 172.21.15.47:0/818295436 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19400f9e0 con 0x7fd1a00b4ec0 2024-04-14T23:35:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.053+0000 7fd1a66de640 1 -- 172.21.15.47:0/818295436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a00c7cb0 con 0x7fd1a00b4ec0 2024-04-14T23:35:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.053+0000 7fd19cff9640 1 -- 172.21.15.47:0/818295436 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19400fdd0 con 0x7fd1a00b4ec0 2024-04-14T23:35:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.053+0000 7fd1a66de640 1 -- 172.21.15.47:0/818295436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a00c7f70 con 0x7fd1a00b4ec0 2024-04-14T23:35:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.054+0000 7fd1a66de640 1 -- 172.21.15.47:0/818295436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1a00b2580 con 0x7fd1a00b4ec0 2024-04-14T23:35:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.054+0000 7fd19cff9640 1 -- 172.21.15.47:0/818295436 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd19401d070 con 0x7fd1a00b4ec0 2024-04-14T23:35:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.055+0000 7fd19cff9640 1 --2- 172.21.15.47:0/818295436 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd18c06b990 0x7fd18c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.055+0000 7fd19cff9640 1 -- 172.21.15.47:0/818295436 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd19408a470 con 0x7fd1a00b4ec0 2024-04-14T23:35:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.055+0000 7fd19ffff640 1 --2- 172.21.15.47:0/818295436 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd18c06b990 0x7fd18c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:55.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.056+0000 7fd19ffff640 1 --2- 172.21.15.47:0/818295436 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd18c06b990 0x7fd18c06de50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd190009a80 tx=0x7fd190008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:55.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.059+0000 7fd19cff9640 1 -- 172.21.15.47:0/818295436 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd194058ef0 con 0x7fd1a00b4ec0 2024-04-14T23:35:55.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.313+0000 7fd1a66de640 1 -- 172.21.15.47:0/818295436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd1a00ce110 con 0x7fd1a00b4ec0 2024-04-14T23:35:55.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.315+0000 7fd19cff9640 1 -- 172.21.15.47:0/818295436 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fd1940587f0 con 0x7fd1a00b4ec0 2024-04-14T23:35:55.319 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-04-14T23:35:55.319 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDWZxxmvmX2JRAAIQq0oHP9ehuYsHlAvadMIw== 2024-04-14T23:35:55.319 INFO:teuthology.orchestra.run.smithi047.stdout: caps mds = "allow" 2024-04-14T23:35:55.319 INFO:teuthology.orchestra.run.smithi047.stdout: caps mon = "allow r" 2024-04-14T23:35:55.319 INFO:teuthology.orchestra.run.smithi047.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-14T23:35:55.319 INFO:teuthology.orchestra.run.smithi047.stderr:updated caps for client.0 2024-04-14T23:35:55.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.317+0000 7fd1a66de640 1 -- 172.21.15.47:0/818295436 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd18c06b990 msgr2=0x7fd18c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:55.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.317+0000 7fd1a66de640 1 --2- 172.21.15.47:0/818295436 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd18c06b990 0x7fd18c06de50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd190009a80 tx=0x7fd190008040 comp rx=0 tx=0).stop 2024-04-14T23:35:55.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.317+0000 7fd1a66de640 1 -- 172.21.15.47:0/818295436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a00b4ec0 msgr2=0x7fd1a00b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:55.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.317+0000 7fd1a66de640 1 --2- 172.21.15.47:0/818295436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a00b4ec0 0x7fd1a00b5320 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd194007340 tx=0x7fd194007800 comp rx=0 tx=0).stop 2024-04-14T23:35:55.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.317+0000 7fd1a66de640 1 -- 172.21.15.47:0/818295436 shutdown_connections 2024-04-14T23:35:55.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.317+0000 7fd1a66de640 1 --2- 172.21.15.47:0/818295436 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd18c06b990 0x7fd18c06de50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.317+0000 7fd1a66de640 1 --2- 172.21.15.47:0/818295436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a00cc000 0x7fd1a00cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.317+0000 7fd1a66de640 1 --2- 172.21.15.47:0/818295436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a00b4ec0 0x7fd1a00b5320 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.318+0000 7fd1a66de640 1 --2- 172.21.15.47:0/818295436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd188004d40 0x7fd1a00c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.318+0000 7fd1a66de640 1 -- 172.21.15.47:0/818295436 >> 172.21.15.47:0/818295436 conn(0x7fd1a00b2810 msgr2=0x7fd1a00affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:55.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.318+0000 7fd1a66de640 1 -- 172.21.15.47:0/818295436 shutdown_connections 2024-04-14T23:35:55.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.318+0000 7fd1a66de640 1 -- 172.21.15.47:0/818295436 wait complete. 2024-04-14T23:35:55.332 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T23:35:55.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.430+0000 7f645839c640 1 Processor -- start 2024-04-14T23:35:55.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.430+0000 7f645839c640 1 -- start start 2024-04-14T23:35:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.431+0000 7f645839c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f645006cc20 0x7f645006d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.431+0000 7f645839c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f64500cc2e0 0x7f64500cc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.431+0000 7f645839c640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64500cfed0 con 0x7f64500cdcb0 2024-04-14T23:35:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.431+0000 7f645839c640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f64500cf630 con 0x7f64500cc2e0 2024-04-14T23:35:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.431+0000 7f645839c640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f64500d0170 con 0x7f645006cc20 2024-04-14T23:35:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.431+0000 7f6456939640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f64500cc2e0 0x7f64500cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.431+0000 7f6455937640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f645006cc20 0x7f645006d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.431+0000 7f6456138640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f64500cdcb0 0x7f64500cef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.47:49074/0 (socket says 172.21.15.47:49074) 2024-04-14T23:35:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.431+0000 7f6456138640 1 -- 172.21.15.47:0/1049647716 learned_addr learned my addr 172.21.15.47:0/1049647716 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.431+0000 7f6455937640 1 -- 172.21.15.47:0/1049647716 >> v2:172.21.15.191:3300/0 conn(0x7f64500cc2e0 msgr2=0x7f64500cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.431+0000 7f6455937640 1 --2- 172.21.15.47:0/1049647716 >> v2:172.21.15.191:3300/0 conn(0x7f64500cc2e0 0x7f64500cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.431+0000 7f6455937640 1 -- 172.21.15.47:0/1049647716 >> v1:172.21.15.191:6789/0 conn(0x7f64500cdcb0 legacy=0x7f64500cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:55.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.431+0000 7f6455937640 1 -- 172.21.15.47:0/1049647716 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64500d0450 con 0x7f645006cc20 2024-04-14T23:35:55.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.431+0000 7f6456939640 1 --2- 172.21.15.47:0/1049647716 >> v2:172.21.15.191:3300/0 conn(0x7f64500cc2e0 0x7f64500cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.432+0000 7f6455937640 1 --2- 172.21.15.47:0/1049647716 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f645006cc20 0x7f645006d0b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f64400097a0 tx=0x7f644002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e58d36819dba46e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.432+0000 7f6455136640 1 -- 172.21.15.47:0/1049647716 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6440035020 con 0x7f645006cc20 2024-04-14T23:35:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.432+0000 7f6455136640 1 -- 172.21.15.47:0/1049647716 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6440031810 con 0x7f645006cc20 2024-04-14T23:35:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.432+0000 7f6455136640 1 -- 172.21.15.47:0/1049647716 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6440031be0 con 0x7f645006cc20 2024-04-14T23:35:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.433+0000 7f645839c640 1 -- 172.21.15.47:0/1049647716 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f645006cc20 msgr2=0x7f645006d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.433+0000 7f645839c640 1 --2- 172.21.15.47:0/1049647716 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f645006cc20 0x7f645006d0b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f64400097a0 tx=0x7f644002b8b0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.433+0000 7f645839c640 1 -- 172.21.15.47:0/1049647716 shutdown_connections 2024-04-14T23:35:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.433+0000 7f645839c640 1 --2- 172.21.15.47:0/1049647716 >> v2:172.21.15.191:3300/0 conn(0x7f64500cc2e0 0x7f64500cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.433+0000 7f645839c640 1 --2- 172.21.15.47:0/1049647716 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f645006cc20 0x7f645006d0b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.433+0000 7f645839c640 1 -- 172.21.15.47:0/1049647716 >> 172.21.15.47:0/1049647716 conn(0x7f64500d1c90 msgr2=0x7f64500d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.433+0000 7f645839c640 1 -- 172.21.15.47:0/1049647716 shutdown_connections 2024-04-14T23:35:55.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.433+0000 7f645839c640 1 -- 172.21.15.47:0/1049647716 wait complete. 2024-04-14T23:35:55.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.434+0000 7f645839c640 1 Processor -- start 2024-04-14T23:35:55.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.434+0000 7f645839c640 1 -- start start 2024-04-14T23:35:55.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.435+0000 7f645839c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f645006cc20 0x7f64501561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:55.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.435+0000 7f645839c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64500cc2e0 0x7f64500ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.435+0000 7f645839c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64500cdcb0 0x7f64501576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.435+0000 7f645839c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f64500d0cf0 con 0x7f64500cdcb0 2024-04-14T23:35:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.435+0000 7f645839c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f64500d0a10 con 0x7f64500cc2e0 2024-04-14T23:35:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.435+0000 7f645839c640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f64500ce090 con 0x7f645006cc20 2024-04-14T23:35:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.435+0000 7f6456939640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64500cdcb0 0x7f64501576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.435+0000 7f6456939640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64500cdcb0 0x7f64501576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43542/0 (socket says 172.21.15.47:43542) 2024-04-14T23:35:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.435+0000 7f6456939640 1 -- 172.21.15.47:0/1801766341 learned_addr learned my addr 172.21.15.47:0/1801766341 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.435+0000 7f6456138640 1 --2- 172.21.15.47:0/1801766341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f645006cc20 0x7f64501561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.435+0000 7f6455937640 1 --2- 172.21.15.47:0/1801766341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64500cc2e0 0x7f64500ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.435+0000 7f6456939640 1 -- 172.21.15.47:0/1801766341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f645006cc20 msgr2=0x7f64501561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.435+0000 7f6456939640 1 --2- 172.21.15.47:0/1801766341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f645006cc20 0x7f64501561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.435+0000 7f6456939640 1 -- 172.21.15.47:0/1801766341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64500cc2e0 msgr2=0x7f64500ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.435+0000 7f6456939640 1 --2- 172.21.15.47:0/1801766341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64500cc2e0 0x7f64500ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.435+0000 7f6456939640 1 -- 172.21.15.47:0/1801766341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6450155110 con 0x7f64500cdcb0 2024-04-14T23:35:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.436+0000 7f6456939640 1 --2- 172.21.15.47:0/1801766341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64500cdcb0 0x7f64501576c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f644800efc0 tx=0x7f644800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.436+0000 7f6446ffd640 1 -- 172.21.15.47:0/1801766341 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6448018030 con 0x7f64500cdcb0 2024-04-14T23:35:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.436+0000 7f6446ffd640 1 -- 172.21.15.47:0/1801766341 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f644800cdf0 con 0x7f64500cdcb0 2024-04-14T23:35:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.436+0000 7f645839c640 1 -- 172.21.15.47:0/1801766341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64501553f0 con 0x7f64500cdcb0 2024-04-14T23:35:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.436+0000 7f6446ffd640 1 -- 172.21.15.47:0/1801766341 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6448003bb0 con 0x7f64500cdcb0 2024-04-14T23:35:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.436+0000 7f645839c640 1 -- 172.21.15.47:0/1801766341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64501559b0 con 0x7f64500cdcb0 2024-04-14T23:35:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.437+0000 7f645839c640 1 -- 172.21.15.47:0/1801766341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64500ca810 con 0x7f64500cdcb0 2024-04-14T23:35:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.437+0000 7f6446ffd640 1 -- 172.21.15.47:0/1801766341 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f644801b070 con 0x7f64500cdcb0 2024-04-14T23:35:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.438+0000 7f6446ffd640 1 --2- 172.21.15.47:0/1801766341 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f643406b990 0x7f643406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.438+0000 7f6446ffd640 1 -- 172.21.15.47:0/1801766341 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f644808b280 con 0x7f64500cdcb0 2024-04-14T23:35:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.438+0000 7f6456138640 1 --2- 172.21.15.47:0/1801766341 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f643406b990 0x7f643406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.438+0000 7f6456138640 1 --2- 172.21.15.47:0/1801766341 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f643406b990 0x7f643406de50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f644c005880 tx=0x7f644c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.442+0000 7f6446ffd640 1 -- 172.21.15.47:0/1801766341 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6448010040 con 0x7f64500cdcb0 2024-04-14T23:35:55.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.662+0000 7f645839c640 1 -- 172.21.15.47:0/1801766341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6450075430 con 0x7f64500cdcb0 2024-04-14T23:35:55.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.663+0000 7f6446ffd640 1 -- 172.21.15.47:0/1801766341 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5187 (secure 0 0 0) 0x7f64480596c0 con 0x7f64500cdcb0 2024-04-14T23:35:55.667 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:35:55.667 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5098,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/1048029655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1048029655},{"type":"v1","addr":"172.21.15.191:6836","nonce":1048029655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5101,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3689956959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":3689956959},{"type":"v1","addr":"172.21.15.191:6837","nonce":3689956959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/3726899017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3726899017},{"type":"v1","addr":"172.21.15.47:6834","nonce":3726899017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T23:35:46.488445+0000","modified":"2024-04-14T23:35:48.489599+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/1026300185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":1026300185},{"type":"v1","addr":"172.21.15.47:6835","nonce":1026300185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-04-14T23:35:55.668 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 15 2024-04-14T23:35:55.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.665+0000 7f645839c640 1 -- 172.21.15.47:0/1801766341 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f643406b990 msgr2=0x7f643406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:55.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.665+0000 7f645839c640 1 --2- 172.21.15.47:0/1801766341 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f643406b990 0x7f643406de50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f644c005880 tx=0x7f644c009040 comp rx=0 tx=0).stop 2024-04-14T23:35:55.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.665+0000 7f645839c640 1 -- 172.21.15.47:0/1801766341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64500cdcb0 msgr2=0x7f64501576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:55.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.665+0000 7f645839c640 1 --2- 172.21.15.47:0/1801766341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64500cdcb0 0x7f64501576c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f644800efc0 tx=0x7f644800c490 comp rx=0 tx=0).stop 2024-04-14T23:35:55.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.665+0000 7f645839c640 1 -- 172.21.15.47:0/1801766341 shutdown_connections 2024-04-14T23:35:55.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.665+0000 7f645839c640 1 --2- 172.21.15.47:0/1801766341 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f643406b990 0x7f643406de50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.665+0000 7f645839c640 1 --2- 172.21.15.47:0/1801766341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64500cdcb0 0x7f64501576c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.665+0000 7f645839c640 1 --2- 172.21.15.47:0/1801766341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64500cc2e0 0x7f64500ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.665+0000 7f645839c640 1 --2- 172.21.15.47:0/1801766341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f645006cc20 0x7f64501561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:55.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.665+0000 7f645839c640 1 -- 172.21.15.47:0/1801766341 >> 172.21.15.47:0/1801766341 conn(0x7f64500d1c90 msgr2=0x7f64500d2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:55.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.665+0000 7f645839c640 1 -- 172.21.15.47:0/1801766341 shutdown_connections 2024-04-14T23:35:55.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:55.665+0000 7f645839c640 1 -- 172.21.15.47:0/1801766341 wait complete. 2024-04-14T23:35:56.081 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-14T23:35:46.488445+0000', 'modified': '2024-04-14T23:35:48.489599+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5334}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5334': {'gid': 5334, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.47:6835/1026300185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6833', 'nonce': 1026300185}, {'type': 'v1', 'addr': '172.21.15.47:6835', 'nonce': 1026300185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5334, 'qdb_cluster': [5334]} 2024-04-14T23:35:56.082 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-14T23:35:56.082 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-14T23:35:56.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.184+0000 7f6724ade640 1 Processor -- start 2024-04-14T23:35:56.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.184+0000 7f6724ade640 1 -- start start 2024-04-14T23:35:56.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.185+0000 7f6724ade640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f67200cca50 0x7f67200cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.185+0000 7f6724ade640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6720162b90 con 0x7f67200d16d0 2024-04-14T23:35:56.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.185+0000 7f6724ade640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672015e9a0 con 0x7f67200ceab0 2024-04-14T23:35:56.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.185+0000 7f6724ade640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f672015f5b0 con 0x7f67200cca50 2024-04-14T23:35:56.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.185+0000 7f671ed9d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f67200d16d0 0x7f6720162480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49876/0 (socket says 172.21.15.47:49876) 2024-04-14T23:35:56.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.185+0000 7f671ed9d640 1 -- 172.21.15.47:0/2834969077 learned_addr learned my addr 172.21.15.47:0/2834969077 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:56.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671e59c640 1 --2- 172.21.15.47:0/2834969077 >> v2:172.21.15.191:3300/0 conn(0x7f67200cca50 0x7f67200cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671d59a640 1 -- 172.21.15.47:0/2834969077 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1833105533 0 0) 0x7f6720162b90 con 0x7f67200d16d0 2024-04-14T23:35:56.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671d59a640 1 -- 172.21.15.47:0/2834969077 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f670c003520 con 0x7f67200d16d0 2024-04-14T23:35:56.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671d59a640 1 -- 172.21.15.47:0/2834969077 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2843691086 0 0) 0x7f670c003520 con 0x7f67200d16d0 2024-04-14T23:35:56.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671d59a640 1 -- 172.21.15.47:0/2834969077 >> v2:172.21.15.191:3300/0 conn(0x7f67200cca50 msgr2=0x7f67200cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:56.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671d59a640 1 --2- 172.21.15.47:0/2834969077 >> v2:172.21.15.191:3300/0 conn(0x7f67200cca50 0x7f67200cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671d59a640 1 -- 172.21.15.47:0/2834969077 >> v1:172.21.15.191:6789/0 conn(0x7f67200ceab0 legacy=0x7f6720161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671d59a640 1 -- 172.21.15.47:0/2834969077 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672015ec80 con 0x7f67200d16d0 2024-04-14T23:35:56.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671d59a640 1 -- 172.21.15.47:0/2834969077 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f67100019f0 con 0x7f67200d16d0 2024-04-14T23:35:56.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671d59a640 1 -- 172.21.15.47:0/2834969077 >> v1:172.21.15.47:6789/0 conn(0x7f67200d16d0 legacy=0x7f6720162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671d59a640 1 --2- 172.21.15.47:0/2834969077 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f670c0039b0 0x7f670c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671d59a640 1 --2- 172.21.15.47:0/2834969077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f670c004800 0x7f670c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671d59a640 1 --2- 172.21.15.47:0/2834969077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f670c0052e0 0x7f670c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671d59a640 1 -- 172.21.15.47:0/2834969077 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f672015f5b0 con 0x7f670c0052e0 2024-04-14T23:35:56.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671d59a640 1 -- 172.21.15.47:0/2834969077 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f670c00c1b0 con 0x7f670c004800 2024-04-14T23:35:56.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671d59a640 1 -- 172.21.15.47:0/2834969077 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f670c00c3b0 con 0x7f670c0039b0 2024-04-14T23:35:56.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671ed9d640 1 --2- 172.21.15.47:0/2834969077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f670c0052e0 0x7f670c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671dd9b640 1 --2- 172.21.15.47:0/2834969077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f670c004800 0x7f670c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671e59c640 1 --2- 172.21.15.47:0/2834969077 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f670c0039b0 0x7f670c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671ed9d640 1 -- 172.21.15.47:0/2834969077 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f670c0039b0 msgr2=0x7f670c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:56.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671ed9d640 1 --2- 172.21.15.47:0/2834969077 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f670c0039b0 0x7f670c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671ed9d640 1 -- 172.21.15.47:0/2834969077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f670c004800 msgr2=0x7f670c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:56.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.186+0000 7f671ed9d640 1 --2- 172.21.15.47:0/2834969077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f670c004800 0x7f670c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.187+0000 7f671ed9d640 1 -- 172.21.15.47:0/2834969077 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670c003520 con 0x7f670c0052e0 2024-04-14T23:35:56.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.187+0000 7f671ed9d640 1 -- 172.21.15.47:0/2834969077 reap_dead start 2024-04-14T23:35:56.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.187+0000 7f671ed9d640 1 --2- 172.21.15.47:0/2834969077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f670c0052e0 0x7f670c00b9c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f671000a810 tx=0x7f670c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8423da8b0b34a044 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:56.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.187+0000 7f671d59a640 1 -- 172.21.15.47:0/2834969077 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671000a460 con 0x7f670c0052e0 2024-04-14T23:35:56.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.187+0000 7f671d59a640 1 -- 172.21.15.47:0/2834969077 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6710034650 con 0x7f670c0052e0 2024-04-14T23:35:56.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.187+0000 7f671d59a640 1 -- 172.21.15.47:0/2834969077 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710034a40 con 0x7f670c0052e0 2024-04-14T23:35:56.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.188+0000 7f6724ade640 1 -- 172.21.15.47:0/2834969077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f670c0052e0 msgr2=0x7f670c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.188+0000 7f6724ade640 1 --2- 172.21.15.47:0/2834969077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f670c0052e0 0x7f670c00b9c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f671000a810 tx=0x7f670c005830 comp rx=0 tx=0).stop 2024-04-14T23:35:56.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.188+0000 7f6724ade640 1 -- 172.21.15.47:0/2834969077 shutdown_connections 2024-04-14T23:35:56.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.188+0000 7f6724ade640 1 --2- 172.21.15.47:0/2834969077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f670c0052e0 0x7f670c00b9c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.188+0000 7f6724ade640 1 -- 172.21.15.47:0/2834969077 >> 172.21.15.47:0/2834969077 conn(0x7f67200d0bb0 msgr2=0x7f67200d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:56.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.188+0000 7f6724ade640 1 -- 172.21.15.47:0/2834969077 shutdown_connections 2024-04-14T23:35:56.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.188+0000 7f6724ade640 1 -- 172.21.15.47:0/2834969077 wait complete. 2024-04-14T23:35:56.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.189+0000 7f6724ade640 1 Processor -- start 2024-04-14T23:35:56.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.189+0000 7f6724ade640 1 -- start start 2024-04-14T23:35:56.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.190+0000 7f6724ade640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f670c0052e0 0x7f67200c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.190+0000 7f6724ade640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67200ca660 0x7f6720161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.190+0000 7f6724ade640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67200b0780 0x7f6720157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.190+0000 7f6724ade640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f672015e660 con 0x7f67200b0780 2024-04-14T23:35:56.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.190+0000 7f6724ade640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f672015f240 con 0x7f670c0052e0 2024-04-14T23:35:56.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.190+0000 7f6724ade640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f67200cb3c0 con 0x7f67200ca660 2024-04-14T23:35:56.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.190+0000 7f671ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67200b0780 0x7f6720157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.190+0000 7f671ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67200b0780 0x7f6720157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43560/0 (socket says 172.21.15.47:43560) 2024-04-14T23:35:56.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.190+0000 7f671ed9d640 1 -- 172.21.15.47:0/1085469515 learned_addr learned my addr 172.21.15.47:0/1085469515 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:56.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.190+0000 7f671dd9b640 1 --2- 172.21.15.47:0/1085469515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67200ca660 0x7f6720161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.190+0000 7f671e59c640 1 --2- 172.21.15.47:0/1085469515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f670c0052e0 0x7f67200c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.191+0000 7f671ed9d640 1 -- 172.21.15.47:0/1085469515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67200ca660 msgr2=0x7f6720161ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.191+0000 7f671ed9d640 1 --2- 172.21.15.47:0/1085469515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67200ca660 0x7f6720161ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.191+0000 7f671ed9d640 1 -- 172.21.15.47:0/1085469515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f670c0052e0 msgr2=0x7f67200c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.191+0000 7f671ed9d640 1 --2- 172.21.15.47:0/1085469515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f670c0052e0 0x7f67200c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.191+0000 7f671ed9d640 1 -- 172.21.15.47:0/1085469515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6720162000 con 0x7f67200b0780 2024-04-14T23:35:56.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.191+0000 7f671e59c640 1 --2- 172.21.15.47:0/1085469515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f670c0052e0 0x7f67200c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:56.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.191+0000 7f671ed9d640 1 --2- 172.21.15.47:0/1085469515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67200b0780 0x7f6720157680 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f671000a810 tx=0x7f672015ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:56.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.191+0000 7f6716ffd640 1 -- 172.21.15.47:0/1085469515 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710044070 con 0x7f67200b0780 2024-04-14T23:35:56.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.191+0000 7f6716ffd640 1 -- 172.21.15.47:0/1085469515 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67100019b0 con 0x7f67200b0780 2024-04-14T23:35:56.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.191+0000 7f6724ade640 1 -- 172.21.15.47:0/1085469515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67200c95c0 con 0x7f67200b0780 2024-04-14T23:35:56.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.191+0000 7f6716ffd640 1 -- 172.21.15.47:0/1085469515 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710039040 con 0x7f67200b0780 2024-04-14T23:35:56.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.191+0000 7f6724ade640 1 -- 172.21.15.47:0/1085469515 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67200c9b80 con 0x7f67200b0780 2024-04-14T23:35:56.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.192+0000 7f6716ffd640 1 -- 172.21.15.47:0/1085469515 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6710047070 con 0x7f67200b0780 2024-04-14T23:35:56.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.193+0000 7f6716ffd640 1 --2- 172.21.15.47:0/1085469515 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f670006b990 0x7f670006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.193+0000 7f6716ffd640 1 -- 172.21.15.47:0/1085469515 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f67100abc00 con 0x7f67200b0780 2024-04-14T23:35:56.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.193+0000 7f671e59c640 1 --2- 172.21.15.47:0/1085469515 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f670006b990 0x7f670006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.194+0000 7f671e59c640 1 --2- 172.21.15.47:0/1085469515 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f670006b990 0x7f670006de50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6718009b40 tx=0x7f6718008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:56.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.194+0000 7f67279a2740 1 Processor -- start 2024-04-14T23:35:56.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.194+0000 7f67279a2740 1 -- start start 2024-04-14T23:35:56.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f67279a2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a86f0 0x55eadd17b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f67279a2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1a8ad0 0x55eadd1ab480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f67279a2740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd17bbd0 0x55eadd1ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f67279a2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55eadd0e4f80 con 0x55eadd1a8ad0 2024-04-14T23:35:56.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f67279a2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55eadd08d9a0 con 0x55eadd1a86f0 2024-04-14T23:35:56.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f67279a2740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55eadd0e0f30 con 0x55eadd17bbd0 2024-04-14T23:35:56.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f671dd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1a8ad0 0x55eadd1ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f671dd9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1a8ad0 0x55eadd1ab480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43574/0 (socket says 172.21.15.47:43574) 2024-04-14T23:35:56.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f671dd9b640 1 -- 172.21.15.47:0/724087265 learned_addr learned my addr 172.21.15.47:0/724087265 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f671ed9d640 1 --2- 172.21.15.47:0/724087265 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd17bbd0 0x55eadd1ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f671e59c640 1 --2- 172.21.15.47:0/724087265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a86f0 0x55eadd17b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f671dd9b640 1 -- 172.21.15.47:0/724087265 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd17bbd0 msgr2=0x55eadd1ab9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f671dd9b640 1 --2- 172.21.15.47:0/724087265 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd17bbd0 0x55eadd1ab9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f671dd9b640 1 -- 172.21.15.47:0/724087265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a86f0 msgr2=0x55eadd17b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f671dd9b640 1 --2- 172.21.15.47:0/724087265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a86f0 0x55eadd17b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f671dd9b640 1 -- 172.21.15.47:0/724087265 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eadd0ae480 con 0x55eadd1a8ad0 2024-04-14T23:35:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.195+0000 7f671dd9b640 1 --2- 172.21.15.47:0/724087265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1a8ad0 0x55eadd1ab480 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f67080017c0 tx=0x7f6708007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0afb02719f03669 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.196+0000 7f66fffff640 1 -- 172.21.15.47:0/724087265 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67080053e0 con 0x55eadd1a8ad0 2024-04-14T23:35:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.196+0000 7f66fffff640 1 -- 172.21.15.47:0/724087265 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67080128a0 con 0x55eadd1a8ad0 2024-04-14T23:35:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.196+0000 7f66fffff640 1 -- 172.21.15.47:0/724087265 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708012c70 con 0x55eadd1a8ad0 2024-04-14T23:35:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.196+0000 7f67279a2740 1 -- 172.21.15.47:0/724087265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1a8ad0 msgr2=0x55eadd1ab480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.196+0000 7f67279a2740 1 --2- 172.21.15.47:0/724087265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1a8ad0 0x55eadd1ab480 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f67080017c0 tx=0x7f6708007c80 comp rx=0 tx=0).stop 2024-04-14T23:35:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.196+0000 7f67279a2740 1 -- 172.21.15.47:0/724087265 shutdown_connections 2024-04-14T23:35:56.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.196+0000 7f67279a2740 1 --2- 172.21.15.47:0/724087265 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd17bbd0 0x55eadd1ab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.196+0000 7f67279a2740 1 --2- 172.21.15.47:0/724087265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1a8ad0 0x55eadd1ab480 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.196+0000 7f67279a2740 1 --2- 172.21.15.47:0/724087265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a86f0 0x55eadd17b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.196+0000 7f67279a2740 1 -- 172.21.15.47:0/724087265 >> 172.21.15.47:0/724087265 conn(0x55eadd17d900 msgr2=0x55eadd1c6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.196+0000 7f67279a2740 1 -- 172.21.15.47:0/724087265 shutdown_connections 2024-04-14T23:35:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.196+0000 7f67279a2740 1 -- 172.21.15.47:0/724087265 wait complete. 2024-04-14T23:35:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.197+0000 7f67279a2740 1 -- start start 2024-04-14T23:35:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.197+0000 7f67279a2740 1 Processor -- start 2024-04-14T23:35:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f67279a2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a86f0 0x55eadd1c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f67279a2740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd1a8ad0 0x55eadd1ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f67279a2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd1ada00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f67279a2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55eadd17fea0 con 0x55eadd1c0ff0 2024-04-14T23:35:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f67279a2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55eadd0a0f40 con 0x55eadd1a86f0 2024-04-14T23:35:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f67279a2740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55eadd17f290 con 0x55eadd1a8ad0 2024-04-14T23:35:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f67279a2740 10 client.0 _ll_register_callbacks cb 0x55eadd09b9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T23:35:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f671ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd1ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f671ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd1ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43590/0 (socket says 172.21.15.47:43590) 2024-04-14T23:35:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f671ed9d640 1 -- 172.21.15.47:0/2992803405 learned_addr learned my addr 172.21.15.47:0/2992803405 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f671dd9b640 1 --2- 172.21.15.47:0/2992803405 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd1a8ad0 0x55eadd1ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f671e59c640 1 --2- 172.21.15.47:0/2992803405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a86f0 0x55eadd1c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f671ed9d640 1 -- 172.21.15.47:0/2992803405 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd1a8ad0 msgr2=0x55eadd1ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f671ed9d640 1 --2- 172.21.15.47:0/2992803405 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd1a8ad0 0x55eadd1ad4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f671ed9d640 1 -- 172.21.15.47:0/2992803405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a86f0 msgr2=0x55eadd1c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f671ed9d640 1 --2- 172.21.15.47:0/2992803405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a86f0 0x55eadd1c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f671ed9d640 1 -- 172.21.15.47:0/2992803405 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eadcdf92d0 con 0x55eadd1c0ff0 2024-04-14T23:35:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f671ed9d640 1 --2- 172.21.15.47:0/2992803405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd1ada00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6710001bc0 tx=0x7f6710001390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5889007c32db3ae7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.198+0000 7f66fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-14T23:35:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f66fd7fa640 1 -- 172.21.15.47:0/2992803405 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710082900 con 0x55eadd1c0ff0 2024-04-14T23:35:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f66fd7fa640 1 -- 172.21.15.47:0/2992803405 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f67100766a0 con 0x55eadd1c0ff0 2024-04-14T23:35:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f67279a2740 1 -- 172.21.15.47:0/2992803405 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67080128a0 con 0x55eadd1c0ff0 2024-04-14T23:35:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f66fd7fa640 1 -- 172.21.15.47:0/2992803405 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f6710098050 con 0x55eadd1c0ff0 2024-04-14T23:35:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f67279a2740 10 client.5535 fetch_fsmap learned FSMap version 15 2024-04-14T23:35:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f67279a2740 1 -- 172.21.15.47:0/2992803405 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55eadcec36b0 con 0x55eadd1c0ff0 2024-04-14T23:35:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f66fd7fa640 1 -- 172.21.15.47:0/2992803405 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67080128a0 con 0x55eadd1c0ff0 2024-04-14T23:35:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f66fd7fa640 1 -- 172.21.15.47:0/2992803405 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 15) ==== 3494+0+0 (secure 0 0 0) 0x7f6710079480 con 0x55eadd1c0ff0 2024-04-14T23:35:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f67279a2740 10 client.5535 fetch_fsmap finished waiting for FSMap version 15 2024-04-14T23:35:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f67279a2740 10 client.5535 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-14T23:35:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f67279a2740 20 client.5535 populate_metadata read hostname 'smithi047' 2024-04-14T23:35:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f67279a2740 1 --2- 172.21.15.47:0/2992803405 >> [v2:172.21.15.47:6833/1026300185,v1:172.21.15.47:6835/1026300185] conn(0x55eadd1dfe30 0x55eadd1e40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f67279a2740 4 client.5535 mds_command: new command op to 5334 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T23:35:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f67279a2740 1 -- 172.21.15.47:0/2992803405 --> [v2:172.21.15.47:6833/1026300185,v1:172.21.15.47:6835/1026300185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eadd0f24c0 con 0x55eadd1dfe30 2024-04-14T23:35:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f671e59c640 1 --2- 172.21.15.47:0/2992803405 >> [v2:172.21.15.47:6833/1026300185,v1:172.21.15.47:6835/1026300185] conn(0x55eadd1dfe30 0x55eadd1e40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f66fd7fa640 10 client.5535 ms_handle_connect on v2:172.21.15.47:6833/1026300185 2024-04-14T23:35:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.199+0000 7f671e59c640 1 --2- 172.21.15.47:0/2992803405 >> [v2:172.21.15.47:6833/1026300185,v1:172.21.15.47:6835/1026300185] conn(0x55eadd1dfe30 0x55eadd1e40f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20847f33b364c40a server_cookie=d7c8de7229e8526e in_seq=0 out_seq=0 2024-04-14T23:35:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.200+0000 7f66fd7fa640 1 -- 172.21.15.47:0/2992803405 <== mds.0 v2:172.21.15.47:6833/1026300185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55eadd0f24c0 con 0x55eadd1dfe30 2024-04-14T23:35:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.200+0000 7f66fd7fa640 10 client.5535 handle_command_reply: tid=0 2024-04-14T23:35:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.200+0000 7f67279a2740 1 client.5535 shutdown 2024-04-14T23:35:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.200+0000 7f67279a2740 1 -- 172.21.15.47:0/2992803405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 msgr2=0x55eadd1ada00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.200+0000 7f67279a2740 1 --2- 172.21.15.47:0/2992803405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd1ada00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6710001bc0 tx=0x7f6710001390 comp rx=0 tx=0).stop 2024-04-14T23:35:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.200+0000 7f67279a2740 1 -- 172.21.15.47:0/2992803405 shutdown_connections 2024-04-14T23:35:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.200+0000 7f67279a2740 1 --2- 172.21.15.47:0/2992803405 >> [v2:172.21.15.47:6833/1026300185,v1:172.21.15.47:6835/1026300185] conn(0x55eadd1dfe30 0x55eadd1e40f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.200+0000 7f67279a2740 1 --2- 172.21.15.47:0/2992803405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd1ada00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.200+0000 7f67279a2740 1 --2- 172.21.15.47:0/2992803405 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd1a8ad0 0x55eadd1ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.200+0000 7f67279a2740 1 --2- 172.21.15.47:0/2992803405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a86f0 0x55eadd1c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.200+0000 7f66fd7fa640 0 client.5535 ms_handle_reset on v2:172.21.15.47:6833/1026300185 2024-04-14T23:35:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.200+0000 7f67279a2740 1 -- 172.21.15.47:0/2992803405 >> 172.21.15.47:0/2992803405 conn(0x55eadd17bbd0 msgr2=0x55eadd1c9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.200+0000 7f67279a2740 1 -- 172.21.15.47:0/2992803405 shutdown_connections 2024-04-14T23:35:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.200+0000 7f67279a2740 1 -- 172.21.15.47:0/2992803405 wait complete. 2024-04-14T23:35:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.201+0000 7f67279a2740 20 client.5535 trim_cache size 0 max 16384 2024-04-14T23:35:56.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.219+0000 7f67279a2740 1 Processor -- start 2024-04-14T23:35:56.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.219+0000 7f67279a2740 1 -- start start 2024-04-14T23:35:56.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.219+0000 7f67279a2740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd1a86f0 0x55eadd1e91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.219+0000 7f67279a2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a8ad0 0x55eadd1e8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.219+0000 7f67279a2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd1e8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.219+0000 7f67279a2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6720200350 con 0x55eadd1c0ff0 2024-04-14T23:35:56.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.219+0000 7f67279a2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f67201611f0 con 0x55eadd1a8ad0 2024-04-14T23:35:56.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.219+0000 7f67279a2740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f67201ffd90 con 0x55eadd1a86f0 2024-04-14T23:35:56.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.220+0000 7f671ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd1e8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.220+0000 7f671ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd1e8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43596/0 (socket says 172.21.15.47:43596) 2024-04-14T23:35:56.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.220+0000 7f671ed9d640 1 -- 172.21.15.47:0/1647845142 learned_addr learned my addr 172.21.15.47:0/1647845142 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:56.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.220+0000 7f671ed9d640 1 -- 172.21.15.47:0/1647845142 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd1a86f0 msgr2=0x55eadd1e91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:56.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.220+0000 7f671dd9b640 1 --2- 172.21.15.47:0/1647845142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a8ad0 0x55eadd1e8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.220+0000 7f671ed9d640 1 --2- 172.21.15.47:0/1647845142 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd1a86f0 0x55eadd1e91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.220+0000 7f671ed9d640 1 -- 172.21.15.47:0/1647845142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a8ad0 msgr2=0x55eadd1e8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:56.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.220+0000 7f671ed9d640 1 --2- 172.21.15.47:0/1647845142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a8ad0 0x55eadd1e8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.220+0000 7f671ed9d640 1 -- 172.21.15.47:0/1647845142 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eadd1c23a0 con 0x55eadd1c0ff0 2024-04-14T23:35:56.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.220+0000 7f671ed9d640 1 --2- 172.21.15.47:0/1647845142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd1e8650 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6710079fc0 tx=0x7f6710091000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cdd1af57cb6d16 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.220+0000 7f66ff7fe640 1 -- 172.21.15.47:0/1647845142 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710082900 con 0x55eadd1c0ff0 2024-04-14T23:35:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.220+0000 7f66ff7fe640 1 -- 172.21.15.47:0/1647845142 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67100a8070 con 0x55eadd1c0ff0 2024-04-14T23:35:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.220+0000 7f66ff7fe640 1 -- 172.21.15.47:0/1647845142 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710079b70 con 0x55eadd1c0ff0 2024-04-14T23:35:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.221+0000 7f67279a2740 1 -- 172.21.15.47:0/1647845142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 msgr2=0x55eadd1e8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.221+0000 7f67279a2740 1 --2- 172.21.15.47:0/1647845142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd1e8650 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6710079fc0 tx=0x7f6710091000 comp rx=0 tx=0).stop 2024-04-14T23:35:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.221+0000 7f67279a2740 1 -- 172.21.15.47:0/1647845142 shutdown_connections 2024-04-14T23:35:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.221+0000 7f67279a2740 1 --2- 172.21.15.47:0/1647845142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd1e8650 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.221+0000 7f67279a2740 1 --2- 172.21.15.47:0/1647845142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a8ad0 0x55eadd1e8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.221+0000 7f67279a2740 1 --2- 172.21.15.47:0/1647845142 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd1a86f0 0x55eadd1e91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.221+0000 7f67279a2740 1 -- 172.21.15.47:0/1647845142 >> 172.21.15.47:0/1647845142 conn(0x55eadd17bbd0 msgr2=0x55eadd1c1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.221+0000 7f67279a2740 1 -- 172.21.15.47:0/1647845142 shutdown_connections 2024-04-14T23:35:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.221+0000 7f67279a2740 1 -- 172.21.15.47:0/1647845142 wait complete. 2024-04-14T23:35:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.221+0000 7f67279a2740 1 -- start start 2024-04-14T23:35:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.221+0000 7f67279a2740 1 Processor -- start 2024-04-14T23:35:56.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.222+0000 7f67279a2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a86f0 0x55eadd1e8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.222+0000 7f67279a2740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd1a8ad0 0x55eadd1e8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.222+0000 7f67279a2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd23d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.222+0000 7f67279a2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55eadd1dfcb0 con 0x55eadd1c0ff0 2024-04-14T23:35:56.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.222+0000 7f67279a2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55eadd17fea0 con 0x55eadd1a86f0 2024-04-14T23:35:56.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.222+0000 7f67279a2740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55eadd1e0240 con 0x55eadd1a8ad0 2024-04-14T23:35:56.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.222+0000 7f67279a2740 10 client.0 _ll_register_callbacks cb 0x7f671000a600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T23:35:56.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.222+0000 7f671ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd23d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.222+0000 7f671ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd23d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43608/0 (socket says 172.21.15.47:43608) 2024-04-14T23:35:56.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.222+0000 7f671ed9d640 1 -- 172.21.15.47:0/2393049377 learned_addr learned my addr 172.21.15.47:0/2393049377 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:56.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.222+0000 7f671dd9b640 1 --2- 172.21.15.47:0/2393049377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd1a8ad0 0x55eadd1e8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.222+0000 7f671e59c640 1 --2- 172.21.15.47:0/2393049377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a86f0 0x55eadd1e8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f671ed9d640 1 -- 172.21.15.47:0/2393049377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd1a8ad0 msgr2=0x55eadd1e8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:56.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f671ed9d640 1 --2- 172.21.15.47:0/2393049377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd1a8ad0 0x55eadd1e8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f671ed9d640 1 -- 172.21.15.47:0/2393049377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a86f0 msgr2=0x55eadd1e8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:56.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f671ed9d640 1 --2- 172.21.15.47:0/2393049377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a86f0 0x55eadd1e8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f671ed9d640 1 -- 172.21.15.47:0/2393049377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eadd1e8a50 con 0x55eadd1c0ff0 2024-04-14T23:35:56.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f671e59c640 1 --2- 172.21.15.47:0/2393049377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a86f0 0x55eadd1e8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:56.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f671dd9b640 1 --2- 172.21.15.47:0/2393049377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd1a8ad0 0x55eadd1e8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:35:56.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f671ed9d640 1 --2- 172.21.15.47:0/2393049377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd23d6a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6710001580 tx=0x7f6710041070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49dd62b32381731b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:56.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f66fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-14T23:35:56.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f66fd7fa640 1 -- 172.21.15.47:0/2393049377 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710079b70 con 0x55eadd1c0ff0 2024-04-14T23:35:56.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f66fd7fa640 1 -- 172.21.15.47:0/2393049377 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6710082d50 con 0x55eadd1c0ff0 2024-04-14T23:35:56.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f67279a2740 1 -- 172.21.15.47:0/2393049377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67100a8070 con 0x55eadd1c0ff0 2024-04-14T23:35:56.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f66fd7fa640 1 -- 172.21.15.47:0/2393049377 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f6710082900 con 0x55eadd1c0ff0 2024-04-14T23:35:56.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f67279a2740 10 client.5541 fetch_fsmap learned FSMap version 15 2024-04-14T23:35:56.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f67279a2740 1 -- 172.21.15.47:0/2393049377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55eadd1e8a50 con 0x55eadd1c0ff0 2024-04-14T23:35:56.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f66fd7fa640 1 -- 172.21.15.47:0/2393049377 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67100a8070 con 0x55eadd1c0ff0 2024-04-14T23:35:56.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f66fd7fa640 1 -- 172.21.15.47:0/2393049377 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 15) ==== 3494+0+0 (secure 0 0 0) 0x7f67100802d0 con 0x55eadd1c0ff0 2024-04-14T23:35:56.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f67279a2740 10 client.5541 fetch_fsmap finished waiting for FSMap version 15 2024-04-14T23:35:56.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f67279a2740 10 client.5541 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-14T23:35:56.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f67279a2740 20 client.5541 populate_metadata read hostname 'smithi047' 2024-04-14T23:35:56.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f67279a2740 1 --2- 172.21.15.47:0/2393049377 >> [v2:172.21.15.47:6833/1026300185,v1:172.21.15.47:6835/1026300185] conn(0x55eadd1ae870 0x55eadd1aec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f67279a2740 4 client.5541 mds_command: new command op to 5334 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-14T23:35:56.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f67279a2740 1 -- 172.21.15.47:0/2393049377 --> [v2:172.21.15.47:6833/1026300185,v1:172.21.15.47:6835/1026300185] -- command(tid 0: {"prefix": "status"}) -- 0x55eadd1c94d0 con 0x55eadd1ae870 2024-04-14T23:35:56.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.223+0000 7f671e59c640 1 --2- 172.21.15.47:0/2393049377 >> [v2:172.21.15.47:6833/1026300185,v1:172.21.15.47:6835/1026300185] conn(0x55eadd1ae870 0x55eadd1aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f671e59c640 1 --2- 172.21.15.47:0/2393049377 >> [v2:172.21.15.47:6833/1026300185,v1:172.21.15.47:6835/1026300185] conn(0x55eadd1ae870 0x55eadd1aec50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce0a23eabf5306d server_cookie=d935a8b13ed9071a in_seq=0 out_seq=0 2024-04-14T23:35:56.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f66fd7fa640 10 client.5541 ms_handle_connect on v2:172.21.15.47:6833/1026300185 2024-04-14T23:35:56.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f66fd7fa640 1 -- 172.21.15.47:0/2393049377 <== mds.0 v2:172.21.15.47:6833/1026300185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55eadd1c94d0 con 0x55eadd1ae870 2024-04-14T23:35:56.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f66fd7fa640 10 client.5541 handle_command_reply: tid=0 2024-04-14T23:35:56.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f67279a2740 1 client.5541 shutdown 2024-04-14T23:35:56.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f67279a2740 1 -- 172.21.15.47:0/2393049377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 msgr2=0x55eadd23d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f67279a2740 1 --2- 172.21.15.47:0/2393049377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd23d6a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6710001580 tx=0x7f6710041070 comp rx=0 tx=0).stop 2024-04-14T23:35:56.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f67279a2740 1 -- 172.21.15.47:0/2393049377 shutdown_connections 2024-04-14T23:35:56.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f67279a2740 1 --2- 172.21.15.47:0/2393049377 >> [v2:172.21.15.47:6833/1026300185,v1:172.21.15.47:6835/1026300185] conn(0x55eadd1ae870 0x55eadd1aec50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f67279a2740 1 --2- 172.21.15.47:0/2393049377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eadd1c0ff0 0x55eadd23d6a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f67279a2740 1 --2- 172.21.15.47:0/2393049377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55eadd1a8ad0 0x55eadd1e8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f67279a2740 1 --2- 172.21.15.47:0/2393049377 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eadd1a86f0 0x55eadd1e8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f67279a2740 1 -- 172.21.15.47:0/2393049377 >> 172.21.15.47:0/2393049377 conn(0x55eadd17bbd0 msgr2=0x55eadd1a7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:56.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f66fd7fa640 0 client.5541 ms_handle_reset on v2:172.21.15.47:6833/1026300185 2024-04-14T23:35:56.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f67279a2740 1 -- 172.21.15.47:0/2393049377 shutdown_connections 2024-04-14T23:35:56.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f67279a2740 1 -- 172.21.15.47:0/2393049377 wait complete. 2024-04-14T23:35:56.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.224+0000 7f67279a2740 20 client.5541 trim_cache size 0 max 16384 2024-04-14T23:35:56.234 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-14T23:35:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "4f54965e-64cf-4502-8b02-6c5af72b63aa", 2024-04-14T23:35:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-04-14T23:35:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 5334, 2024-04-14T23:35:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-04-14T23:35:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-04-14T23:35:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-04-14T23:35:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 9.0993306660000002, 2024-04-14T23:35:56.235 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 15, 2024-04-14T23:35:56.235 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 39, 2024-04-14T23:35:56.235 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 39, 2024-04-14T23:35:56.235 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 16.170239833 2024-04-14T23:35:56.235 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-14T23:35:56.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.225+0000 7f6724ade640 1 -- 172.21.15.47:0/1085469515 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f670006b990 msgr2=0x7f670006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.225+0000 7f6724ade640 1 --2- 172.21.15.47:0/1085469515 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f670006b990 0x7f670006de50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6718009b40 tx=0x7f6718008040 comp rx=0 tx=0).stop 2024-04-14T23:35:56.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.225+0000 7f6724ade640 1 -- 172.21.15.47:0/1085469515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67200b0780 msgr2=0x7f6720157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.225+0000 7f6724ade640 1 --2- 172.21.15.47:0/1085469515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67200b0780 0x7f6720157680 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f671000a810 tx=0x7f672015ee50 comp rx=0 tx=0).stop 2024-04-14T23:35:56.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.225+0000 7f6724ade640 1 -- 172.21.15.47:0/1085469515 shutdown_connections 2024-04-14T23:35:56.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.225+0000 7f6724ade640 1 --2- 172.21.15.47:0/1085469515 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f670006b990 0x7f670006de50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.225+0000 7f6724ade640 1 --2- 172.21.15.47:0/1085469515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67200b0780 0x7f6720157680 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.225+0000 7f6724ade640 1 --2- 172.21.15.47:0/1085469515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67200ca660 0x7f6720161ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.225+0000 7f6724ade640 1 --2- 172.21.15.47:0/1085469515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f670c0052e0 0x7f67200c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.225+0000 7f6724ade640 1 -- 172.21.15.47:0/1085469515 >> 172.21.15.47:0/1085469515 conn(0x7f67200d0bb0 msgr2=0x7f672009f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:56.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.225+0000 7f6724ade640 1 -- 172.21.15.47:0/1085469515 shutdown_connections 2024-04-14T23:35:56.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.225+0000 7f6724ade640 1 -- 172.21.15.47:0/1085469515 wait complete. 2024-04-14T23:35:56.239 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-14T23:35:56.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.336+0000 7f003adcc640 1 Processor -- start 2024-04-14T23:35:56.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.336+0000 7f003adcc640 1 -- start start 2024-04-14T23:35:56.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.337+0000 7f003adcc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00340d2b30 0x7f00340cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.337+0000 7f003adcc640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00340c83c0 con 0x7f003415e4a0 2024-04-14T23:35:56.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.337+0000 7f003adcc640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00340c86a0 con 0x7f00340d1c40 2024-04-14T23:35:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.337+0000 7f003adcc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f003415e880 con 0x7f00340d2b30 2024-04-14T23:35:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.337+0000 7f0038b68640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f003415e4a0 0x7f00340d2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49878/0 (socket says 172.21.15.47:49878) 2024-04-14T23:35:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.337+0000 7f0038b68640 1 -- 172.21.15.47:0/124155187 learned_addr learned my addr 172.21.15.47:0/124155187 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:35:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.337+0000 7f0033fff640 1 --2- 172.21.15.47:0/124155187 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00340d2b30 0x7f00340cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.337+0000 7f00337fe640 1 -- 172.21.15.47:0/124155187 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1837850858 0 0) 0x7f00340c83c0 con 0x7f003415e4a0 2024-04-14T23:35:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f00337fe640 1 -- 172.21.15.47:0/124155187 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f001c003520 con 0x7f003415e4a0 2024-04-14T23:35:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f00337fe640 1 -- 172.21.15.47:0/124155187 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4005269280 0 0) 0x7f001c003520 con 0x7f003415e4a0 2024-04-14T23:35:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f00337fe640 1 -- 172.21.15.47:0/124155187 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00340d2b30 msgr2=0x7f00340cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f00337fe640 1 --2- 172.21.15.47:0/124155187 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00340d2b30 0x7f00340cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f00337fe640 1 -- 172.21.15.47:0/124155187 >> v1:172.21.15.191:6789/0 conn(0x7f00340d1c40 legacy=0x7f00340cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f00337fe640 1 -- 172.21.15.47:0/124155187 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00340c8980 con 0x7f003415e4a0 2024-04-14T23:35:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f00337fe640 1 -- 172.21.15.47:0/124155187 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f002c0019f0 con 0x7f003415e4a0 2024-04-14T23:35:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f00337fe640 1 -- 172.21.15.47:0/124155187 >> v1:172.21.15.47:6789/0 conn(0x7f003415e4a0 legacy=0x7f00340d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f00337fe640 1 --2- 172.21.15.47:0/124155187 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f001c0039e0 0x7f001c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f00337fe640 1 --2- 172.21.15.47:0/124155187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c004340 0x7f001c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f00337fe640 1 --2- 172.21.15.47:0/124155187 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f001c005020 0x7f001c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f00337fe640 1 -- 172.21.15.47:0/124155187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f003415e880 con 0x7f001c004340 2024-04-14T23:35:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f00337fe640 1 -- 172.21.15.47:0/124155187 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f001c00bf30 con 0x7f001c005020 2024-04-14T23:35:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f00337fe640 1 -- 172.21.15.47:0/124155187 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f001c00c130 con 0x7f001c0039e0 2024-04-14T23:35:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f0033fff640 1 --2- 172.21.15.47:0/124155187 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00340d2b30 0x7f00340cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T23:35:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f0038b68640 1 --2- 172.21.15.47:0/124155187 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f001c0039e0 0x7f001c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f0033fff640 1 --2- 172.21.15.47:0/124155187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c004340 0x7f001c004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f0039369640 1 --2- 172.21.15.47:0/124155187 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f001c005020 0x7f001c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f0033fff640 1 -- 172.21.15.47:0/124155187 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f001c0039e0 msgr2=0x7f001c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f0033fff640 1 --2- 172.21.15.47:0/124155187 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f001c0039e0 0x7f001c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f0033fff640 1 -- 172.21.15.47:0/124155187 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f001c005020 msgr2=0x7f001c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:35:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f0033fff640 1 --2- 172.21.15.47:0/124155187 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f001c005020 0x7f001c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.338+0000 7f0033fff640 1 -- 172.21.15.47:0/124155187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c003520 con 0x7f001c004340 2024-04-14T23:35:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.339+0000 7f0033fff640 1 --2- 172.21.15.47:0/124155187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c004340 0x7f001c004820 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f00340b9f80 tx=0x7f001c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa596bf820559cf server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.339+0000 7f00337fe640 1 -- 172.21.15.47:0/124155187 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00280097d0 con 0x7f001c004340 2024-04-14T23:35:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.339+0000 7f00337fe640 1 -- 172.21.15.47:0/124155187 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0028004030 con 0x7f001c004340 2024-04-14T23:35:56.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.339+0000 7f00337fe640 1 -- 172.21.15.47:0/124155187 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0028004400 con 0x7f001c004340 2024-04-14T23:35:56.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.340+0000 7f003adcc640 1 -- 172.21.15.47:0/124155187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c004340 msgr2=0x7f001c004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.340+0000 7f003adcc640 1 --2- 172.21.15.47:0/124155187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f001c004340 0x7f001c004820 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f00340b9f80 tx=0x7f001c005830 comp rx=0 tx=0).stop 2024-04-14T23:35:56.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.340+0000 7f0039369640 1 -- 172.21.15.47:0/124155187 reap_dead start 2024-04-14T23:35:56.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.340+0000 7f003adcc640 1 -- 172.21.15.47:0/124155187 shutdown_connections 2024-04-14T23:35:56.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.340+0000 7f003adcc640 1 -- 172.21.15.47:0/124155187 >> 172.21.15.47:0/124155187 conn(0x7f00340d3ef0 msgr2=0x7f00340d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:56.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.340+0000 7f003adcc640 1 -- 172.21.15.47:0/124155187 shutdown_connections 2024-04-14T23:35:56.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.340+0000 7f003adcc640 1 -- 172.21.15.47:0/124155187 wait complete. 2024-04-14T23:35:56.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.341+0000 7f003adcc640 1 Processor -- start 2024-04-14T23:35:56.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.341+0000 7f003adcc640 1 -- start start 2024-04-14T23:35:56.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f003adcc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f001c004340 0x7f00340c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f003adcc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00341f7ce0 0x7f00340cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f003adcc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00341f70d0 0x7f00341f7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f003adcc640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0034067bb0 con 0x7f00341f7ce0 2024-04-14T23:35:56.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f003adcc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f00340c8f40 con 0x7f00341f70d0 2024-04-14T23:35:56.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f003adcc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0034067d30 con 0x7f001c004340 2024-04-14T23:35:56.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f0033fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00341f7ce0 0x7f00340cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f0033fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00341f7ce0 0x7f00340cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43622/0 (socket says 172.21.15.47:43622) 2024-04-14T23:35:56.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f0033fff640 1 -- 172.21.15.47:0/638431840 learned_addr learned my addr 172.21.15.47:0/638431840 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:35:56.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f0033fff640 1 -- 172.21.15.47:0/638431840 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f001c004340 msgr2=0x7f00340c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f0038b68640 1 --2- 172.21.15.47:0/638431840 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f001c004340 0x7f00340c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f0039369640 1 --2- 172.21.15.47:0/638431840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00341f70d0 0x7f00341f7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f0033fff640 1 --2- 172.21.15.47:0/638431840 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f001c004340 0x7f00340c6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f0033fff640 1 -- 172.21.15.47:0/638431840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00341f70d0 msgr2=0x7f00341f7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f0033fff640 1 --2- 172.21.15.47:0/638431840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00341f70d0 0x7f00341f7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f0033fff640 1 -- 172.21.15.47:0/638431840 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00340ccc50 con 0x7f00341f7ce0 2024-04-14T23:35:56.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f0033fff640 1 --2- 172.21.15.47:0/638431840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00341f7ce0 0x7f00340cb0e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0028009bf0 tx=0x7f0028004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:56.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f00317fa640 1 -- 172.21.15.47:0/638431840 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0028042070 con 0x7f00341f7ce0 2024-04-14T23:35:56.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f00317fa640 1 -- 172.21.15.47:0/638431840 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f002802c910 con 0x7f00341f7ce0 2024-04-14T23:35:56.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f003adcc640 1 -- 172.21.15.47:0/638431840 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00340cced0 con 0x7f00341f7ce0 2024-04-14T23:35:56.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.342+0000 7f00317fa640 1 -- 172.21.15.47:0/638431840 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002802ccc0 con 0x7f00341f7ce0 2024-04-14T23:35:56.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.343+0000 7f003adcc640 1 -- 172.21.15.47:0/638431840 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00340cd490 con 0x7f00341f7ce0 2024-04-14T23:35:56.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.344+0000 7f003adcc640 1 -- 172.21.15.47:0/638431840 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0034075430 con 0x7f00341f7ce0 2024-04-14T23:35:56.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.344+0000 7f00317fa640 1 -- 172.21.15.47:0/638431840 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0028045070 con 0x7f00341f7ce0 2024-04-14T23:35:56.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.344+0000 7f00317fa640 1 --2- 172.21.15.47:0/638431840 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f002006b9c0 0x7f002006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:35:56.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.344+0000 7f00317fa640 1 -- 172.21.15.47:0/638431840 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f00280ac950 con 0x7f00341f7ce0 2024-04-14T23:35:56.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.345+0000 7f0038b68640 1 --2- 172.21.15.47:0/638431840 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f002006b9c0 0x7f002006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:35:56.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.345+0000 7f0038b68640 1 --2- 172.21.15.47:0/638431840 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f002006b9c0 0x7f002006de80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f002c0013d0 tx=0x7f002c006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:35:56.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.349+0000 7f00317fa640 1 -- 172.21.15.47:0/638431840 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f00340ccc50 con 0x7f00341f7ce0 2024-04-14T23:35:56.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.567+0000 7f003adcc640 1 -- 172.21.15.47:0/638431840 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f00340d21e0 con 0x7f00341f7ce0 2024-04-14T23:35:56.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.568+0000 7f00317fa640 1 -- 172.21.15.47:0/638431840 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7f002807b4f0 con 0x7f00341f7ce0 2024-04-14T23:35:56.571 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-14T23:35:56.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.570+0000 7f003adcc640 1 -- 172.21.15.47:0/638431840 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f002006b9c0 msgr2=0x7f002006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.570+0000 7f003adcc640 1 --2- 172.21.15.47:0/638431840 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f002006b9c0 0x7f002006de80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f002c0013d0 tx=0x7f002c006040 comp rx=0 tx=0).stop 2024-04-14T23:35:56.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.570+0000 7f003adcc640 1 -- 172.21.15.47:0/638431840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00341f7ce0 msgr2=0x7f00340cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:35:56.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.570+0000 7f003adcc640 1 --2- 172.21.15.47:0/638431840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00341f7ce0 0x7f00340cb0e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0028009bf0 tx=0x7f0028004730 comp rx=0 tx=0).stop 2024-04-14T23:35:56.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.570+0000 7f003adcc640 1 -- 172.21.15.47:0/638431840 shutdown_connections 2024-04-14T23:35:56.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.570+0000 7f003adcc640 1 --2- 172.21.15.47:0/638431840 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f002006b9c0 0x7f002006de80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.570+0000 7f003adcc640 1 --2- 172.21.15.47:0/638431840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00341f70d0 0x7f00341f7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.570+0000 7f003adcc640 1 --2- 172.21.15.47:0/638431840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00341f7ce0 0x7f00340cb0e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.570+0000 7f003adcc640 1 --2- 172.21.15.47:0/638431840 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f001c004340 0x7f00340c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:35:56.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.570+0000 7f003adcc640 1 -- 172.21.15.47:0/638431840 >> 172.21.15.47:0/638431840 conn(0x7f00340d3ef0 msgr2=0x7f00340c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:35:56.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.570+0000 7f003adcc640 1 -- 172.21.15.47:0/638431840 shutdown_connections 2024-04-14T23:35:56.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56.570+0000 7f003adcc640 1 -- 172.21.15.47:0/638431840 wait complete. 2024-04-14T23:35:56.584 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-14T23:35:56.584 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-14T23:35:56.584 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-04-14T23:35:56.584 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-14T23:35:56.584 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-14T23:35:56.584 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-14T23:35:56.584 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-14T23:35:56.584 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-14T23:35:56.584 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-14T23:35:56.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:56.584 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-04-14T23:35:56.599 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T23:35:56.599 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T23:35:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T23:35:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-04-14T23:35:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:56.600 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:35:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-04-14T23:35:56.600 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:35:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-04-14T23:35:56.600 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-14T23:35:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-04-14T23:35:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-14T23:35:56.600 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42654sec preferred_lft 42654sec 2024-04-14T23:35:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-04-14T23:35:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:56.601 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T23:35:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-04-14T23:35:56.601 INFO:teuthology.orchestra.run.smithi047.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-14T23:35:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 16:37:9f:73:3d:33 brd ff:ff:ff:ff:ff:ff 2024-04-14T23:35:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-14T23:35:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::88f0:ccff:fece:938d/64 scope link 2024-04-14T23:35:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:56.601 INFO:teuthology.orchestra.run.smithi047.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-14T23:35:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 82:cf:01:ef:df:83 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-14T23:35:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::80cf:1ff:feef:df83/64 scope link 2024-04-14T23:35:56.601 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:56.602 INFO:teuthology.orchestra.run.smithi047.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-14T23:35:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 16:37:9f:73:3d:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-14T23:35:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::1437:9fff:fe73:3d33/64 scope link 2024-04-14T23:35:56.602 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-14T23:35:56.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:56.602 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-14T23:35:56.665 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-04-14T23:35:56.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:56.666 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-04-14T23:35:56.722 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-04-14T23:35:56.722 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-14T23:35:56.722 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-14T23:35:56.722 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-14T23:35:56.722 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-14T23:35:56.723 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T23:35:56.723 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-14T23:35:56.723 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-14T23:35:56.723 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-14T23:35:56.723 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-14T23:35:56.723 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-14T23:35:56.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T23:35:56.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:56.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:56.858 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-14T23:35:56.872 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-14T23:35:56.872 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-14T23:35:56.872 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-14T23:35:56.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:56.872 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-04-14T23:35:56.938 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T23:35:56.938 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-14T23:35:56.992 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-14T23:35:56.992 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T23:35:56.992 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-14T23:35:57.046 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-14T23:35:57.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:57.047 DEBUG:teuthology.orchestra.run.smithi047:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-14T23:35:57.133 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-14T23:35:57.133 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-14T23:35:57.133 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-04-14T23:35:57.140 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-14T23:35:57.140 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-14T23:35:57.140 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-04-14T23:35:57.140 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.191:3300,172.21.15.191:3301" 2024-04-14T23:35:57.140 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-14T23:35:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-14T23:35:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-14T23:35:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-04-14T23:35:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.191:3300,172.21.15.191:3301" 2024-04-14T23:35:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-14T23:35:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.47:6789,172.21.15.191:6789,172.21.15.191:6790" 2024-04-14T23:35:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.47:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2024-04-14T23:35:57.147 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=4f54965e-64cf-4502-8b02-6c5af72b63aa" will pass to kernel 2024-04-14T23:35:57.148 INFO:teuthology.orchestra.run.smithi047.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-14T23:35:57.148 INFO:teuthology.orchestra.run.smithi047.stdout: You just mounted a file system that supports labels which does not 2024-04-14T23:35:57.148 INFO:teuthology.orchestra.run.smithi047.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-14T23:35:57.148 INFO:teuthology.orchestra.run.smithi047.stdout: applications will generate AVC messages and not be allowed access to 2024-04-14T23:35:57.148 INFO:teuthology.orchestra.run.smithi047.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-14T23:35:57.150 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-14T23:35:57.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:57.150 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-14T23:35:57.177 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T23:35:57.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T23:35:57.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:35:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T23:35:57.280 INFO:teuthology.orchestra.run.smithi047.stdout:client5254 2024-04-14T23:35:57.280 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:35:57.280 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:57.295 DEBUG:teuthology.orchestra.run.smithi047:> mktemp -d --suffix=xfstests-dev 2024-04-14T23:35:57.349 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.tZ64MkRsJ9xfstests-dev 2024-04-14T23:35:57.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:57.349 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.tZ64MkRsJ9xfstests-dev) 2024-04-14T23:35:57.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:57.417 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.tZ64MkRsJ9xfstests-dev) 2024-04-14T23:35:57.474 INFO:teuthology.orchestra.run.smithi047.stderr:Cloning into '/tmp/tmp.tZ64MkRsJ9xfstests-dev'... 2024-04-14T23:35:58.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:58.243 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-04-14T23:35:58.303 DEBUG:teuthology.orchestra.run.smithi047:> mktemp -d --suffix=test 2024-04-14T23:35:58.357 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.S4hiVIZxd3test 2024-04-14T23:35:58.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:35:58.358 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-04-14T23:35:58.414 DEBUG:teuthology.orchestra.run.smithi047:> mktemp -d --suffix=scratch 2024-04-14T23:35:58.469 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.TkGGZHtECxscratch 2024-04-14T23:35:58.469 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-04-14T23:35:58.470 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-04-14T23:35:59.115 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:04:22 ago on Sun 14 Apr 2024 11:31:37 PM UTC. 2024-04-14T23:35:59.420 INFO:teuthology.orchestra.run.smithi047.stderr:Modular dependency problems: 2024-04-14T23:35:59.420 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-14T23:35:59.420 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 1: conflicting requests 2024-04-14T23:35:59.420 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.420 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 2: conflicting requests 2024-04-14T23:35:59.420 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.420 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 3: conflicting requests 2024-04-14T23:35:59.420 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.420 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 4: conflicting requests 2024-04-14T23:35:59.420 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.420 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 5: conflicting requests 2024-04-14T23:35:59.420 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.421 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 6: conflicting requests 2024-04-14T23:35:59.421 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.421 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 7: conflicting requests 2024-04-14T23:35:59.421 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.421 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 8: conflicting requests 2024-04-14T23:35:59.421 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.421 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 9: conflicting requests 2024-04-14T23:35:59.421 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.421 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 10: conflicting requests 2024-04-14T23:35:59.421 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.421 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 11: conflicting requests 2024-04-14T23:35:59.421 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.421 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 12: conflicting requests 2024-04-14T23:35:59.421 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.421 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 13: conflicting requests 2024-04-14T23:35:59.422 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.422 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 14: conflicting requests 2024-04-14T23:35:59.422 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.422 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 15: conflicting requests 2024-04-14T23:35:59.422 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.422 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 16: conflicting requests 2024-04-14T23:35:59.422 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.422 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 17: conflicting requests 2024-04-14T23:35:59.422 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.422 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 18: conflicting requests 2024-04-14T23:35:59.422 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.422 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 19: conflicting requests 2024-04-14T23:35:59.422 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.422 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 20: conflicting requests 2024-04-14T23:35:59.422 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.423 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 21: conflicting requests 2024-04-14T23:35:59.423 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.423 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 22: conflicting requests 2024-04-14T23:35:59.423 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.423 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 23: conflicting requests 2024-04-14T23:35:59.423 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.423 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 24: conflicting requests 2024-04-14T23:35:59.423 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.423 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 25: conflicting requests 2024-04-14T23:35:59.423 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.423 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 26: conflicting requests 2024-04-14T23:35:59.423 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.423 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 27: conflicting requests 2024-04-14T23:35:59.423 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.423 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 28: conflicting requests 2024-04-14T23:35:59.423 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.424 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 29: conflicting requests 2024-04-14T23:35:59.424 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.424 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 30: conflicting requests 2024-04-14T23:35:59.424 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.424 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 31: conflicting requests 2024-04-14T23:35:59.424 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.424 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 32: conflicting requests 2024-04-14T23:35:59.424 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.424 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 33: conflicting requests 2024-04-14T23:35:59.424 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.424 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 34: conflicting requests 2024-04-14T23:35:59.424 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.424 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 35: conflicting requests 2024-04-14T23:35:59.424 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.424 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 36: conflicting requests 2024-04-14T23:35:59.424 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.425 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 37: conflicting requests 2024-04-14T23:35:59.425 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.425 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.425 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.425 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T23:35:59.425 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.425 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.425 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.425 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.425 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 39: conflicting requests 2024-04-14T23:35:59.425 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.425 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.425 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.425 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.425 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.425 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.426 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T23:35:59.426 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.426 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.426 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.426 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.426 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T23:35:59.426 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.426 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.426 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.426 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.426 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T23:35:59.426 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.426 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.426 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.426 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.427 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T23:35:59.427 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.427 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.427 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.427 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.427 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T23:35:59.427 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.427 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.427 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.427 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.427 INFO:teuthology.orchestra.run.smithi047.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T23:35:59.427 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.427 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.427 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.427 INFO:teuthology.orchestra.run.smithi047.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T23:35:59.428 INFO:teuthology.orchestra.run.smithi047.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-04-14T23:35:59.428 INFO:teuthology.orchestra.run.smithi047.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-04-14T23:35:59.428 INFO:teuthology.orchestra.run.smithi047.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-04-14T23:35:59.428 INFO:teuthology.orchestra.run.smithi047.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-04-14T23:35:59.428 INFO:teuthology.orchestra.run.smithi047.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-04-14T23:35:59.430 INFO:teuthology.orchestra.run.smithi047.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-04-14T23:35:59.432 INFO:teuthology.orchestra.run.smithi047.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-04-14T23:35:59.433 INFO:teuthology.orchestra.run.smithi047.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-04-14T23:35:59.435 INFO:teuthology.orchestra.run.smithi047.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-04-14T23:35:59.438 INFO:teuthology.orchestra.run.smithi047.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-14T23:35:59.439 INFO:teuthology.orchestra.run.smithi047.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2024-04-14T23:35:59.441 INFO:teuthology.orchestra.run.smithi047.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-04-14T23:35:59.442 INFO:teuthology.orchestra.run.smithi047.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-04-14T23:35:59.445 INFO:teuthology.orchestra.run.smithi047.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-04-14T23:35:59.445 INFO:teuthology.orchestra.run.smithi047.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-04-14T23:35:59.446 INFO:teuthology.orchestra.run.smithi047.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-04-14T23:35:59.446 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-04-14T23:35:59.448 INFO:teuthology.orchestra.run.smithi047.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-04-14T23:35:59.449 INFO:teuthology.orchestra.run.smithi047.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-04-14T23:35:59.452 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-14T23:35:59.531 INFO:teuthology.orchestra.run.smithi047.stderr:Error: 2024-04-14T23:35:59.531 INFO:teuthology.orchestra.run.smithi047.stderr: Problem: package python3-libs-3.9.18-3.el9.x86_64 from baseos requires libreadline.so.8()(64bit), but none of the providers can be installed 2024-04-14T23:35:59.532 INFO:teuthology.orchestra.run.smithi047.stderr: - cannot install both readline-7.0-10.el8.x86_64 from CentOS-BaseOS and readline-8.1-4.el9.x86_64 from @System 2024-04-14T23:35:59.532 INFO:teuthology.orchestra.run.smithi047.stderr: - cannot install both readline-8.1-4.el9.x86_64 from baseos and readline-7.0-10.el8.x86_64 from CentOS-BaseOS 2024-04-14T23:35:59.532 INFO:teuthology.orchestra.run.smithi047.stderr: - package udftools-2.3-2.el8.x86_64 from CentOS-AppStream requires libreadline.so.7()(64bit), but none of the providers can be installed 2024-04-14T23:35:59.532 INFO:teuthology.orchestra.run.smithi047.stderr: - package python3-3.9.18-3.el9.x86_64 from baseos requires python3-libs(x86-64) = 3.9.18-3.el9, but none of the providers can be installed 2024-04-14T23:35:59.532 INFO:teuthology.orchestra.run.smithi047.stderr: - cannot install the best candidate for the job 2024-04-14T23:35:59.532 INFO:teuthology.orchestra.run.smithi047.stdout:(try to add '--allowerasing' to command line to replace conflicting packages or '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages) 2024-04-14T23:35:59.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:35:59.569 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... ERROR 2024-04-14T23:35:59.570 INFO:tasks.cephfs_test_runner: 2024-04-14T23:35:59.570 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-14T23:35:59.570 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-14T23:35:59.570 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-14T23:35:59.570 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-14T23:35:59.570 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/cephfs/xfstests_dev.py", line 29, in setUp 2024-04-14T23:35:59.570 INFO:tasks.cephfs_test_runner: self.prepare_xfstests_devs() 2024-04-14T23:35:59.570 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/cephfs/xfstests_dev.py", line 44, in prepare_xfstests_devs 2024-04-14T23:35:59.570 INFO:tasks.cephfs_test_runner: self.install_deps() 2024-04-14T23:35:59.570 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/cephfs/xfstests_dev.py", line 252, in install_deps 2024-04-14T23:35:59.570 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=args, omit_sudo=False) 2024-04-14T23:35:59.570 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run 2024-04-14T23:35:59.570 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-04-14T23:35:59.570 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run 2024-04-14T23:35:59.570 INFO:tasks.cephfs_test_runner: r.wait() 2024-04-14T23:35:59.571 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait 2024-04-14T23:35:59.571 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-14T23:35:59.571 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-14T23:35:59.571 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-14T23:35:59.571 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi047 with status 1: 'sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs' 2024-04-14T23:35:59.571 INFO:tasks.cephfs_test_runner: 2024-04-14T23:35:59.571 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-14T23:35:59.571 INFO:tasks.cephfs_test_runner:Ran 1 test in 39.653s 2024-04-14T23:35:59.571 INFO:tasks.cephfs_test_runner: 2024-04-14T23:35:59.571 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-14T23:35:59.571 INFO:tasks.cephfs_test_runner: 2024-04-14T23:35:59.571 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-14T23:35:59.571 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-14T23:35:59.571 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-14T23:35:59.571 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-14T23:35:59.571 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/cephfs/xfstests_dev.py", line 29, in setUp 2024-04-14T23:35:59.572 INFO:tasks.cephfs_test_runner: self.prepare_xfstests_devs() 2024-04-14T23:35:59.572 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/cephfs/xfstests_dev.py", line 44, in prepare_xfstests_devs 2024-04-14T23:35:59.572 INFO:tasks.cephfs_test_runner: self.install_deps() 2024-04-14T23:35:59.572 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/cephfs/xfstests_dev.py", line 252, in install_deps 2024-04-14T23:35:59.572 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=args, omit_sudo=False) 2024-04-14T23:35:59.572 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run 2024-04-14T23:35:59.572 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-04-14T23:35:59.572 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run 2024-04-14T23:35:59.572 INFO:tasks.cephfs_test_runner: r.wait() 2024-04-14T23:35:59.572 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait 2024-04-14T23:35:59.572 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-14T23:35:59.572 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-14T23:35:59.572 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-14T23:35:59.572 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi047 with status 1: 'sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs' 2024-04-14T23:35:59.572 INFO:tasks.cephfs_test_runner: 2024-04-14T23:35:59.573 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-14T23:35:59.787 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ea1a1e4af26344e982a2e9547460bbdb Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_a9a752df26c63acad72e1b3569fd79a515ca0765/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-14T23:35:59.788 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-14T23:35:59.797 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-14T23:35:59.806 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-14T23:35:59.806 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:35:59.806 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:59.824 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:35:59.824 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:35:59.879 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:36:00.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.018+0000 7f6e88695640 1 Processor -- start 2024-04-14T23:36:00.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.018+0000 7f6e88695640 1 -- start start 2024-04-14T23:36:00.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e88695640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6e8006e340 0x7f6e800cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e88695640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e8015c370 con 0x7f6e8015bcc0 2024-04-14T23:36:00.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e88695640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e8015ead0 con 0x7f6e800cff70 2024-04-14T23:36:00.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e88695640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f6e8015c130 con 0x7f6e8006e340 2024-04-14T23:36:00.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e86c32640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6e8015bcc0 0x7f6e80071a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49882/0 (socket says 172.21.15.47:49882) 2024-04-14T23:36:00.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e86c32640 1 -- 172.21.15.47:0/2986141060 learned_addr learned my addr 172.21.15.47:0/2986141060 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:00.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e8542f640 1 -- 172.21.15.47:0/2986141060 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2348294526 0 0) 0x7f6e8015c370 con 0x7f6e8015bcc0 2024-04-14T23:36:00.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e8542f640 1 -- 172.21.15.47:0/2986141060 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e6c003520 con 0x7f6e8015bcc0 2024-04-14T23:36:00.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e86431640 1 --2- 172.21.15.47:0/2986141060 >> v2:172.21.15.191:3300/0 conn(0x7f6e8006e340 0x7f6e800cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e8542f640 1 -- 172.21.15.47:0/2986141060 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2184233508 0 0) 0x7f6e6c003520 con 0x7f6e8015bcc0 2024-04-14T23:36:00.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e8542f640 1 -- 172.21.15.47:0/2986141060 >> v2:172.21.15.191:3300/0 conn(0x7f6e8006e340 msgr2=0x7f6e800cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:00.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e8542f640 1 --2- 172.21.15.47:0/2986141060 >> v2:172.21.15.191:3300/0 conn(0x7f6e8006e340 0x7f6e800cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e8542f640 1 -- 172.21.15.47:0/2986141060 >> v1:172.21.15.191:6789/0 conn(0x7f6e800cff70 legacy=0x7f6e8015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e8542f640 1 -- 172.21.15.47:0/2986141060 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8015edb0 con 0x7f6e8015bcc0 2024-04-14T23:36:00.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e8542f640 1 -- 172.21.15.47:0/2986141060 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f6e780019f0 con 0x7f6e8015bcc0 2024-04-14T23:36:00.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e8542f640 1 -- 172.21.15.47:0/2986141060 >> v1:172.21.15.47:6789/0 conn(0x7f6e8015bcc0 legacy=0x7f6e80071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e8542f640 1 --2- 172.21.15.47:0/2986141060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e6c003a00 0x7f6e6c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e8542f640 1 --2- 172.21.15.47:0/2986141060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e6c004800 0x7f6e6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e8542f640 1 --2- 172.21.15.47:0/2986141060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e6c0052e0 0x7f6e6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e8542f640 1 -- 172.21.15.47:0/2986141060 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8015c130 con 0x7f6e6c0052e0 2024-04-14T23:36:00.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e8542f640 1 -- 172.21.15.47:0/2986141060 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c00c200 con 0x7f6e6c003a00 2024-04-14T23:36:00.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.019+0000 7f6e8542f640 1 -- 172.21.15.47:0/2986141060 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6e6c00c400 con 0x7f6e6c004800 2024-04-14T23:36:00.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.020+0000 7f6e86c32640 1 --2- 172.21.15.47:0/2986141060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e6c0052e0 0x7f6e6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.020+0000 7f6e86431640 1 --2- 172.21.15.47:0/2986141060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e6c003a00 0x7f6e6c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.020+0000 7f6e85c30640 1 --2- 172.21.15.47:0/2986141060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e6c004800 0x7f6e6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.020+0000 7f6e86c32640 1 -- 172.21.15.47:0/2986141060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e6c004800 msgr2=0x7f6e6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:00.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.020+0000 7f6e86c32640 1 --2- 172.21.15.47:0/2986141060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e6c004800 0x7f6e6c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.020+0000 7f6e86c32640 1 -- 172.21.15.47:0/2986141060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e6c003a00 msgr2=0x7f6e6c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:00.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.020+0000 7f6e86c32640 1 --2- 172.21.15.47:0/2986141060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e6c003a00 0x7f6e6c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.020+0000 7f6e86c32640 1 -- 172.21.15.47:0/2986141060 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6c003520 con 0x7f6e6c0052e0 2024-04-14T23:36:00.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.020+0000 7f6e86c32640 1 -- 172.21.15.47:0/2986141060 reap_dead start 2024-04-14T23:36:00.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.020+0000 7f6e86c32640 1 --2- 172.21.15.47:0/2986141060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e6c0052e0 0x7f6e6c00b9c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800a770 tx=0x7f6e6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cb311e86e195fb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:00.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.021+0000 7f6e8542f640 1 -- 172.21.15.47:0/2986141060 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800a390 con 0x7f6e6c0052e0 2024-04-14T23:36:00.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.021+0000 7f6e8542f640 1 -- 172.21.15.47:0/2986141060 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e78034650 con 0x7f6e6c0052e0 2024-04-14T23:36:00.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.021+0000 7f6e8542f640 1 -- 172.21.15.47:0/2986141060 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78034a40 con 0x7f6e6c0052e0 2024-04-14T23:36:00.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.021+0000 7f6e88695640 1 -- 172.21.15.47:0/2986141060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e6c0052e0 msgr2=0x7f6e6c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.021+0000 7f6e88695640 1 --2- 172.21.15.47:0/2986141060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e6c0052e0 0x7f6e6c00b9c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800a770 tx=0x7f6e6c005830 comp rx=0 tx=0).stop 2024-04-14T23:36:00.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.021+0000 7f6e88695640 1 -- 172.21.15.47:0/2986141060 shutdown_connections 2024-04-14T23:36:00.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.021+0000 7f6e88695640 1 --2- 172.21.15.47:0/2986141060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e6c0052e0 0x7f6e6c00b9c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.021+0000 7f6e88695640 1 -- 172.21.15.47:0/2986141060 >> 172.21.15.47:0/2986141060 conn(0x7f6e8006b200 msgr2=0x7f6e8006b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:00.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.021+0000 7f6e88695640 1 -- 172.21.15.47:0/2986141060 shutdown_connections 2024-04-14T23:36:00.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.021+0000 7f6e88695640 1 -- 172.21.15.47:0/2986141060 wait complete. 2024-04-14T23:36:00.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.022+0000 7f6e88695640 1 Processor -- start 2024-04-14T23:36:00.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.022+0000 7f6e88695640 1 -- start start 2024-04-14T23:36:00.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.023+0000 7f6e88695640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e6c0052e0 0x7f6e800ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.023+0000 7f6e88695640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e8014ea40 0x7f6e8014eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.023+0000 7f6e88695640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e8014b0e0 0x7f6e8014b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.023+0000 7f6e88695640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8015f890 con 0x7f6e8014ea40 2024-04-14T23:36:00.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.023+0000 7f6e88695640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8006e720 con 0x7f6e6c0052e0 2024-04-14T23:36:00.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.023+0000 7f6e88695640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6e800cfa30 con 0x7f6e8014b0e0 2024-04-14T23:36:00.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.023+0000 7f6e85c30640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e8014ea40 0x7f6e8014eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.023+0000 7f6e85c30640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e8014ea40 0x7f6e8014eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43638/0 (socket says 172.21.15.47:43638) 2024-04-14T23:36:00.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.023+0000 7f6e85c30640 1 -- 172.21.15.47:0/145466451 learned_addr learned my addr 172.21.15.47:0/145466451 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:00.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.023+0000 7f6e86431640 1 --2- 172.21.15.47:0/145466451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e6c0052e0 0x7f6e800ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.023+0000 7f6e86c32640 1 --2- 172.21.15.47:0/145466451 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e8014b0e0 0x7f6e8014b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.024+0000 7f6e85c30640 1 -- 172.21.15.47:0/145466451 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e8014b0e0 msgr2=0x7f6e8014b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.024+0000 7f6e85c30640 1 --2- 172.21.15.47:0/145466451 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e8014b0e0 0x7f6e8014b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.024+0000 7f6e85c30640 1 -- 172.21.15.47:0/145466451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e6c0052e0 msgr2=0x7f6e800ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.024+0000 7f6e85c30640 1 --2- 172.21.15.47:0/145466451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e6c0052e0 0x7f6e800ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.024+0000 7f6e85c30640 1 -- 172.21.15.47:0/145466451 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e80155e50 con 0x7f6e8014ea40 2024-04-14T23:36:00.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.024+0000 7f6e85c30640 1 --2- 172.21.15.47:0/145466451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e8014ea40 0x7f6e8014eec0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000f620 tx=0x7f6e7000fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:00.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.024+0000 7f6e76ffd640 1 -- 172.21.15.47:0/145466451 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e700052e0 con 0x7f6e8014ea40 2024-04-14T23:36:00.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.024+0000 7f6e76ffd640 1 -- 172.21.15.47:0/145466451 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e70018070 con 0x7f6e8014ea40 2024-04-14T23:36:00.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.024+0000 7f6e88695640 1 -- 172.21.15.47:0/145466451 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e80156130 con 0x7f6e8014ea40 2024-04-14T23:36:00.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.024+0000 7f6e76ffd640 1 -- 172.21.15.47:0/145466451 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e70003810 con 0x7f6e8014ea40 2024-04-14T23:36:00.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.024+0000 7f6e88695640 1 -- 172.21.15.47:0/145466451 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e801569d0 con 0x7f6e8014ea40 2024-04-14T23:36:00.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.025+0000 7f6e88695640 1 -- 172.21.15.47:0/145466451 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e80156300 con 0x7f6e8014ea40 2024-04-14T23:36:00.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.025+0000 7f6e76ffd640 1 -- 172.21.15.47:0/145466451 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6e700039b0 con 0x7f6e8014ea40 2024-04-14T23:36:00.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.026+0000 7f6e76ffd640 1 --2- 172.21.15.47:0/145466451 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6e6406b9c0 0x7f6e6406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.026+0000 7f6e76ffd640 1 -- 172.21.15.47:0/145466451 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6e7008a750 con 0x7f6e8014ea40 2024-04-14T23:36:00.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.026+0000 7f6e86431640 1 --2- 172.21.15.47:0/145466451 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6e6406b9c0 0x7f6e6406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.027+0000 7f6e86431640 1 --2- 172.21.15.47:0/145466451 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6e6406b9c0 0x7f6e6406de80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c006fd0 tx=0x7f6e7c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:00.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.030+0000 7f6e76ffd640 1 -- 172.21.15.47:0/145466451 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6e700591d0 con 0x7f6e8014ea40 2024-04-14T23:36:00.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.211+0000 7f6e88695640 1 -- 172.21.15.47:0/145466451 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e80075430 con 0x7f6e8014ea40 2024-04-14T23:36:00.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.212+0000 7f6e76ffd640 1 -- 172.21.15.47:0/145466451 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16930 (secure 0 0 0) 0x7f6e70058ad0 con 0x7f6e8014ea40 2024-04-14T23:36:00.216 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:36:00.216 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":39,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:35:48.125365+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:35:44.881683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-14T23:35:45.449906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:36:00.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.215+0000 7f6e88695640 1 -- 172.21.15.47:0/145466451 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6e6406b9c0 msgr2=0x7f6e6406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.215+0000 7f6e88695640 1 --2- 172.21.15.47:0/145466451 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6e6406b9c0 0x7f6e6406de80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c006fd0 tx=0x7f6e7c008040 comp rx=0 tx=0).stop 2024-04-14T23:36:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.215+0000 7f6e88695640 1 -- 172.21.15.47:0/145466451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e8014ea40 msgr2=0x7f6e8014eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.215+0000 7f6e88695640 1 --2- 172.21.15.47:0/145466451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e8014ea40 0x7f6e8014eec0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000f620 tx=0x7f6e7000fae0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.215+0000 7f6e88695640 1 -- 172.21.15.47:0/145466451 shutdown_connections 2024-04-14T23:36:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.215+0000 7f6e88695640 1 --2- 172.21.15.47:0/145466451 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6e6406b9c0 0x7f6e6406de80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.215+0000 7f6e88695640 1 --2- 172.21.15.47:0/145466451 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e8014b0e0 0x7f6e8014b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.215+0000 7f6e88695640 1 --2- 172.21.15.47:0/145466451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e8014ea40 0x7f6e8014eec0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.215+0000 7f6e88695640 1 --2- 172.21.15.47:0/145466451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e6c0052e0 0x7f6e800ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.215+0000 7f6e88695640 1 -- 172.21.15.47:0/145466451 >> 172.21.15.47:0/145466451 conn(0x7f6e8006b200 msgr2=0x7f6e80071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:00.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.215+0000 7f6e88695640 1 -- 172.21.15.47:0/145466451 shutdown_connections 2024-04-14T23:36:00.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.215+0000 7f6e88695640 1 -- 172.21.15.47:0/145466451 wait complete. 2024-04-14T23:36:00.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T23:34:26.390241+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T23:35:44.881683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T23:35:45.449906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T23:36:00.229 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T23:36:00.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.330+0000 7fea4b71e640 1 Processor -- start 2024-04-14T23:36:00.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.331+0000 7fea4b71e640 1 -- start start 2024-04-14T23:36:00.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.331+0000 7fea4b71e640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fea44161870 0x7fea440ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.331+0000 7fea4b71e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fea440b4e30 0x7fea440cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.331+0000 7fea4b71e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea440b5590 con 0x7fea440cf590 2024-04-14T23:36:00.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.331+0000 7fea4b71e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fea440cff40 con 0x7fea440b4e30 2024-04-14T23:36:00.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.331+0000 7fea4b71e640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fea440b52b0 con 0x7fea44161870 2024-04-14T23:36:00.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.332+0000 7fea48cb9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fea440b4e30 0x7fea440cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.332+0000 7fea48cb9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fea440b4e30 0x7fea440cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43640/0 (socket says 172.21.15.47:43640) 2024-04-14T23:36:00.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.332+0000 7fea48cb9640 1 -- 172.21.15.47:0/2290018430 learned_addr learned my addr 172.21.15.47:0/2290018430 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:00.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.332+0000 7fea494ba640 1 --2- 172.21.15.47:0/2290018430 >> v2:172.21.15.191:3300/0 conn(0x7fea44161870 0x7fea440ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.332+0000 7fea48cb9640 1 -- 172.21.15.47:0/2290018430 >> v2:172.21.15.191:3300/0 conn(0x7fea44161870 msgr2=0x7fea440ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:00.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.332+0000 7fea48cb9640 1 --2- 172.21.15.47:0/2290018430 >> v2:172.21.15.191:3300/0 conn(0x7fea44161870 0x7fea440ceb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.332+0000 7fea48cb9640 1 -- 172.21.15.47:0/2290018430 >> v1:172.21.15.191:6789/0 conn(0x7fea440cf590 legacy=0x7fea440d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.332+0000 7fea48cb9640 1 -- 172.21.15.47:0/2290018430 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea440d2680 con 0x7fea440b4e30 2024-04-14T23:36:00.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.332+0000 7fea494ba640 1 --2- 172.21.15.47:0/2290018430 >> v2:172.21.15.191:3300/0 conn(0x7fea44161870 0x7fea440ceb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:36:00.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.333+0000 7fea48cb9640 1 --2- 172.21.15.47:0/2290018430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea440b4e30 0x7fea440cf050 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fea440b6a90 tx=0x7fea3402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a8251c9598fdc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:00.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.333+0000 7fea3bfff640 1 -- 172.21.15.47:0/2290018430 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea34035020 con 0x7fea440b4e30 2024-04-14T23:36:00.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.333+0000 7fea3bfff640 1 -- 172.21.15.47:0/2290018430 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea34031870 con 0x7fea440b4e30 2024-04-14T23:36:00.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.333+0000 7fea3bfff640 1 -- 172.21.15.47:0/2290018430 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea34031c40 con 0x7fea440b4e30 2024-04-14T23:36:00.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.333+0000 7fea4b71e640 1 -- 172.21.15.47:0/2290018430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea440b4e30 msgr2=0x7fea440cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.333+0000 7fea4b71e640 1 --2- 172.21.15.47:0/2290018430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea440b4e30 0x7fea440cf050 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fea440b6a90 tx=0x7fea3402b910 comp rx=0 tx=0).stop 2024-04-14T23:36:00.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.333+0000 7fea4b71e640 1 -- 172.21.15.47:0/2290018430 shutdown_connections 2024-04-14T23:36:00.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.333+0000 7fea4b71e640 1 --2- 172.21.15.47:0/2290018430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea440b4e30 0x7fea440cf050 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.333+0000 7fea4b71e640 1 --2- 172.21.15.47:0/2290018430 >> v2:172.21.15.191:3300/0 conn(0x7fea44161870 0x7fea440ceb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.333+0000 7fea4b71e640 1 -- 172.21.15.47:0/2290018430 >> 172.21.15.47:0/2290018430 conn(0x7fea440d3f70 msgr2=0x7fea440d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:00.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.333+0000 7fea4b71e640 1 -- 172.21.15.47:0/2290018430 shutdown_connections 2024-04-14T23:36:00.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.333+0000 7fea4b71e640 1 -- 172.21.15.47:0/2290018430 wait complete. 2024-04-14T23:36:00.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.335+0000 7fea4b71e640 1 Processor -- start 2024-04-14T23:36:00.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.335+0000 7fea4b71e640 1 -- start start 2024-04-14T23:36:00.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.335+0000 7fea4b71e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea440b4e30 0x7fea440b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.335+0000 7fea4b71e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea440cf590 0x7fea44154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.335+0000 7fea4b71e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea44161870 0x7fea440c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.335+0000 7fea4b71e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fea440cf9e0 con 0x7fea44161870 2024-04-14T23:36:00.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.335+0000 7fea4b71e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fea440d2c40 con 0x7fea440b4e30 2024-04-14T23:36:00.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.335+0000 7fea4b71e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fea44161c50 con 0x7fea440cf590 2024-04-14T23:36:00.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.335+0000 7fea49cbb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea44161870 0x7fea440c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.335+0000 7fea49cbb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea44161870 0x7fea440c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43654/0 (socket says 172.21.15.47:43654) 2024-04-14T23:36:00.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.336+0000 7fea49cbb640 1 -- 172.21.15.47:0/164628088 learned_addr learned my addr 172.21.15.47:0/164628088 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:00.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.336+0000 7fea494ba640 1 --2- 172.21.15.47:0/164628088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea440b4e30 0x7fea440b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.336+0000 7fea48cb9640 1 --2- 172.21.15.47:0/164628088 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea440cf590 0x7fea44154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.336+0000 7fea49cbb640 1 -- 172.21.15.47:0/164628088 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea440cf590 msgr2=0x7fea44154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.336+0000 7fea49cbb640 1 --2- 172.21.15.47:0/164628088 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea440cf590 0x7fea44154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.336+0000 7fea49cbb640 1 -- 172.21.15.47:0/164628088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea440b4e30 msgr2=0x7fea440b6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.336+0000 7fea49cbb640 1 --2- 172.21.15.47:0/164628088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea440b4e30 0x7fea440b6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.336+0000 7fea49cbb640 1 -- 172.21.15.47:0/164628088 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea441f77b0 con 0x7fea44161870 2024-04-14T23:36:00.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.336+0000 7fea49cbb640 1 --2- 172.21.15.47:0/164628088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea44161870 0x7fea440c8af0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00c7a0 tx=0x7fea3c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:00.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.336+0000 7fea39ffb640 1 -- 172.21.15.47:0/164628088 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c003b70 con 0x7fea44161870 2024-04-14T23:36:00.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.336+0000 7fea39ffb640 1 -- 172.21.15.47:0/164628088 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c003d30 con 0x7fea44161870 2024-04-14T23:36:00.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.336+0000 7fea4b71e640 1 -- 172.21.15.47:0/164628088 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea441f7a90 con 0x7fea44161870 2024-04-14T23:36:00.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.336+0000 7fea39ffb640 1 -- 172.21.15.47:0/164628088 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c00aa90 con 0x7fea44161870 2024-04-14T23:36:00.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.336+0000 7fea4b71e640 1 -- 172.21.15.47:0/164628088 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea441f8050 con 0x7fea44161870 2024-04-14T23:36:00.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.337+0000 7fea4b71e640 1 -- 172.21.15.47:0/164628088 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea440cc1b0 con 0x7fea44161870 2024-04-14T23:36:00.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.338+0000 7fea39ffb640 1 -- 172.21.15.47:0/164628088 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fea3c00ac30 con 0x7fea44161870 2024-04-14T23:36:00.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.338+0000 7fea39ffb640 1 --2- 172.21.15.47:0/164628088 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fea2806b990 0x7fea2806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.338+0000 7fea39ffb640 1 -- 172.21.15.47:0/164628088 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fea3c08a7a0 con 0x7fea44161870 2024-04-14T23:36:00.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.338+0000 7fea494ba640 1 --2- 172.21.15.47:0/164628088 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fea2806b990 0x7fea2806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.339+0000 7fea494ba640 1 --2- 172.21.15.47:0/164628088 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fea2806b990 0x7fea2806de50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fea40006fd0 tx=0x7fea40008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:00.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.342+0000 7fea39ffb640 1 -- 172.21.15.47:0/164628088 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fea3c058bd0 con 0x7fea44161870 2024-04-14T23:36:00.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.526+0000 7fea4b71e640 1 -- 172.21.15.47:0/164628088 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fea440b9a00 con 0x7fea44161870 2024-04-14T23:36:00.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.526+0000 7fea39ffb640 1 -- 172.21.15.47:0/164628088 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7fea440b9a00 con 0x7fea44161870 2024-04-14T23:36:00.530 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-14T23:36:00.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.528+0000 7fea4b71e640 1 -- 172.21.15.47:0/164628088 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fea2806b990 msgr2=0x7fea2806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.528+0000 7fea4b71e640 1 --2- 172.21.15.47:0/164628088 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fea2806b990 0x7fea2806de50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fea40006fd0 tx=0x7fea40008040 comp rx=0 tx=0).stop 2024-04-14T23:36:00.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.528+0000 7fea4b71e640 1 -- 172.21.15.47:0/164628088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea44161870 msgr2=0x7fea440c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.528+0000 7fea4b71e640 1 --2- 172.21.15.47:0/164628088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea44161870 0x7fea440c8af0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00c7a0 tx=0x7fea3c00cc60 comp rx=0 tx=0).stop 2024-04-14T23:36:00.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.528+0000 7fea4b71e640 1 -- 172.21.15.47:0/164628088 shutdown_connections 2024-04-14T23:36:00.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.528+0000 7fea4b71e640 1 --2- 172.21.15.47:0/164628088 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fea2806b990 0x7fea2806de50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.528+0000 7fea4b71e640 1 --2- 172.21.15.47:0/164628088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea44161870 0x7fea440c8af0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.528+0000 7fea4b71e640 1 --2- 172.21.15.47:0/164628088 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea440cf590 0x7fea44154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.528+0000 7fea4b71e640 1 --2- 172.21.15.47:0/164628088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea440b4e30 0x7fea440b6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.528+0000 7fea4b71e640 1 -- 172.21.15.47:0/164628088 >> 172.21.15.47:0/164628088 conn(0x7fea440d3f70 msgr2=0x7fea4406d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:00.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.528+0000 7fea4b71e640 1 -- 172.21.15.47:0/164628088 shutdown_connections 2024-04-14T23:36:00.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.528+0000 7fea4b71e640 1 -- 172.21.15.47:0/164628088 wait complete. 2024-04-14T23:36:00.542 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T23:36:00.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.642+0000 7f9594fa3640 1 Processor -- start 2024-04-14T23:36:00.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.642+0000 7f9594fa3640 1 -- start start 2024-04-14T23:36:00.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.643+0000 7f9594fa3640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95900b8e60 0x7f9590168f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.643+0000 7f9594fa3640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95900b7090 con 0x7f95900b53c0 2024-04-14T23:36:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.643+0000 7f9594fa3640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95900b7370 con 0x7f95900d25d0 2024-04-14T23:36:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.643+0000 7f9594fa3640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f95900b6e40 con 0x7f95900b8e60 2024-04-14T23:36:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.643+0000 7f958e59c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f95900b53c0 0x7f95900cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49896/0 (socket says 172.21.15.47:49896) 2024-04-14T23:36:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958e59c640 1 -- 172.21.15.47:0/2966109300 learned_addr learned my addr 172.21.15.47:0/2966109300 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958ed9d640 1 --2- 172.21.15.47:0/2966109300 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95900b8e60 0x7f9590168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 -- 172.21.15.47:0/2966109300 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1031099028 0 0) 0x7f95900b7090 con 0x7f95900b53c0 2024-04-14T23:36:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 -- 172.21.15.47:0/2966109300 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f957c003520 con 0x7f95900b53c0 2024-04-14T23:36:00.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 -- 172.21.15.47:0/2966109300 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3497811938 0 0) 0x7f95900b7370 con 0x7f95900d25d0 2024-04-14T23:36:00.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 -- 172.21.15.47:0/2966109300 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95900b7090 con 0x7f95900d25d0 2024-04-14T23:36:00.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 -- 172.21.15.47:0/2966109300 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 982203763 0 0) 0x7f957c003520 con 0x7f95900b53c0 2024-04-14T23:36:00.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 -- 172.21.15.47:0/2966109300 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95900b8e60 msgr2=0x7f9590168f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:00.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 --2- 172.21.15.47:0/2966109300 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95900b8e60 0x7f9590168f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 -- 172.21.15.47:0/2966109300 >> v1:172.21.15.191:6789/0 conn(0x7f95900d25d0 legacy=0x7f95900d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 -- 172.21.15.47:0/2966109300 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95900b7650 con 0x7f95900b53c0 2024-04-14T23:36:00.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 -- 172.21.15.47:0/2966109300 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f9588001670 con 0x7f95900b53c0 2024-04-14T23:36:00.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 -- 172.21.15.47:0/2966109300 >> v1:172.21.15.47:6789/0 conn(0x7f95900b53c0 legacy=0x7f95900cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 --2- 172.21.15.47:0/2966109300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f957c003b70 0x7f957c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 --2- 172.21.15.47:0/2966109300 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95900b8e60 0x7f957c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 --2- 172.21.15.47:0/2966109300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f957c004d40 0x7f957c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 -- 172.21.15.47:0/2966109300 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f95900b6e40 con 0x7f957c004d40 2024-04-14T23:36:00.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 -- 172.21.15.47:0/2966109300 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f957c00ba70 con 0x7f957c003b70 2024-04-14T23:36:00.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958d59a640 1 -- 172.21.15.47:0/2966109300 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f957c00bc20 con 0x7f95900b8e60 2024-04-14T23:36:00.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958ed9d640 1 --2- 172.21.15.47:0/2966109300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f957c004d40 0x7f957c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958e59c640 1 --2- 172.21.15.47:0/2966109300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f957c003b70 0x7f957c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.644+0000 7f958dd9b640 1 --2- 172.21.15.47:0/2966109300 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95900b8e60 0x7f957c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.645+0000 7f958ed9d640 1 -- 172.21.15.47:0/2966109300 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95900b8e60 msgr2=0x7f957c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:00.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.645+0000 7f958ed9d640 1 --2- 172.21.15.47:0/2966109300 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95900b8e60 0x7f957c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.645+0000 7f958ed9d640 1 -- 172.21.15.47:0/2966109300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f957c003b70 msgr2=0x7f957c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:00.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.645+0000 7f958ed9d640 1 --2- 172.21.15.47:0/2966109300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f957c003b70 0x7f957c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.645+0000 7f958ed9d640 1 -- 172.21.15.47:0/2966109300 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f957c003520 con 0x7f957c004d40 2024-04-14T23:36:00.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.645+0000 7f958dd9b640 1 --2- 172.21.15.47:0/2966109300 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95900b8e60 0x7f957c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:36:00.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.645+0000 7f958ed9d640 1 --2- 172.21.15.47:0/2966109300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f957c004d40 0x7f957c0051c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9580009fc0 tx=0x7f957c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c629587470a267 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:00.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.645+0000 7f958d59a640 1 -- 172.21.15.47:0/2966109300 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580039070 con 0x7f957c004d40 2024-04-14T23:36:00.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.645+0000 7f958d59a640 1 -- 172.21.15.47:0/2966109300 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f958002cc20 con 0x7f957c004d40 2024-04-14T23:36:00.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.645+0000 7f958d59a640 1 -- 172.21.15.47:0/2966109300 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580009c10 con 0x7f957c004d40 2024-04-14T23:36:00.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.646+0000 7f9594fa3640 1 -- 172.21.15.47:0/2966109300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f957c004d40 msgr2=0x7f957c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.646+0000 7f9594fa3640 1 --2- 172.21.15.47:0/2966109300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f957c004d40 0x7f957c0051c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9580009fc0 tx=0x7f957c005830 comp rx=0 tx=0).stop 2024-04-14T23:36:00.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.646+0000 7f958ed9d640 1 -- 172.21.15.47:0/2966109300 reap_dead start 2024-04-14T23:36:00.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.646+0000 7f9594fa3640 1 -- 172.21.15.47:0/2966109300 shutdown_connections 2024-04-14T23:36:00.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.646+0000 7f9594fa3640 1 -- 172.21.15.47:0/2966109300 >> 172.21.15.47:0/2966109300 conn(0x7f959009d2c0 msgr2=0x7f95900d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:00.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.646+0000 7f9594fa3640 1 -- 172.21.15.47:0/2966109300 shutdown_connections 2024-04-14T23:36:00.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.646+0000 7f9594fa3640 1 -- 172.21.15.47:0/2966109300 wait complete. 2024-04-14T23:36:00.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.647+0000 7f9594fa3640 1 Processor -- start 2024-04-14T23:36:00.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.647+0000 7f9594fa3640 1 -- start start 2024-04-14T23:36:00.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.648+0000 7f9594fa3640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f957c004d40 0x7f95900b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.648+0000 7f9594fa3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95900b41b0 0x7f95900b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.648+0000 7f9594fa3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95901f3f40 0x7f95901f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.648+0000 7f9594fa3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f95900b57a0 con 0x7f95901f3f40 2024-04-14T23:36:00.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.648+0000 7f9594fa3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f95900cfd00 con 0x7f95900b41b0 2024-04-14T23:36:00.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.648+0000 7f9594fa3640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f95900b5920 con 0x7f957c004d40 2024-04-14T23:36:00.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.648+0000 7f958ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95901f3f40 0x7f95901f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.648+0000 7f958ed9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95901f3f40 0x7f95901f43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43674/0 (socket says 172.21.15.47:43674) 2024-04-14T23:36:00.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.648+0000 7f958ed9d640 1 -- 172.21.15.47:0/1580829825 learned_addr learned my addr 172.21.15.47:0/1580829825 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:00.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.648+0000 7f958dd9b640 1 --2- 172.21.15.47:0/1580829825 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95900b41b0 0x7f95900b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.648+0000 7f958e59c640 1 --2- 172.21.15.47:0/1580829825 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f957c004d40 0x7f95900b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.649+0000 7f958ed9d640 1 -- 172.21.15.47:0/1580829825 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f957c004d40 msgr2=0x7f95900b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.649+0000 7f958ed9d640 1 --2- 172.21.15.47:0/1580829825 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f957c004d40 0x7f95900b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.649+0000 7f958ed9d640 1 -- 172.21.15.47:0/1580829825 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95900b41b0 msgr2=0x7f95900b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.649+0000 7f958ed9d640 1 --2- 172.21.15.47:0/1580829825 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95900b41b0 0x7f95900b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.649+0000 7f958ed9d640 1 -- 172.21.15.47:0/1580829825 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95900b2cd0 con 0x7f95901f3f40 2024-04-14T23:36:00.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.649+0000 7f958ed9d640 1 --2- 172.21.15.47:0/1580829825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95901f3f40 0x7f95901f43c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f958002c690 tx=0x7f9580009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:00.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.649+0000 7f9586ffd640 1 -- 172.21.15.47:0/1580829825 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580039070 con 0x7f95901f3f40 2024-04-14T23:36:00.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.649+0000 7f9586ffd640 1 -- 172.21.15.47:0/1580829825 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9580044070 con 0x7f95901f3f40 2024-04-14T23:36:00.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.649+0000 7f9586ffd640 1 -- 172.21.15.47:0/1580829825 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958003e810 con 0x7f95901f3f40 2024-04-14T23:36:00.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.649+0000 7f9594fa3640 1 -- 172.21.15.47:0/1580829825 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95900b16f0 con 0x7f95901f3f40 2024-04-14T23:36:00.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.649+0000 7f9594fa3640 1 -- 172.21.15.47:0/1580829825 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95900b1cb0 con 0x7f95901f3f40 2024-04-14T23:36:00.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.650+0000 7f9594fa3640 1 -- 172.21.15.47:0/1580829825 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95900cfb20 con 0x7f95901f3f40 2024-04-14T23:36:00.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.650+0000 7f9586ffd640 1 -- 172.21.15.47:0/1580829825 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f958003e9b0 con 0x7f95901f3f40 2024-04-14T23:36:00.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.651+0000 7f9586ffd640 1 --2- 172.21.15.47:0/1580829825 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f957006b9c0 0x7f957006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.651+0000 7f9586ffd640 1 -- 172.21.15.47:0/1580829825 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f95800acbe0 con 0x7f95901f3f40 2024-04-14T23:36:00.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.651+0000 7f958e59c640 1 --2- 172.21.15.47:0/1580829825 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f957006b9c0 0x7f957006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.651+0000 7f958e59c640 1 --2- 172.21.15.47:0/1580829825 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f957006b9c0 0x7f957006de80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9588001c80 tx=0x7f9588001c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:00.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.655+0000 7f9586ffd640 1 -- 172.21.15.47:0/1580829825 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f95900cfb20 con 0x7f95901f3f40 2024-04-14T23:36:00.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.839+0000 7f9594fa3640 1 -- 172.21.15.47:0/1580829825 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9590073f50 con 0x7f95901f3f40 2024-04-14T23:36:00.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.839+0000 7f9586ffd640 1 -- 172.21.15.47:0/1580829825 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) ==== 104+0+11 (secure 0 0 0) 0x7f958007b0a0 con 0x7f95901f3f40 2024-04-14T23:36:00.843 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-14T23:36:00.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.842+0000 7f9594fa3640 1 -- 172.21.15.47:0/1580829825 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f957006b9c0 msgr2=0x7f957006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.842+0000 7f9594fa3640 1 --2- 172.21.15.47:0/1580829825 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f957006b9c0 0x7f957006de80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9588001c80 tx=0x7f9588001c10 comp rx=0 tx=0).stop 2024-04-14T23:36:00.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.842+0000 7f9594fa3640 1 -- 172.21.15.47:0/1580829825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95901f3f40 msgr2=0x7f95901f43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.842+0000 7f9594fa3640 1 --2- 172.21.15.47:0/1580829825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95901f3f40 0x7f95901f43c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f958002c690 tx=0x7f9580009750 comp rx=0 tx=0).stop 2024-04-14T23:36:00.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.842+0000 7f9594fa3640 1 -- 172.21.15.47:0/1580829825 shutdown_connections 2024-04-14T23:36:00.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.842+0000 7f9594fa3640 1 --2- 172.21.15.47:0/1580829825 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f957006b9c0 0x7f957006de80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.842+0000 7f9594fa3640 1 --2- 172.21.15.47:0/1580829825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95901f3f40 0x7f95901f43c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.842+0000 7f9594fa3640 1 --2- 172.21.15.47:0/1580829825 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95900b41b0 0x7f95900b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.842+0000 7f9594fa3640 1 --2- 172.21.15.47:0/1580829825 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f957c004d40 0x7f95900b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.842+0000 7f9594fa3640 1 -- 172.21.15.47:0/1580829825 >> 172.21.15.47:0/1580829825 conn(0x7f959009d2c0 msgr2=0x7f959006c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:00.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.842+0000 7f9594fa3640 1 -- 172.21.15.47:0/1580829825 shutdown_connections 2024-04-14T23:36:00.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.842+0000 7f9594fa3640 1 -- 172.21.15.47:0/1580829825 wait complete. 2024-04-14T23:36:00.855 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T23:36:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.956+0000 7fc420d84640 1 Processor -- start 2024-04-14T23:36:00.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.956+0000 7fc420d84640 1 -- start start 2024-04-14T23:36:00.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.957+0000 7fc420d84640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc41c0cec90 0x7fc41c0cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.957+0000 7fc420d84640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc41c0d0b40 0x7fc41c0cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.957+0000 7fc420d84640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc41c0d1090 con 0x7fc41c0c8410 2024-04-14T23:36:00.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.957+0000 7fc420d84640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc41c0cc3f0 con 0x7fc41c0cec90 2024-04-14T23:36:00.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.957+0000 7fc420d84640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc41c0cc6d0 con 0x7fc41c0d0b40 2024-04-14T23:36:00.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.957+0000 7fc419d9b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc41c0cec90 0x7fc41c0cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.957+0000 7fc419d9b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc41c0cec90 0x7fc41c0cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43690/0 (socket says 172.21.15.47:43690) 2024-04-14T23:36:00.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.957+0000 7fc41a59c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc41c0c8410 0x7fc41c0ce580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49912/0 (socket says 172.21.15.47:49912) 2024-04-14T23:36:00.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.957+0000 7fc419d9b640 1 -- 172.21.15.47:0/336471136 learned_addr learned my addr 172.21.15.47:0/336471136 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:00.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.957+0000 7fc41ad9d640 1 --2- 172.21.15.47:0/336471136 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc41c0d0b40 0x7fc41c0cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.957+0000 7fc419d9b640 1 -- 172.21.15.47:0/336471136 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc41c0d0b40 msgr2=0x7fc41c0cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:00.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.957+0000 7fc419d9b640 1 --2- 172.21.15.47:0/336471136 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc41c0d0b40 0x7fc41c0cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.957+0000 7fc419d9b640 1 -- 172.21.15.47:0/336471136 >> v1:172.21.15.47:6789/0 conn(0x7fc41c0c8410 legacy=0x7fc41c0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.957+0000 7fc41959a640 1 -- 172.21.15.47:0/336471136 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2895730023 0 0) 0x7fc41c0d1090 con 0x7fc41c0c8410 2024-04-14T23:36:00.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.957+0000 7fc419d9b640 1 -- 172.21.15.47:0/336471136 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41c0cc9b0 con 0x7fc41c0cec90 2024-04-14T23:36:00.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.958+0000 7fc419d9b640 1 --2- 172.21.15.47:0/336471136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc41c0cec90 0x7fc41c0cced0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc404009870 tx=0x7fc40402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9681e07bfa2cab server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.958+0000 7fc41959a640 1 -- 172.21.15.47:0/336471136 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404035020 con 0x7fc41c0cec90 2024-04-14T23:36:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.958+0000 7fc41959a640 1 -- 172.21.15.47:0/336471136 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc404031640 con 0x7fc41c0cec90 2024-04-14T23:36:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.958+0000 7fc41959a640 1 -- 172.21.15.47:0/336471136 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40402d040 con 0x7fc41c0cec90 2024-04-14T23:36:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.959+0000 7fc420d84640 1 -- 172.21.15.47:0/336471136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc41c0cec90 msgr2=0x7fc41c0cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.959+0000 7fc420d84640 1 --2- 172.21.15.47:0/336471136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc41c0cec90 0x7fc41c0cced0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc404009870 tx=0x7fc40402b8f0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.959+0000 7fc420d84640 1 -- 172.21.15.47:0/336471136 shutdown_connections 2024-04-14T23:36:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.959+0000 7fc420d84640 1 --2- 172.21.15.47:0/336471136 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc41c0d0b40 0x7fc41c0cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.959+0000 7fc420d84640 1 --2- 172.21.15.47:0/336471136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc41c0cec90 0x7fc41c0cced0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.959+0000 7fc420d84640 1 -- 172.21.15.47:0/336471136 >> 172.21.15.47:0/336471136 conn(0x7fc41c0d1d00 msgr2=0x7fc41c0d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.959+0000 7fc420d84640 1 -- 172.21.15.47:0/336471136 shutdown_connections 2024-04-14T23:36:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.959+0000 7fc420d84640 1 -- 172.21.15.47:0/336471136 wait complete. 2024-04-14T23:36:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.960+0000 7fc420d84640 1 Processor -- start 2024-04-14T23:36:00.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.960+0000 7fc420d84640 1 -- start start 2024-04-14T23:36:00.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.961+0000 7fc420d84640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc41c0c8410 0x7fc41c1d61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.961+0000 7fc420d84640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc41c0cec90 0x7fc41c0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.961+0000 7fc420d84640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc41c0d0b40 0x7fc41c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.961+0000 7fc420d84640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c0cf6b0 con 0x7fc41c0c8410 2024-04-14T23:36:00.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.961+0000 7fc420d84640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c0cf530 con 0x7fc41c0d0b40 2024-04-14T23:36:00.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.961+0000 7fc420d84640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc41c0d2820 con 0x7fc41c0cec90 2024-04-14T23:36:00.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.961+0000 7fc41a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc41c0c8410 0x7fc41c1d61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.961+0000 7fc41a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc41c0c8410 0x7fc41c1d61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43694/0 (socket says 172.21.15.47:43694) 2024-04-14T23:36:00.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.961+0000 7fc41a59c640 1 -- 172.21.15.47:0/2944207644 learned_addr learned my addr 172.21.15.47:0/2944207644 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.961+0000 7fc419d9b640 1 --2- 172.21.15.47:0/2944207644 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc41c0cec90 0x7fc41c0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.961+0000 7fc41ad9d640 1 --2- 172.21.15.47:0/2944207644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc41c0d0b40 0x7fc41c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.961+0000 7fc41a59c640 1 -- 172.21.15.47:0/2944207644 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc41c0cec90 msgr2=0x7fc41c0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.961+0000 7fc41a59c640 1 --2- 172.21.15.47:0/2944207644 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc41c0cec90 0x7fc41c0c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.961+0000 7fc41a59c640 1 -- 172.21.15.47:0/2944207644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc41c0d0b40 msgr2=0x7fc41c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.961+0000 7fc41a59c640 1 --2- 172.21.15.47:0/2944207644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc41c0d0b40 0x7fc41c0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.962+0000 7fc41a59c640 1 -- 172.21.15.47:0/2944207644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41c0ca850 con 0x7fc41c0c8410 2024-04-14T23:36:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.962+0000 7fc41ad9d640 1 --2- 172.21.15.47:0/2944207644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc41c0d0b40 0x7fc41c0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:36:00.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.962+0000 7fc41a59c640 1 --2- 172.21.15.47:0/2944207644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc41c0c8410 0x7fc41c1d61c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00c890 tx=0x7fc40c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:00.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.962+0000 7fc412ffd640 1 -- 172.21.15.47:0/2944207644 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c018070 con 0x7fc41c0c8410 2024-04-14T23:36:00.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.962+0000 7fc412ffd640 1 -- 172.21.15.47:0/2944207644 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc40c00a640 con 0x7fc41c0c8410 2024-04-14T23:36:00.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.962+0000 7fc420d84640 1 -- 172.21.15.47:0/2944207644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc41c0c97b0 con 0x7fc41c0c8410 2024-04-14T23:36:00.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.962+0000 7fc412ffd640 1 -- 172.21.15.47:0/2944207644 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c00aa30 con 0x7fc41c0c8410 2024-04-14T23:36:00.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.962+0000 7fc420d84640 1 -- 172.21.15.47:0/2944207644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc41c0c9d70 con 0x7fc41c0c8410 2024-04-14T23:36:00.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.963+0000 7fc420d84640 1 -- 172.21.15.47:0/2944207644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc41c073f50 con 0x7fc41c0c8410 2024-04-14T23:36:00.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.963+0000 7fc412ffd640 1 -- 172.21.15.47:0/2944207644 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc40c01b070 con 0x7fc41c0c8410 2024-04-14T23:36:00.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.964+0000 7fc412ffd640 1 --2- 172.21.15.47:0/2944207644 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc3fc06b990 0x7fc3fc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:00.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.964+0000 7fc412ffd640 1 -- 172.21.15.47:0/2944207644 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fc40c08a080 con 0x7fc41c0c8410 2024-04-14T23:36:00.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.964+0000 7fc419d9b640 1 --2- 172.21.15.47:0/2944207644 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc3fc06b990 0x7fc3fc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:00.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.964+0000 7fc419d9b640 1 --2- 172.21.15.47:0/2944207644 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc3fc06b990 0x7fc3fc06de50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc404036000 tx=0x7fc40403c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:00.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:00.968+0000 7fc412ffd640 1 -- 172.21.15.47:0/2944207644 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc41c0ca850 con 0x7fc41c0c8410 2024-04-14T23:36:01.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.149+0000 7fc420d84640 1 -- 172.21.15.47:0/2944207644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc41c0b4320 con 0x7fc41c0c8410 2024-04-14T23:36:01.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.149+0000 7fc412ffd640 1 -- 172.21.15.47:0/2944207644 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) ==== 100+0+11 (secure 0 0 0) 0x7fc40c058b00 con 0x7fc41c0c8410 2024-04-14T23:36:01.152 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-14T23:36:01.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.151+0000 7fc420d84640 1 -- 172.21.15.47:0/2944207644 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc3fc06b990 msgr2=0x7fc3fc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:01.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.151+0000 7fc420d84640 1 --2- 172.21.15.47:0/2944207644 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc3fc06b990 0x7fc3fc06de50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc404036000 tx=0x7fc40403c040 comp rx=0 tx=0).stop 2024-04-14T23:36:01.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.151+0000 7fc420d84640 1 -- 172.21.15.47:0/2944207644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc41c0c8410 msgr2=0x7fc41c1d61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:01.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.151+0000 7fc420d84640 1 --2- 172.21.15.47:0/2944207644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc41c0c8410 0x7fc41c1d61c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00c890 tx=0x7fc40c00cd50 comp rx=0 tx=0).stop 2024-04-14T23:36:01.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.151+0000 7fc420d84640 1 -- 172.21.15.47:0/2944207644 shutdown_connections 2024-04-14T23:36:01.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.151+0000 7fc420d84640 1 --2- 172.21.15.47:0/2944207644 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc3fc06b990 0x7fc3fc06de50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:01.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.151+0000 7fc420d84640 1 --2- 172.21.15.47:0/2944207644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc41c0d0b40 0x7fc41c0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:01.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.151+0000 7fc420d84640 1 --2- 172.21.15.47:0/2944207644 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc41c0cec90 0x7fc41c0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:01.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.151+0000 7fc420d84640 1 --2- 172.21.15.47:0/2944207644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc41c0c8410 0x7fc41c1d61c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:01.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.151+0000 7fc420d84640 1 -- 172.21.15.47:0/2944207644 >> 172.21.15.47:0/2944207644 conn(0x7fc41c0d1d00 msgr2=0x7fc41c0d20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:01.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.151+0000 7fc420d84640 1 -- 172.21.15.47:0/2944207644 shutdown_connections 2024-04-14T23:36:01.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.151+0000 7fc420d84640 1 -- 172.21.15.47:0/2944207644 wait complete. 2024-04-14T23:36:01.165 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T23:36:01.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.264+0000 7f1884ed1640 1 Processor -- start 2024-04-14T23:36:01.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.264+0000 7f1884ed1640 1 -- start start 2024-04-14T23:36:01.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f1884ed1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f18800cc2d0 0x7f18800cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:01.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f1884ed1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18800c39c0 0x7f18800b0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:01.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f1884ed1640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f18800ccbf0 0x7f18800b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:01.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f1884ed1640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f18800cd720 con 0x7f18800cc2d0 2024-04-14T23:36:01.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f1884ed1640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f188006c050 con 0x7f18800ccbf0 2024-04-14T23:36:01.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f1884ed1640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f18800cd110 con 0x7f18800c39c0 2024-04-14T23:36:01.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f187e59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f18800cc2d0 0x7f18800cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f187e59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f18800cc2d0 0x7f18800cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43704/0 (socket says 172.21.15.47:43704) 2024-04-14T23:36:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f187e59c640 1 -- 172.21.15.47:0/145290223 learned_addr learned my addr 172.21.15.47:0/145290223 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f187ed9d640 1 --2- 172.21.15.47:0/145290223 >> v2:172.21.15.191:3300/0 conn(0x7f18800ccbf0 0x7f18800b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f1875d9b640 1 --2- 172.21.15.47:0/145290223 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18800c39c0 0x7f18800b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f187e59c640 1 -- 172.21.15.47:0/145290223 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18800c39c0 msgr2=0x7f18800b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f187e59c640 1 --2- 172.21.15.47:0/145290223 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18800c39c0 0x7f18800b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f187e59c640 1 -- 172.21.15.47:0/145290223 >> v2:172.21.15.191:3300/0 conn(0x7f18800ccbf0 msgr2=0x7f18800b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f187e59c640 1 --2- 172.21.15.47:0/145290223 >> v2:172.21.15.191:3300/0 conn(0x7f18800ccbf0 0x7f18800b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:01.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f187e59c640 1 -- 172.21.15.47:0/145290223 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1880074900 con 0x7f18800cc2d0 2024-04-14T23:36:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f187ed9d640 1 --2- 172.21.15.47:0/145290223 >> v2:172.21.15.191:3300/0 conn(0x7f18800ccbf0 0x7f18800b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:36:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.265+0000 7f1875d9b640 1 --2- 172.21.15.47:0/145290223 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18800c39c0 0x7f18800b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:36:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.266+0000 7f187e59c640 1 --2- 172.21.15.47:0/145290223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18800cc2d0 0x7f18800cc6b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f18800711c0 tx=0x7f187002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807adff38420a638 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.266+0000 7f187dd9b640 1 -- 172.21.15.47:0/145290223 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187002e070 con 0x7f18800cc2d0 2024-04-14T23:36:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.266+0000 7f187dd9b640 1 -- 172.21.15.47:0/145290223 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1870037070 con 0x7f18800cc2d0 2024-04-14T23:36:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.266+0000 7f187dd9b640 1 -- 172.21.15.47:0/145290223 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870031a00 con 0x7f18800cc2d0 2024-04-14T23:36:01.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.267+0000 7f1884ed1640 1 -- 172.21.15.47:0/145290223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18800cc2d0 msgr2=0x7f18800cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:01.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.267+0000 7f1884ed1640 1 --2- 172.21.15.47:0/145290223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18800cc2d0 0x7f18800cc6b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f18800711c0 tx=0x7f187002b880 comp rx=0 tx=0).stop 2024-04-14T23:36:01.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.267+0000 7f1884ed1640 1 -- 172.21.15.47:0/145290223 shutdown_connections 2024-04-14T23:36:01.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.267+0000 7f1884ed1640 1 --2- 172.21.15.47:0/145290223 >> v2:172.21.15.191:3300/0 conn(0x7f18800ccbf0 0x7f18800b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:01.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.267+0000 7f1884ed1640 1 --2- 172.21.15.47:0/145290223 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18800c39c0 0x7f18800b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:01.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.267+0000 7f1884ed1640 1 --2- 172.21.15.47:0/145290223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18800cc2d0 0x7f18800cc6b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:01.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.267+0000 7f1884ed1640 1 -- 172.21.15.47:0/145290223 >> 172.21.15.47:0/145290223 conn(0x7f18800d0330 msgr2=0x7f18800d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:01.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.267+0000 7f1884ed1640 1 -- 172.21.15.47:0/145290223 shutdown_connections 2024-04-14T23:36:01.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.267+0000 7f1884ed1640 1 -- 172.21.15.47:0/145290223 wait complete. 2024-04-14T23:36:01.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.268+0000 7f1884ed1640 1 Processor -- start 2024-04-14T23:36:01.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.268+0000 7f1884ed1640 1 -- start start 2024-04-14T23:36:01.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.269+0000 7f1884ed1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18800c39c0 0x7f18801f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.269+0000 7f1884ed1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18800cc2d0 0x7f18801f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.269+0000 7f1884ed1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18800ccbf0 0x7f18801f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.269+0000 7f1884ed1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f18800745b0 con 0x7f18800cc2d0 2024-04-14T23:36:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.269+0000 7f1884ed1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1880074be0 con 0x7f18800c39c0 2024-04-14T23:36:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.269+0000 7f1884ed1640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f18800cdaa0 con 0x7f18800ccbf0 2024-04-14T23:36:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.269+0000 7f1875d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18800cc2d0 0x7f18801f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.269+0000 7f1875d9b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18800cc2d0 0x7f18801f25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43720/0 (socket says 172.21.15.47:43720) 2024-04-14T23:36:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.269+0000 7f1875d9b640 1 -- 172.21.15.47:0/393480685 learned_addr learned my addr 172.21.15.47:0/393480685 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:01.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.269+0000 7f187ed9d640 1 --2- 172.21.15.47:0/393480685 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18800ccbf0 0x7f18801f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.269+0000 7f187e59c640 1 --2- 172.21.15.47:0/393480685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18800c39c0 0x7f18801f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.270+0000 7f1875d9b640 1 -- 172.21.15.47:0/393480685 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18800ccbf0 msgr2=0x7f18801f2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.270+0000 7f1875d9b640 1 --2- 172.21.15.47:0/393480685 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18800ccbf0 0x7f18801f2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.270+0000 7f1875d9b640 1 -- 172.21.15.47:0/393480685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18800c39c0 msgr2=0x7f18801f1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.270+0000 7f1875d9b640 1 --2- 172.21.15.47:0/393480685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18800c39c0 0x7f18801f1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.270+0000 7f1875d9b640 1 -- 172.21.15.47:0/393480685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188015d030 con 0x7f18800cc2d0 2024-04-14T23:36:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.270+0000 7f187e59c640 1 --2- 172.21.15.47:0/393480685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18800c39c0 0x7f18801f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:36:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.270+0000 7f1875d9b640 1 --2- 172.21.15.47:0/393480685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18800cc2d0 0x7f18801f25f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f186800c7f0 tx=0x7f186800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:01.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.270+0000 7f18777fe640 1 -- 172.21.15.47:0/393480685 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1868015070 con 0x7f18800cc2d0 2024-04-14T23:36:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.270+0000 7f18777fe640 1 -- 172.21.15.47:0/393480685 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1868004220 con 0x7f18800cc2d0 2024-04-14T23:36:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.270+0000 7f1884ed1640 1 -- 172.21.15.47:0/393480685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188015d310 con 0x7f18800cc2d0 2024-04-14T23:36:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.270+0000 7f18777fe640 1 -- 172.21.15.47:0/393480685 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1868007620 con 0x7f18800cc2d0 2024-04-14T23:36:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.270+0000 7f1884ed1640 1 -- 172.21.15.47:0/393480685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f188015d8d0 con 0x7f18800cc2d0 2024-04-14T23:36:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.271+0000 7f1884ed1640 1 -- 172.21.15.47:0/393480685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18800d0fe0 con 0x7f18800cc2d0 2024-04-14T23:36:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.271+0000 7f18777fe640 1 -- 172.21.15.47:0/393480685 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f18680079d0 con 0x7f18800cc2d0 2024-04-14T23:36:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.272+0000 7f18777fe640 1 --2- 172.21.15.47:0/393480685 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f186006b9c0 0x7f186006de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.272+0000 7f18777fe640 1 -- 172.21.15.47:0/393480685 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f186808a9d0 con 0x7f18800cc2d0 2024-04-14T23:36:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.272+0000 7f187e59c640 1 --2- 172.21.15.47:0/393480685 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f186006b9c0 0x7f186006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.273+0000 7f187e59c640 1 --2- 172.21.15.47:0/393480685 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f186006b9c0 0x7f186006de80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1870036000 tx=0x7f187003d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.276+0000 7f18777fe640 1 -- 172.21.15.47:0/393480685 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f18800d0fe0 con 0x7f18800cc2d0 2024-04-14T23:36:01.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.469+0000 7f1884ed1640 1 -- 172.21.15.47:0/393480685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f18800c5d80 con 0x7f18800cc2d0 2024-04-14T23:36:01.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.470+0000 7f18777fe640 1 -- 172.21.15.47:0/393480685 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) ==== 80+0+0 (secure 0 0 0) 0x7f1868058d70 con 0x7f18800cc2d0 2024-04-14T23:36:01.473 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-14T23:36:01.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.472+0000 7f1884ed1640 1 -- 172.21.15.47:0/393480685 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f186006b9c0 msgr2=0x7f186006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:01.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.472+0000 7f1884ed1640 1 --2- 172.21.15.47:0/393480685 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f186006b9c0 0x7f186006de80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1870036000 tx=0x7f187003d040 comp rx=0 tx=0).stop 2024-04-14T23:36:01.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.472+0000 7f1884ed1640 1 -- 172.21.15.47:0/393480685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18800cc2d0 msgr2=0x7f18801f25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:01.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.472+0000 7f1884ed1640 1 --2- 172.21.15.47:0/393480685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18800cc2d0 0x7f18801f25f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f186800c7f0 tx=0x7f186800ccb0 comp rx=0 tx=0).stop 2024-04-14T23:36:01.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.472+0000 7f1884ed1640 1 -- 172.21.15.47:0/393480685 shutdown_connections 2024-04-14T23:36:01.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.472+0000 7f1884ed1640 1 --2- 172.21.15.47:0/393480685 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f186006b9c0 0x7f186006de80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:01.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.472+0000 7f1884ed1640 1 --2- 172.21.15.47:0/393480685 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18800ccbf0 0x7f18801f2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:01.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.472+0000 7f1884ed1640 1 --2- 172.21.15.47:0/393480685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18800cc2d0 0x7f18801f25f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:01.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.472+0000 7f1884ed1640 1 --2- 172.21.15.47:0/393480685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18800c39c0 0x7f18801f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:01.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.472+0000 7f1884ed1640 1 -- 172.21.15.47:0/393480685 >> 172.21.15.47:0/393480685 conn(0x7f18800d0330 msgr2=0x7f18800af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:01.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.472+0000 7f1884ed1640 1 -- 172.21.15.47:0/393480685 shutdown_connections 2024-04-14T23:36:01.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:01.472+0000 7f1884ed1640 1 -- 172.21.15.47:0/393480685 wait complete. 2024-04-14T23:36:01.485 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-14T23:36:01.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:36:01.486 DEBUG:teuthology.orchestra.run.smithi047:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-14T23:36:01.515 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-04-14T23:36:01.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:36:01.516 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-14T23:36:01.571 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-14T23:36:01.571 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:36:01.626 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057146,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15742 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-14T23:36:01.626 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:36:01.626 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:36:01.646 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056375,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15863 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248848k,nr_inodes=812212,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-14T23:36:01.647 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-14T23:36:01.647 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T23:36:01.705 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056375,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15863 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248848k,nr_inodes=812212,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-14T23:36:01.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:36:01.705 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-14T23:36:01.720 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-14T23:36:01.720 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-14T23:36:01.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:36:01.720 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-14T23:36:01.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:36:01.786 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-14T23:36:01.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:36:01.854 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-04-14T23:36:01.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:36:01.962 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-14T23:36:01.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:36:01.977 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-04-14T23:36:02.046 INFO:teuthology.orchestra.run.smithi047.stderr:Cannot find device "ceph-brx" 2024-04-14T23:36:02.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:36:02.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:36:02.048 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2024-04-14T23:36:02.066 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-14T23:36:02.066 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-14T23:36:02.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:36:02.067 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-14T23:36:02.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:36:02.141 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-14T23:36:02.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:36:02.211 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link delete ceph-brx 2024-04-14T23:36:02.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:36:02.306 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2024-04-14T23:36:02.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T23:36:02.321 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link delete ceph-brx 2024-04-14T23:36:02.391 INFO:teuthology.orchestra.run.smithi191.stderr:Cannot find device "ceph-brx" 2024-04-14T23:36:02.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:36:02.393 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-14T23:36:02.402 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-14T23:36:02.403 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T23:36:02.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.503+0000 7f0546ad1640 1 Processor -- start 2024-04-14T23:36:02.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.503+0000 7f0546ad1640 1 -- start start 2024-04-14T23:36:02.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.504+0000 7f0546ad1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f054006e340 0x7f05400cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:02.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.504+0000 7f0546ad1640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f05400cff70 0x7f054015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:02.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.504+0000 7f0546ad1640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0540072a50 con 0x7f054015baf0 2024-04-14T23:36:02.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.504+0000 7f0546ad1640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f054015c370 con 0x7f054006e340 2024-04-14T23:36:02.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.504+0000 7f0546ad1640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f054015ead0 con 0x7f05400cff70 2024-04-14T23:36:02.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.504+0000 7f054486d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f054006e340 0x7f05400cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:02.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.504+0000 7f054486d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f054006e340 0x7f05400cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43730/0 (socket says 172.21.15.47:43730) 2024-04-14T23:36:02.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.504+0000 7f054486d640 1 -- 172.21.15.47:0/4266753001 learned_addr learned my addr 172.21.15.47:0/4266753001 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:02.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.504+0000 7f053ffff640 1 --2- 172.21.15.47:0/4266753001 >> v2:172.21.15.191:3300/0 conn(0x7f05400cff70 0x7f054015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:02.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.504+0000 7f054486d640 1 -- 172.21.15.47:0/4266753001 >> v2:172.21.15.191:3300/0 conn(0x7f05400cff70 msgr2=0x7f054015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:02.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.504+0000 7f054486d640 1 --2- 172.21.15.47:0/4266753001 >> v2:172.21.15.191:3300/0 conn(0x7f05400cff70 0x7f054015b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:02.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.504+0000 7f054486d640 1 -- 172.21.15.47:0/4266753001 >> v1:172.21.15.191:6789/0 conn(0x7f054015baf0 legacy=0x7f05400b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:02.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.504+0000 7f054486d640 1 -- 172.21.15.47:0/4266753001 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054015edb0 con 0x7f054006e340 2024-04-14T23:36:02.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.505+0000 7f054486d640 1 --2- 172.21.15.47:0/4266753001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f054006e340 0x7f05400cfa30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f05400b4d40 tx=0x7f053402e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295796ac456c3f6c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:02.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.505+0000 7f053f7fe640 1 -- 172.21.15.47:0/4266753001 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053403b070 con 0x7f054006e340 2024-04-14T23:36:02.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.505+0000 7f053f7fe640 1 -- 172.21.15.47:0/4266753001 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053402ee00 con 0x7f054006e340 2024-04-14T23:36:02.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.505+0000 7f053f7fe640 1 -- 172.21.15.47:0/4266753001 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0534036660 con 0x7f054006e340 2024-04-14T23:36:02.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.505+0000 7f0546ad1640 1 -- 172.21.15.47:0/4266753001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f054006e340 msgr2=0x7f05400cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:02.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.505+0000 7f0546ad1640 1 --2- 172.21.15.47:0/4266753001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f054006e340 0x7f05400cfa30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f05400b4d40 tx=0x7f053402e050 comp rx=0 tx=0).stop 2024-04-14T23:36:02.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.505+0000 7f0546ad1640 1 -- 172.21.15.47:0/4266753001 shutdown_connections 2024-04-14T23:36:02.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.505+0000 7f0546ad1640 1 --2- 172.21.15.47:0/4266753001 >> v2:172.21.15.191:3300/0 conn(0x7f05400cff70 0x7f054015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:02.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.505+0000 7f0546ad1640 1 --2- 172.21.15.47:0/4266753001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f054006e340 0x7f05400cfa30 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:02.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.505+0000 7f0546ad1640 1 -- 172.21.15.47:0/4266753001 >> 172.21.15.47:0/4266753001 conn(0x7f054006b200 msgr2=0x7f054006b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:02.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.506+0000 7f0546ad1640 1 -- 172.21.15.47:0/4266753001 shutdown_connections 2024-04-14T23:36:02.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.506+0000 7f0546ad1640 1 -- 172.21.15.47:0/4266753001 wait complete. 2024-04-14T23:36:02.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.507+0000 7f0546ad1640 1 Processor -- start 2024-04-14T23:36:02.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.507+0000 7f0546ad1640 1 -- start start 2024-04-14T23:36:02.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f0546ad1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f054006e340 0x7f05400ced40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:02.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f0546ad1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05400cff70 0x7f0540153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:02.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f0546ad1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f054015baf0 0x7f0540152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:02.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f0546ad1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f054015f890 con 0x7f05400cff70 2024-04-14T23:36:02.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f0546ad1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f054006e720 con 0x7f054015baf0 2024-04-14T23:36:02.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f0546ad1640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f054015bf60 con 0x7f054006e340 2024-04-14T23:36:02.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f053ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05400cff70 0x7f0540153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:02.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f053ffff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05400cff70 0x7f0540153130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43734/0 (socket says 172.21.15.47:43734) 2024-04-14T23:36:02.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f053ffff640 1 -- 172.21.15.47:0/2152610461 learned_addr learned my addr 172.21.15.47:0/2152610461 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:02.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f054506e640 1 --2- 172.21.15.47:0/2152610461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f054015baf0 0x7f0540152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:02.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f054486d640 1 --2- 172.21.15.47:0/2152610461 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f054006e340 0x7f05400ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:02.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f053ffff640 1 -- 172.21.15.47:0/2152610461 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f054006e340 msgr2=0x7f05400ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:02.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f053ffff640 1 --2- 172.21.15.47:0/2152610461 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f054006e340 0x7f05400ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:02.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f053ffff640 1 -- 172.21.15.47:0/2152610461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f054015baf0 msgr2=0x7f0540152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:02.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f053ffff640 1 --2- 172.21.15.47:0/2152610461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f054015baf0 0x7f0540152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:02.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f053ffff640 1 -- 172.21.15.47:0/2152610461 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05400ce2a0 con 0x7f05400cff70 2024-04-14T23:36:02.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f053ffff640 1 --2- 172.21.15.47:0/2152610461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05400cff70 0x7f0540153130 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f052c00d5f0 tx=0x7f052c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:02.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f053d7fa640 1 -- 172.21.15.47:0/2152610461 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c0125f0 con 0x7f05400cff70 2024-04-14T23:36:02.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f053d7fa640 1 -- 172.21.15.47:0/2152610461 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f052c019070 con 0x7f05400cff70 2024-04-14T23:36:02.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f0546ad1640 1 -- 172.21.15.47:0/2152610461 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05400b4750 con 0x7f05400cff70 2024-04-14T23:36:02.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f053d7fa640 1 -- 172.21.15.47:0/2152610461 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c0129d0 con 0x7f05400cff70 2024-04-14T23:36:02.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.508+0000 7f0546ad1640 1 -- 172.21.15.47:0/2152610461 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05400b4a30 con 0x7f05400cff70 2024-04-14T23:36:02.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.509+0000 7f0546ad1640 1 -- 172.21.15.47:0/2152610461 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0540075430 con 0x7f05400cff70 2024-04-14T23:36:02.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.510+0000 7f053d7fa640 1 -- 172.21.15.47:0/2152610461 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f052c012b70 con 0x7f05400cff70 2024-04-14T23:36:02.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.510+0000 7f053d7fa640 1 --2- 172.21.15.47:0/2152610461 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f052406b990 0x7f052406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:02.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.510+0000 7f053d7fa640 1 -- 172.21.15.47:0/2152610461 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f052c08ad60 con 0x7f05400cff70 2024-04-14T23:36:02.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.510+0000 7f054486d640 1 --2- 172.21.15.47:0/2152610461 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f052406b990 0x7f052406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:02.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.511+0000 7f054486d640 1 --2- 172.21.15.47:0/2152610461 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f052406b990 0x7f052406de50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0534038000 tx=0x7f0534032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:02.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.514+0000 7f053d7fa640 1 -- 172.21.15.47:0/2152610461 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f052c0590f0 con 0x7f05400cff70 2024-04-14T23:36:02.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.690+0000 7f0546ad1640 1 -- 172.21.15.47:0/2152610461 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0540071820 con 0x7f052406b990 2024-04-14T23:36:02.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.696+0000 7f053d7fa640 1 -- 172.21.15.47:0/2152610461 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251850 (secure 0 0 0) 0x7f0540071820 con 0x7f052406b990 2024-04-14T23:36:02.702 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:36:02.703 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-14T23:36:02.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.699+0000 7f0546ad1640 1 -- 172.21.15.47:0/2152610461 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f052406b990 msgr2=0x7f052406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:02.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.699+0000 7f0546ad1640 1 --2- 172.21.15.47:0/2152610461 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f052406b990 0x7f052406de50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0534038000 tx=0x7f0534032000 comp rx=0 tx=0).stop 2024-04-14T23:36:02.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.699+0000 7f0546ad1640 1 -- 172.21.15.47:0/2152610461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05400cff70 msgr2=0x7f0540153130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:02.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.699+0000 7f0546ad1640 1 --2- 172.21.15.47:0/2152610461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05400cff70 0x7f0540153130 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f052c00d5f0 tx=0x7f052c00dab0 comp rx=0 tx=0).stop 2024-04-14T23:36:02.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.699+0000 7f0546ad1640 1 -- 172.21.15.47:0/2152610461 shutdown_connections 2024-04-14T23:36:02.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.699+0000 7f0546ad1640 1 --2- 172.21.15.47:0/2152610461 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f052406b990 0x7f052406de50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:02.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.699+0000 7f0546ad1640 1 --2- 172.21.15.47:0/2152610461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f054015baf0 0x7f0540152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:02.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.699+0000 7f0546ad1640 1 --2- 172.21.15.47:0/2152610461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05400cff70 0x7f0540153130 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:02.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.699+0000 7f0546ad1640 1 --2- 172.21.15.47:0/2152610461 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f054006e340 0x7f05400ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:02.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.699+0000 7f0546ad1640 1 -- 172.21.15.47:0/2152610461 >> 172.21.15.47:0/2152610461 conn(0x7f054006b200 msgr2=0x7f054015b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:02.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.699+0000 7f0546ad1640 1 -- 172.21.15.47:0/2152610461 shutdown_connections 2024-04-14T23:36:02.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.699+0000 7f0546ad1640 1 -- 172.21.15.47:0/2152610461 wait complete. 2024-04-14T23:36:02.713 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-04-14T23:36:02.377899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598154,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237544,"kb_used_data":4752,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737176,"statfs":{"total":773094113280,"available":772850868224,"internally_reserved":0,"allocated":4866048,"data_stored":2769572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7786,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003107"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128934+0000","last_change":"2024-04-14T23:35:47.145996+0000","last_active":"2024-04-14T23:35:48.128934+0000","last_peered":"2024-04-14T23:35:48.128934+0000","last_clean":"2024-04-14T23:35:48.128934+0000","last_became_active":"2024-04-14T23:35:47.145716+0000","last_became_peered":"2024-04-14T23:35:47.145716+0000","last_unstale":"2024-04-14T23:35:48.128934+0000","last_undegraded":"2024-04-14T23:35:48.128934+0000","last_fullsized":"2024-04-14T23:35:48.128934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:17:32.571374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128951+0000","last_change":"2024-04-14T23:35:47.154551+0000","last_active":"2024-04-14T23:35:48.128951+0000","last_peered":"2024-04-14T23:35:48.128951+0000","last_clean":"2024-04-14T23:35:48.128951+0000","last_became_active":"2024-04-14T23:35:47.154286+0000","last_became_peered":"2024-04-14T23:35:47.154286+0000","last_unstale":"2024-04-14T23:35:48.128951+0000","last_undegraded":"2024-04-14T23:35:48.128951+0000","last_fullsized":"2024-04-14T23:35:48.128951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:07:06.644232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929709+0000","last_change":"2024-04-14T23:35:47.160513+0000","last_active":"2024-04-14T23:35:48.929709+0000","last_peered":"2024-04-14T23:35:48.929709+0000","last_clean":"2024-04-14T23:35:48.929709+0000","last_became_active":"2024-04-14T23:35:47.160208+0000","last_became_peered":"2024-04-14T23:35:47.160208+0000","last_unstale":"2024-04-14T23:35:48.929709+0000","last_undegraded":"2024-04-14T23:35:48.929709+0000","last_fullsized":"2024-04-14T23:35:48.929709+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:38.502135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930879+0000","last_change":"2024-04-14T23:35:47.153454+0000","last_active":"2024-04-14T23:35:48.930879+0000","last_peered":"2024-04-14T23:35:48.930879+0000","last_clean":"2024-04-14T23:35:48.930879+0000","last_became_active":"2024-04-14T23:35:47.153133+0000","last_became_peered":"2024-04-14T23:35:47.153133+0000","last_unstale":"2024-04-14T23:35:48.930879+0000","last_undegraded":"2024-04-14T23:35:48.930879+0000","last_fullsized":"2024-04-14T23:35:48.930879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:58:36.176049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930648+0000","last_change":"2024-04-14T23:35:47.154211+0000","last_active":"2024-04-14T23:35:48.930648+0000","last_peered":"2024-04-14T23:35:48.930648+0000","last_clean":"2024-04-14T23:35:48.930648+0000","last_became_active":"2024-04-14T23:35:47.153936+0000","last_became_peered":"2024-04-14T23:35:47.153936+0000","last_unstale":"2024-04-14T23:35:48.930648+0000","last_undegraded":"2024-04-14T23:35:48.930648+0000","last_fullsized":"2024-04-14T23:35:48.930648+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:07:13.534770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929869+0000","last_change":"2024-04-14T23:35:47.143406+0000","last_active":"2024-04-14T23:35:48.929869+0000","last_peered":"2024-04-14T23:35:48.929869+0000","last_clean":"2024-04-14T23:35:48.929869+0000","last_became_active":"2024-04-14T23:35:47.143142+0000","last_became_peered":"2024-04-14T23:35:47.143142+0000","last_unstale":"2024-04-14T23:35:48.929869+0000","last_undegraded":"2024-04-14T23:35:48.929869+0000","last_fullsized":"2024-04-14T23:35:48.929869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:49.647834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129403+0000","last_change":"2024-04-14T23:35:47.159443+0000","last_active":"2024-04-14T23:35:48.129403+0000","last_peered":"2024-04-14T23:35:48.129403+0000","last_clean":"2024-04-14T23:35:48.129403+0000","last_became_active":"2024-04-14T23:35:47.157644+0000","last_became_peered":"2024-04-14T23:35:47.157644+0000","last_unstale":"2024-04-14T23:35:48.129403+0000","last_undegraded":"2024-04-14T23:35:48.129403+0000","last_fullsized":"2024-04-14T23:35:48.129403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128520+0000","last_change":"2024-04-14T23:35:47.150895+0000","last_active":"2024-04-14T23:35:48.128520+0000","last_peered":"2024-04-14T23:35:48.128520+0000","last_clean":"2024-04-14T23:35:48.128520+0000","last_became_active":"2024-04-14T23:35:47.150520+0000","last_became_peered":"2024-04-14T23:35:47.150520+0000","last_unstale":"2024-04-14T23:35:48.128520+0000","last_undegraded":"2024-04-14T23:35:48.128520+0000","last_fullsized":"2024-04-14T23:35:48.128520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:00.141829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930024+0000","last_change":"2024-04-14T23:35:47.160830+0000","last_active":"2024-04-14T23:35:48.930024+0000","last_peered":"2024-04-14T23:35:48.930024+0000","last_clean":"2024-04-14T23:35:48.930024+0000","last_became_active":"2024-04-14T23:35:47.160554+0000","last_became_peered":"2024-04-14T23:35:47.160554+0000","last_unstale":"2024-04-14T23:35:48.930024+0000","last_undegraded":"2024-04-14T23:35:48.930024+0000","last_fullsized":"2024-04-14T23:35:48.930024+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130272+0000","last_change":"2024-04-14T23:35:47.157661+0000","last_active":"2024-04-14T23:35:48.130272+0000","last_peered":"2024-04-14T23:35:48.130272+0000","last_clean":"2024-04-14T23:35:48.130272+0000","last_became_active":"2024-04-14T23:35:47.157377+0000","last_became_peered":"2024-04-14T23:35:47.157377+0000","last_unstale":"2024-04-14T23:35:48.130272+0000","last_undegraded":"2024-04-14T23:35:48.130272+0000","last_fullsized":"2024-04-14T23:35:48.130272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:54:50.487935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130985+0000","last_change":"2024-04-14T23:35:47.153073+0000","last_active":"2024-04-14T23:35:48.130985+0000","last_peered":"2024-04-14T23:35:48.130985+0000","last_clean":"2024-04-14T23:35:48.130985+0000","last_became_active":"2024-04-14T23:35:47.152649+0000","last_became_peered":"2024-04-14T23:35:47.152649+0000","last_unstale":"2024-04-14T23:35:48.130985+0000","last_undegraded":"2024-04-14T23:35:48.130985+0000","last_fullsized":"2024-04-14T23:35:48.130985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:47:32.718724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930449+0000","last_change":"2024-04-14T23:35:47.149389+0000","last_active":"2024-04-14T23:35:48.930449+0000","last_peered":"2024-04-14T23:35:48.930449+0000","last_clean":"2024-04-14T23:35:48.930449+0000","last_became_active":"2024-04-14T23:35:47.149130+0000","last_became_peered":"2024-04-14T23:35:47.149130+0000","last_unstale":"2024-04-14T23:35:48.930449+0000","last_undegraded":"2024-04-14T23:35:48.930449+0000","last_fullsized":"2024-04-14T23:35:48.930449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129857+0000","last_change":"2024-04-14T23:35:47.153273+0000","last_active":"2024-04-14T23:35:48.129857+0000","last_peered":"2024-04-14T23:35:48.129857+0000","last_clean":"2024-04-14T23:35:48.129857+0000","last_became_active":"2024-04-14T23:35:47.153005+0000","last_became_peered":"2024-04-14T23:35:47.153005+0000","last_unstale":"2024-04-14T23:35:48.129857+0000","last_undegraded":"2024-04-14T23:35:48.129857+0000","last_fullsized":"2024-04-14T23:35:48.129857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:33:25.414410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390635+0000","last_change":"2024-04-14T23:35:47.152798+0000","last_active":"2024-04-14T23:35:48.390635+0000","last_peered":"2024-04-14T23:35:48.390635+0000","last_clean":"2024-04-14T23:35:48.390635+0000","last_became_active":"2024-04-14T23:35:47.152530+0000","last_became_peered":"2024-04-14T23:35:47.152530+0000","last_unstale":"2024-04-14T23:35:48.390635+0000","last_undegraded":"2024-04-14T23:35:48.390635+0000","last_fullsized":"2024-04-14T23:35:48.390635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129640+0000","last_change":"2024-04-14T23:35:47.157364+0000","last_active":"2024-04-14T23:35:48.129640+0000","last_peered":"2024-04-14T23:35:48.129640+0000","last_clean":"2024-04-14T23:35:48.129640+0000","last_became_active":"2024-04-14T23:35:47.157069+0000","last_became_peered":"2024-04-14T23:35:47.157069+0000","last_unstale":"2024-04-14T23:35:48.129640+0000","last_undegraded":"2024-04-14T23:35:48.129640+0000","last_fullsized":"2024-04-14T23:35:48.129640+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929628+0000","last_change":"2024-04-14T23:35:47.157646+0000","last_active":"2024-04-14T23:35:48.929628+0000","last_peered":"2024-04-14T23:35:48.929628+0000","last_clean":"2024-04-14T23:35:48.929628+0000","last_became_active":"2024-04-14T23:35:47.157374+0000","last_became_peered":"2024-04-14T23:35:47.157374+0000","last_unstale":"2024-04-14T23:35:48.929628+0000","last_undegraded":"2024-04-14T23:35:48.929628+0000","last_fullsized":"2024-04-14T23:35:48.929628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:49.647834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930137+0000","last_change":"2024-04-14T23:35:47.160288+0000","last_active":"2024-04-14T23:35:48.930137+0000","last_peered":"2024-04-14T23:35:48.930137+0000","last_clean":"2024-04-14T23:35:48.930137+0000","last_became_active":"2024-04-14T23:35:47.160045+0000","last_became_peered":"2024-04-14T23:35:47.160045+0000","last_unstale":"2024-04-14T23:35:48.930137+0000","last_undegraded":"2024-04-14T23:35:48.930137+0000","last_fullsized":"2024-04-14T23:35:48.930137+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:33:25.414410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130094+0000","last_change":"2024-04-14T23:35:47.150954+0000","last_active":"2024-04-14T23:35:48.130094+0000","last_peered":"2024-04-14T23:35:48.130094+0000","last_clean":"2024-04-14T23:35:48.130094+0000","last_became_active":"2024-04-14T23:35:47.150606+0000","last_became_peered":"2024-04-14T23:35:47.150606+0000","last_unstale":"2024-04-14T23:35:48.130094+0000","last_undegraded":"2024-04-14T23:35:48.130094+0000","last_fullsized":"2024-04-14T23:35:48.130094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:39.427143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930862+0000","last_change":"2024-04-14T23:35:47.137492+0000","last_active":"2024-04-14T23:35:48.930862+0000","last_peered":"2024-04-14T23:35:48.930862+0000","last_clean":"2024-04-14T23:35:48.930862+0000","last_became_active":"2024-04-14T23:35:47.137234+0000","last_became_peered":"2024-04-14T23:35:47.137234+0000","last_unstale":"2024-04-14T23:35:48.930862+0000","last_undegraded":"2024-04-14T23:35:48.930862+0000","last_fullsized":"2024-04-14T23:35:48.930862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:30:05.284391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129997+0000","last_change":"2024-04-14T23:35:47.150013+0000","last_active":"2024-04-14T23:35:48.129997+0000","last_peered":"2024-04-14T23:35:48.129997+0000","last_clean":"2024-04-14T23:35:48.129997+0000","last_became_active":"2024-04-14T23:35:47.149754+0000","last_became_peered":"2024-04-14T23:35:47.149754+0000","last_unstale":"2024-04-14T23:35:48.129997+0000","last_undegraded":"2024-04-14T23:35:48.129997+0000","last_fullsized":"2024-04-14T23:35:48.129997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:12.344810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129783+0000","last_change":"2024-04-14T23:35:47.149073+0000","last_active":"2024-04-14T23:35:48.129783+0000","last_peered":"2024-04-14T23:35:48.129783+0000","last_clean":"2024-04-14T23:35:48.129783+0000","last_became_active":"2024-04-14T23:35:47.148806+0000","last_became_peered":"2024-04-14T23:35:47.148806+0000","last_unstale":"2024-04-14T23:35:48.129783+0000","last_undegraded":"2024-04-14T23:35:48.129783+0000","last_fullsized":"2024-04-14T23:35:48.129783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:18.147979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391033+0000","last_change":"2024-04-14T23:35:47.154397+0000","last_active":"2024-04-14T23:35:48.391033+0000","last_peered":"2024-04-14T23:35:48.391033+0000","last_clean":"2024-04-14T23:35:48.391033+0000","last_became_active":"2024-04-14T23:35:47.154054+0000","last_became_peered":"2024-04-14T23:35:47.154054+0000","last_unstale":"2024-04-14T23:35:48.391033+0000","last_undegraded":"2024-04-14T23:35:48.391033+0000","last_fullsized":"2024-04-14T23:35:48.391033+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:13:37.995199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929730+0000","last_change":"2024-04-14T23:35:47.135157+0000","last_active":"2024-04-14T23:35:48.929730+0000","last_peered":"2024-04-14T23:35:48.929730+0000","last_clean":"2024-04-14T23:35:48.929730+0000","last_became_active":"2024-04-14T23:35:47.134846+0000","last_became_peered":"2024-04-14T23:35:47.134846+0000","last_unstale":"2024-04-14T23:35:48.929730+0000","last_undegraded":"2024-04-14T23:35:48.929730+0000","last_fullsized":"2024-04-14T23:35:48.929730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:38.502135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930226+0000","last_change":"2024-04-14T23:35:47.134176+0000","last_active":"2024-04-14T23:35:48.930226+0000","last_peered":"2024-04-14T23:35:48.930226+0000","last_clean":"2024-04-14T23:35:48.930226+0000","last_became_active":"2024-04-14T23:35:47.133837+0000","last_became_peered":"2024-04-14T23:35:47.133837+0000","last_unstale":"2024-04-14T23:35:48.930226+0000","last_undegraded":"2024-04-14T23:35:48.930226+0000","last_fullsized":"2024-04-14T23:35:48.930226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:13:32.134259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130962+0000","last_change":"2024-04-14T23:35:47.141736+0000","last_active":"2024-04-14T23:35:48.130962+0000","last_peered":"2024-04-14T23:35:48.130962+0000","last_clean":"2024-04-14T23:35:48.130962+0000","last_became_active":"2024-04-14T23:35:47.141474+0000","last_became_peered":"2024-04-14T23:35:47.141474+0000","last_unstale":"2024-04-14T23:35:48.130962+0000","last_undegraded":"2024-04-14T23:35:48.130962+0000","last_fullsized":"2024-04-14T23:35:48.130962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:31:38.223026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930267+0000","last_change":"2024-04-14T23:35:47.151371+0000","last_active":"2024-04-14T23:35:48.930267+0000","last_peered":"2024-04-14T23:35:48.930267+0000","last_clean":"2024-04-14T23:35:48.930267+0000","last_became_active":"2024-04-14T23:35:47.151113+0000","last_became_peered":"2024-04-14T23:35:47.151113+0000","last_unstale":"2024-04-14T23:35:48.930267+0000","last_undegraded":"2024-04-14T23:35:48.930267+0000","last_fullsized":"2024-04-14T23:35:48.930267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:26.044901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130325+0000","last_change":"2024-04-14T23:35:47.144676+0000","last_active":"2024-04-14T23:35:48.130325+0000","last_peered":"2024-04-14T23:35:48.130325+0000","last_clean":"2024-04-14T23:35:48.130325+0000","last_became_active":"2024-04-14T23:35:47.144429+0000","last_became_peered":"2024-04-14T23:35:47.144429+0000","last_unstale":"2024-04-14T23:35:48.130325+0000","last_undegraded":"2024-04-14T23:35:48.130325+0000","last_fullsized":"2024-04-14T23:35:48.130325+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:40.857176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130449+0000","last_change":"2024-04-14T23:35:47.149677+0000","last_active":"2024-04-14T23:35:48.130449+0000","last_peered":"2024-04-14T23:35:48.130449+0000","last_clean":"2024-04-14T23:35:48.130449+0000","last_became_active":"2024-04-14T23:35:47.149370+0000","last_became_peered":"2024-04-14T23:35:47.149370+0000","last_unstale":"2024-04-14T23:35:48.130449+0000","last_undegraded":"2024-04-14T23:35:48.130449+0000","last_fullsized":"2024-04-14T23:35:48.130449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:56:02.290384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130652+0000","last_change":"2024-04-14T23:35:47.138179+0000","last_active":"2024-04-14T23:35:48.130652+0000","last_peered":"2024-04-14T23:35:48.130652+0000","last_clean":"2024-04-14T23:35:48.130652+0000","last_became_active":"2024-04-14T23:35:47.137917+0000","last_became_peered":"2024-04-14T23:35:47.137917+0000","last_unstale":"2024-04-14T23:35:48.130652+0000","last_undegraded":"2024-04-14T23:35:48.130652+0000","last_fullsized":"2024-04-14T23:35:48.130652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:10:16.379713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130246+0000","last_change":"2024-04-14T23:35:47.140281+0000","last_active":"2024-04-14T23:35:48.130246+0000","last_peered":"2024-04-14T23:35:48.130246+0000","last_clean":"2024-04-14T23:35:48.130246+0000","last_became_active":"2024-04-14T23:35:47.140018+0000","last_became_peered":"2024-04-14T23:35:47.140018+0000","last_unstale":"2024-04-14T23:35:48.130246+0000","last_undegraded":"2024-04-14T23:35:48.130246+0000","last_fullsized":"2024-04-14T23:35:48.130246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:12.833964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929754+0000","last_change":"2024-04-14T23:35:47.150510+0000","last_active":"2024-04-14T23:35:48.929754+0000","last_peered":"2024-04-14T23:35:48.929754+0000","last_clean":"2024-04-14T23:35:48.929754+0000","last_became_active":"2024-04-14T23:35:47.150210+0000","last_became_peered":"2024-04-14T23:35:47.150210+0000","last_unstale":"2024-04-14T23:35:48.929754+0000","last_undegraded":"2024-04-14T23:35:48.929754+0000","last_fullsized":"2024-04-14T23:35:48.929754+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:27.967946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929546+0000","last_change":"2024-04-14T23:35:47.154478+0000","last_active":"2024-04-14T23:35:48.929546+0000","last_peered":"2024-04-14T23:35:48.929546+0000","last_clean":"2024-04-14T23:35:48.929546+0000","last_became_active":"2024-04-14T23:35:47.154196+0000","last_became_peered":"2024-04-14T23:35:47.154196+0000","last_unstale":"2024-04-14T23:35:48.929546+0000","last_undegraded":"2024-04-14T23:35:48.929546+0000","last_fullsized":"2024-04-14T23:35:48.929546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:47:00.159204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929959+0000","last_change":"2024-04-14T23:35:47.157634+0000","last_active":"2024-04-14T23:35:48.929959+0000","last_peered":"2024-04-14T23:35:48.929959+0000","last_clean":"2024-04-14T23:35:48.929959+0000","last_became_active":"2024-04-14T23:35:47.157342+0000","last_became_peered":"2024-04-14T23:35:47.157342+0000","last_unstale":"2024-04-14T23:35:48.929959+0000","last_undegraded":"2024-04-14T23:35:48.929959+0000","last_fullsized":"2024-04-14T23:35:48.929959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130857+0000","last_change":"2024-04-14T23:35:46.130076+0000","last_active":"2024-04-14T23:35:48.130857+0000","last_peered":"2024-04-14T23:35:48.130857+0000","last_clean":"2024-04-14T23:35:48.130857+0000","last_became_active":"2024-04-14T23:35:46.129786+0000","last_became_peered":"2024-04-14T23:35:46.129786+0000","last_unstale":"2024-04-14T23:35:48.130857+0000","last_undegraded":"2024-04-14T23:35:48.130857+0000","last_fullsized":"2024-04-14T23:35:48.130857+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:55:49.584788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930680+0000","last_change":"2024-04-14T23:35:47.157788+0000","last_active":"2024-04-14T23:35:48.930680+0000","last_peered":"2024-04-14T23:35:48.930680+0000","last_clean":"2024-04-14T23:35:48.930680+0000","last_became_active":"2024-04-14T23:35:47.157538+0000","last_became_peered":"2024-04-14T23:35:47.157538+0000","last_unstale":"2024-04-14T23:35:48.930680+0000","last_undegraded":"2024-04-14T23:35:48.930680+0000","last_fullsized":"2024-04-14T23:35:48.930680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929932+0000","last_change":"2024-04-14T23:35:46.136432+0000","last_active":"2024-04-14T23:35:48.929932+0000","last_peered":"2024-04-14T23:35:48.929932+0000","last_clean":"2024-04-14T23:35:48.929932+0000","last_became_active":"2024-04-14T23:35:46.136168+0000","last_became_peered":"2024-04-14T23:35:46.136168+0000","last_unstale":"2024-04-14T23:35:48.929932+0000","last_undegraded":"2024-04-14T23:35:48.929932+0000","last_fullsized":"2024-04-14T23:35:48.929932+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:11.340513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391012+0000","last_change":"2024-04-14T23:35:47.149283+0000","last_active":"2024-04-14T23:35:48.391012+0000","last_peered":"2024-04-14T23:35:48.391012+0000","last_clean":"2024-04-14T23:35:48.391012+0000","last_became_active":"2024-04-14T23:35:47.148963+0000","last_became_peered":"2024-04-14T23:35:47.148963+0000","last_unstale":"2024-04-14T23:35:48.391012+0000","last_undegraded":"2024-04-14T23:35:48.391012+0000","last_fullsized":"2024-04-14T23:35:48.391012+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:33:25.414410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930741+0000","last_change":"2024-04-14T23:35:46.137540+0000","last_active":"2024-04-14T23:35:48.930741+0000","last_peered":"2024-04-14T23:35:48.930741+0000","last_clean":"2024-04-14T23:35:48.930741+0000","last_became_active":"2024-04-14T23:35:46.137096+0000","last_became_peered":"2024-04-14T23:35:46.137096+0000","last_unstale":"2024-04-14T23:35:48.930741+0000","last_undegraded":"2024-04-14T23:35:48.930741+0000","last_fullsized":"2024-04-14T23:35:48.930741+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128931+0000","last_change":"2024-04-14T23:35:47.146618+0000","last_active":"2024-04-14T23:35:48.128931+0000","last_peered":"2024-04-14T23:35:48.128931+0000","last_clean":"2024-04-14T23:35:48.128931+0000","last_became_active":"2024-04-14T23:35:47.146329+0000","last_became_peered":"2024-04-14T23:35:47.146329+0000","last_unstale":"2024-04-14T23:35:48.128931+0000","last_undegraded":"2024-04-14T23:35:48.128931+0000","last_fullsized":"2024-04-14T23:35:48.128931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:59:58.258654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390798+0000","last_change":"2024-04-14T23:35:46.133465+0000","last_active":"2024-04-14T23:35:48.390798+0000","last_peered":"2024-04-14T23:35:48.390798+0000","last_clean":"2024-04-14T23:35:48.390798+0000","last_became_active":"2024-04-14T23:35:46.133188+0000","last_became_peered":"2024-04-14T23:35:46.133188+0000","last_unstale":"2024-04-14T23:35:48.390798+0000","last_undegraded":"2024-04-14T23:35:48.390798+0000","last_fullsized":"2024-04-14T23:35:48.390798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:38.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929549+0000","last_change":"2024-04-14T23:35:47.142488+0000","last_active":"2024-04-14T23:35:48.929549+0000","last_peered":"2024-04-14T23:35:48.929549+0000","last_clean":"2024-04-14T23:35:48.929549+0000","last_became_active":"2024-04-14T23:35:47.142140+0000","last_became_peered":"2024-04-14T23:35:47.142140+0000","last_unstale":"2024-04-14T23:35:48.929549+0000","last_undegraded":"2024-04-14T23:35:48.929549+0000","last_fullsized":"2024-04-14T23:35:48.929549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:47:00.159204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129923+0000","last_change":"2024-04-14T23:35:46.135150+0000","last_active":"2024-04-14T23:35:48.129923+0000","last_peered":"2024-04-14T23:35:48.129923+0000","last_clean":"2024-04-14T23:35:48.129923+0000","last_became_active":"2024-04-14T23:35:46.134786+0000","last_became_peered":"2024-04-14T23:35:46.134786+0000","last_unstale":"2024-04-14T23:35:48.129923+0000","last_undegraded":"2024-04-14T23:35:48.129923+0000","last_fullsized":"2024-04-14T23:35:48.129923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:28.026305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130028+0000","last_change":"2024-04-14T23:35:47.159541+0000","last_active":"2024-04-14T23:35:48.130028+0000","last_peered":"2024-04-14T23:35:48.130028+0000","last_clean":"2024-04-14T23:35:48.130028+0000","last_became_active":"2024-04-14T23:35:47.158355+0000","last_became_peered":"2024-04-14T23:35:47.158355+0000","last_unstale":"2024-04-14T23:35:48.130028+0000","last_undegraded":"2024-04-14T23:35:48.130028+0000","last_fullsized":"2024-04-14T23:35:48.130028+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:13:37.995199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929626+0000","last_change":"2024-04-14T23:35:46.139410+0000","last_active":"2024-04-14T23:35:48.929626+0000","last_peered":"2024-04-14T23:35:48.929626+0000","last_clean":"2024-04-14T23:35:48.929626+0000","last_became_active":"2024-04-14T23:35:46.138931+0000","last_became_peered":"2024-04-14T23:35:46.138931+0000","last_unstale":"2024-04-14T23:35:48.929626+0000","last_undegraded":"2024-04-14T23:35:48.929626+0000","last_fullsized":"2024-04-14T23:35:48.929626+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:28.026305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390862+0000","last_change":"2024-04-14T23:35:47.158537+0000","last_active":"2024-04-14T23:35:48.390862+0000","last_peered":"2024-04-14T23:35:48.390862+0000","last_clean":"2024-04-14T23:35:48.390862+0000","last_became_active":"2024-04-14T23:35:47.158238+0000","last_became_peered":"2024-04-14T23:35:47.158238+0000","last_unstale":"2024-04-14T23:35:48.390862+0000","last_undegraded":"2024-04-14T23:35:48.390862+0000","last_fullsized":"2024-04-14T23:35:48.390862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929960+0000","last_change":"2024-04-14T23:35:46.134765+0000","last_active":"2024-04-14T23:35:48.929960+0000","last_peered":"2024-04-14T23:35:48.929960+0000","last_clean":"2024-04-14T23:35:48.929960+0000","last_became_active":"2024-04-14T23:35:46.134477+0000","last_became_peered":"2024-04-14T23:35:46.134477+0000","last_unstale":"2024-04-14T23:35:48.929960+0000","last_undegraded":"2024-04-14T23:35:48.929960+0000","last_fullsized":"2024-04-14T23:35:48.929960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:38.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128703+0000","last_change":"2024-04-14T23:35:47.153332+0000","last_active":"2024-04-14T23:35:48.128703+0000","last_peered":"2024-04-14T23:35:48.128703+0000","last_clean":"2024-04-14T23:35:48.128703+0000","last_became_active":"2024-04-14T23:35:47.152701+0000","last_became_peered":"2024-04-14T23:35:47.152701+0000","last_unstale":"2024-04-14T23:35:48.128703+0000","last_undegraded":"2024-04-14T23:35:48.128703+0000","last_fullsized":"2024-04-14T23:35:48.128703+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:45:43.060746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390464+0000","last_change":"2024-04-14T23:35:46.132189+0000","last_active":"2024-04-14T23:35:48.390464+0000","last_peered":"2024-04-14T23:35:48.390464+0000","last_clean":"2024-04-14T23:35:48.390464+0000","last_became_active":"2024-04-14T23:35:46.131898+0000","last_became_peered":"2024-04-14T23:35:46.131898+0000","last_unstale":"2024-04-14T23:35:48.390464+0000","last_undegraded":"2024-04-14T23:35:48.390464+0000","last_fullsized":"2024-04-14T23:35:48.390464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:39.852879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930999+0000","last_change":"2024-04-14T23:35:47.151785+0000","last_active":"2024-04-14T23:35:48.930999+0000","last_peered":"2024-04-14T23:35:48.930999+0000","last_clean":"2024-04-14T23:35:48.930999+0000","last_became_active":"2024-04-14T23:35:47.151273+0000","last_became_peered":"2024-04-14T23:35:47.151273+0000","last_unstale":"2024-04-14T23:35:48.930999+0000","last_undegraded":"2024-04-14T23:35:48.930999+0000","last_fullsized":"2024-04-14T23:35:48.930999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:51.707591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128964+0000","last_change":"2024-04-14T23:35:46.130128+0000","last_active":"2024-04-14T23:35:48.128964+0000","last_peered":"2024-04-14T23:35:48.128964+0000","last_clean":"2024-04-14T23:35:48.128964+0000","last_became_active":"2024-04-14T23:35:46.129848+0000","last_became_peered":"2024-04-14T23:35:46.129848+0000","last_unstale":"2024-04-14T23:35:48.128964+0000","last_undegraded":"2024-04-14T23:35:48.128964+0000","last_fullsized":"2024-04-14T23:35:48.128964+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:25.040605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930239+0000","last_change":"2024-04-14T23:35:47.135501+0000","last_active":"2024-04-14T23:35:48.930239+0000","last_peered":"2024-04-14T23:35:48.930239+0000","last_clean":"2024-04-14T23:35:48.930239+0000","last_became_active":"2024-04-14T23:35:47.135240+0000","last_became_peered":"2024-04-14T23:35:47.135240+0000","last_unstale":"2024-04-14T23:35:48.930239+0000","last_undegraded":"2024-04-14T23:35:48.930239+0000","last_fullsized":"2024-04-14T23:35:48.930239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130481+0000","last_change":"2024-04-14T23:35:46.132005+0000","last_active":"2024-04-14T23:35:48.130481+0000","last_peered":"2024-04-14T23:35:48.130481+0000","last_clean":"2024-04-14T23:35:48.130481+0000","last_became_active":"2024-04-14T23:35:46.131640+0000","last_became_peered":"2024-04-14T23:35:46.131640+0000","last_unstale":"2024-04-14T23:35:48.130481+0000","last_undegraded":"2024-04-14T23:35:48.130481+0000","last_fullsized":"2024-04-14T23:35:48.130481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:11.340513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929884+0000","last_change":"2024-04-14T23:35:47.153756+0000","last_active":"2024-04-14T23:35:48.929884+0000","last_peered":"2024-04-14T23:35:48.929884+0000","last_clean":"2024-04-14T23:35:48.929884+0000","last_became_active":"2024-04-14T23:35:47.153494+0000","last_became_peered":"2024-04-14T23:35:47.153494+0000","last_unstale":"2024-04-14T23:35:48.929884+0000","last_undegraded":"2024-04-14T23:35:48.929884+0000","last_fullsized":"2024-04-14T23:35:48.929884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:26.044901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.131064+0000","last_change":"2024-04-14T23:35:46.129168+0000","last_active":"2024-04-14T23:35:48.131064+0000","last_peered":"2024-04-14T23:35:48.131064+0000","last_clean":"2024-04-14T23:35:48.131064+0000","last_became_active":"2024-04-14T23:35:46.128883+0000","last_became_peered":"2024-04-14T23:35:46.128883+0000","last_unstale":"2024-04-14T23:35:48.131064+0000","last_undegraded":"2024-04-14T23:35:48.131064+0000","last_fullsized":"2024-04-14T23:35:48.131064+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391075+0000","last_change":"2024-04-14T23:35:47.154541+0000","last_active":"2024-04-14T23:35:48.391075+0000","last_peered":"2024-04-14T23:35:48.391075+0000","last_clean":"2024-04-14T23:35:48.391075+0000","last_became_active":"2024-04-14T23:35:47.154276+0000","last_became_peered":"2024-04-14T23:35:47.154276+0000","last_unstale":"2024-04-14T23:35:48.391075+0000","last_undegraded":"2024-04-14T23:35:48.391075+0000","last_fullsized":"2024-04-14T23:35:48.391075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:54:50.487935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'9","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:58.300100+0000","last_change":"2024-04-14T23:35:46.136620+0000","last_active":"2024-04-14T23:35:58.300100+0000","last_peered":"2024-04-14T23:35:58.300100+0000","last_clean":"2024-04-14T23:35:58.300100+0000","last_became_active":"2024-04-14T23:35:46.136185+0000","last_became_peered":"2024-04-14T23:35:46.136185+0000","last_unstale":"2024-04-14T23:35:58.300100+0000","last_undegraded":"2024-04-14T23:35:58.300100+0000","last_fullsized":"2024-04-14T23:35:58.300100+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:26.963649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929540+0000","last_change":"2024-04-14T23:35:47.158305+0000","last_active":"2024-04-14T23:35:48.929540+0000","last_peered":"2024-04-14T23:35:48.929540+0000","last_clean":"2024-04-14T23:35:48.929540+0000","last_became_active":"2024-04-14T23:35:47.157745+0000","last_became_peered":"2024-04-14T23:35:47.157745+0000","last_unstale":"2024-04-14T23:35:48.929540+0000","last_undegraded":"2024-04-14T23:35:48.929540+0000","last_fullsized":"2024-04-14T23:35:48.929540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:49.647834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128763+0000","last_change":"2024-04-14T23:35:46.133651+0000","last_active":"2024-04-14T23:35:48.128763+0000","last_peered":"2024-04-14T23:35:48.128763+0000","last_clean":"2024-04-14T23:35:48.128763+0000","last_became_active":"2024-04-14T23:35:46.133356+0000","last_became_peered":"2024-04-14T23:35:46.133356+0000","last_unstale":"2024-04-14T23:35:48.128763+0000","last_undegraded":"2024-04-14T23:35:48.128763+0000","last_fullsized":"2024-04-14T23:35:48.128763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:39.741647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128618+0000","last_change":"2024-04-14T23:35:47.143315+0000","last_active":"2024-04-14T23:35:48.128618+0000","last_peered":"2024-04-14T23:35:48.128618+0000","last_clean":"2024-04-14T23:35:48.128618+0000","last_became_active":"2024-04-14T23:35:47.143045+0000","last_became_peered":"2024-04-14T23:35:47.143045+0000","last_unstale":"2024-04-14T23:35:48.128618+0000","last_undegraded":"2024-04-14T23:35:48.128618+0000","last_fullsized":"2024-04-14T23:35:48.128618+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:10:25.940509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929923+0000","last_change":"2024-04-14T23:35:46.134679+0000","last_active":"2024-04-14T23:35:48.929923+0000","last_peered":"2024-04-14T23:35:48.929923+0000","last_clean":"2024-04-14T23:35:48.929923+0000","last_became_active":"2024-04-14T23:35:46.134400+0000","last_became_peered":"2024-04-14T23:35:46.134400+0000","last_unstale":"2024-04-14T23:35:48.929923+0000","last_undegraded":"2024-04-14T23:35:48.929923+0000","last_fullsized":"2024-04-14T23:35:48.929923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:11.829667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929760+0000","last_change":"2024-04-14T23:35:47.135899+0000","last_active":"2024-04-14T23:35:48.929760+0000","last_peered":"2024-04-14T23:35:48.929760+0000","last_clean":"2024-04-14T23:35:48.929760+0000","last_became_active":"2024-04-14T23:35:47.134733+0000","last_became_peered":"2024-04-14T23:35:47.134733+0000","last_unstale":"2024-04-14T23:35:48.929760+0000","last_undegraded":"2024-04-14T23:35:48.929760+0000","last_fullsized":"2024-04-14T23:35:48.929760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:26.044901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129540+0000","last_change":"2024-04-14T23:35:46.128127+0000","last_active":"2024-04-14T23:35:48.129540+0000","last_peered":"2024-04-14T23:35:48.129540+0000","last_clean":"2024-04-14T23:35:48.129540+0000","last_became_active":"2024-04-14T23:35:46.127852+0000","last_became_peered":"2024-04-14T23:35:46.127852+0000","last_unstale":"2024-04-14T23:35:48.129540+0000","last_undegraded":"2024-04-14T23:35:48.129540+0000","last_fullsized":"2024-04-14T23:35:48.129540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:28:27.338198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128687+0000","last_change":"2024-04-14T23:35:47.147302+0000","last_active":"2024-04-14T23:35:48.128687+0000","last_peered":"2024-04-14T23:35:48.128687+0000","last_clean":"2024-04-14T23:35:48.128687+0000","last_became_active":"2024-04-14T23:35:47.147022+0000","last_became_peered":"2024-04-14T23:35:47.147022+0000","last_unstale":"2024-04-14T23:35:48.128687+0000","last_undegraded":"2024-04-14T23:35:48.128687+0000","last_fullsized":"2024-04-14T23:35:48.128687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:29:11.592779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929556+0000","last_change":"2024-04-14T23:35:46.139301+0000","last_active":"2024-04-14T23:35:48.929556+0000","last_peered":"2024-04-14T23:35:48.929556+0000","last_clean":"2024-04-14T23:35:48.929556+0000","last_became_active":"2024-04-14T23:35:46.138922+0000","last_became_peered":"2024-04-14T23:35:46.138922+0000","last_unstale":"2024-04-14T23:35:48.929556+0000","last_undegraded":"2024-04-14T23:35:48.929556+0000","last_fullsized":"2024-04-14T23:35:48.929556+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:30:04.280095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128762+0000","last_change":"2024-04-14T23:35:47.143210+0000","last_active":"2024-04-14T23:35:48.128762+0000","last_peered":"2024-04-14T23:35:48.128762+0000","last_clean":"2024-04-14T23:35:48.128762+0000","last_became_active":"2024-04-14T23:35:47.142925+0000","last_became_peered":"2024-04-14T23:35:47.142925+0000","last_unstale":"2024-04-14T23:35:48.128762+0000","last_undegraded":"2024-04-14T23:35:48.128762+0000","last_fullsized":"2024-04-14T23:35:48.128762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:19:31.536395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130578+0000","last_change":"2024-04-14T23:35:46.130896+0000","last_active":"2024-04-14T23:35:48.130578+0000","last_peered":"2024-04-14T23:35:48.130578+0000","last_clean":"2024-04-14T23:35:48.130578+0000","last_became_active":"2024-04-14T23:35:46.130423+0000","last_became_peered":"2024-04-14T23:35:46.130423+0000","last_unstale":"2024-04-14T23:35:48.130578+0000","last_undegraded":"2024-04-14T23:35:48.130578+0000","last_fullsized":"2024-04-14T23:35:48.130578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:38.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.131117+0000","last_change":"2024-04-14T23:35:47.149269+0000","last_active":"2024-04-14T23:35:48.131117+0000","last_peered":"2024-04-14T23:35:48.131117+0000","last_clean":"2024-04-14T23:35:48.131117+0000","last_became_active":"2024-04-14T23:35:47.148964+0000","last_became_peered":"2024-04-14T23:35:47.148964+0000","last_unstale":"2024-04-14T23:35:48.131117+0000","last_undegraded":"2024-04-14T23:35:48.131117+0000","last_fullsized":"2024-04-14T23:35:48.131117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:16:06.767783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391019+0000","last_change":"2024-04-14T23:35:46.137019+0000","last_active":"2024-04-14T23:35:48.391019+0000","last_peered":"2024-04-14T23:35:48.391019+0000","last_clean":"2024-04-14T23:35:48.391019+0000","last_became_active":"2024-04-14T23:35:46.136718+0000","last_became_peered":"2024-04-14T23:35:46.136718+0000","last_unstale":"2024-04-14T23:35:48.391019+0000","last_undegraded":"2024-04-14T23:35:48.391019+0000","last_fullsized":"2024-04-14T23:35:48.391019+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:11.829667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390937+0000","last_change":"2024-04-14T23:35:47.149376+0000","last_active":"2024-04-14T23:35:48.390937+0000","last_peered":"2024-04-14T23:35:48.390937+0000","last_clean":"2024-04-14T23:35:48.390937+0000","last_became_active":"2024-04-14T23:35:47.149067+0000","last_became_peered":"2024-04-14T23:35:47.149067+0000","last_unstale":"2024-04-14T23:35:48.390937+0000","last_undegraded":"2024-04-14T23:35:48.390937+0000","last_fullsized":"2024-04-14T23:35:48.390937+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:18.147979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930844+0000","last_change":"2024-04-14T23:35:46.136557+0000","last_active":"2024-04-14T23:35:48.930844+0000","last_peered":"2024-04-14T23:35:48.930844+0000","last_clean":"2024-04-14T23:35:48.930844+0000","last_became_active":"2024-04-14T23:35:46.136236+0000","last_became_peered":"2024-04-14T23:35:46.136236+0000","last_unstale":"2024-04-14T23:35:48.930844+0000","last_undegraded":"2024-04-14T23:35:48.930844+0000","last_fullsized":"2024-04-14T23:35:48.930844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:08:47.351218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930975+0000","last_change":"2024-04-14T23:35:47.150822+0000","last_active":"2024-04-14T23:35:48.930975+0000","last_peered":"2024-04-14T23:35:48.930975+0000","last_clean":"2024-04-14T23:35:48.930975+0000","last_became_active":"2024-04-14T23:35:47.150517+0000","last_became_peered":"2024-04-14T23:35:47.150517+0000","last_unstale":"2024-04-14T23:35:48.930975+0000","last_undegraded":"2024-04-14T23:35:48.930975+0000","last_fullsized":"2024-04-14T23:35:48.930975+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:29.030602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930275+0000","last_change":"2024-04-14T23:35:46.136475+0000","last_active":"2024-04-14T23:35:48.930275+0000","last_peered":"2024-04-14T23:35:48.930275+0000","last_clean":"2024-04-14T23:35:48.930275+0000","last_became_active":"2024-04-14T23:35:46.136103+0000","last_became_peered":"2024-04-14T23:35:46.136103+0000","last_unstale":"2024-04-14T23:35:48.930275+0000","last_undegraded":"2024-04-14T23:35:48.930275+0000","last_fullsized":"2024-04-14T23:35:48.930275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:11.340513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929988+0000","last_change":"2024-04-14T23:35:47.146919+0000","last_active":"2024-04-14T23:35:48.929988+0000","last_peered":"2024-04-14T23:35:48.929988+0000","last_clean":"2024-04-14T23:35:48.929988+0000","last_became_active":"2024-04-14T23:35:47.146080+0000","last_became_peered":"2024-04-14T23:35:47.146080+0000","last_unstale":"2024-04-14T23:35:48.929988+0000","last_undegraded":"2024-04-14T23:35:48.929988+0000","last_fullsized":"2024-04-14T23:35:48.929988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930583+0000","last_change":"2024-04-14T23:35:46.132858+0000","last_active":"2024-04-14T23:35:48.930583+0000","last_peered":"2024-04-14T23:35:48.930583+0000","last_clean":"2024-04-14T23:35:48.930583+0000","last_became_active":"2024-04-14T23:35:46.132542+0000","last_became_peered":"2024-04-14T23:35:46.132542+0000","last_unstale":"2024-04-14T23:35:48.930583+0000","last_undegraded":"2024-04-14T23:35:48.930583+0000","last_fullsized":"2024-04-14T23:35:48.930583+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:51:12.197819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929957+0000","last_change":"2024-04-14T23:35:47.154850+0000","last_active":"2024-04-14T23:35:48.929957+0000","last_peered":"2024-04-14T23:35:48.929957+0000","last_clean":"2024-04-14T23:35:48.929957+0000","last_became_active":"2024-04-14T23:35:47.154568+0000","last_became_peered":"2024-04-14T23:35:47.154568+0000","last_unstale":"2024-04-14T23:35:48.929957+0000","last_undegraded":"2024-04-14T23:35:48.929957+0000","last_fullsized":"2024-04-14T23:35:48.929957+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930191+0000","last_change":"2024-04-14T23:35:46.131620+0000","last_active":"2024-04-14T23:35:48.930191+0000","last_peered":"2024-04-14T23:35:48.930191+0000","last_clean":"2024-04-14T23:35:48.930191+0000","last_became_active":"2024-04-14T23:35:46.131245+0000","last_became_peered":"2024-04-14T23:35:46.131245+0000","last_unstale":"2024-04-14T23:35:48.930191+0000","last_undegraded":"2024-04-14T23:35:48.930191+0000","last_fullsized":"2024-04-14T23:35:48.930191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:43:31.510170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129762+0000","last_change":"2024-04-14T23:35:47.149519+0000","last_active":"2024-04-14T23:35:48.129762+0000","last_peered":"2024-04-14T23:35:48.129762+0000","last_clean":"2024-04-14T23:35:48.129762+0000","last_became_active":"2024-04-14T23:35:47.149206+0000","last_became_peered":"2024-04-14T23:35:47.149206+0000","last_unstale":"2024-04-14T23:35:48.129762+0000","last_undegraded":"2024-04-14T23:35:48.129762+0000","last_fullsized":"2024-04-14T23:35:48.129762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929811+0000","last_change":"2024-04-14T23:35:46.136409+0000","last_active":"2024-04-14T23:35:48.929811+0000","last_peered":"2024-04-14T23:35:48.929811+0000","last_clean":"2024-04-14T23:35:48.929811+0000","last_became_active":"2024-04-14T23:35:46.136141+0000","last_became_peered":"2024-04-14T23:35:46.136141+0000","last_unstale":"2024-04-14T23:35:48.929811+0000","last_undegraded":"2024-04-14T23:35:48.929811+0000","last_fullsized":"2024-04-14T23:35:48.929811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128851+0000","last_change":"2024-04-14T23:35:47.152792+0000","last_active":"2024-04-14T23:35:48.128851+0000","last_peered":"2024-04-14T23:35:48.128851+0000","last_clean":"2024-04-14T23:35:48.128851+0000","last_became_active":"2024-04-14T23:35:47.152529+0000","last_became_peered":"2024-04-14T23:35:47.152529+0000","last_unstale":"2024-04-14T23:35:48.128851+0000","last_undegraded":"2024-04-14T23:35:48.128851+0000","last_fullsized":"2024-04-14T23:35:48.128851+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:26:37.825904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930189+0000","last_change":"2024-04-14T23:35:46.131128+0000","last_active":"2024-04-14T23:35:48.930189+0000","last_peered":"2024-04-14T23:35:48.930189+0000","last_clean":"2024-04-14T23:35:48.930189+0000","last_became_active":"2024-04-14T23:35:46.130829+0000","last_became_peered":"2024-04-14T23:35:46.130829+0000","last_unstale":"2024-04-14T23:35:48.930189+0000","last_undegraded":"2024-04-14T23:35:48.930189+0000","last_fullsized":"2024-04-14T23:35:48.930189+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:26:22.509424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930226+0000","last_change":"2024-04-14T23:35:47.157604+0000","last_active":"2024-04-14T23:35:48.930226+0000","last_peered":"2024-04-14T23:35:48.930226+0000","last_clean":"2024-04-14T23:35:48.930226+0000","last_became_active":"2024-04-14T23:35:47.157332+0000","last_became_peered":"2024-04-14T23:35:47.157332+0000","last_unstale":"2024-04-14T23:35:48.930226+0000","last_undegraded":"2024-04-14T23:35:48.930226+0000","last_fullsized":"2024-04-14T23:35:48.930226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:27.967946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130676+0000","last_change":"2024-04-14T23:35:46.130670+0000","last_active":"2024-04-14T23:35:48.130676+0000","last_peered":"2024-04-14T23:35:48.130676+0000","last_clean":"2024-04-14T23:35:48.130676+0000","last_became_active":"2024-04-14T23:35:46.130053+0000","last_became_peered":"2024-04-14T23:35:46.130053+0000","last_unstale":"2024-04-14T23:35:48.130676+0000","last_undegraded":"2024-04-14T23:35:48.130676+0000","last_fullsized":"2024-04-14T23:35:48.130676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:11.829667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930021+0000","last_change":"2024-04-14T23:35:47.135664+0000","last_active":"2024-04-14T23:35:48.930021+0000","last_peered":"2024-04-14T23:35:48.930021+0000","last_clean":"2024-04-14T23:35:48.930021+0000","last_became_active":"2024-04-14T23:35:47.135290+0000","last_became_peered":"2024-04-14T23:35:47.135290+0000","last_unstale":"2024-04-14T23:35:48.930021+0000","last_undegraded":"2024-04-14T23:35:48.930021+0000","last_fullsized":"2024-04-14T23:35:48.930021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:18.147979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:49.131837+0000","last_change":"2024-04-14T23:35:46.133201+0000","last_active":"2024-04-14T23:35:49.131837+0000","last_peered":"2024-04-14T23:35:49.131837+0000","last_clean":"2024-04-14T23:35:49.131837+0000","last_became_active":"2024-04-14T23:35:46.132894+0000","last_became_peered":"2024-04-14T23:35:46.132894+0000","last_unstale":"2024-04-14T23:35:49.131837+0000","last_undegraded":"2024-04-14T23:35:49.131837+0000","last_fullsized":"2024-04-14T23:35:49.131837+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:23:21.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128887+0000","last_change":"2024-04-14T23:35:47.153255+0000","last_active":"2024-04-14T23:35:48.128887+0000","last_peered":"2024-04-14T23:35:48.128887+0000","last_clean":"2024-04-14T23:35:48.128887+0000","last_became_active":"2024-04-14T23:35:47.152994+0000","last_became_peered":"2024-04-14T23:35:47.152994+0000","last_unstale":"2024-04-14T23:35:48.128887+0000","last_undegraded":"2024-04-14T23:35:48.128887+0000","last_fullsized":"2024-04-14T23:35:48.128887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:32:36.376204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929974+0000","last_change":"2024-04-14T23:35:46.129019+0000","last_active":"2024-04-14T23:35:48.929974+0000","last_peered":"2024-04-14T23:35:48.929974+0000","last_clean":"2024-04-14T23:35:48.929974+0000","last_became_active":"2024-04-14T23:35:46.128736+0000","last_became_peered":"2024-04-14T23:35:46.128736+0000","last_unstale":"2024-04-14T23:35:48.929974+0000","last_undegraded":"2024-04-14T23:35:48.929974+0000","last_fullsized":"2024-04-14T23:35:48.929974+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:28.026305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929722+0000","last_change":"2024-04-14T23:35:47.146466+0000","last_active":"2024-04-14T23:35:48.929722+0000","last_peered":"2024-04-14T23:35:48.929722+0000","last_clean":"2024-04-14T23:35:48.929722+0000","last_became_active":"2024-04-14T23:35:47.146038+0000","last_became_peered":"2024-04-14T23:35:47.146038+0000","last_unstale":"2024-04-14T23:35:48.929722+0000","last_undegraded":"2024-04-14T23:35:48.929722+0000","last_fullsized":"2024-04-14T23:35:48.929722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:27.967946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929825+0000","last_change":"2024-04-14T23:35:46.137505+0000","last_active":"2024-04-14T23:35:48.929825+0000","last_peered":"2024-04-14T23:35:48.929825+0000","last_clean":"2024-04-14T23:35:48.929825+0000","last_became_active":"2024-04-14T23:35:46.137073+0000","last_became_peered":"2024-04-14T23:35:46.137073+0000","last_unstale":"2024-04-14T23:35:48.929825+0000","last_undegraded":"2024-04-14T23:35:48.929825+0000","last_fullsized":"2024-04-14T23:35:48.929825+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929904+0000","last_change":"2024-04-14T23:35:47.144646+0000","last_active":"2024-04-14T23:35:48.929904+0000","last_peered":"2024-04-14T23:35:48.929904+0000","last_clean":"2024-04-14T23:35:48.929904+0000","last_became_active":"2024-04-14T23:35:47.144302+0000","last_became_peered":"2024-04-14T23:35:47.144302+0000","last_unstale":"2024-04-14T23:35:48.929904+0000","last_undegraded":"2024-04-14T23:35:48.929904+0000","last_fullsized":"2024-04-14T23:35:48.929904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:38.502135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130300+0000","last_change":"2024-04-14T23:35:46.132200+0000","last_active":"2024-04-14T23:35:48.130300+0000","last_peered":"2024-04-14T23:35:48.130300+0000","last_clean":"2024-04-14T23:35:48.130300+0000","last_became_active":"2024-04-14T23:35:46.131951+0000","last_became_peered":"2024-04-14T23:35:46.131951+0000","last_unstale":"2024-04-14T23:35:48.130300+0000","last_undegraded":"2024-04-14T23:35:48.130300+0000","last_fullsized":"2024-04-14T23:35:48.130300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:50:42.618031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390704+0000","last_change":"2024-04-14T23:35:47.152240+0000","last_active":"2024-04-14T23:35:48.390704+0000","last_peered":"2024-04-14T23:35:48.390704+0000","last_clean":"2024-04-14T23:35:48.390704+0000","last_became_active":"2024-04-14T23:35:47.151949+0000","last_became_peered":"2024-04-14T23:35:47.151949+0000","last_unstale":"2024-04-14T23:35:48.390704+0000","last_undegraded":"2024-04-14T23:35:48.390704+0000","last_fullsized":"2024-04-14T23:35:48.390704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390467+0000","last_change":"2024-04-14T23:35:46.133774+0000","last_active":"2024-04-14T23:35:48.390467+0000","last_peered":"2024-04-14T23:35:48.390467+0000","last_clean":"2024-04-14T23:35:48.390467+0000","last_became_active":"2024-04-14T23:35:46.133248+0000","last_became_peered":"2024-04-14T23:35:46.133248+0000","last_unstale":"2024-04-14T23:35:48.390467+0000","last_undegraded":"2024-04-14T23:35:48.390467+0000","last_fullsized":"2024-04-14T23:35:48.390467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:10:15.375417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930207+0000","last_change":"2024-04-14T23:35:47.137101+0000","last_active":"2024-04-14T23:35:48.930207+0000","last_peered":"2024-04-14T23:35:48.930207+0000","last_clean":"2024-04-14T23:35:48.930207+0000","last_became_active":"2024-04-14T23:35:47.135299+0000","last_became_peered":"2024-04-14T23:35:47.135299+0000","last_unstale":"2024-04-14T23:35:48.930207+0000","last_undegraded":"2024-04-14T23:35:48.930207+0000","last_fullsized":"2024-04-14T23:35:48.930207+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:13:37.995199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128481+0000","last_change":"2024-04-14T23:35:46.130340+0000","last_active":"2024-04-14T23:35:48.128481+0000","last_peered":"2024-04-14T23:35:48.128481+0000","last_clean":"2024-04-14T23:35:48.128481+0000","last_became_active":"2024-04-14T23:35:46.129730+0000","last_became_peered":"2024-04-14T23:35:46.129730+0000","last_unstale":"2024-04-14T23:35:48.128481+0000","last_undegraded":"2024-04-14T23:35:48.128481+0000","last_fullsized":"2024-04-14T23:35:48.128481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:37.497838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130505+0000","last_change":"2024-04-14T23:35:47.158482+0000","last_active":"2024-04-14T23:35:48.130505+0000","last_peered":"2024-04-14T23:35:48.130505+0000","last_clean":"2024-04-14T23:35:48.130505+0000","last_became_active":"2024-04-14T23:35:47.158231+0000","last_became_peered":"2024-04-14T23:35:47.158231+0000","last_unstale":"2024-04-14T23:35:48.130505+0000","last_undegraded":"2024-04-14T23:35:48.130505+0000","last_fullsized":"2024-04-14T23:35:48.130505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:28:35.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929927+0000","last_change":"2024-04-14T23:35:46.136429+0000","last_active":"2024-04-14T23:35:48.929927+0000","last_peered":"2024-04-14T23:35:48.929927+0000","last_clean":"2024-04-14T23:35:48.929927+0000","last_became_active":"2024-04-14T23:35:46.136181+0000","last_became_peered":"2024-04-14T23:35:46.136181+0000","last_unstale":"2024-04-14T23:35:48.929927+0000","last_undegraded":"2024-04-14T23:35:48.929927+0000","last_fullsized":"2024-04-14T23:35:48.929927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:58:35.171753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929803+0000","last_change":"2024-04-14T23:34:27.438796+0000","last_active":"2024-04-14T23:35:48.929803+0000","last_peered":"2024-04-14T23:35:48.929803+0000","last_clean":"2024-04-14T23:35:48.929803+0000","last_became_active":"2024-04-14T23:34:27.437932+0000","last_became_peered":"2024-04-14T23:34:27.437932+0000","last_unstale":"2024-04-14T23:35:48.929803+0000","last_undegraded":"2024-04-14T23:35:48.929803+0000","last_fullsized":"2024-04-14T23:35:48.929803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_clean_scrub_stamp":"2024-04-14T23:34:26.390323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:11:13.484245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":7786,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1064960,"data_stored":792539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":471040,"data_stored":202135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":197243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":197263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":787575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T23:36:02.718 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T23:36:02.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.851+0000 7fc6bfc29640 1 Processor -- start 2024-04-14T23:36:02.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.851+0000 7fc6bfc29640 1 -- start start 2024-04-14T23:36:02.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.852+0000 7fc6bfc29640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc6b80d24e0 0x7fc6b816d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:02.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.852+0000 7fc6bfc29640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b8162d90 con 0x7fc6b80b3120 2024-04-14T23:36:02.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.852+0000 7fc6bfc29640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b80cf8f0 con 0x7fc6b80cf4f0 2024-04-14T23:36:02.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.852+0000 7fc6bfc29640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fc6b80b3500 con 0x7fc6b80d24e0 2024-04-14T23:36:02.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.852+0000 7fc6bd9c5640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc6b80b3120 0x7fc6b80d2970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49926/0 (socket says 172.21.15.47:49926) 2024-04-14T23:36:02.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.852+0000 7fc6bd9c5640 1 -- 172.21.15.47:0/1555857424 learned_addr learned my addr 172.21.15.47:0/1555857424 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:02.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.853+0000 7fc6be1c6640 1 --2- 172.21.15.47:0/1555857424 >> v2:172.21.15.191:3300/0 conn(0x7fc6b80d24e0 0x7fc6b816d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:02.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.853+0000 7fc6bc9c3640 1 -- 172.21.15.47:0/1555857424 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 817570011 0 0) 0x7fc6b8162d90 con 0x7fc6b80b3120 2024-04-14T23:36:02.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.853+0000 7fc6bc9c3640 1 -- 172.21.15.47:0/1555857424 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6a0003520 con 0x7fc6b80b3120 2024-04-14T23:36:02.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.853+0000 7fc6be1c6640 1 -- 172.21.15.47:0/1555857424 >> v1:172.21.15.191:6789/0 conn(0x7fc6b80cf4f0 legacy=0x7fc6b80d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:02.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.853+0000 7fc6bc9c3640 1 -- 172.21.15.47:0/1555857424 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3983756408 0 0) 0x7fc6a0003520 con 0x7fc6b80b3120 2024-04-14T23:36:02.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.853+0000 7fc6be1c6640 1 -- 172.21.15.47:0/1555857424 >> v1:172.21.15.47:6789/0 conn(0x7fc6b80b3120 legacy=0x7fc6b80d2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:02.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.853+0000 7fc6be1c6640 1 -- 172.21.15.47:0/1555857424 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b80cfb90 con 0x7fc6b80d24e0 2024-04-14T23:36:02.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.854+0000 7fc6be1c6640 1 --2- 172.21.15.47:0/1555857424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6b80d24e0 0x7fc6b816d4a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009720 tx=0x7fc6b002b620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b74f40740ae6c6c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:02.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.854+0000 7fc6bc9c3640 1 -- 172.21.15.47:0/1555857424 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0037070 con 0x7fc6b80d24e0 2024-04-14T23:36:02.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.854+0000 7fc6bc9c3640 1 -- 172.21.15.47:0/1555857424 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6b0030510 con 0x7fc6b80d24e0 2024-04-14T23:36:02.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.854+0000 7fc6bc9c3640 1 -- 172.21.15.47:0/1555857424 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a80019f0 con 0x7fc6b80d24e0 2024-04-14T23:36:02.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.854+0000 7fc6bfc29640 1 -- 172.21.15.47:0/1555857424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6b80d24e0 msgr2=0x7fc6b816d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:02.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.854+0000 7fc6bfc29640 1 --2- 172.21.15.47:0/1555857424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6b80d24e0 0x7fc6b816d4a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009720 tx=0x7fc6b002b620 comp rx=0 tx=0).stop 2024-04-14T23:36:02.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.854+0000 7fc6bfc29640 1 -- 172.21.15.47:0/1555857424 shutdown_connections 2024-04-14T23:36:02.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.854+0000 7fc6bfc29640 1 --2- 172.21.15.47:0/1555857424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6b80d24e0 0x7fc6b816d4a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:02.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.854+0000 7fc6bfc29640 1 -- 172.21.15.47:0/1555857424 >> 172.21.15.47:0/1555857424 conn(0x7fc6b80d3ed0 msgr2=0x7fc6b80d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:02.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.855+0000 7fc6bfc29640 1 -- 172.21.15.47:0/1555857424 shutdown_connections 2024-04-14T23:36:02.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.855+0000 7fc6bfc29640 1 -- 172.21.15.47:0/1555857424 wait complete. 2024-04-14T23:36:02.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.856+0000 7fc6bfc29640 1 Processor -- start 2024-04-14T23:36:02.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.856+0000 7fc6bfc29640 1 -- start start 2024-04-14T23:36:02.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.856+0000 7fc6bfc29640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6b80b3120 0x7fc6b8154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:02.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.856+0000 7fc6bfc29640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6b80cf4f0 0x7fc6b80c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:02.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.856+0000 7fc6bfc29640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6b80d24e0 0x7fc6b81535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:02.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.856+0000 7fc6bfc29640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b80b5250 con 0x7fc6b80b3120 2024-04-14T23:36:02.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.856+0000 7fc6bfc29640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b80b3a40 con 0x7fc6b80cf4f0 2024-04-14T23:36:02.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.856+0000 7fc6bfc29640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc6b80b53d0 con 0x7fc6b80d24e0 2024-04-14T23:36:02.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.856+0000 7fc6bd9c5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6b80b3120 0x7fc6b8154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:02.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.857+0000 7fc6bd9c5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6b80b3120 0x7fc6b8154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43740/0 (socket says 172.21.15.47:43740) 2024-04-14T23:36:02.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.857+0000 7fc6bd9c5640 1 -- 172.21.15.47:0/1802588925 learned_addr learned my addr 172.21.15.47:0/1802588925 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:02.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.857+0000 7fc6be1c6640 1 --2- 172.21.15.47:0/1802588925 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6b80d24e0 0x7fc6b81535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:02.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.857+0000 7fc6bd1c4640 1 --2- 172.21.15.47:0/1802588925 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6b80cf4f0 0x7fc6b80c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:02.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.857+0000 7fc6bd9c5640 1 -- 172.21.15.47:0/1802588925 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6b80d24e0 msgr2=0x7fc6b81535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:02.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.857+0000 7fc6bd9c5640 1 --2- 172.21.15.47:0/1802588925 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6b80d24e0 0x7fc6b81535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:02.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.857+0000 7fc6bd9c5640 1 -- 172.21.15.47:0/1802588925 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6b80cf4f0 msgr2=0x7fc6b80c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:02.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.857+0000 7fc6bd9c5640 1 --2- 172.21.15.47:0/1802588925 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6b80cf4f0 0x7fc6b80c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:02.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.857+0000 7fc6bd9c5640 1 -- 172.21.15.47:0/1802588925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b8161470 con 0x7fc6b80b3120 2024-04-14T23:36:02.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.857+0000 7fc6bd9c5640 1 --2- 172.21.15.47:0/1802588925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6b80b3120 0x7fc6b8154b00 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc6a800c8c0 tx=0x7fc6a800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:02.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.857+0000 7fc6b67fc640 1 -- 172.21.15.47:0/1802588925 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8018070 con 0x7fc6b80b3120 2024-04-14T23:36:02.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.857+0000 7fc6b67fc640 1 -- 172.21.15.47:0/1802588925 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a800a5e0 con 0x7fc6b80b3120 2024-04-14T23:36:02.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.857+0000 7fc6bfc29640 1 -- 172.21.15.47:0/1802588925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b8155040 con 0x7fc6b80b3120 2024-04-14T23:36:02.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.857+0000 7fc6b67fc640 1 -- 172.21.15.47:0/1802588925 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800a9d0 con 0x7fc6b80b3120 2024-04-14T23:36:02.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.857+0000 7fc6bfc29640 1 -- 172.21.15.47:0/1802588925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b81527e0 con 0x7fc6b80b3120 2024-04-14T23:36:02.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.858+0000 7fc6bfc29640 1 -- 172.21.15.47:0/1802588925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b8075430 con 0x7fc6b80b3120 2024-04-14T23:36:02.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.859+0000 7fc6b67fc640 1 -- 172.21.15.47:0/1802588925 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc6a801b070 con 0x7fc6b80b3120 2024-04-14T23:36:02.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.859+0000 7fc6b67fc640 1 --2- 172.21.15.47:0/1802588925 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc6a406b990 0x7fc6a406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:02.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.859+0000 7fc6b67fc640 1 -- 172.21.15.47:0/1802588925 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fc6a808a150 con 0x7fc6b80b3120 2024-04-14T23:36:02.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.860+0000 7fc6bd1c4640 1 --2- 172.21.15.47:0/1802588925 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc6a406b990 0x7fc6a406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:02.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.860+0000 7fc6bd1c4640 1 --2- 172.21.15.47:0/1802588925 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc6a406b990 0x7fc6a406de50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc6b81fb880 tx=0x7fc6ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:02.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:02.864+0000 7fc6b67fc640 1 -- 172.21.15.47:0/1802588925 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc6a8058580 con 0x7fc6b80b3120 2024-04-14T23:36:03.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.040+0000 7fc6bfc29640 1 -- 172.21.15.47:0/1802588925 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6b80cef10 con 0x7fc6a406b990 2024-04-14T23:36:03.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.047+0000 7fc6b67fc640 1 -- 172.21.15.47:0/1802588925 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251850 (secure 0 0 0) 0x7fc6b80cef10 con 0x7fc6a406b990 2024-04-14T23:36:03.052 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:36:03.053 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-14T23:36:03.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.049+0000 7fc6bfc29640 1 -- 172.21.15.47:0/1802588925 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc6a406b990 msgr2=0x7fc6a406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:03.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.049+0000 7fc6bfc29640 1 --2- 172.21.15.47:0/1802588925 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc6a406b990 0x7fc6a406de50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc6b81fb880 tx=0x7fc6ac009040 comp rx=0 tx=0).stop 2024-04-14T23:36:03.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.049+0000 7fc6bfc29640 1 -- 172.21.15.47:0/1802588925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6b80b3120 msgr2=0x7fc6b8154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:03.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.049+0000 7fc6bfc29640 1 --2- 172.21.15.47:0/1802588925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6b80b3120 0x7fc6b8154b00 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc6a800c8c0 tx=0x7fc6a800cd80 comp rx=0 tx=0).stop 2024-04-14T23:36:03.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.049+0000 7fc6bfc29640 1 -- 172.21.15.47:0/1802588925 shutdown_connections 2024-04-14T23:36:03.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.049+0000 7fc6bfc29640 1 --2- 172.21.15.47:0/1802588925 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc6a406b990 0x7fc6a406de50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.049+0000 7fc6bfc29640 1 --2- 172.21.15.47:0/1802588925 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6b80d24e0 0x7fc6b81535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.049+0000 7fc6bfc29640 1 --2- 172.21.15.47:0/1802588925 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6b80cf4f0 0x7fc6b80c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.049+0000 7fc6bfc29640 1 --2- 172.21.15.47:0/1802588925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6b80b3120 0x7fc6b8154b00 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.049+0000 7fc6bfc29640 1 -- 172.21.15.47:0/1802588925 >> 172.21.15.47:0/1802588925 conn(0x7fc6b80d3ed0 msgr2=0x7fc6b80b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:03.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.049+0000 7fc6bfc29640 1 -- 172.21.15.47:0/1802588925 shutdown_connections 2024-04-14T23:36:03.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.049+0000 7fc6bfc29640 1 -- 172.21.15.47:0/1802588925 wait complete. 2024-04-14T23:36:03.063 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-04-14T23:36:02.377899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598154,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237544,"kb_used_data":4752,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737176,"statfs":{"total":773094113280,"available":772850868224,"internally_reserved":0,"allocated":4866048,"data_stored":2769572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7786,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003107"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128934+0000","last_change":"2024-04-14T23:35:47.145996+0000","last_active":"2024-04-14T23:35:48.128934+0000","last_peered":"2024-04-14T23:35:48.128934+0000","last_clean":"2024-04-14T23:35:48.128934+0000","last_became_active":"2024-04-14T23:35:47.145716+0000","last_became_peered":"2024-04-14T23:35:47.145716+0000","last_unstale":"2024-04-14T23:35:48.128934+0000","last_undegraded":"2024-04-14T23:35:48.128934+0000","last_fullsized":"2024-04-14T23:35:48.128934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:17:32.571374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128951+0000","last_change":"2024-04-14T23:35:47.154551+0000","last_active":"2024-04-14T23:35:48.128951+0000","last_peered":"2024-04-14T23:35:48.128951+0000","last_clean":"2024-04-14T23:35:48.128951+0000","last_became_active":"2024-04-14T23:35:47.154286+0000","last_became_peered":"2024-04-14T23:35:47.154286+0000","last_unstale":"2024-04-14T23:35:48.128951+0000","last_undegraded":"2024-04-14T23:35:48.128951+0000","last_fullsized":"2024-04-14T23:35:48.128951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:07:06.644232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929709+0000","last_change":"2024-04-14T23:35:47.160513+0000","last_active":"2024-04-14T23:35:48.929709+0000","last_peered":"2024-04-14T23:35:48.929709+0000","last_clean":"2024-04-14T23:35:48.929709+0000","last_became_active":"2024-04-14T23:35:47.160208+0000","last_became_peered":"2024-04-14T23:35:47.160208+0000","last_unstale":"2024-04-14T23:35:48.929709+0000","last_undegraded":"2024-04-14T23:35:48.929709+0000","last_fullsized":"2024-04-14T23:35:48.929709+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:38.502135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930879+0000","last_change":"2024-04-14T23:35:47.153454+0000","last_active":"2024-04-14T23:35:48.930879+0000","last_peered":"2024-04-14T23:35:48.930879+0000","last_clean":"2024-04-14T23:35:48.930879+0000","last_became_active":"2024-04-14T23:35:47.153133+0000","last_became_peered":"2024-04-14T23:35:47.153133+0000","last_unstale":"2024-04-14T23:35:48.930879+0000","last_undegraded":"2024-04-14T23:35:48.930879+0000","last_fullsized":"2024-04-14T23:35:48.930879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:58:36.176049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930648+0000","last_change":"2024-04-14T23:35:47.154211+0000","last_active":"2024-04-14T23:35:48.930648+0000","last_peered":"2024-04-14T23:35:48.930648+0000","last_clean":"2024-04-14T23:35:48.930648+0000","last_became_active":"2024-04-14T23:35:47.153936+0000","last_became_peered":"2024-04-14T23:35:47.153936+0000","last_unstale":"2024-04-14T23:35:48.930648+0000","last_undegraded":"2024-04-14T23:35:48.930648+0000","last_fullsized":"2024-04-14T23:35:48.930648+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:07:13.534770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929869+0000","last_change":"2024-04-14T23:35:47.143406+0000","last_active":"2024-04-14T23:35:48.929869+0000","last_peered":"2024-04-14T23:35:48.929869+0000","last_clean":"2024-04-14T23:35:48.929869+0000","last_became_active":"2024-04-14T23:35:47.143142+0000","last_became_peered":"2024-04-14T23:35:47.143142+0000","last_unstale":"2024-04-14T23:35:48.929869+0000","last_undegraded":"2024-04-14T23:35:48.929869+0000","last_fullsized":"2024-04-14T23:35:48.929869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:49.647834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129403+0000","last_change":"2024-04-14T23:35:47.159443+0000","last_active":"2024-04-14T23:35:48.129403+0000","last_peered":"2024-04-14T23:35:48.129403+0000","last_clean":"2024-04-14T23:35:48.129403+0000","last_became_active":"2024-04-14T23:35:47.157644+0000","last_became_peered":"2024-04-14T23:35:47.157644+0000","last_unstale":"2024-04-14T23:35:48.129403+0000","last_undegraded":"2024-04-14T23:35:48.129403+0000","last_fullsized":"2024-04-14T23:35:48.129403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128520+0000","last_change":"2024-04-14T23:35:47.150895+0000","last_active":"2024-04-14T23:35:48.128520+0000","last_peered":"2024-04-14T23:35:48.128520+0000","last_clean":"2024-04-14T23:35:48.128520+0000","last_became_active":"2024-04-14T23:35:47.150520+0000","last_became_peered":"2024-04-14T23:35:47.150520+0000","last_unstale":"2024-04-14T23:35:48.128520+0000","last_undegraded":"2024-04-14T23:35:48.128520+0000","last_fullsized":"2024-04-14T23:35:48.128520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:00.141829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930024+0000","last_change":"2024-04-14T23:35:47.160830+0000","last_active":"2024-04-14T23:35:48.930024+0000","last_peered":"2024-04-14T23:35:48.930024+0000","last_clean":"2024-04-14T23:35:48.930024+0000","last_became_active":"2024-04-14T23:35:47.160554+0000","last_became_peered":"2024-04-14T23:35:47.160554+0000","last_unstale":"2024-04-14T23:35:48.930024+0000","last_undegraded":"2024-04-14T23:35:48.930024+0000","last_fullsized":"2024-04-14T23:35:48.930024+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130272+0000","last_change":"2024-04-14T23:35:47.157661+0000","last_active":"2024-04-14T23:35:48.130272+0000","last_peered":"2024-04-14T23:35:48.130272+0000","last_clean":"2024-04-14T23:35:48.130272+0000","last_became_active":"2024-04-14T23:35:47.157377+0000","last_became_peered":"2024-04-14T23:35:47.157377+0000","last_unstale":"2024-04-14T23:35:48.130272+0000","last_undegraded":"2024-04-14T23:35:48.130272+0000","last_fullsized":"2024-04-14T23:35:48.130272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:54:50.487935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130985+0000","last_change":"2024-04-14T23:35:47.153073+0000","last_active":"2024-04-14T23:35:48.130985+0000","last_peered":"2024-04-14T23:35:48.130985+0000","last_clean":"2024-04-14T23:35:48.130985+0000","last_became_active":"2024-04-14T23:35:47.152649+0000","last_became_peered":"2024-04-14T23:35:47.152649+0000","last_unstale":"2024-04-14T23:35:48.130985+0000","last_undegraded":"2024-04-14T23:35:48.130985+0000","last_fullsized":"2024-04-14T23:35:48.130985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:47:32.718724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930449+0000","last_change":"2024-04-14T23:35:47.149389+0000","last_active":"2024-04-14T23:35:48.930449+0000","last_peered":"2024-04-14T23:35:48.930449+0000","last_clean":"2024-04-14T23:35:48.930449+0000","last_became_active":"2024-04-14T23:35:47.149130+0000","last_became_peered":"2024-04-14T23:35:47.149130+0000","last_unstale":"2024-04-14T23:35:48.930449+0000","last_undegraded":"2024-04-14T23:35:48.930449+0000","last_fullsized":"2024-04-14T23:35:48.930449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129857+0000","last_change":"2024-04-14T23:35:47.153273+0000","last_active":"2024-04-14T23:35:48.129857+0000","last_peered":"2024-04-14T23:35:48.129857+0000","last_clean":"2024-04-14T23:35:48.129857+0000","last_became_active":"2024-04-14T23:35:47.153005+0000","last_became_peered":"2024-04-14T23:35:47.153005+0000","last_unstale":"2024-04-14T23:35:48.129857+0000","last_undegraded":"2024-04-14T23:35:48.129857+0000","last_fullsized":"2024-04-14T23:35:48.129857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:33:25.414410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390635+0000","last_change":"2024-04-14T23:35:47.152798+0000","last_active":"2024-04-14T23:35:48.390635+0000","last_peered":"2024-04-14T23:35:48.390635+0000","last_clean":"2024-04-14T23:35:48.390635+0000","last_became_active":"2024-04-14T23:35:47.152530+0000","last_became_peered":"2024-04-14T23:35:47.152530+0000","last_unstale":"2024-04-14T23:35:48.390635+0000","last_undegraded":"2024-04-14T23:35:48.390635+0000","last_fullsized":"2024-04-14T23:35:48.390635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129640+0000","last_change":"2024-04-14T23:35:47.157364+0000","last_active":"2024-04-14T23:35:48.129640+0000","last_peered":"2024-04-14T23:35:48.129640+0000","last_clean":"2024-04-14T23:35:48.129640+0000","last_became_active":"2024-04-14T23:35:47.157069+0000","last_became_peered":"2024-04-14T23:35:47.157069+0000","last_unstale":"2024-04-14T23:35:48.129640+0000","last_undegraded":"2024-04-14T23:35:48.129640+0000","last_fullsized":"2024-04-14T23:35:48.129640+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929628+0000","last_change":"2024-04-14T23:35:47.157646+0000","last_active":"2024-04-14T23:35:48.929628+0000","last_peered":"2024-04-14T23:35:48.929628+0000","last_clean":"2024-04-14T23:35:48.929628+0000","last_became_active":"2024-04-14T23:35:47.157374+0000","last_became_peered":"2024-04-14T23:35:47.157374+0000","last_unstale":"2024-04-14T23:35:48.929628+0000","last_undegraded":"2024-04-14T23:35:48.929628+0000","last_fullsized":"2024-04-14T23:35:48.929628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:49.647834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930137+0000","last_change":"2024-04-14T23:35:47.160288+0000","last_active":"2024-04-14T23:35:48.930137+0000","last_peered":"2024-04-14T23:35:48.930137+0000","last_clean":"2024-04-14T23:35:48.930137+0000","last_became_active":"2024-04-14T23:35:47.160045+0000","last_became_peered":"2024-04-14T23:35:47.160045+0000","last_unstale":"2024-04-14T23:35:48.930137+0000","last_undegraded":"2024-04-14T23:35:48.930137+0000","last_fullsized":"2024-04-14T23:35:48.930137+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:33:25.414410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130094+0000","last_change":"2024-04-14T23:35:47.150954+0000","last_active":"2024-04-14T23:35:48.130094+0000","last_peered":"2024-04-14T23:35:48.130094+0000","last_clean":"2024-04-14T23:35:48.130094+0000","last_became_active":"2024-04-14T23:35:47.150606+0000","last_became_peered":"2024-04-14T23:35:47.150606+0000","last_unstale":"2024-04-14T23:35:48.130094+0000","last_undegraded":"2024-04-14T23:35:48.130094+0000","last_fullsized":"2024-04-14T23:35:48.130094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:39.427143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930862+0000","last_change":"2024-04-14T23:35:47.137492+0000","last_active":"2024-04-14T23:35:48.930862+0000","last_peered":"2024-04-14T23:35:48.930862+0000","last_clean":"2024-04-14T23:35:48.930862+0000","last_became_active":"2024-04-14T23:35:47.137234+0000","last_became_peered":"2024-04-14T23:35:47.137234+0000","last_unstale":"2024-04-14T23:35:48.930862+0000","last_undegraded":"2024-04-14T23:35:48.930862+0000","last_fullsized":"2024-04-14T23:35:48.930862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:30:05.284391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129997+0000","last_change":"2024-04-14T23:35:47.150013+0000","last_active":"2024-04-14T23:35:48.129997+0000","last_peered":"2024-04-14T23:35:48.129997+0000","last_clean":"2024-04-14T23:35:48.129997+0000","last_became_active":"2024-04-14T23:35:47.149754+0000","last_became_peered":"2024-04-14T23:35:47.149754+0000","last_unstale":"2024-04-14T23:35:48.129997+0000","last_undegraded":"2024-04-14T23:35:48.129997+0000","last_fullsized":"2024-04-14T23:35:48.129997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:12.344810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129783+0000","last_change":"2024-04-14T23:35:47.149073+0000","last_active":"2024-04-14T23:35:48.129783+0000","last_peered":"2024-04-14T23:35:48.129783+0000","last_clean":"2024-04-14T23:35:48.129783+0000","last_became_active":"2024-04-14T23:35:47.148806+0000","last_became_peered":"2024-04-14T23:35:47.148806+0000","last_unstale":"2024-04-14T23:35:48.129783+0000","last_undegraded":"2024-04-14T23:35:48.129783+0000","last_fullsized":"2024-04-14T23:35:48.129783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:18.147979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391033+0000","last_change":"2024-04-14T23:35:47.154397+0000","last_active":"2024-04-14T23:35:48.391033+0000","last_peered":"2024-04-14T23:35:48.391033+0000","last_clean":"2024-04-14T23:35:48.391033+0000","last_became_active":"2024-04-14T23:35:47.154054+0000","last_became_peered":"2024-04-14T23:35:47.154054+0000","last_unstale":"2024-04-14T23:35:48.391033+0000","last_undegraded":"2024-04-14T23:35:48.391033+0000","last_fullsized":"2024-04-14T23:35:48.391033+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:13:37.995199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929730+0000","last_change":"2024-04-14T23:35:47.135157+0000","last_active":"2024-04-14T23:35:48.929730+0000","last_peered":"2024-04-14T23:35:48.929730+0000","last_clean":"2024-04-14T23:35:48.929730+0000","last_became_active":"2024-04-14T23:35:47.134846+0000","last_became_peered":"2024-04-14T23:35:47.134846+0000","last_unstale":"2024-04-14T23:35:48.929730+0000","last_undegraded":"2024-04-14T23:35:48.929730+0000","last_fullsized":"2024-04-14T23:35:48.929730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:38.502135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930226+0000","last_change":"2024-04-14T23:35:47.134176+0000","last_active":"2024-04-14T23:35:48.930226+0000","last_peered":"2024-04-14T23:35:48.930226+0000","last_clean":"2024-04-14T23:35:48.930226+0000","last_became_active":"2024-04-14T23:35:47.133837+0000","last_became_peered":"2024-04-14T23:35:47.133837+0000","last_unstale":"2024-04-14T23:35:48.930226+0000","last_undegraded":"2024-04-14T23:35:48.930226+0000","last_fullsized":"2024-04-14T23:35:48.930226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:13:32.134259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130962+0000","last_change":"2024-04-14T23:35:47.141736+0000","last_active":"2024-04-14T23:35:48.130962+0000","last_peered":"2024-04-14T23:35:48.130962+0000","last_clean":"2024-04-14T23:35:48.130962+0000","last_became_active":"2024-04-14T23:35:47.141474+0000","last_became_peered":"2024-04-14T23:35:47.141474+0000","last_unstale":"2024-04-14T23:35:48.130962+0000","last_undegraded":"2024-04-14T23:35:48.130962+0000","last_fullsized":"2024-04-14T23:35:48.130962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:31:38.223026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930267+0000","last_change":"2024-04-14T23:35:47.151371+0000","last_active":"2024-04-14T23:35:48.930267+0000","last_peered":"2024-04-14T23:35:48.930267+0000","last_clean":"2024-04-14T23:35:48.930267+0000","last_became_active":"2024-04-14T23:35:47.151113+0000","last_became_peered":"2024-04-14T23:35:47.151113+0000","last_unstale":"2024-04-14T23:35:48.930267+0000","last_undegraded":"2024-04-14T23:35:48.930267+0000","last_fullsized":"2024-04-14T23:35:48.930267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:26.044901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130325+0000","last_change":"2024-04-14T23:35:47.144676+0000","last_active":"2024-04-14T23:35:48.130325+0000","last_peered":"2024-04-14T23:35:48.130325+0000","last_clean":"2024-04-14T23:35:48.130325+0000","last_became_active":"2024-04-14T23:35:47.144429+0000","last_became_peered":"2024-04-14T23:35:47.144429+0000","last_unstale":"2024-04-14T23:35:48.130325+0000","last_undegraded":"2024-04-14T23:35:48.130325+0000","last_fullsized":"2024-04-14T23:35:48.130325+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:40.857176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130449+0000","last_change":"2024-04-14T23:35:47.149677+0000","last_active":"2024-04-14T23:35:48.130449+0000","last_peered":"2024-04-14T23:35:48.130449+0000","last_clean":"2024-04-14T23:35:48.130449+0000","last_became_active":"2024-04-14T23:35:47.149370+0000","last_became_peered":"2024-04-14T23:35:47.149370+0000","last_unstale":"2024-04-14T23:35:48.130449+0000","last_undegraded":"2024-04-14T23:35:48.130449+0000","last_fullsized":"2024-04-14T23:35:48.130449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:56:02.290384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130652+0000","last_change":"2024-04-14T23:35:47.138179+0000","last_active":"2024-04-14T23:35:48.130652+0000","last_peered":"2024-04-14T23:35:48.130652+0000","last_clean":"2024-04-14T23:35:48.130652+0000","last_became_active":"2024-04-14T23:35:47.137917+0000","last_became_peered":"2024-04-14T23:35:47.137917+0000","last_unstale":"2024-04-14T23:35:48.130652+0000","last_undegraded":"2024-04-14T23:35:48.130652+0000","last_fullsized":"2024-04-14T23:35:48.130652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:10:16.379713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130246+0000","last_change":"2024-04-14T23:35:47.140281+0000","last_active":"2024-04-14T23:35:48.130246+0000","last_peered":"2024-04-14T23:35:48.130246+0000","last_clean":"2024-04-14T23:35:48.130246+0000","last_became_active":"2024-04-14T23:35:47.140018+0000","last_became_peered":"2024-04-14T23:35:47.140018+0000","last_unstale":"2024-04-14T23:35:48.130246+0000","last_undegraded":"2024-04-14T23:35:48.130246+0000","last_fullsized":"2024-04-14T23:35:48.130246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:12.833964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929754+0000","last_change":"2024-04-14T23:35:47.150510+0000","last_active":"2024-04-14T23:35:48.929754+0000","last_peered":"2024-04-14T23:35:48.929754+0000","last_clean":"2024-04-14T23:35:48.929754+0000","last_became_active":"2024-04-14T23:35:47.150210+0000","last_became_peered":"2024-04-14T23:35:47.150210+0000","last_unstale":"2024-04-14T23:35:48.929754+0000","last_undegraded":"2024-04-14T23:35:48.929754+0000","last_fullsized":"2024-04-14T23:35:48.929754+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:27.967946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929546+0000","last_change":"2024-04-14T23:35:47.154478+0000","last_active":"2024-04-14T23:35:48.929546+0000","last_peered":"2024-04-14T23:35:48.929546+0000","last_clean":"2024-04-14T23:35:48.929546+0000","last_became_active":"2024-04-14T23:35:47.154196+0000","last_became_peered":"2024-04-14T23:35:47.154196+0000","last_unstale":"2024-04-14T23:35:48.929546+0000","last_undegraded":"2024-04-14T23:35:48.929546+0000","last_fullsized":"2024-04-14T23:35:48.929546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:47:00.159204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929959+0000","last_change":"2024-04-14T23:35:47.157634+0000","last_active":"2024-04-14T23:35:48.929959+0000","last_peered":"2024-04-14T23:35:48.929959+0000","last_clean":"2024-04-14T23:35:48.929959+0000","last_became_active":"2024-04-14T23:35:47.157342+0000","last_became_peered":"2024-04-14T23:35:47.157342+0000","last_unstale":"2024-04-14T23:35:48.929959+0000","last_undegraded":"2024-04-14T23:35:48.929959+0000","last_fullsized":"2024-04-14T23:35:48.929959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130857+0000","last_change":"2024-04-14T23:35:46.130076+0000","last_active":"2024-04-14T23:35:48.130857+0000","last_peered":"2024-04-14T23:35:48.130857+0000","last_clean":"2024-04-14T23:35:48.130857+0000","last_became_active":"2024-04-14T23:35:46.129786+0000","last_became_peered":"2024-04-14T23:35:46.129786+0000","last_unstale":"2024-04-14T23:35:48.130857+0000","last_undegraded":"2024-04-14T23:35:48.130857+0000","last_fullsized":"2024-04-14T23:35:48.130857+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:55:49.584788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930680+0000","last_change":"2024-04-14T23:35:47.157788+0000","last_active":"2024-04-14T23:35:48.930680+0000","last_peered":"2024-04-14T23:35:48.930680+0000","last_clean":"2024-04-14T23:35:48.930680+0000","last_became_active":"2024-04-14T23:35:47.157538+0000","last_became_peered":"2024-04-14T23:35:47.157538+0000","last_unstale":"2024-04-14T23:35:48.930680+0000","last_undegraded":"2024-04-14T23:35:48.930680+0000","last_fullsized":"2024-04-14T23:35:48.930680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929932+0000","last_change":"2024-04-14T23:35:46.136432+0000","last_active":"2024-04-14T23:35:48.929932+0000","last_peered":"2024-04-14T23:35:48.929932+0000","last_clean":"2024-04-14T23:35:48.929932+0000","last_became_active":"2024-04-14T23:35:46.136168+0000","last_became_peered":"2024-04-14T23:35:46.136168+0000","last_unstale":"2024-04-14T23:35:48.929932+0000","last_undegraded":"2024-04-14T23:35:48.929932+0000","last_fullsized":"2024-04-14T23:35:48.929932+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:11.340513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391012+0000","last_change":"2024-04-14T23:35:47.149283+0000","last_active":"2024-04-14T23:35:48.391012+0000","last_peered":"2024-04-14T23:35:48.391012+0000","last_clean":"2024-04-14T23:35:48.391012+0000","last_became_active":"2024-04-14T23:35:47.148963+0000","last_became_peered":"2024-04-14T23:35:47.148963+0000","last_unstale":"2024-04-14T23:35:48.391012+0000","last_undegraded":"2024-04-14T23:35:48.391012+0000","last_fullsized":"2024-04-14T23:35:48.391012+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:33:25.414410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930741+0000","last_change":"2024-04-14T23:35:46.137540+0000","last_active":"2024-04-14T23:35:48.930741+0000","last_peered":"2024-04-14T23:35:48.930741+0000","last_clean":"2024-04-14T23:35:48.930741+0000","last_became_active":"2024-04-14T23:35:46.137096+0000","last_became_peered":"2024-04-14T23:35:46.137096+0000","last_unstale":"2024-04-14T23:35:48.930741+0000","last_undegraded":"2024-04-14T23:35:48.930741+0000","last_fullsized":"2024-04-14T23:35:48.930741+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128931+0000","last_change":"2024-04-14T23:35:47.146618+0000","last_active":"2024-04-14T23:35:48.128931+0000","last_peered":"2024-04-14T23:35:48.128931+0000","last_clean":"2024-04-14T23:35:48.128931+0000","last_became_active":"2024-04-14T23:35:47.146329+0000","last_became_peered":"2024-04-14T23:35:47.146329+0000","last_unstale":"2024-04-14T23:35:48.128931+0000","last_undegraded":"2024-04-14T23:35:48.128931+0000","last_fullsized":"2024-04-14T23:35:48.128931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:59:58.258654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390798+0000","last_change":"2024-04-14T23:35:46.133465+0000","last_active":"2024-04-14T23:35:48.390798+0000","last_peered":"2024-04-14T23:35:48.390798+0000","last_clean":"2024-04-14T23:35:48.390798+0000","last_became_active":"2024-04-14T23:35:46.133188+0000","last_became_peered":"2024-04-14T23:35:46.133188+0000","last_unstale":"2024-04-14T23:35:48.390798+0000","last_undegraded":"2024-04-14T23:35:48.390798+0000","last_fullsized":"2024-04-14T23:35:48.390798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:38.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929549+0000","last_change":"2024-04-14T23:35:47.142488+0000","last_active":"2024-04-14T23:35:48.929549+0000","last_peered":"2024-04-14T23:35:48.929549+0000","last_clean":"2024-04-14T23:35:48.929549+0000","last_became_active":"2024-04-14T23:35:47.142140+0000","last_became_peered":"2024-04-14T23:35:47.142140+0000","last_unstale":"2024-04-14T23:35:48.929549+0000","last_undegraded":"2024-04-14T23:35:48.929549+0000","last_fullsized":"2024-04-14T23:35:48.929549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:47:00.159204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129923+0000","last_change":"2024-04-14T23:35:46.135150+0000","last_active":"2024-04-14T23:35:48.129923+0000","last_peered":"2024-04-14T23:35:48.129923+0000","last_clean":"2024-04-14T23:35:48.129923+0000","last_became_active":"2024-04-14T23:35:46.134786+0000","last_became_peered":"2024-04-14T23:35:46.134786+0000","last_unstale":"2024-04-14T23:35:48.129923+0000","last_undegraded":"2024-04-14T23:35:48.129923+0000","last_fullsized":"2024-04-14T23:35:48.129923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:28.026305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130028+0000","last_change":"2024-04-14T23:35:47.159541+0000","last_active":"2024-04-14T23:35:48.130028+0000","last_peered":"2024-04-14T23:35:48.130028+0000","last_clean":"2024-04-14T23:35:48.130028+0000","last_became_active":"2024-04-14T23:35:47.158355+0000","last_became_peered":"2024-04-14T23:35:47.158355+0000","last_unstale":"2024-04-14T23:35:48.130028+0000","last_undegraded":"2024-04-14T23:35:48.130028+0000","last_fullsized":"2024-04-14T23:35:48.130028+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:13:37.995199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929626+0000","last_change":"2024-04-14T23:35:46.139410+0000","last_active":"2024-04-14T23:35:48.929626+0000","last_peered":"2024-04-14T23:35:48.929626+0000","last_clean":"2024-04-14T23:35:48.929626+0000","last_became_active":"2024-04-14T23:35:46.138931+0000","last_became_peered":"2024-04-14T23:35:46.138931+0000","last_unstale":"2024-04-14T23:35:48.929626+0000","last_undegraded":"2024-04-14T23:35:48.929626+0000","last_fullsized":"2024-04-14T23:35:48.929626+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:28.026305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390862+0000","last_change":"2024-04-14T23:35:47.158537+0000","last_active":"2024-04-14T23:35:48.390862+0000","last_peered":"2024-04-14T23:35:48.390862+0000","last_clean":"2024-04-14T23:35:48.390862+0000","last_became_active":"2024-04-14T23:35:47.158238+0000","last_became_peered":"2024-04-14T23:35:47.158238+0000","last_unstale":"2024-04-14T23:35:48.390862+0000","last_undegraded":"2024-04-14T23:35:48.390862+0000","last_fullsized":"2024-04-14T23:35:48.390862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929960+0000","last_change":"2024-04-14T23:35:46.134765+0000","last_active":"2024-04-14T23:35:48.929960+0000","last_peered":"2024-04-14T23:35:48.929960+0000","last_clean":"2024-04-14T23:35:48.929960+0000","last_became_active":"2024-04-14T23:35:46.134477+0000","last_became_peered":"2024-04-14T23:35:46.134477+0000","last_unstale":"2024-04-14T23:35:48.929960+0000","last_undegraded":"2024-04-14T23:35:48.929960+0000","last_fullsized":"2024-04-14T23:35:48.929960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:38.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128703+0000","last_change":"2024-04-14T23:35:47.153332+0000","last_active":"2024-04-14T23:35:48.128703+0000","last_peered":"2024-04-14T23:35:48.128703+0000","last_clean":"2024-04-14T23:35:48.128703+0000","last_became_active":"2024-04-14T23:35:47.152701+0000","last_became_peered":"2024-04-14T23:35:47.152701+0000","last_unstale":"2024-04-14T23:35:48.128703+0000","last_undegraded":"2024-04-14T23:35:48.128703+0000","last_fullsized":"2024-04-14T23:35:48.128703+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:45:43.060746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390464+0000","last_change":"2024-04-14T23:35:46.132189+0000","last_active":"2024-04-14T23:35:48.390464+0000","last_peered":"2024-04-14T23:35:48.390464+0000","last_clean":"2024-04-14T23:35:48.390464+0000","last_became_active":"2024-04-14T23:35:46.131898+0000","last_became_peered":"2024-04-14T23:35:46.131898+0000","last_unstale":"2024-04-14T23:35:48.390464+0000","last_undegraded":"2024-04-14T23:35:48.390464+0000","last_fullsized":"2024-04-14T23:35:48.390464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:39.852879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930999+0000","last_change":"2024-04-14T23:35:47.151785+0000","last_active":"2024-04-14T23:35:48.930999+0000","last_peered":"2024-04-14T23:35:48.930999+0000","last_clean":"2024-04-14T23:35:48.930999+0000","last_became_active":"2024-04-14T23:35:47.151273+0000","last_became_peered":"2024-04-14T23:35:47.151273+0000","last_unstale":"2024-04-14T23:35:48.930999+0000","last_undegraded":"2024-04-14T23:35:48.930999+0000","last_fullsized":"2024-04-14T23:35:48.930999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:51.707591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128964+0000","last_change":"2024-04-14T23:35:46.130128+0000","last_active":"2024-04-14T23:35:48.128964+0000","last_peered":"2024-04-14T23:35:48.128964+0000","last_clean":"2024-04-14T23:35:48.128964+0000","last_became_active":"2024-04-14T23:35:46.129848+0000","last_became_peered":"2024-04-14T23:35:46.129848+0000","last_unstale":"2024-04-14T23:35:48.128964+0000","last_undegraded":"2024-04-14T23:35:48.128964+0000","last_fullsized":"2024-04-14T23:35:48.128964+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:25.040605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930239+0000","last_change":"2024-04-14T23:35:47.135501+0000","last_active":"2024-04-14T23:35:48.930239+0000","last_peered":"2024-04-14T23:35:48.930239+0000","last_clean":"2024-04-14T23:35:48.930239+0000","last_became_active":"2024-04-14T23:35:47.135240+0000","last_became_peered":"2024-04-14T23:35:47.135240+0000","last_unstale":"2024-04-14T23:35:48.930239+0000","last_undegraded":"2024-04-14T23:35:48.930239+0000","last_fullsized":"2024-04-14T23:35:48.930239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130481+0000","last_change":"2024-04-14T23:35:46.132005+0000","last_active":"2024-04-14T23:35:48.130481+0000","last_peered":"2024-04-14T23:35:48.130481+0000","last_clean":"2024-04-14T23:35:48.130481+0000","last_became_active":"2024-04-14T23:35:46.131640+0000","last_became_peered":"2024-04-14T23:35:46.131640+0000","last_unstale":"2024-04-14T23:35:48.130481+0000","last_undegraded":"2024-04-14T23:35:48.130481+0000","last_fullsized":"2024-04-14T23:35:48.130481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:11.340513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929884+0000","last_change":"2024-04-14T23:35:47.153756+0000","last_active":"2024-04-14T23:35:48.929884+0000","last_peered":"2024-04-14T23:35:48.929884+0000","last_clean":"2024-04-14T23:35:48.929884+0000","last_became_active":"2024-04-14T23:35:47.153494+0000","last_became_peered":"2024-04-14T23:35:47.153494+0000","last_unstale":"2024-04-14T23:35:48.929884+0000","last_undegraded":"2024-04-14T23:35:48.929884+0000","last_fullsized":"2024-04-14T23:35:48.929884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:26.044901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.131064+0000","last_change":"2024-04-14T23:35:46.129168+0000","last_active":"2024-04-14T23:35:48.131064+0000","last_peered":"2024-04-14T23:35:48.131064+0000","last_clean":"2024-04-14T23:35:48.131064+0000","last_became_active":"2024-04-14T23:35:46.128883+0000","last_became_peered":"2024-04-14T23:35:46.128883+0000","last_unstale":"2024-04-14T23:35:48.131064+0000","last_undegraded":"2024-04-14T23:35:48.131064+0000","last_fullsized":"2024-04-14T23:35:48.131064+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391075+0000","last_change":"2024-04-14T23:35:47.154541+0000","last_active":"2024-04-14T23:35:48.391075+0000","last_peered":"2024-04-14T23:35:48.391075+0000","last_clean":"2024-04-14T23:35:48.391075+0000","last_became_active":"2024-04-14T23:35:47.154276+0000","last_became_peered":"2024-04-14T23:35:47.154276+0000","last_unstale":"2024-04-14T23:35:48.391075+0000","last_undegraded":"2024-04-14T23:35:48.391075+0000","last_fullsized":"2024-04-14T23:35:48.391075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:54:50.487935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'9","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:58.300100+0000","last_change":"2024-04-14T23:35:46.136620+0000","last_active":"2024-04-14T23:35:58.300100+0000","last_peered":"2024-04-14T23:35:58.300100+0000","last_clean":"2024-04-14T23:35:58.300100+0000","last_became_active":"2024-04-14T23:35:46.136185+0000","last_became_peered":"2024-04-14T23:35:46.136185+0000","last_unstale":"2024-04-14T23:35:58.300100+0000","last_undegraded":"2024-04-14T23:35:58.300100+0000","last_fullsized":"2024-04-14T23:35:58.300100+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:26.963649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929540+0000","last_change":"2024-04-14T23:35:47.158305+0000","last_active":"2024-04-14T23:35:48.929540+0000","last_peered":"2024-04-14T23:35:48.929540+0000","last_clean":"2024-04-14T23:35:48.929540+0000","last_became_active":"2024-04-14T23:35:47.157745+0000","last_became_peered":"2024-04-14T23:35:47.157745+0000","last_unstale":"2024-04-14T23:35:48.929540+0000","last_undegraded":"2024-04-14T23:35:48.929540+0000","last_fullsized":"2024-04-14T23:35:48.929540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:49.647834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128763+0000","last_change":"2024-04-14T23:35:46.133651+0000","last_active":"2024-04-14T23:35:48.128763+0000","last_peered":"2024-04-14T23:35:48.128763+0000","last_clean":"2024-04-14T23:35:48.128763+0000","last_became_active":"2024-04-14T23:35:46.133356+0000","last_became_peered":"2024-04-14T23:35:46.133356+0000","last_unstale":"2024-04-14T23:35:48.128763+0000","last_undegraded":"2024-04-14T23:35:48.128763+0000","last_fullsized":"2024-04-14T23:35:48.128763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:39.741647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128618+0000","last_change":"2024-04-14T23:35:47.143315+0000","last_active":"2024-04-14T23:35:48.128618+0000","last_peered":"2024-04-14T23:35:48.128618+0000","last_clean":"2024-04-14T23:35:48.128618+0000","last_became_active":"2024-04-14T23:35:47.143045+0000","last_became_peered":"2024-04-14T23:35:47.143045+0000","last_unstale":"2024-04-14T23:35:48.128618+0000","last_undegraded":"2024-04-14T23:35:48.128618+0000","last_fullsized":"2024-04-14T23:35:48.128618+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:10:25.940509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929923+0000","last_change":"2024-04-14T23:35:46.134679+0000","last_active":"2024-04-14T23:35:48.929923+0000","last_peered":"2024-04-14T23:35:48.929923+0000","last_clean":"2024-04-14T23:35:48.929923+0000","last_became_active":"2024-04-14T23:35:46.134400+0000","last_became_peered":"2024-04-14T23:35:46.134400+0000","last_unstale":"2024-04-14T23:35:48.929923+0000","last_undegraded":"2024-04-14T23:35:48.929923+0000","last_fullsized":"2024-04-14T23:35:48.929923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:11.829667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929760+0000","last_change":"2024-04-14T23:35:47.135899+0000","last_active":"2024-04-14T23:35:48.929760+0000","last_peered":"2024-04-14T23:35:48.929760+0000","last_clean":"2024-04-14T23:35:48.929760+0000","last_became_active":"2024-04-14T23:35:47.134733+0000","last_became_peered":"2024-04-14T23:35:47.134733+0000","last_unstale":"2024-04-14T23:35:48.929760+0000","last_undegraded":"2024-04-14T23:35:48.929760+0000","last_fullsized":"2024-04-14T23:35:48.929760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:26.044901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129540+0000","last_change":"2024-04-14T23:35:46.128127+0000","last_active":"2024-04-14T23:35:48.129540+0000","last_peered":"2024-04-14T23:35:48.129540+0000","last_clean":"2024-04-14T23:35:48.129540+0000","last_became_active":"2024-04-14T23:35:46.127852+0000","last_became_peered":"2024-04-14T23:35:46.127852+0000","last_unstale":"2024-04-14T23:35:48.129540+0000","last_undegraded":"2024-04-14T23:35:48.129540+0000","last_fullsized":"2024-04-14T23:35:48.129540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:28:27.338198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128687+0000","last_change":"2024-04-14T23:35:47.147302+0000","last_active":"2024-04-14T23:35:48.128687+0000","last_peered":"2024-04-14T23:35:48.128687+0000","last_clean":"2024-04-14T23:35:48.128687+0000","last_became_active":"2024-04-14T23:35:47.147022+0000","last_became_peered":"2024-04-14T23:35:47.147022+0000","last_unstale":"2024-04-14T23:35:48.128687+0000","last_undegraded":"2024-04-14T23:35:48.128687+0000","last_fullsized":"2024-04-14T23:35:48.128687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:29:11.592779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929556+0000","last_change":"2024-04-14T23:35:46.139301+0000","last_active":"2024-04-14T23:35:48.929556+0000","last_peered":"2024-04-14T23:35:48.929556+0000","last_clean":"2024-04-14T23:35:48.929556+0000","last_became_active":"2024-04-14T23:35:46.138922+0000","last_became_peered":"2024-04-14T23:35:46.138922+0000","last_unstale":"2024-04-14T23:35:48.929556+0000","last_undegraded":"2024-04-14T23:35:48.929556+0000","last_fullsized":"2024-04-14T23:35:48.929556+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:30:04.280095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128762+0000","last_change":"2024-04-14T23:35:47.143210+0000","last_active":"2024-04-14T23:35:48.128762+0000","last_peered":"2024-04-14T23:35:48.128762+0000","last_clean":"2024-04-14T23:35:48.128762+0000","last_became_active":"2024-04-14T23:35:47.142925+0000","last_became_peered":"2024-04-14T23:35:47.142925+0000","last_unstale":"2024-04-14T23:35:48.128762+0000","last_undegraded":"2024-04-14T23:35:48.128762+0000","last_fullsized":"2024-04-14T23:35:48.128762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:19:31.536395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130578+0000","last_change":"2024-04-14T23:35:46.130896+0000","last_active":"2024-04-14T23:35:48.130578+0000","last_peered":"2024-04-14T23:35:48.130578+0000","last_clean":"2024-04-14T23:35:48.130578+0000","last_became_active":"2024-04-14T23:35:46.130423+0000","last_became_peered":"2024-04-14T23:35:46.130423+0000","last_unstale":"2024-04-14T23:35:48.130578+0000","last_undegraded":"2024-04-14T23:35:48.130578+0000","last_fullsized":"2024-04-14T23:35:48.130578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:38.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.131117+0000","last_change":"2024-04-14T23:35:47.149269+0000","last_active":"2024-04-14T23:35:48.131117+0000","last_peered":"2024-04-14T23:35:48.131117+0000","last_clean":"2024-04-14T23:35:48.131117+0000","last_became_active":"2024-04-14T23:35:47.148964+0000","last_became_peered":"2024-04-14T23:35:47.148964+0000","last_unstale":"2024-04-14T23:35:48.131117+0000","last_undegraded":"2024-04-14T23:35:48.131117+0000","last_fullsized":"2024-04-14T23:35:48.131117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:16:06.767783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391019+0000","last_change":"2024-04-14T23:35:46.137019+0000","last_active":"2024-04-14T23:35:48.391019+0000","last_peered":"2024-04-14T23:35:48.391019+0000","last_clean":"2024-04-14T23:35:48.391019+0000","last_became_active":"2024-04-14T23:35:46.136718+0000","last_became_peered":"2024-04-14T23:35:46.136718+0000","last_unstale":"2024-04-14T23:35:48.391019+0000","last_undegraded":"2024-04-14T23:35:48.391019+0000","last_fullsized":"2024-04-14T23:35:48.391019+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:11.829667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390937+0000","last_change":"2024-04-14T23:35:47.149376+0000","last_active":"2024-04-14T23:35:48.390937+0000","last_peered":"2024-04-14T23:35:48.390937+0000","last_clean":"2024-04-14T23:35:48.390937+0000","last_became_active":"2024-04-14T23:35:47.149067+0000","last_became_peered":"2024-04-14T23:35:47.149067+0000","last_unstale":"2024-04-14T23:35:48.390937+0000","last_undegraded":"2024-04-14T23:35:48.390937+0000","last_fullsized":"2024-04-14T23:35:48.390937+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:18.147979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930844+0000","last_change":"2024-04-14T23:35:46.136557+0000","last_active":"2024-04-14T23:35:48.930844+0000","last_peered":"2024-04-14T23:35:48.930844+0000","last_clean":"2024-04-14T23:35:48.930844+0000","last_became_active":"2024-04-14T23:35:46.136236+0000","last_became_peered":"2024-04-14T23:35:46.136236+0000","last_unstale":"2024-04-14T23:35:48.930844+0000","last_undegraded":"2024-04-14T23:35:48.930844+0000","last_fullsized":"2024-04-14T23:35:48.930844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:08:47.351218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930975+0000","last_change":"2024-04-14T23:35:47.150822+0000","last_active":"2024-04-14T23:35:48.930975+0000","last_peered":"2024-04-14T23:35:48.930975+0000","last_clean":"2024-04-14T23:35:48.930975+0000","last_became_active":"2024-04-14T23:35:47.150517+0000","last_became_peered":"2024-04-14T23:35:47.150517+0000","last_unstale":"2024-04-14T23:35:48.930975+0000","last_undegraded":"2024-04-14T23:35:48.930975+0000","last_fullsized":"2024-04-14T23:35:48.930975+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:29.030602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930275+0000","last_change":"2024-04-14T23:35:46.136475+0000","last_active":"2024-04-14T23:35:48.930275+0000","last_peered":"2024-04-14T23:35:48.930275+0000","last_clean":"2024-04-14T23:35:48.930275+0000","last_became_active":"2024-04-14T23:35:46.136103+0000","last_became_peered":"2024-04-14T23:35:46.136103+0000","last_unstale":"2024-04-14T23:35:48.930275+0000","last_undegraded":"2024-04-14T23:35:48.930275+0000","last_fullsized":"2024-04-14T23:35:48.930275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:11.340513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929988+0000","last_change":"2024-04-14T23:35:47.146919+0000","last_active":"2024-04-14T23:35:48.929988+0000","last_peered":"2024-04-14T23:35:48.929988+0000","last_clean":"2024-04-14T23:35:48.929988+0000","last_became_active":"2024-04-14T23:35:47.146080+0000","last_became_peered":"2024-04-14T23:35:47.146080+0000","last_unstale":"2024-04-14T23:35:48.929988+0000","last_undegraded":"2024-04-14T23:35:48.929988+0000","last_fullsized":"2024-04-14T23:35:48.929988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930583+0000","last_change":"2024-04-14T23:35:46.132858+0000","last_active":"2024-04-14T23:35:48.930583+0000","last_peered":"2024-04-14T23:35:48.930583+0000","last_clean":"2024-04-14T23:35:48.930583+0000","last_became_active":"2024-04-14T23:35:46.132542+0000","last_became_peered":"2024-04-14T23:35:46.132542+0000","last_unstale":"2024-04-14T23:35:48.930583+0000","last_undegraded":"2024-04-14T23:35:48.930583+0000","last_fullsized":"2024-04-14T23:35:48.930583+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:51:12.197819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929957+0000","last_change":"2024-04-14T23:35:47.154850+0000","last_active":"2024-04-14T23:35:48.929957+0000","last_peered":"2024-04-14T23:35:48.929957+0000","last_clean":"2024-04-14T23:35:48.929957+0000","last_became_active":"2024-04-14T23:35:47.154568+0000","last_became_peered":"2024-04-14T23:35:47.154568+0000","last_unstale":"2024-04-14T23:35:48.929957+0000","last_undegraded":"2024-04-14T23:35:48.929957+0000","last_fullsized":"2024-04-14T23:35:48.929957+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930191+0000","last_change":"2024-04-14T23:35:46.131620+0000","last_active":"2024-04-14T23:35:48.930191+0000","last_peered":"2024-04-14T23:35:48.930191+0000","last_clean":"2024-04-14T23:35:48.930191+0000","last_became_active":"2024-04-14T23:35:46.131245+0000","last_became_peered":"2024-04-14T23:35:46.131245+0000","last_unstale":"2024-04-14T23:35:48.930191+0000","last_undegraded":"2024-04-14T23:35:48.930191+0000","last_fullsized":"2024-04-14T23:35:48.930191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:43:31.510170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129762+0000","last_change":"2024-04-14T23:35:47.149519+0000","last_active":"2024-04-14T23:35:48.129762+0000","last_peered":"2024-04-14T23:35:48.129762+0000","last_clean":"2024-04-14T23:35:48.129762+0000","last_became_active":"2024-04-14T23:35:47.149206+0000","last_became_peered":"2024-04-14T23:35:47.149206+0000","last_unstale":"2024-04-14T23:35:48.129762+0000","last_undegraded":"2024-04-14T23:35:48.129762+0000","last_fullsized":"2024-04-14T23:35:48.129762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929811+0000","last_change":"2024-04-14T23:35:46.136409+0000","last_active":"2024-04-14T23:35:48.929811+0000","last_peered":"2024-04-14T23:35:48.929811+0000","last_clean":"2024-04-14T23:35:48.929811+0000","last_became_active":"2024-04-14T23:35:46.136141+0000","last_became_peered":"2024-04-14T23:35:46.136141+0000","last_unstale":"2024-04-14T23:35:48.929811+0000","last_undegraded":"2024-04-14T23:35:48.929811+0000","last_fullsized":"2024-04-14T23:35:48.929811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128851+0000","last_change":"2024-04-14T23:35:47.152792+0000","last_active":"2024-04-14T23:35:48.128851+0000","last_peered":"2024-04-14T23:35:48.128851+0000","last_clean":"2024-04-14T23:35:48.128851+0000","last_became_active":"2024-04-14T23:35:47.152529+0000","last_became_peered":"2024-04-14T23:35:47.152529+0000","last_unstale":"2024-04-14T23:35:48.128851+0000","last_undegraded":"2024-04-14T23:35:48.128851+0000","last_fullsized":"2024-04-14T23:35:48.128851+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:26:37.825904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930189+0000","last_change":"2024-04-14T23:35:46.131128+0000","last_active":"2024-04-14T23:35:48.930189+0000","last_peered":"2024-04-14T23:35:48.930189+0000","last_clean":"2024-04-14T23:35:48.930189+0000","last_became_active":"2024-04-14T23:35:46.130829+0000","last_became_peered":"2024-04-14T23:35:46.130829+0000","last_unstale":"2024-04-14T23:35:48.930189+0000","last_undegraded":"2024-04-14T23:35:48.930189+0000","last_fullsized":"2024-04-14T23:35:48.930189+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:26:22.509424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930226+0000","last_change":"2024-04-14T23:35:47.157604+0000","last_active":"2024-04-14T23:35:48.930226+0000","last_peered":"2024-04-14T23:35:48.930226+0000","last_clean":"2024-04-14T23:35:48.930226+0000","last_became_active":"2024-04-14T23:35:47.157332+0000","last_became_peered":"2024-04-14T23:35:47.157332+0000","last_unstale":"2024-04-14T23:35:48.930226+0000","last_undegraded":"2024-04-14T23:35:48.930226+0000","last_fullsized":"2024-04-14T23:35:48.930226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:27.967946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130676+0000","last_change":"2024-04-14T23:35:46.130670+0000","last_active":"2024-04-14T23:35:48.130676+0000","last_peered":"2024-04-14T23:35:48.130676+0000","last_clean":"2024-04-14T23:35:48.130676+0000","last_became_active":"2024-04-14T23:35:46.130053+0000","last_became_peered":"2024-04-14T23:35:46.130053+0000","last_unstale":"2024-04-14T23:35:48.130676+0000","last_undegraded":"2024-04-14T23:35:48.130676+0000","last_fullsized":"2024-04-14T23:35:48.130676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:11.829667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930021+0000","last_change":"2024-04-14T23:35:47.135664+0000","last_active":"2024-04-14T23:35:48.930021+0000","last_peered":"2024-04-14T23:35:48.930021+0000","last_clean":"2024-04-14T23:35:48.930021+0000","last_became_active":"2024-04-14T23:35:47.135290+0000","last_became_peered":"2024-04-14T23:35:47.135290+0000","last_unstale":"2024-04-14T23:35:48.930021+0000","last_undegraded":"2024-04-14T23:35:48.930021+0000","last_fullsized":"2024-04-14T23:35:48.930021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:18.147979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:49.131837+0000","last_change":"2024-04-14T23:35:46.133201+0000","last_active":"2024-04-14T23:35:49.131837+0000","last_peered":"2024-04-14T23:35:49.131837+0000","last_clean":"2024-04-14T23:35:49.131837+0000","last_became_active":"2024-04-14T23:35:46.132894+0000","last_became_peered":"2024-04-14T23:35:46.132894+0000","last_unstale":"2024-04-14T23:35:49.131837+0000","last_undegraded":"2024-04-14T23:35:49.131837+0000","last_fullsized":"2024-04-14T23:35:49.131837+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:23:21.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128887+0000","last_change":"2024-04-14T23:35:47.153255+0000","last_active":"2024-04-14T23:35:48.128887+0000","last_peered":"2024-04-14T23:35:48.128887+0000","last_clean":"2024-04-14T23:35:48.128887+0000","last_became_active":"2024-04-14T23:35:47.152994+0000","last_became_peered":"2024-04-14T23:35:47.152994+0000","last_unstale":"2024-04-14T23:35:48.128887+0000","last_undegraded":"2024-04-14T23:35:48.128887+0000","last_fullsized":"2024-04-14T23:35:48.128887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:32:36.376204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929974+0000","last_change":"2024-04-14T23:35:46.129019+0000","last_active":"2024-04-14T23:35:48.929974+0000","last_peered":"2024-04-14T23:35:48.929974+0000","last_clean":"2024-04-14T23:35:48.929974+0000","last_became_active":"2024-04-14T23:35:46.128736+0000","last_became_peered":"2024-04-14T23:35:46.128736+0000","last_unstale":"2024-04-14T23:35:48.929974+0000","last_undegraded":"2024-04-14T23:35:48.929974+0000","last_fullsized":"2024-04-14T23:35:48.929974+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:28.026305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929722+0000","last_change":"2024-04-14T23:35:47.146466+0000","last_active":"2024-04-14T23:35:48.929722+0000","last_peered":"2024-04-14T23:35:48.929722+0000","last_clean":"2024-04-14T23:35:48.929722+0000","last_became_active":"2024-04-14T23:35:47.146038+0000","last_became_peered":"2024-04-14T23:35:47.146038+0000","last_unstale":"2024-04-14T23:35:48.929722+0000","last_undegraded":"2024-04-14T23:35:48.929722+0000","last_fullsized":"2024-04-14T23:35:48.929722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:27.967946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929825+0000","last_change":"2024-04-14T23:35:46.137505+0000","last_active":"2024-04-14T23:35:48.929825+0000","last_peered":"2024-04-14T23:35:48.929825+0000","last_clean":"2024-04-14T23:35:48.929825+0000","last_became_active":"2024-04-14T23:35:46.137073+0000","last_became_peered":"2024-04-14T23:35:46.137073+0000","last_unstale":"2024-04-14T23:35:48.929825+0000","last_undegraded":"2024-04-14T23:35:48.929825+0000","last_fullsized":"2024-04-14T23:35:48.929825+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929904+0000","last_change":"2024-04-14T23:35:47.144646+0000","last_active":"2024-04-14T23:35:48.929904+0000","last_peered":"2024-04-14T23:35:48.929904+0000","last_clean":"2024-04-14T23:35:48.929904+0000","last_became_active":"2024-04-14T23:35:47.144302+0000","last_became_peered":"2024-04-14T23:35:47.144302+0000","last_unstale":"2024-04-14T23:35:48.929904+0000","last_undegraded":"2024-04-14T23:35:48.929904+0000","last_fullsized":"2024-04-14T23:35:48.929904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:38.502135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130300+0000","last_change":"2024-04-14T23:35:46.132200+0000","last_active":"2024-04-14T23:35:48.130300+0000","last_peered":"2024-04-14T23:35:48.130300+0000","last_clean":"2024-04-14T23:35:48.130300+0000","last_became_active":"2024-04-14T23:35:46.131951+0000","last_became_peered":"2024-04-14T23:35:46.131951+0000","last_unstale":"2024-04-14T23:35:48.130300+0000","last_undegraded":"2024-04-14T23:35:48.130300+0000","last_fullsized":"2024-04-14T23:35:48.130300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:50:42.618031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390704+0000","last_change":"2024-04-14T23:35:47.152240+0000","last_active":"2024-04-14T23:35:48.390704+0000","last_peered":"2024-04-14T23:35:48.390704+0000","last_clean":"2024-04-14T23:35:48.390704+0000","last_became_active":"2024-04-14T23:35:47.151949+0000","last_became_peered":"2024-04-14T23:35:47.151949+0000","last_unstale":"2024-04-14T23:35:48.390704+0000","last_undegraded":"2024-04-14T23:35:48.390704+0000","last_fullsized":"2024-04-14T23:35:48.390704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390467+0000","last_change":"2024-04-14T23:35:46.133774+0000","last_active":"2024-04-14T23:35:48.390467+0000","last_peered":"2024-04-14T23:35:48.390467+0000","last_clean":"2024-04-14T23:35:48.390467+0000","last_became_active":"2024-04-14T23:35:46.133248+0000","last_became_peered":"2024-04-14T23:35:46.133248+0000","last_unstale":"2024-04-14T23:35:48.390467+0000","last_undegraded":"2024-04-14T23:35:48.390467+0000","last_fullsized":"2024-04-14T23:35:48.390467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:10:15.375417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930207+0000","last_change":"2024-04-14T23:35:47.137101+0000","last_active":"2024-04-14T23:35:48.930207+0000","last_peered":"2024-04-14T23:35:48.930207+0000","last_clean":"2024-04-14T23:35:48.930207+0000","last_became_active":"2024-04-14T23:35:47.135299+0000","last_became_peered":"2024-04-14T23:35:47.135299+0000","last_unstale":"2024-04-14T23:35:48.930207+0000","last_undegraded":"2024-04-14T23:35:48.930207+0000","last_fullsized":"2024-04-14T23:35:48.930207+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:13:37.995199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128481+0000","last_change":"2024-04-14T23:35:46.130340+0000","last_active":"2024-04-14T23:35:48.128481+0000","last_peered":"2024-04-14T23:35:48.128481+0000","last_clean":"2024-04-14T23:35:48.128481+0000","last_became_active":"2024-04-14T23:35:46.129730+0000","last_became_peered":"2024-04-14T23:35:46.129730+0000","last_unstale":"2024-04-14T23:35:48.128481+0000","last_undegraded":"2024-04-14T23:35:48.128481+0000","last_fullsized":"2024-04-14T23:35:48.128481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:37.497838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130505+0000","last_change":"2024-04-14T23:35:47.158482+0000","last_active":"2024-04-14T23:35:48.130505+0000","last_peered":"2024-04-14T23:35:48.130505+0000","last_clean":"2024-04-14T23:35:48.130505+0000","last_became_active":"2024-04-14T23:35:47.158231+0000","last_became_peered":"2024-04-14T23:35:47.158231+0000","last_unstale":"2024-04-14T23:35:48.130505+0000","last_undegraded":"2024-04-14T23:35:48.130505+0000","last_fullsized":"2024-04-14T23:35:48.130505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:28:35.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929927+0000","last_change":"2024-04-14T23:35:46.136429+0000","last_active":"2024-04-14T23:35:48.929927+0000","last_peered":"2024-04-14T23:35:48.929927+0000","last_clean":"2024-04-14T23:35:48.929927+0000","last_became_active":"2024-04-14T23:35:46.136181+0000","last_became_peered":"2024-04-14T23:35:46.136181+0000","last_unstale":"2024-04-14T23:35:48.929927+0000","last_undegraded":"2024-04-14T23:35:48.929927+0000","last_fullsized":"2024-04-14T23:35:48.929927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:58:35.171753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929803+0000","last_change":"2024-04-14T23:34:27.438796+0000","last_active":"2024-04-14T23:35:48.929803+0000","last_peered":"2024-04-14T23:35:48.929803+0000","last_clean":"2024-04-14T23:35:48.929803+0000","last_became_active":"2024-04-14T23:34:27.437932+0000","last_became_peered":"2024-04-14T23:34:27.437932+0000","last_unstale":"2024-04-14T23:35:48.929803+0000","last_undegraded":"2024-04-14T23:35:48.929803+0000","last_fullsized":"2024-04-14T23:35:48.929803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_clean_scrub_stamp":"2024-04-14T23:34:26.390323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:11:13.484245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":7786,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1064960,"data_stored":792539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":471040,"data_stored":202135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":197243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":197263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":787575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T23:36:03.067 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-14T23:36:03.067 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T23:36:03.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.204+0000 7fd0cee36640 1 Processor -- start 2024-04-14T23:36:03.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.204+0000 7fd0cee36640 1 -- start start 2024-04-14T23:36:03.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.205+0000 7fd0cee36640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0c80d0140 0x7fd0c815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:03.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.205+0000 7fd0cee36640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0c815c370 con 0x7fd0c806e340 2024-04-14T23:36:03.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.205+0000 7fd0cee36640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0c815ead0 con 0x7fd0c815baf0 2024-04-14T23:36:03.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.205+0000 7fd0cee36640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd0c815edb0 con 0x7fd0c80d0140 2024-04-14T23:36:03.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.205+0000 7fd0ccbd2640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd0c806e340 0x7fd0c80cfa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49932/0 (socket says 172.21.15.47:49932) 2024-04-14T23:36:03.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.205+0000 7fd0ccbd2640 1 -- 172.21.15.47:0/1565743470 learned_addr learned my addr 172.21.15.47:0/1565743470 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:03.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c7fff640 1 --2- 172.21.15.47:0/1565743470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0c80d0140 0x7fd0c815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:03.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c77fe640 1 -- 172.21.15.47:0/1565743470 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 979785158 0 0) 0x7fd0c815c370 con 0x7fd0c806e340 2024-04-14T23:36:03.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c77fe640 1 -- 172.21.15.47:0/1565743470 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0b0005730 con 0x7fd0c806e340 2024-04-14T23:36:03.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c77fe640 1 -- 172.21.15.47:0/1565743470 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1000392537 0 0) 0x7fd0b0005730 con 0x7fd0c806e340 2024-04-14T23:36:03.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c77fe640 1 -- 172.21.15.47:0/1565743470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0c80d0140 msgr2=0x7fd0c815b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:03.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c77fe640 1 --2- 172.21.15.47:0/1565743470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0c80d0140 0x7fd0c815b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c77fe640 1 -- 172.21.15.47:0/1565743470 >> v1:172.21.15.191:6789/0 conn(0x7fd0c815baf0 legacy=0x7fd0c8071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:03.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c77fe640 1 -- 172.21.15.47:0/1565743470 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c815f090 con 0x7fd0c806e340 2024-04-14T23:36:03.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c77fe640 1 -- 172.21.15.47:0/1565743470 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7fd0c00019f0 con 0x7fd0c806e340 2024-04-14T23:36:03.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c77fe640 1 -- 172.21.15.47:0/1565743470 >> v1:172.21.15.47:6789/0 conn(0x7fd0c806e340 legacy=0x7fd0c80cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:03.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c77fe640 1 --2- 172.21.15.47:0/1565743470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0b0005bf0 0x7fd0b0006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:03.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c77fe640 1 --2- 172.21.15.47:0/1565743470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b0006a10 0x7fd0b0006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:03.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c77fe640 1 --2- 172.21.15.47:0/1565743470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0c80d0140 0x7fd0b0007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:03.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c77fe640 1 -- 172.21.15.47:0/1565743470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c815edb0 con 0x7fd0b0006a10 2024-04-14T23:36:03.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c77fe640 1 -- 172.21.15.47:0/1565743470 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b000dd00 con 0x7fd0b0005bf0 2024-04-14T23:36:03.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c77fe640 1 -- 172.21.15.47:0/1565743470 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd0b000df00 con 0x7fd0c80d0140 2024-04-14T23:36:03.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c7fff640 1 --2- 172.21.15.47:0/1565743470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b0006a10 0x7fd0b0006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:03.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0ccbd2640 1 --2- 172.21.15.47:0/1565743470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0b0005bf0 0x7fd0b0006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:03.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0cd3d3640 1 --2- 172.21.15.47:0/1565743470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0c80d0140 0x7fd0b0007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:03.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c7fff640 1 -- 172.21.15.47:0/1565743470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0c80d0140 msgr2=0x7fd0b0007410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:03.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c7fff640 1 --2- 172.21.15.47:0/1565743470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0c80d0140 0x7fd0b0007410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c7fff640 1 -- 172.21.15.47:0/1565743470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0b0005bf0 msgr2=0x7fd0b0006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:03.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c7fff640 1 --2- 172.21.15.47:0/1565743470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0b0005bf0 0x7fd0b0006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.206+0000 7fd0c7fff640 1 -- 172.21.15.47:0/1565743470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b0005730 con 0x7fd0b0006a10 2024-04-14T23:36:03.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.207+0000 7fd0c7fff640 1 --2- 172.21.15.47:0/1565743470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b0006a10 0x7fd0b0006e90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009ac0 tx=0x7fd0b0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680e68db73d454ee server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:03.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.207+0000 7fd0c77fe640 1 -- 172.21.15.47:0/1565743470 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc039070 con 0x7fd0b0006a10 2024-04-14T23:36:03.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.207+0000 7fd0c77fe640 1 -- 172.21.15.47:0/1565743470 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0bc02c6b0 con 0x7fd0b0006a10 2024-04-14T23:36:03.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.207+0000 7fd0c77fe640 1 -- 172.21.15.47:0/1565743470 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc009690 con 0x7fd0b0006a10 2024-04-14T23:36:03.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.208+0000 7fd0cee36640 1 -- 172.21.15.47:0/1565743470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b0006a10 msgr2=0x7fd0b0006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:03.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.208+0000 7fd0cee36640 1 --2- 172.21.15.47:0/1565743470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b0006a10 0x7fd0b0006e90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009ac0 tx=0x7fd0b0007a40 comp rx=0 tx=0).stop 2024-04-14T23:36:03.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.208+0000 7fd0cd3d3640 1 -- 172.21.15.47:0/1565743470 reap_dead start 2024-04-14T23:36:03.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.208+0000 7fd0cee36640 1 -- 172.21.15.47:0/1565743470 shutdown_connections 2024-04-14T23:36:03.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.208+0000 7fd0cee36640 1 -- 172.21.15.47:0/1565743470 >> 172.21.15.47:0/1565743470 conn(0x7fd0c806b200 msgr2=0x7fd0c806b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:03.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.208+0000 7fd0cee36640 1 -- 172.21.15.47:0/1565743470 shutdown_connections 2024-04-14T23:36:03.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.208+0000 7fd0cee36640 1 -- 172.21.15.47:0/1565743470 wait complete. 2024-04-14T23:36:03.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.209+0000 7fd0cee36640 1 Processor -- start 2024-04-14T23:36:03.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.209+0000 7fd0cee36640 1 -- start start 2024-04-14T23:36:03.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0cee36640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b0006a10 0x7fd0c81498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:03.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0cee36640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0c8151980 0x7fd0c8151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:03.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0cee36640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0c80ce600 0x7fd0c80cea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:03.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0cee36640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c815bfa0 con 0x7fd0b0006a10 2024-04-14T23:36:03.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0cee36640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c815f890 con 0x7fd0c80ce600 2024-04-14T23:36:03.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0cee36640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd0c815c120 con 0x7fd0c8151980 2024-04-14T23:36:03.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0ccbd2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b0006a10 0x7fd0c81498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:03.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0ccbd2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b0006a10 0x7fd0c81498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43766/0 (socket says 172.21.15.47:43766) 2024-04-14T23:36:03.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0ccbd2640 1 -- 172.21.15.47:0/3367396356 learned_addr learned my addr 172.21.15.47:0/3367396356 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:03.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0ccbd2640 1 -- 172.21.15.47:0/3367396356 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0c8151980 msgr2=0x7fd0c8151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:03.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0ccbd2640 1 --2- 172.21.15.47:0/3367396356 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0c8151980 0x7fd0c8151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0ccbd2640 1 -- 172.21.15.47:0/3367396356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0c80ce600 msgr2=0x7fd0c80cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:03.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0ccbd2640 1 --2- 172.21.15.47:0/3367396356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0c80ce600 0x7fd0c80cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0ccbd2640 1 -- 172.21.15.47:0/3367396356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c80cdf90 con 0x7fd0b0006a10 2024-04-14T23:36:03.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0ccbd2640 1 --2- 172.21.15.47:0/3367396356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b0006a10 0x7fd0c81498a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0007b60 tx=0x7fd0c000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:03.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0c57fa640 1 -- 172.21.15.47:0/3367396356 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0013420 con 0x7fd0b0006a10 2024-04-14T23:36:03.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.210+0000 7fd0c57fa640 1 -- 172.21.15.47:0/3367396356 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c0018070 con 0x7fd0b0006a10 2024-04-14T23:36:03.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.211+0000 7fd0cee36640 1 -- 172.21.15.47:0/3367396356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c80cd1d0 con 0x7fd0b0006a10 2024-04-14T23:36:03.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.211+0000 7fd0c57fa640 1 -- 172.21.15.47:0/3367396356 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0013800 con 0x7fd0b0006a10 2024-04-14T23:36:03.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.211+0000 7fd0cee36640 1 -- 172.21.15.47:0/3367396356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c80cd790 con 0x7fd0b0006a10 2024-04-14T23:36:03.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.212+0000 7fd0cee36640 1 -- 172.21.15.47:0/3367396356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c8075430 con 0x7fd0b0006a10 2024-04-14T23:36:03.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.212+0000 7fd0c57fa640 1 -- 172.21.15.47:0/3367396356 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd0c00139a0 con 0x7fd0b0006a10 2024-04-14T23:36:03.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.212+0000 7fd0c57fa640 1 --2- 172.21.15.47:0/3367396356 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd0b406b990 0x7fd0b406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:03.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.213+0000 7fd0c57fa640 1 -- 172.21.15.47:0/3367396356 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd0c008b000 con 0x7fd0b0006a10 2024-04-14T23:36:03.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.213+0000 7fd0c7fff640 1 --2- 172.21.15.47:0/3367396356 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd0b406b990 0x7fd0b406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:03.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.213+0000 7fd0c7fff640 1 --2- 172.21.15.47:0/3367396356 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd0b406b990 0x7fd0b406de50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc036000 tx=0x7fd0bc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:03.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.217+0000 7fd0c57fa640 1 -- 172.21.15.47:0/3367396356 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd0c0059b10 con 0x7fd0b0006a10 2024-04-14T23:36:03.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.395+0000 7fd0cee36640 1 -- 172.21.15.47:0/3367396356 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0c8071820 con 0x7fd0b406b990 2024-04-14T23:36:03.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.401+0000 7fd0c57fa640 1 -- 172.21.15.47:0/3367396356 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251850 (secure 0 0 0) 0x7fd0c8071820 con 0x7fd0b406b990 2024-04-14T23:36:03.407 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:36:03.408 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-14T23:36:03.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.405+0000 7fd0cee36640 1 -- 172.21.15.47:0/3367396356 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd0b406b990 msgr2=0x7fd0b406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:03.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.405+0000 7fd0cee36640 1 --2- 172.21.15.47:0/3367396356 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd0b406b990 0x7fd0b406de50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc036000 tx=0x7fd0bc02e000 comp rx=0 tx=0).stop 2024-04-14T23:36:03.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.405+0000 7fd0cee36640 1 -- 172.21.15.47:0/3367396356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b0006a10 msgr2=0x7fd0c81498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:03.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.405+0000 7fd0cee36640 1 --2- 172.21.15.47:0/3367396356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b0006a10 0x7fd0c81498a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0007b60 tx=0x7fd0c000e530 comp rx=0 tx=0).stop 2024-04-14T23:36:03.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.405+0000 7fd0cee36640 1 -- 172.21.15.47:0/3367396356 shutdown_connections 2024-04-14T23:36:03.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.405+0000 7fd0cee36640 1 --2- 172.21.15.47:0/3367396356 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd0b406b990 0x7fd0b406de50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.405+0000 7fd0cee36640 1 --2- 172.21.15.47:0/3367396356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0c80ce600 0x7fd0c80cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.405+0000 7fd0cee36640 1 --2- 172.21.15.47:0/3367396356 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0c8151980 0x7fd0c8151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.405+0000 7fd0cee36640 1 --2- 172.21.15.47:0/3367396356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b0006a10 0x7fd0c81498a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.405+0000 7fd0cee36640 1 -- 172.21.15.47:0/3367396356 >> 172.21.15.47:0/3367396356 conn(0x7fd0c806b200 msgr2=0x7fd0c815c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:03.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.405+0000 7fd0cee36640 1 -- 172.21.15.47:0/3367396356 shutdown_connections 2024-04-14T23:36:03.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.405+0000 7fd0cee36640 1 -- 172.21.15.47:0/3367396356 wait complete. 2024-04-14T23:36:03.419 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-04-14T23:36:02.377899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598154,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237544,"kb_used_data":4752,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737176,"statfs":{"total":773094113280,"available":772850868224,"internally_reserved":0,"allocated":4866048,"data_stored":2769572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7786,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003107"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128934+0000","last_change":"2024-04-14T23:35:47.145996+0000","last_active":"2024-04-14T23:35:48.128934+0000","last_peered":"2024-04-14T23:35:48.128934+0000","last_clean":"2024-04-14T23:35:48.128934+0000","last_became_active":"2024-04-14T23:35:47.145716+0000","last_became_peered":"2024-04-14T23:35:47.145716+0000","last_unstale":"2024-04-14T23:35:48.128934+0000","last_undegraded":"2024-04-14T23:35:48.128934+0000","last_fullsized":"2024-04-14T23:35:48.128934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:17:32.571374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128951+0000","last_change":"2024-04-14T23:35:47.154551+0000","last_active":"2024-04-14T23:35:48.128951+0000","last_peered":"2024-04-14T23:35:48.128951+0000","last_clean":"2024-04-14T23:35:48.128951+0000","last_became_active":"2024-04-14T23:35:47.154286+0000","last_became_peered":"2024-04-14T23:35:47.154286+0000","last_unstale":"2024-04-14T23:35:48.128951+0000","last_undegraded":"2024-04-14T23:35:48.128951+0000","last_fullsized":"2024-04-14T23:35:48.128951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:07:06.644232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929709+0000","last_change":"2024-04-14T23:35:47.160513+0000","last_active":"2024-04-14T23:35:48.929709+0000","last_peered":"2024-04-14T23:35:48.929709+0000","last_clean":"2024-04-14T23:35:48.929709+0000","last_became_active":"2024-04-14T23:35:47.160208+0000","last_became_peered":"2024-04-14T23:35:47.160208+0000","last_unstale":"2024-04-14T23:35:48.929709+0000","last_undegraded":"2024-04-14T23:35:48.929709+0000","last_fullsized":"2024-04-14T23:35:48.929709+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:38.502135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930879+0000","last_change":"2024-04-14T23:35:47.153454+0000","last_active":"2024-04-14T23:35:48.930879+0000","last_peered":"2024-04-14T23:35:48.930879+0000","last_clean":"2024-04-14T23:35:48.930879+0000","last_became_active":"2024-04-14T23:35:47.153133+0000","last_became_peered":"2024-04-14T23:35:47.153133+0000","last_unstale":"2024-04-14T23:35:48.930879+0000","last_undegraded":"2024-04-14T23:35:48.930879+0000","last_fullsized":"2024-04-14T23:35:48.930879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:58:36.176049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930648+0000","last_change":"2024-04-14T23:35:47.154211+0000","last_active":"2024-04-14T23:35:48.930648+0000","last_peered":"2024-04-14T23:35:48.930648+0000","last_clean":"2024-04-14T23:35:48.930648+0000","last_became_active":"2024-04-14T23:35:47.153936+0000","last_became_peered":"2024-04-14T23:35:47.153936+0000","last_unstale":"2024-04-14T23:35:48.930648+0000","last_undegraded":"2024-04-14T23:35:48.930648+0000","last_fullsized":"2024-04-14T23:35:48.930648+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:07:13.534770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929869+0000","last_change":"2024-04-14T23:35:47.143406+0000","last_active":"2024-04-14T23:35:48.929869+0000","last_peered":"2024-04-14T23:35:48.929869+0000","last_clean":"2024-04-14T23:35:48.929869+0000","last_became_active":"2024-04-14T23:35:47.143142+0000","last_became_peered":"2024-04-14T23:35:47.143142+0000","last_unstale":"2024-04-14T23:35:48.929869+0000","last_undegraded":"2024-04-14T23:35:48.929869+0000","last_fullsized":"2024-04-14T23:35:48.929869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:49.647834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129403+0000","last_change":"2024-04-14T23:35:47.159443+0000","last_active":"2024-04-14T23:35:48.129403+0000","last_peered":"2024-04-14T23:35:48.129403+0000","last_clean":"2024-04-14T23:35:48.129403+0000","last_became_active":"2024-04-14T23:35:47.157644+0000","last_became_peered":"2024-04-14T23:35:47.157644+0000","last_unstale":"2024-04-14T23:35:48.129403+0000","last_undegraded":"2024-04-14T23:35:48.129403+0000","last_fullsized":"2024-04-14T23:35:48.129403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128520+0000","last_change":"2024-04-14T23:35:47.150895+0000","last_active":"2024-04-14T23:35:48.128520+0000","last_peered":"2024-04-14T23:35:48.128520+0000","last_clean":"2024-04-14T23:35:48.128520+0000","last_became_active":"2024-04-14T23:35:47.150520+0000","last_became_peered":"2024-04-14T23:35:47.150520+0000","last_unstale":"2024-04-14T23:35:48.128520+0000","last_undegraded":"2024-04-14T23:35:48.128520+0000","last_fullsized":"2024-04-14T23:35:48.128520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:00.141829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930024+0000","last_change":"2024-04-14T23:35:47.160830+0000","last_active":"2024-04-14T23:35:48.930024+0000","last_peered":"2024-04-14T23:35:48.930024+0000","last_clean":"2024-04-14T23:35:48.930024+0000","last_became_active":"2024-04-14T23:35:47.160554+0000","last_became_peered":"2024-04-14T23:35:47.160554+0000","last_unstale":"2024-04-14T23:35:48.930024+0000","last_undegraded":"2024-04-14T23:35:48.930024+0000","last_fullsized":"2024-04-14T23:35:48.930024+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130272+0000","last_change":"2024-04-14T23:35:47.157661+0000","last_active":"2024-04-14T23:35:48.130272+0000","last_peered":"2024-04-14T23:35:48.130272+0000","last_clean":"2024-04-14T23:35:48.130272+0000","last_became_active":"2024-04-14T23:35:47.157377+0000","last_became_peered":"2024-04-14T23:35:47.157377+0000","last_unstale":"2024-04-14T23:35:48.130272+0000","last_undegraded":"2024-04-14T23:35:48.130272+0000","last_fullsized":"2024-04-14T23:35:48.130272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:54:50.487935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130985+0000","last_change":"2024-04-14T23:35:47.153073+0000","last_active":"2024-04-14T23:35:48.130985+0000","last_peered":"2024-04-14T23:35:48.130985+0000","last_clean":"2024-04-14T23:35:48.130985+0000","last_became_active":"2024-04-14T23:35:47.152649+0000","last_became_peered":"2024-04-14T23:35:47.152649+0000","last_unstale":"2024-04-14T23:35:48.130985+0000","last_undegraded":"2024-04-14T23:35:48.130985+0000","last_fullsized":"2024-04-14T23:35:48.130985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:47:32.718724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930449+0000","last_change":"2024-04-14T23:35:47.149389+0000","last_active":"2024-04-14T23:35:48.930449+0000","last_peered":"2024-04-14T23:35:48.930449+0000","last_clean":"2024-04-14T23:35:48.930449+0000","last_became_active":"2024-04-14T23:35:47.149130+0000","last_became_peered":"2024-04-14T23:35:47.149130+0000","last_unstale":"2024-04-14T23:35:48.930449+0000","last_undegraded":"2024-04-14T23:35:48.930449+0000","last_fullsized":"2024-04-14T23:35:48.930449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129857+0000","last_change":"2024-04-14T23:35:47.153273+0000","last_active":"2024-04-14T23:35:48.129857+0000","last_peered":"2024-04-14T23:35:48.129857+0000","last_clean":"2024-04-14T23:35:48.129857+0000","last_became_active":"2024-04-14T23:35:47.153005+0000","last_became_peered":"2024-04-14T23:35:47.153005+0000","last_unstale":"2024-04-14T23:35:48.129857+0000","last_undegraded":"2024-04-14T23:35:48.129857+0000","last_fullsized":"2024-04-14T23:35:48.129857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:33:25.414410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390635+0000","last_change":"2024-04-14T23:35:47.152798+0000","last_active":"2024-04-14T23:35:48.390635+0000","last_peered":"2024-04-14T23:35:48.390635+0000","last_clean":"2024-04-14T23:35:48.390635+0000","last_became_active":"2024-04-14T23:35:47.152530+0000","last_became_peered":"2024-04-14T23:35:47.152530+0000","last_unstale":"2024-04-14T23:35:48.390635+0000","last_undegraded":"2024-04-14T23:35:48.390635+0000","last_fullsized":"2024-04-14T23:35:48.390635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129640+0000","last_change":"2024-04-14T23:35:47.157364+0000","last_active":"2024-04-14T23:35:48.129640+0000","last_peered":"2024-04-14T23:35:48.129640+0000","last_clean":"2024-04-14T23:35:48.129640+0000","last_became_active":"2024-04-14T23:35:47.157069+0000","last_became_peered":"2024-04-14T23:35:47.157069+0000","last_unstale":"2024-04-14T23:35:48.129640+0000","last_undegraded":"2024-04-14T23:35:48.129640+0000","last_fullsized":"2024-04-14T23:35:48.129640+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929628+0000","last_change":"2024-04-14T23:35:47.157646+0000","last_active":"2024-04-14T23:35:48.929628+0000","last_peered":"2024-04-14T23:35:48.929628+0000","last_clean":"2024-04-14T23:35:48.929628+0000","last_became_active":"2024-04-14T23:35:47.157374+0000","last_became_peered":"2024-04-14T23:35:47.157374+0000","last_unstale":"2024-04-14T23:35:48.929628+0000","last_undegraded":"2024-04-14T23:35:48.929628+0000","last_fullsized":"2024-04-14T23:35:48.929628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:49.647834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930137+0000","last_change":"2024-04-14T23:35:47.160288+0000","last_active":"2024-04-14T23:35:48.930137+0000","last_peered":"2024-04-14T23:35:48.930137+0000","last_clean":"2024-04-14T23:35:48.930137+0000","last_became_active":"2024-04-14T23:35:47.160045+0000","last_became_peered":"2024-04-14T23:35:47.160045+0000","last_unstale":"2024-04-14T23:35:48.930137+0000","last_undegraded":"2024-04-14T23:35:48.930137+0000","last_fullsized":"2024-04-14T23:35:48.930137+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:33:25.414410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130094+0000","last_change":"2024-04-14T23:35:47.150954+0000","last_active":"2024-04-14T23:35:48.130094+0000","last_peered":"2024-04-14T23:35:48.130094+0000","last_clean":"2024-04-14T23:35:48.130094+0000","last_became_active":"2024-04-14T23:35:47.150606+0000","last_became_peered":"2024-04-14T23:35:47.150606+0000","last_unstale":"2024-04-14T23:35:48.130094+0000","last_undegraded":"2024-04-14T23:35:48.130094+0000","last_fullsized":"2024-04-14T23:35:48.130094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:39.427143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930862+0000","last_change":"2024-04-14T23:35:47.137492+0000","last_active":"2024-04-14T23:35:48.930862+0000","last_peered":"2024-04-14T23:35:48.930862+0000","last_clean":"2024-04-14T23:35:48.930862+0000","last_became_active":"2024-04-14T23:35:47.137234+0000","last_became_peered":"2024-04-14T23:35:47.137234+0000","last_unstale":"2024-04-14T23:35:48.930862+0000","last_undegraded":"2024-04-14T23:35:48.930862+0000","last_fullsized":"2024-04-14T23:35:48.930862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:30:05.284391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129997+0000","last_change":"2024-04-14T23:35:47.150013+0000","last_active":"2024-04-14T23:35:48.129997+0000","last_peered":"2024-04-14T23:35:48.129997+0000","last_clean":"2024-04-14T23:35:48.129997+0000","last_became_active":"2024-04-14T23:35:47.149754+0000","last_became_peered":"2024-04-14T23:35:47.149754+0000","last_unstale":"2024-04-14T23:35:48.129997+0000","last_undegraded":"2024-04-14T23:35:48.129997+0000","last_fullsized":"2024-04-14T23:35:48.129997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:12.344810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129783+0000","last_change":"2024-04-14T23:35:47.149073+0000","last_active":"2024-04-14T23:35:48.129783+0000","last_peered":"2024-04-14T23:35:48.129783+0000","last_clean":"2024-04-14T23:35:48.129783+0000","last_became_active":"2024-04-14T23:35:47.148806+0000","last_became_peered":"2024-04-14T23:35:47.148806+0000","last_unstale":"2024-04-14T23:35:48.129783+0000","last_undegraded":"2024-04-14T23:35:48.129783+0000","last_fullsized":"2024-04-14T23:35:48.129783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:18.147979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391033+0000","last_change":"2024-04-14T23:35:47.154397+0000","last_active":"2024-04-14T23:35:48.391033+0000","last_peered":"2024-04-14T23:35:48.391033+0000","last_clean":"2024-04-14T23:35:48.391033+0000","last_became_active":"2024-04-14T23:35:47.154054+0000","last_became_peered":"2024-04-14T23:35:47.154054+0000","last_unstale":"2024-04-14T23:35:48.391033+0000","last_undegraded":"2024-04-14T23:35:48.391033+0000","last_fullsized":"2024-04-14T23:35:48.391033+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:13:37.995199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929730+0000","last_change":"2024-04-14T23:35:47.135157+0000","last_active":"2024-04-14T23:35:48.929730+0000","last_peered":"2024-04-14T23:35:48.929730+0000","last_clean":"2024-04-14T23:35:48.929730+0000","last_became_active":"2024-04-14T23:35:47.134846+0000","last_became_peered":"2024-04-14T23:35:47.134846+0000","last_unstale":"2024-04-14T23:35:48.929730+0000","last_undegraded":"2024-04-14T23:35:48.929730+0000","last_fullsized":"2024-04-14T23:35:48.929730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:38.502135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930226+0000","last_change":"2024-04-14T23:35:47.134176+0000","last_active":"2024-04-14T23:35:48.930226+0000","last_peered":"2024-04-14T23:35:48.930226+0000","last_clean":"2024-04-14T23:35:48.930226+0000","last_became_active":"2024-04-14T23:35:47.133837+0000","last_became_peered":"2024-04-14T23:35:47.133837+0000","last_unstale":"2024-04-14T23:35:48.930226+0000","last_undegraded":"2024-04-14T23:35:48.930226+0000","last_fullsized":"2024-04-14T23:35:48.930226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:13:32.134259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130962+0000","last_change":"2024-04-14T23:35:47.141736+0000","last_active":"2024-04-14T23:35:48.130962+0000","last_peered":"2024-04-14T23:35:48.130962+0000","last_clean":"2024-04-14T23:35:48.130962+0000","last_became_active":"2024-04-14T23:35:47.141474+0000","last_became_peered":"2024-04-14T23:35:47.141474+0000","last_unstale":"2024-04-14T23:35:48.130962+0000","last_undegraded":"2024-04-14T23:35:48.130962+0000","last_fullsized":"2024-04-14T23:35:48.130962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:31:38.223026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930267+0000","last_change":"2024-04-14T23:35:47.151371+0000","last_active":"2024-04-14T23:35:48.930267+0000","last_peered":"2024-04-14T23:35:48.930267+0000","last_clean":"2024-04-14T23:35:48.930267+0000","last_became_active":"2024-04-14T23:35:47.151113+0000","last_became_peered":"2024-04-14T23:35:47.151113+0000","last_unstale":"2024-04-14T23:35:48.930267+0000","last_undegraded":"2024-04-14T23:35:48.930267+0000","last_fullsized":"2024-04-14T23:35:48.930267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:26.044901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130325+0000","last_change":"2024-04-14T23:35:47.144676+0000","last_active":"2024-04-14T23:35:48.130325+0000","last_peered":"2024-04-14T23:35:48.130325+0000","last_clean":"2024-04-14T23:35:48.130325+0000","last_became_active":"2024-04-14T23:35:47.144429+0000","last_became_peered":"2024-04-14T23:35:47.144429+0000","last_unstale":"2024-04-14T23:35:48.130325+0000","last_undegraded":"2024-04-14T23:35:48.130325+0000","last_fullsized":"2024-04-14T23:35:48.130325+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:40.857176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130449+0000","last_change":"2024-04-14T23:35:47.149677+0000","last_active":"2024-04-14T23:35:48.130449+0000","last_peered":"2024-04-14T23:35:48.130449+0000","last_clean":"2024-04-14T23:35:48.130449+0000","last_became_active":"2024-04-14T23:35:47.149370+0000","last_became_peered":"2024-04-14T23:35:47.149370+0000","last_unstale":"2024-04-14T23:35:48.130449+0000","last_undegraded":"2024-04-14T23:35:48.130449+0000","last_fullsized":"2024-04-14T23:35:48.130449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:56:02.290384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130652+0000","last_change":"2024-04-14T23:35:47.138179+0000","last_active":"2024-04-14T23:35:48.130652+0000","last_peered":"2024-04-14T23:35:48.130652+0000","last_clean":"2024-04-14T23:35:48.130652+0000","last_became_active":"2024-04-14T23:35:47.137917+0000","last_became_peered":"2024-04-14T23:35:47.137917+0000","last_unstale":"2024-04-14T23:35:48.130652+0000","last_undegraded":"2024-04-14T23:35:48.130652+0000","last_fullsized":"2024-04-14T23:35:48.130652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:10:16.379713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130246+0000","last_change":"2024-04-14T23:35:47.140281+0000","last_active":"2024-04-14T23:35:48.130246+0000","last_peered":"2024-04-14T23:35:48.130246+0000","last_clean":"2024-04-14T23:35:48.130246+0000","last_became_active":"2024-04-14T23:35:47.140018+0000","last_became_peered":"2024-04-14T23:35:47.140018+0000","last_unstale":"2024-04-14T23:35:48.130246+0000","last_undegraded":"2024-04-14T23:35:48.130246+0000","last_fullsized":"2024-04-14T23:35:48.130246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:12.833964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929754+0000","last_change":"2024-04-14T23:35:47.150510+0000","last_active":"2024-04-14T23:35:48.929754+0000","last_peered":"2024-04-14T23:35:48.929754+0000","last_clean":"2024-04-14T23:35:48.929754+0000","last_became_active":"2024-04-14T23:35:47.150210+0000","last_became_peered":"2024-04-14T23:35:47.150210+0000","last_unstale":"2024-04-14T23:35:48.929754+0000","last_undegraded":"2024-04-14T23:35:48.929754+0000","last_fullsized":"2024-04-14T23:35:48.929754+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:27.967946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929546+0000","last_change":"2024-04-14T23:35:47.154478+0000","last_active":"2024-04-14T23:35:48.929546+0000","last_peered":"2024-04-14T23:35:48.929546+0000","last_clean":"2024-04-14T23:35:48.929546+0000","last_became_active":"2024-04-14T23:35:47.154196+0000","last_became_peered":"2024-04-14T23:35:47.154196+0000","last_unstale":"2024-04-14T23:35:48.929546+0000","last_undegraded":"2024-04-14T23:35:48.929546+0000","last_fullsized":"2024-04-14T23:35:48.929546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:47:00.159204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929959+0000","last_change":"2024-04-14T23:35:47.157634+0000","last_active":"2024-04-14T23:35:48.929959+0000","last_peered":"2024-04-14T23:35:48.929959+0000","last_clean":"2024-04-14T23:35:48.929959+0000","last_became_active":"2024-04-14T23:35:47.157342+0000","last_became_peered":"2024-04-14T23:35:47.157342+0000","last_unstale":"2024-04-14T23:35:48.929959+0000","last_undegraded":"2024-04-14T23:35:48.929959+0000","last_fullsized":"2024-04-14T23:35:48.929959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130857+0000","last_change":"2024-04-14T23:35:46.130076+0000","last_active":"2024-04-14T23:35:48.130857+0000","last_peered":"2024-04-14T23:35:48.130857+0000","last_clean":"2024-04-14T23:35:48.130857+0000","last_became_active":"2024-04-14T23:35:46.129786+0000","last_became_peered":"2024-04-14T23:35:46.129786+0000","last_unstale":"2024-04-14T23:35:48.130857+0000","last_undegraded":"2024-04-14T23:35:48.130857+0000","last_fullsized":"2024-04-14T23:35:48.130857+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:55:49.584788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930680+0000","last_change":"2024-04-14T23:35:47.157788+0000","last_active":"2024-04-14T23:35:48.930680+0000","last_peered":"2024-04-14T23:35:48.930680+0000","last_clean":"2024-04-14T23:35:48.930680+0000","last_became_active":"2024-04-14T23:35:47.157538+0000","last_became_peered":"2024-04-14T23:35:47.157538+0000","last_unstale":"2024-04-14T23:35:48.930680+0000","last_undegraded":"2024-04-14T23:35:48.930680+0000","last_fullsized":"2024-04-14T23:35:48.930680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929932+0000","last_change":"2024-04-14T23:35:46.136432+0000","last_active":"2024-04-14T23:35:48.929932+0000","last_peered":"2024-04-14T23:35:48.929932+0000","last_clean":"2024-04-14T23:35:48.929932+0000","last_became_active":"2024-04-14T23:35:46.136168+0000","last_became_peered":"2024-04-14T23:35:46.136168+0000","last_unstale":"2024-04-14T23:35:48.929932+0000","last_undegraded":"2024-04-14T23:35:48.929932+0000","last_fullsized":"2024-04-14T23:35:48.929932+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:11.340513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391012+0000","last_change":"2024-04-14T23:35:47.149283+0000","last_active":"2024-04-14T23:35:48.391012+0000","last_peered":"2024-04-14T23:35:48.391012+0000","last_clean":"2024-04-14T23:35:48.391012+0000","last_became_active":"2024-04-14T23:35:47.148963+0000","last_became_peered":"2024-04-14T23:35:47.148963+0000","last_unstale":"2024-04-14T23:35:48.391012+0000","last_undegraded":"2024-04-14T23:35:48.391012+0000","last_fullsized":"2024-04-14T23:35:48.391012+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:33:25.414410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930741+0000","last_change":"2024-04-14T23:35:46.137540+0000","last_active":"2024-04-14T23:35:48.930741+0000","last_peered":"2024-04-14T23:35:48.930741+0000","last_clean":"2024-04-14T23:35:48.930741+0000","last_became_active":"2024-04-14T23:35:46.137096+0000","last_became_peered":"2024-04-14T23:35:46.137096+0000","last_unstale":"2024-04-14T23:35:48.930741+0000","last_undegraded":"2024-04-14T23:35:48.930741+0000","last_fullsized":"2024-04-14T23:35:48.930741+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128931+0000","last_change":"2024-04-14T23:35:47.146618+0000","last_active":"2024-04-14T23:35:48.128931+0000","last_peered":"2024-04-14T23:35:48.128931+0000","last_clean":"2024-04-14T23:35:48.128931+0000","last_became_active":"2024-04-14T23:35:47.146329+0000","last_became_peered":"2024-04-14T23:35:47.146329+0000","last_unstale":"2024-04-14T23:35:48.128931+0000","last_undegraded":"2024-04-14T23:35:48.128931+0000","last_fullsized":"2024-04-14T23:35:48.128931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:59:58.258654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390798+0000","last_change":"2024-04-14T23:35:46.133465+0000","last_active":"2024-04-14T23:35:48.390798+0000","last_peered":"2024-04-14T23:35:48.390798+0000","last_clean":"2024-04-14T23:35:48.390798+0000","last_became_active":"2024-04-14T23:35:46.133188+0000","last_became_peered":"2024-04-14T23:35:46.133188+0000","last_unstale":"2024-04-14T23:35:48.390798+0000","last_undegraded":"2024-04-14T23:35:48.390798+0000","last_fullsized":"2024-04-14T23:35:48.390798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:38.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929549+0000","last_change":"2024-04-14T23:35:47.142488+0000","last_active":"2024-04-14T23:35:48.929549+0000","last_peered":"2024-04-14T23:35:48.929549+0000","last_clean":"2024-04-14T23:35:48.929549+0000","last_became_active":"2024-04-14T23:35:47.142140+0000","last_became_peered":"2024-04-14T23:35:47.142140+0000","last_unstale":"2024-04-14T23:35:48.929549+0000","last_undegraded":"2024-04-14T23:35:48.929549+0000","last_fullsized":"2024-04-14T23:35:48.929549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:47:00.159204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129923+0000","last_change":"2024-04-14T23:35:46.135150+0000","last_active":"2024-04-14T23:35:48.129923+0000","last_peered":"2024-04-14T23:35:48.129923+0000","last_clean":"2024-04-14T23:35:48.129923+0000","last_became_active":"2024-04-14T23:35:46.134786+0000","last_became_peered":"2024-04-14T23:35:46.134786+0000","last_unstale":"2024-04-14T23:35:48.129923+0000","last_undegraded":"2024-04-14T23:35:48.129923+0000","last_fullsized":"2024-04-14T23:35:48.129923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:28.026305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130028+0000","last_change":"2024-04-14T23:35:47.159541+0000","last_active":"2024-04-14T23:35:48.130028+0000","last_peered":"2024-04-14T23:35:48.130028+0000","last_clean":"2024-04-14T23:35:48.130028+0000","last_became_active":"2024-04-14T23:35:47.158355+0000","last_became_peered":"2024-04-14T23:35:47.158355+0000","last_unstale":"2024-04-14T23:35:48.130028+0000","last_undegraded":"2024-04-14T23:35:48.130028+0000","last_fullsized":"2024-04-14T23:35:48.130028+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:13:37.995199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929626+0000","last_change":"2024-04-14T23:35:46.139410+0000","last_active":"2024-04-14T23:35:48.929626+0000","last_peered":"2024-04-14T23:35:48.929626+0000","last_clean":"2024-04-14T23:35:48.929626+0000","last_became_active":"2024-04-14T23:35:46.138931+0000","last_became_peered":"2024-04-14T23:35:46.138931+0000","last_unstale":"2024-04-14T23:35:48.929626+0000","last_undegraded":"2024-04-14T23:35:48.929626+0000","last_fullsized":"2024-04-14T23:35:48.929626+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:28.026305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390862+0000","last_change":"2024-04-14T23:35:47.158537+0000","last_active":"2024-04-14T23:35:48.390862+0000","last_peered":"2024-04-14T23:35:48.390862+0000","last_clean":"2024-04-14T23:35:48.390862+0000","last_became_active":"2024-04-14T23:35:47.158238+0000","last_became_peered":"2024-04-14T23:35:47.158238+0000","last_unstale":"2024-04-14T23:35:48.390862+0000","last_undegraded":"2024-04-14T23:35:48.390862+0000","last_fullsized":"2024-04-14T23:35:48.390862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929960+0000","last_change":"2024-04-14T23:35:46.134765+0000","last_active":"2024-04-14T23:35:48.929960+0000","last_peered":"2024-04-14T23:35:48.929960+0000","last_clean":"2024-04-14T23:35:48.929960+0000","last_became_active":"2024-04-14T23:35:46.134477+0000","last_became_peered":"2024-04-14T23:35:46.134477+0000","last_unstale":"2024-04-14T23:35:48.929960+0000","last_undegraded":"2024-04-14T23:35:48.929960+0000","last_fullsized":"2024-04-14T23:35:48.929960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:38.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128703+0000","last_change":"2024-04-14T23:35:47.153332+0000","last_active":"2024-04-14T23:35:48.128703+0000","last_peered":"2024-04-14T23:35:48.128703+0000","last_clean":"2024-04-14T23:35:48.128703+0000","last_became_active":"2024-04-14T23:35:47.152701+0000","last_became_peered":"2024-04-14T23:35:47.152701+0000","last_unstale":"2024-04-14T23:35:48.128703+0000","last_undegraded":"2024-04-14T23:35:48.128703+0000","last_fullsized":"2024-04-14T23:35:48.128703+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:45:43.060746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390464+0000","last_change":"2024-04-14T23:35:46.132189+0000","last_active":"2024-04-14T23:35:48.390464+0000","last_peered":"2024-04-14T23:35:48.390464+0000","last_clean":"2024-04-14T23:35:48.390464+0000","last_became_active":"2024-04-14T23:35:46.131898+0000","last_became_peered":"2024-04-14T23:35:46.131898+0000","last_unstale":"2024-04-14T23:35:48.390464+0000","last_undegraded":"2024-04-14T23:35:48.390464+0000","last_fullsized":"2024-04-14T23:35:48.390464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:39.852879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930999+0000","last_change":"2024-04-14T23:35:47.151785+0000","last_active":"2024-04-14T23:35:48.930999+0000","last_peered":"2024-04-14T23:35:48.930999+0000","last_clean":"2024-04-14T23:35:48.930999+0000","last_became_active":"2024-04-14T23:35:47.151273+0000","last_became_peered":"2024-04-14T23:35:47.151273+0000","last_unstale":"2024-04-14T23:35:48.930999+0000","last_undegraded":"2024-04-14T23:35:48.930999+0000","last_fullsized":"2024-04-14T23:35:48.930999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:51.707591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128964+0000","last_change":"2024-04-14T23:35:46.130128+0000","last_active":"2024-04-14T23:35:48.128964+0000","last_peered":"2024-04-14T23:35:48.128964+0000","last_clean":"2024-04-14T23:35:48.128964+0000","last_became_active":"2024-04-14T23:35:46.129848+0000","last_became_peered":"2024-04-14T23:35:46.129848+0000","last_unstale":"2024-04-14T23:35:48.128964+0000","last_undegraded":"2024-04-14T23:35:48.128964+0000","last_fullsized":"2024-04-14T23:35:48.128964+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:25.040605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930239+0000","last_change":"2024-04-14T23:35:47.135501+0000","last_active":"2024-04-14T23:35:48.930239+0000","last_peered":"2024-04-14T23:35:48.930239+0000","last_clean":"2024-04-14T23:35:48.930239+0000","last_became_active":"2024-04-14T23:35:47.135240+0000","last_became_peered":"2024-04-14T23:35:47.135240+0000","last_unstale":"2024-04-14T23:35:48.930239+0000","last_undegraded":"2024-04-14T23:35:48.930239+0000","last_fullsized":"2024-04-14T23:35:48.930239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130481+0000","last_change":"2024-04-14T23:35:46.132005+0000","last_active":"2024-04-14T23:35:48.130481+0000","last_peered":"2024-04-14T23:35:48.130481+0000","last_clean":"2024-04-14T23:35:48.130481+0000","last_became_active":"2024-04-14T23:35:46.131640+0000","last_became_peered":"2024-04-14T23:35:46.131640+0000","last_unstale":"2024-04-14T23:35:48.130481+0000","last_undegraded":"2024-04-14T23:35:48.130481+0000","last_fullsized":"2024-04-14T23:35:48.130481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:11.340513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929884+0000","last_change":"2024-04-14T23:35:47.153756+0000","last_active":"2024-04-14T23:35:48.929884+0000","last_peered":"2024-04-14T23:35:48.929884+0000","last_clean":"2024-04-14T23:35:48.929884+0000","last_became_active":"2024-04-14T23:35:47.153494+0000","last_became_peered":"2024-04-14T23:35:47.153494+0000","last_unstale":"2024-04-14T23:35:48.929884+0000","last_undegraded":"2024-04-14T23:35:48.929884+0000","last_fullsized":"2024-04-14T23:35:48.929884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:26.044901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.131064+0000","last_change":"2024-04-14T23:35:46.129168+0000","last_active":"2024-04-14T23:35:48.131064+0000","last_peered":"2024-04-14T23:35:48.131064+0000","last_clean":"2024-04-14T23:35:48.131064+0000","last_became_active":"2024-04-14T23:35:46.128883+0000","last_became_peered":"2024-04-14T23:35:46.128883+0000","last_unstale":"2024-04-14T23:35:48.131064+0000","last_undegraded":"2024-04-14T23:35:48.131064+0000","last_fullsized":"2024-04-14T23:35:48.131064+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391075+0000","last_change":"2024-04-14T23:35:47.154541+0000","last_active":"2024-04-14T23:35:48.391075+0000","last_peered":"2024-04-14T23:35:48.391075+0000","last_clean":"2024-04-14T23:35:48.391075+0000","last_became_active":"2024-04-14T23:35:47.154276+0000","last_became_peered":"2024-04-14T23:35:47.154276+0000","last_unstale":"2024-04-14T23:35:48.391075+0000","last_undegraded":"2024-04-14T23:35:48.391075+0000","last_fullsized":"2024-04-14T23:35:48.391075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:54:50.487935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'9","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:58.300100+0000","last_change":"2024-04-14T23:35:46.136620+0000","last_active":"2024-04-14T23:35:58.300100+0000","last_peered":"2024-04-14T23:35:58.300100+0000","last_clean":"2024-04-14T23:35:58.300100+0000","last_became_active":"2024-04-14T23:35:46.136185+0000","last_became_peered":"2024-04-14T23:35:46.136185+0000","last_unstale":"2024-04-14T23:35:58.300100+0000","last_undegraded":"2024-04-14T23:35:58.300100+0000","last_fullsized":"2024-04-14T23:35:58.300100+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:26.963649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6988,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929540+0000","last_change":"2024-04-14T23:35:47.158305+0000","last_active":"2024-04-14T23:35:48.929540+0000","last_peered":"2024-04-14T23:35:48.929540+0000","last_clean":"2024-04-14T23:35:48.929540+0000","last_became_active":"2024-04-14T23:35:47.157745+0000","last_became_peered":"2024-04-14T23:35:47.157745+0000","last_unstale":"2024-04-14T23:35:48.929540+0000","last_undegraded":"2024-04-14T23:35:48.929540+0000","last_fullsized":"2024-04-14T23:35:48.929540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:49.647834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128763+0000","last_change":"2024-04-14T23:35:46.133651+0000","last_active":"2024-04-14T23:35:48.128763+0000","last_peered":"2024-04-14T23:35:48.128763+0000","last_clean":"2024-04-14T23:35:48.128763+0000","last_became_active":"2024-04-14T23:35:46.133356+0000","last_became_peered":"2024-04-14T23:35:46.133356+0000","last_unstale":"2024-04-14T23:35:48.128763+0000","last_undegraded":"2024-04-14T23:35:48.128763+0000","last_fullsized":"2024-04-14T23:35:48.128763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:39.741647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128618+0000","last_change":"2024-04-14T23:35:47.143315+0000","last_active":"2024-04-14T23:35:48.128618+0000","last_peered":"2024-04-14T23:35:48.128618+0000","last_clean":"2024-04-14T23:35:48.128618+0000","last_became_active":"2024-04-14T23:35:47.143045+0000","last_became_peered":"2024-04-14T23:35:47.143045+0000","last_unstale":"2024-04-14T23:35:48.128618+0000","last_undegraded":"2024-04-14T23:35:48.128618+0000","last_fullsized":"2024-04-14T23:35:48.128618+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:10:25.940509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929923+0000","last_change":"2024-04-14T23:35:46.134679+0000","last_active":"2024-04-14T23:35:48.929923+0000","last_peered":"2024-04-14T23:35:48.929923+0000","last_clean":"2024-04-14T23:35:48.929923+0000","last_became_active":"2024-04-14T23:35:46.134400+0000","last_became_peered":"2024-04-14T23:35:46.134400+0000","last_unstale":"2024-04-14T23:35:48.929923+0000","last_undegraded":"2024-04-14T23:35:48.929923+0000","last_fullsized":"2024-04-14T23:35:48.929923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:11.829667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929760+0000","last_change":"2024-04-14T23:35:47.135899+0000","last_active":"2024-04-14T23:35:48.929760+0000","last_peered":"2024-04-14T23:35:48.929760+0000","last_clean":"2024-04-14T23:35:48.929760+0000","last_became_active":"2024-04-14T23:35:47.134733+0000","last_became_peered":"2024-04-14T23:35:47.134733+0000","last_unstale":"2024-04-14T23:35:48.929760+0000","last_undegraded":"2024-04-14T23:35:48.929760+0000","last_fullsized":"2024-04-14T23:35:48.929760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:26.044901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129540+0000","last_change":"2024-04-14T23:35:46.128127+0000","last_active":"2024-04-14T23:35:48.129540+0000","last_peered":"2024-04-14T23:35:48.129540+0000","last_clean":"2024-04-14T23:35:48.129540+0000","last_became_active":"2024-04-14T23:35:46.127852+0000","last_became_peered":"2024-04-14T23:35:46.127852+0000","last_unstale":"2024-04-14T23:35:48.129540+0000","last_undegraded":"2024-04-14T23:35:48.129540+0000","last_fullsized":"2024-04-14T23:35:48.129540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:28:27.338198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128687+0000","last_change":"2024-04-14T23:35:47.147302+0000","last_active":"2024-04-14T23:35:48.128687+0000","last_peered":"2024-04-14T23:35:48.128687+0000","last_clean":"2024-04-14T23:35:48.128687+0000","last_became_active":"2024-04-14T23:35:47.147022+0000","last_became_peered":"2024-04-14T23:35:47.147022+0000","last_unstale":"2024-04-14T23:35:48.128687+0000","last_undegraded":"2024-04-14T23:35:48.128687+0000","last_fullsized":"2024-04-14T23:35:48.128687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:29:11.592779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929556+0000","last_change":"2024-04-14T23:35:46.139301+0000","last_active":"2024-04-14T23:35:48.929556+0000","last_peered":"2024-04-14T23:35:48.929556+0000","last_clean":"2024-04-14T23:35:48.929556+0000","last_became_active":"2024-04-14T23:35:46.138922+0000","last_became_peered":"2024-04-14T23:35:46.138922+0000","last_unstale":"2024-04-14T23:35:48.929556+0000","last_undegraded":"2024-04-14T23:35:48.929556+0000","last_fullsized":"2024-04-14T23:35:48.929556+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:30:04.280095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128762+0000","last_change":"2024-04-14T23:35:47.143210+0000","last_active":"2024-04-14T23:35:48.128762+0000","last_peered":"2024-04-14T23:35:48.128762+0000","last_clean":"2024-04-14T23:35:48.128762+0000","last_became_active":"2024-04-14T23:35:47.142925+0000","last_became_peered":"2024-04-14T23:35:47.142925+0000","last_unstale":"2024-04-14T23:35:48.128762+0000","last_undegraded":"2024-04-14T23:35:48.128762+0000","last_fullsized":"2024-04-14T23:35:48.128762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:19:31.536395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130578+0000","last_change":"2024-04-14T23:35:46.130896+0000","last_active":"2024-04-14T23:35:48.130578+0000","last_peered":"2024-04-14T23:35:48.130578+0000","last_clean":"2024-04-14T23:35:48.130578+0000","last_became_active":"2024-04-14T23:35:46.130423+0000","last_became_peered":"2024-04-14T23:35:46.130423+0000","last_unstale":"2024-04-14T23:35:48.130578+0000","last_undegraded":"2024-04-14T23:35:48.130578+0000","last_fullsized":"2024-04-14T23:35:48.130578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:38.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.131117+0000","last_change":"2024-04-14T23:35:47.149269+0000","last_active":"2024-04-14T23:35:48.131117+0000","last_peered":"2024-04-14T23:35:48.131117+0000","last_clean":"2024-04-14T23:35:48.131117+0000","last_became_active":"2024-04-14T23:35:47.148964+0000","last_became_peered":"2024-04-14T23:35:47.148964+0000","last_unstale":"2024-04-14T23:35:48.131117+0000","last_undegraded":"2024-04-14T23:35:48.131117+0000","last_fullsized":"2024-04-14T23:35:48.131117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:16:06.767783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391019+0000","last_change":"2024-04-14T23:35:46.137019+0000","last_active":"2024-04-14T23:35:48.391019+0000","last_peered":"2024-04-14T23:35:48.391019+0000","last_clean":"2024-04-14T23:35:48.391019+0000","last_became_active":"2024-04-14T23:35:46.136718+0000","last_became_peered":"2024-04-14T23:35:46.136718+0000","last_unstale":"2024-04-14T23:35:48.391019+0000","last_undegraded":"2024-04-14T23:35:48.391019+0000","last_fullsized":"2024-04-14T23:35:48.391019+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:11.829667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390937+0000","last_change":"2024-04-14T23:35:47.149376+0000","last_active":"2024-04-14T23:35:48.390937+0000","last_peered":"2024-04-14T23:35:48.390937+0000","last_clean":"2024-04-14T23:35:48.390937+0000","last_became_active":"2024-04-14T23:35:47.149067+0000","last_became_peered":"2024-04-14T23:35:47.149067+0000","last_unstale":"2024-04-14T23:35:48.390937+0000","last_undegraded":"2024-04-14T23:35:48.390937+0000","last_fullsized":"2024-04-14T23:35:48.390937+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:18.147979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930844+0000","last_change":"2024-04-14T23:35:46.136557+0000","last_active":"2024-04-14T23:35:48.930844+0000","last_peered":"2024-04-14T23:35:48.930844+0000","last_clean":"2024-04-14T23:35:48.930844+0000","last_became_active":"2024-04-14T23:35:46.136236+0000","last_became_peered":"2024-04-14T23:35:46.136236+0000","last_unstale":"2024-04-14T23:35:48.930844+0000","last_undegraded":"2024-04-14T23:35:48.930844+0000","last_fullsized":"2024-04-14T23:35:48.930844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:08:47.351218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930975+0000","last_change":"2024-04-14T23:35:47.150822+0000","last_active":"2024-04-14T23:35:48.930975+0000","last_peered":"2024-04-14T23:35:48.930975+0000","last_clean":"2024-04-14T23:35:48.930975+0000","last_became_active":"2024-04-14T23:35:47.150517+0000","last_became_peered":"2024-04-14T23:35:47.150517+0000","last_unstale":"2024-04-14T23:35:48.930975+0000","last_undegraded":"2024-04-14T23:35:48.930975+0000","last_fullsized":"2024-04-14T23:35:48.930975+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:29.030602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930275+0000","last_change":"2024-04-14T23:35:46.136475+0000","last_active":"2024-04-14T23:35:48.930275+0000","last_peered":"2024-04-14T23:35:48.930275+0000","last_clean":"2024-04-14T23:35:48.930275+0000","last_became_active":"2024-04-14T23:35:46.136103+0000","last_became_peered":"2024-04-14T23:35:46.136103+0000","last_unstale":"2024-04-14T23:35:48.930275+0000","last_undegraded":"2024-04-14T23:35:48.930275+0000","last_fullsized":"2024-04-14T23:35:48.930275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:11.340513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929988+0000","last_change":"2024-04-14T23:35:47.146919+0000","last_active":"2024-04-14T23:35:48.929988+0000","last_peered":"2024-04-14T23:35:48.929988+0000","last_clean":"2024-04-14T23:35:48.929988+0000","last_became_active":"2024-04-14T23:35:47.146080+0000","last_became_peered":"2024-04-14T23:35:47.146080+0000","last_unstale":"2024-04-14T23:35:48.929988+0000","last_undegraded":"2024-04-14T23:35:48.929988+0000","last_fullsized":"2024-04-14T23:35:48.929988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930583+0000","last_change":"2024-04-14T23:35:46.132858+0000","last_active":"2024-04-14T23:35:48.930583+0000","last_peered":"2024-04-14T23:35:48.930583+0000","last_clean":"2024-04-14T23:35:48.930583+0000","last_became_active":"2024-04-14T23:35:46.132542+0000","last_became_peered":"2024-04-14T23:35:46.132542+0000","last_unstale":"2024-04-14T23:35:48.930583+0000","last_undegraded":"2024-04-14T23:35:48.930583+0000","last_fullsized":"2024-04-14T23:35:48.930583+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:51:12.197819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929957+0000","last_change":"2024-04-14T23:35:47.154850+0000","last_active":"2024-04-14T23:35:48.929957+0000","last_peered":"2024-04-14T23:35:48.929957+0000","last_clean":"2024-04-14T23:35:48.929957+0000","last_became_active":"2024-04-14T23:35:47.154568+0000","last_became_peered":"2024-04-14T23:35:47.154568+0000","last_unstale":"2024-04-14T23:35:48.929957+0000","last_undegraded":"2024-04-14T23:35:48.929957+0000","last_fullsized":"2024-04-14T23:35:48.929957+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930191+0000","last_change":"2024-04-14T23:35:46.131620+0000","last_active":"2024-04-14T23:35:48.930191+0000","last_peered":"2024-04-14T23:35:48.930191+0000","last_clean":"2024-04-14T23:35:48.930191+0000","last_became_active":"2024-04-14T23:35:46.131245+0000","last_became_peered":"2024-04-14T23:35:46.131245+0000","last_unstale":"2024-04-14T23:35:48.930191+0000","last_undegraded":"2024-04-14T23:35:48.930191+0000","last_fullsized":"2024-04-14T23:35:48.930191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:43:31.510170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129762+0000","last_change":"2024-04-14T23:35:47.149519+0000","last_active":"2024-04-14T23:35:48.129762+0000","last_peered":"2024-04-14T23:35:48.129762+0000","last_clean":"2024-04-14T23:35:48.129762+0000","last_became_active":"2024-04-14T23:35:47.149206+0000","last_became_peered":"2024-04-14T23:35:47.149206+0000","last_unstale":"2024-04-14T23:35:48.129762+0000","last_undegraded":"2024-04-14T23:35:48.129762+0000","last_fullsized":"2024-04-14T23:35:48.129762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929811+0000","last_change":"2024-04-14T23:35:46.136409+0000","last_active":"2024-04-14T23:35:48.929811+0000","last_peered":"2024-04-14T23:35:48.929811+0000","last_clean":"2024-04-14T23:35:48.929811+0000","last_became_active":"2024-04-14T23:35:46.136141+0000","last_became_peered":"2024-04-14T23:35:46.136141+0000","last_unstale":"2024-04-14T23:35:48.929811+0000","last_undegraded":"2024-04-14T23:35:48.929811+0000","last_fullsized":"2024-04-14T23:35:48.929811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128851+0000","last_change":"2024-04-14T23:35:47.152792+0000","last_active":"2024-04-14T23:35:48.128851+0000","last_peered":"2024-04-14T23:35:48.128851+0000","last_clean":"2024-04-14T23:35:48.128851+0000","last_became_active":"2024-04-14T23:35:47.152529+0000","last_became_peered":"2024-04-14T23:35:47.152529+0000","last_unstale":"2024-04-14T23:35:48.128851+0000","last_undegraded":"2024-04-14T23:35:48.128851+0000","last_fullsized":"2024-04-14T23:35:48.128851+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:26:37.825904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930189+0000","last_change":"2024-04-14T23:35:46.131128+0000","last_active":"2024-04-14T23:35:48.930189+0000","last_peered":"2024-04-14T23:35:48.930189+0000","last_clean":"2024-04-14T23:35:48.930189+0000","last_became_active":"2024-04-14T23:35:46.130829+0000","last_became_peered":"2024-04-14T23:35:46.130829+0000","last_unstale":"2024-04-14T23:35:48.930189+0000","last_undegraded":"2024-04-14T23:35:48.930189+0000","last_fullsized":"2024-04-14T23:35:48.930189+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:26:22.509424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930226+0000","last_change":"2024-04-14T23:35:47.157604+0000","last_active":"2024-04-14T23:35:48.930226+0000","last_peered":"2024-04-14T23:35:48.930226+0000","last_clean":"2024-04-14T23:35:48.930226+0000","last_became_active":"2024-04-14T23:35:47.157332+0000","last_became_peered":"2024-04-14T23:35:47.157332+0000","last_unstale":"2024-04-14T23:35:48.930226+0000","last_undegraded":"2024-04-14T23:35:48.930226+0000","last_fullsized":"2024-04-14T23:35:48.930226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:27.967946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130676+0000","last_change":"2024-04-14T23:35:46.130670+0000","last_active":"2024-04-14T23:35:48.130676+0000","last_peered":"2024-04-14T23:35:48.130676+0000","last_clean":"2024-04-14T23:35:48.130676+0000","last_became_active":"2024-04-14T23:35:46.130053+0000","last_became_peered":"2024-04-14T23:35:46.130053+0000","last_unstale":"2024-04-14T23:35:48.130676+0000","last_undegraded":"2024-04-14T23:35:48.130676+0000","last_fullsized":"2024-04-14T23:35:48.130676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:11.829667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930021+0000","last_change":"2024-04-14T23:35:47.135664+0000","last_active":"2024-04-14T23:35:48.930021+0000","last_peered":"2024-04-14T23:35:48.930021+0000","last_clean":"2024-04-14T23:35:48.930021+0000","last_became_active":"2024-04-14T23:35:47.135290+0000","last_became_peered":"2024-04-14T23:35:47.135290+0000","last_unstale":"2024-04-14T23:35:48.930021+0000","last_undegraded":"2024-04-14T23:35:48.930021+0000","last_fullsized":"2024-04-14T23:35:48.930021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:18.147979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:49.131837+0000","last_change":"2024-04-14T23:35:46.133201+0000","last_active":"2024-04-14T23:35:49.131837+0000","last_peered":"2024-04-14T23:35:49.131837+0000","last_clean":"2024-04-14T23:35:49.131837+0000","last_became_active":"2024-04-14T23:35:46.132894+0000","last_became_peered":"2024-04-14T23:35:46.132894+0000","last_unstale":"2024-04-14T23:35:49.131837+0000","last_undegraded":"2024-04-14T23:35:49.131837+0000","last_fullsized":"2024-04-14T23:35:49.131837+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:23:21.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128887+0000","last_change":"2024-04-14T23:35:47.153255+0000","last_active":"2024-04-14T23:35:48.128887+0000","last_peered":"2024-04-14T23:35:48.128887+0000","last_clean":"2024-04-14T23:35:48.128887+0000","last_became_active":"2024-04-14T23:35:47.152994+0000","last_became_peered":"2024-04-14T23:35:47.152994+0000","last_unstale":"2024-04-14T23:35:48.128887+0000","last_undegraded":"2024-04-14T23:35:48.128887+0000","last_fullsized":"2024-04-14T23:35:48.128887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:32:36.376204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929974+0000","last_change":"2024-04-14T23:35:46.129019+0000","last_active":"2024-04-14T23:35:48.929974+0000","last_peered":"2024-04-14T23:35:48.929974+0000","last_clean":"2024-04-14T23:35:48.929974+0000","last_became_active":"2024-04-14T23:35:46.128736+0000","last_became_peered":"2024-04-14T23:35:46.128736+0000","last_unstale":"2024-04-14T23:35:48.929974+0000","last_undegraded":"2024-04-14T23:35:48.929974+0000","last_fullsized":"2024-04-14T23:35:48.929974+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:28.026305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929722+0000","last_change":"2024-04-14T23:35:47.146466+0000","last_active":"2024-04-14T23:35:48.929722+0000","last_peered":"2024-04-14T23:35:48.929722+0000","last_clean":"2024-04-14T23:35:48.929722+0000","last_became_active":"2024-04-14T23:35:47.146038+0000","last_became_peered":"2024-04-14T23:35:47.146038+0000","last_unstale":"2024-04-14T23:35:48.929722+0000","last_undegraded":"2024-04-14T23:35:48.929722+0000","last_fullsized":"2024-04-14T23:35:48.929722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:27.967946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929825+0000","last_change":"2024-04-14T23:35:46.137505+0000","last_active":"2024-04-14T23:35:48.929825+0000","last_peered":"2024-04-14T23:35:48.929825+0000","last_clean":"2024-04-14T23:35:48.929825+0000","last_became_active":"2024-04-14T23:35:46.137073+0000","last_became_peered":"2024-04-14T23:35:46.137073+0000","last_unstale":"2024-04-14T23:35:48.929825+0000","last_undegraded":"2024-04-14T23:35:48.929825+0000","last_fullsized":"2024-04-14T23:35:48.929825+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929904+0000","last_change":"2024-04-14T23:35:47.144646+0000","last_active":"2024-04-14T23:35:48.929904+0000","last_peered":"2024-04-14T23:35:48.929904+0000","last_clean":"2024-04-14T23:35:48.929904+0000","last_became_active":"2024-04-14T23:35:47.144302+0000","last_became_peered":"2024-04-14T23:35:47.144302+0000","last_unstale":"2024-04-14T23:35:48.929904+0000","last_undegraded":"2024-04-14T23:35:48.929904+0000","last_fullsized":"2024-04-14T23:35:48.929904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:38.502135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130300+0000","last_change":"2024-04-14T23:35:46.132200+0000","last_active":"2024-04-14T23:35:48.130300+0000","last_peered":"2024-04-14T23:35:48.130300+0000","last_clean":"2024-04-14T23:35:48.130300+0000","last_became_active":"2024-04-14T23:35:46.131951+0000","last_became_peered":"2024-04-14T23:35:46.131951+0000","last_unstale":"2024-04-14T23:35:48.130300+0000","last_undegraded":"2024-04-14T23:35:48.130300+0000","last_fullsized":"2024-04-14T23:35:48.130300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:50:42.618031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390704+0000","last_change":"2024-04-14T23:35:47.152240+0000","last_active":"2024-04-14T23:35:48.390704+0000","last_peered":"2024-04-14T23:35:48.390704+0000","last_clean":"2024-04-14T23:35:48.390704+0000","last_became_active":"2024-04-14T23:35:47.151949+0000","last_became_peered":"2024-04-14T23:35:47.151949+0000","last_unstale":"2024-04-14T23:35:48.390704+0000","last_undegraded":"2024-04-14T23:35:48.390704+0000","last_fullsized":"2024-04-14T23:35:48.390704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390467+0000","last_change":"2024-04-14T23:35:46.133774+0000","last_active":"2024-04-14T23:35:48.390467+0000","last_peered":"2024-04-14T23:35:48.390467+0000","last_clean":"2024-04-14T23:35:48.390467+0000","last_became_active":"2024-04-14T23:35:46.133248+0000","last_became_peered":"2024-04-14T23:35:46.133248+0000","last_unstale":"2024-04-14T23:35:48.390467+0000","last_undegraded":"2024-04-14T23:35:48.390467+0000","last_fullsized":"2024-04-14T23:35:48.390467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:10:15.375417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930207+0000","last_change":"2024-04-14T23:35:47.137101+0000","last_active":"2024-04-14T23:35:48.930207+0000","last_peered":"2024-04-14T23:35:48.930207+0000","last_clean":"2024-04-14T23:35:48.930207+0000","last_became_active":"2024-04-14T23:35:47.135299+0000","last_became_peered":"2024-04-14T23:35:47.135299+0000","last_unstale":"2024-04-14T23:35:48.930207+0000","last_undegraded":"2024-04-14T23:35:48.930207+0000","last_fullsized":"2024-04-14T23:35:48.930207+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:13:37.995199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128481+0000","last_change":"2024-04-14T23:35:46.130340+0000","last_active":"2024-04-14T23:35:48.128481+0000","last_peered":"2024-04-14T23:35:48.128481+0000","last_clean":"2024-04-14T23:35:48.128481+0000","last_became_active":"2024-04-14T23:35:46.129730+0000","last_became_peered":"2024-04-14T23:35:46.129730+0000","last_unstale":"2024-04-14T23:35:48.128481+0000","last_undegraded":"2024-04-14T23:35:48.128481+0000","last_fullsized":"2024-04-14T23:35:48.128481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:37.497838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130505+0000","last_change":"2024-04-14T23:35:47.158482+0000","last_active":"2024-04-14T23:35:48.130505+0000","last_peered":"2024-04-14T23:35:48.130505+0000","last_clean":"2024-04-14T23:35:48.130505+0000","last_became_active":"2024-04-14T23:35:47.158231+0000","last_became_peered":"2024-04-14T23:35:47.158231+0000","last_unstale":"2024-04-14T23:35:48.130505+0000","last_undegraded":"2024-04-14T23:35:48.130505+0000","last_fullsized":"2024-04-14T23:35:48.130505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:28:35.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929927+0000","last_change":"2024-04-14T23:35:46.136429+0000","last_active":"2024-04-14T23:35:48.929927+0000","last_peered":"2024-04-14T23:35:48.929927+0000","last_clean":"2024-04-14T23:35:48.929927+0000","last_became_active":"2024-04-14T23:35:46.136181+0000","last_became_peered":"2024-04-14T23:35:46.136181+0000","last_unstale":"2024-04-14T23:35:48.929927+0000","last_undegraded":"2024-04-14T23:35:48.929927+0000","last_fullsized":"2024-04-14T23:35:48.929927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:58:35.171753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929803+0000","last_change":"2024-04-14T23:34:27.438796+0000","last_active":"2024-04-14T23:35:48.929803+0000","last_peered":"2024-04-14T23:35:48.929803+0000","last_clean":"2024-04-14T23:35:48.929803+0000","last_became_active":"2024-04-14T23:34:27.437932+0000","last_became_peered":"2024-04-14T23:34:27.437932+0000","last_unstale":"2024-04-14T23:35:48.929803+0000","last_undegraded":"2024-04-14T23:35:48.929803+0000","last_fullsized":"2024-04-14T23:35:48.929803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_clean_scrub_stamp":"2024-04-14T23:34:26.390323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:11:13.484245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":7786,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1064960,"data_stored":792539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":471040,"data_stored":202135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":197243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":197263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":787575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T23:36:03.424 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T23:36:03.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.557+0000 7f030331e640 1 Processor -- start 2024-04-14T23:36:03.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.557+0000 7f030331e640 1 -- start start 2024-04-14T23:36:03.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.558+0000 7f030331e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02fc15e420 0x7f02fc0d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:03.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.558+0000 7f030331e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f02fc0cf020 0x7f02fc0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:03.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.558+0000 7f030331e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02fc0d1040 con 0x7f02fc0ce4b0 2024-04-14T23:36:03.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.558+0000 7f030331e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f02fc0cc280 con 0x7f02fc0cf020 2024-04-14T23:36:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.558+0000 7f030331e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f02fc06d750 con 0x7f02fc15e420 2024-04-14T23:36:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.558+0000 7f03018bb640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f02fc0cf020 0x7f02fc0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.558+0000 7f03008b9640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f02fc0ce4b0 0x7f02fc0ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49938/0 (socket says 172.21.15.47:49938) 2024-04-14T23:36:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.558+0000 7f03008b9640 1 -- 172.21.15.47:0/2510637674 learned_addr learned my addr 172.21.15.47:0/2510637674 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.558+0000 7f03010ba640 1 --2- 172.21.15.47:0/2510637674 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02fc15e420 0x7f02fc0d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.559+0000 7f03018bb640 1 -- 172.21.15.47:0/2510637674 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02fc15e420 msgr2=0x7f02fc0d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.559+0000 7f03018bb640 1 --2- 172.21.15.47:0/2510637674 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02fc15e420 0x7f02fc0d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.559+0000 7f03018bb640 1 -- 172.21.15.47:0/2510637674 >> v1:172.21.15.47:6789/0 conn(0x7f02fc0ce4b0 legacy=0x7f02fc0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.559+0000 7f02f3fff640 1 -- 172.21.15.47:0/2510637674 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577873533 0 0) 0x7f02fc0d1040 con 0x7f02fc0ce4b0 2024-04-14T23:36:03.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.559+0000 7f03018bb640 1 -- 172.21.15.47:0/2510637674 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02fc0d1320 con 0x7f02fc0cf020 2024-04-14T23:36:03.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.559+0000 7f03018bb640 1 --2- 172.21.15.47:0/2510637674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02fc0cf020 0x7f02fc0cccd0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009d90 tx=0x7f02f402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4743794c20c686d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:03.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.559+0000 7f02f3fff640 1 -- 172.21.15.47:0/2510637674 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4039070 con 0x7f02fc0cf020 2024-04-14T23:36:03.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.559+0000 7f02f3fff640 1 -- 172.21.15.47:0/2510637674 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f402cce0 con 0x7f02fc0cf020 2024-04-14T23:36:03.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.559+0000 7f02f3fff640 1 -- 172.21.15.47:0/2510637674 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4034660 con 0x7f02fc0cf020 2024-04-14T23:36:03.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.560+0000 7f030331e640 1 -- 172.21.15.47:0/2510637674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02fc0cf020 msgr2=0x7f02fc0cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:03.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.560+0000 7f030331e640 1 --2- 172.21.15.47:0/2510637674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02fc0cf020 0x7f02fc0cccd0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009d90 tx=0x7f02f402bf30 comp rx=0 tx=0).stop 2024-04-14T23:36:03.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.560+0000 7f030331e640 1 -- 172.21.15.47:0/2510637674 shutdown_connections 2024-04-14T23:36:03.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.560+0000 7f030331e640 1 --2- 172.21.15.47:0/2510637674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02fc0cf020 0x7f02fc0cccd0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.560+0000 7f030331e640 1 --2- 172.21.15.47:0/2510637674 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02fc15e420 0x7f02fc0d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.560+0000 7f030331e640 1 -- 172.21.15.47:0/2510637674 >> 172.21.15.47:0/2510637674 conn(0x7f02fc0d1c30 msgr2=0x7f02fc0d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:03.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.560+0000 7f030331e640 1 -- 172.21.15.47:0/2510637674 shutdown_connections 2024-04-14T23:36:03.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.560+0000 7f030331e640 1 -- 172.21.15.47:0/2510637674 wait complete. 2024-04-14T23:36:03.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.561+0000 7f030331e640 1 Processor -- start 2024-04-14T23:36:03.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.561+0000 7f030331e640 1 -- start start 2024-04-14T23:36:03.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.562+0000 7f030331e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02fc0ce4b0 0x7f02fc0af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:03.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.562+0000 7f030331e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02fc0cf020 0x7f02fc0afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:03.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.562+0000 7f030331e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02fc15e420 0x7f02fc0c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:03.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.562+0000 7f030331e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc15e800 con 0x7f02fc0ce4b0 2024-04-14T23:36:03.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.562+0000 7f030331e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc0cc7b0 con 0x7f02fc15e420 2024-04-14T23:36:03.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.562+0000 7f030331e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f02fc0cd210 con 0x7f02fc0cf020 2024-04-14T23:36:03.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.562+0000 7f03010ba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02fc0ce4b0 0x7f02fc0af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:03.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.562+0000 7f03010ba640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02fc0ce4b0 0x7f02fc0af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43770/0 (socket says 172.21.15.47:43770) 2024-04-14T23:36:03.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.562+0000 7f03010ba640 1 -- 172.21.15.47:0/667744652 learned_addr learned my addr 172.21.15.47:0/667744652 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:03.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.562+0000 7f03010ba640 1 -- 172.21.15.47:0/667744652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02fc0cf020 msgr2=0x7f02fc0afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:03.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.562+0000 7f03010ba640 1 --2- 172.21.15.47:0/667744652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02fc0cf020 0x7f02fc0afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.562+0000 7f03010ba640 1 -- 172.21.15.47:0/667744652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02fc15e420 msgr2=0x7f02fc0c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:03.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.562+0000 7f03010ba640 1 --2- 172.21.15.47:0/667744652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02fc15e420 0x7f02fc0c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.562+0000 7f03010ba640 1 -- 172.21.15.47:0/667744652 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02fc1f4cf0 con 0x7f02fc0ce4b0 2024-04-14T23:36:03.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.562+0000 7f03010ba640 1 --2- 172.21.15.47:0/667744652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02fc0ce4b0 0x7f02fc0af990 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f02f800d620 tx=0x7f02f800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:03.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.563+0000 7f02f1ffb640 1 -- 172.21.15.47:0/667744652 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f800b620 con 0x7f02fc0ce4b0 2024-04-14T23:36:03.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.563+0000 7f02f1ffb640 1 -- 172.21.15.47:0/667744652 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f8019070 con 0x7f02fc0ce4b0 2024-04-14T23:36:03.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.563+0000 7f030331e640 1 -- 172.21.15.47:0/667744652 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02fc1f3f30 con 0x7f02fc0ce4b0 2024-04-14T23:36:03.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.563+0000 7f02f1ffb640 1 -- 172.21.15.47:0/667744652 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f800ba00 con 0x7f02fc0ce4b0 2024-04-14T23:36:03.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.563+0000 7f030331e640 1 -- 172.21.15.47:0/667744652 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02fc1f44f0 con 0x7f02fc0ce4b0 2024-04-14T23:36:03.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.564+0000 7f030331e640 1 -- 172.21.15.47:0/667744652 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02fc075430 con 0x7f02fc0ce4b0 2024-04-14T23:36:03.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.564+0000 7f02f1ffb640 1 -- 172.21.15.47:0/667744652 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f02f800bba0 con 0x7f02fc0ce4b0 2024-04-14T23:36:03.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.564+0000 7f02f1ffb640 1 --2- 172.21.15.47:0/667744652 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f02e006b990 0x7f02e006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:03.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.564+0000 7f02f1ffb640 1 -- 172.21.15.47:0/667744652 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f02f808ada0 con 0x7f02fc0ce4b0 2024-04-14T23:36:03.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.565+0000 7f03008b9640 1 --2- 172.21.15.47:0/667744652 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f02e006b990 0x7f02e006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:03.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.565+0000 7f03008b9640 1 --2- 172.21.15.47:0/667744652 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f02e006b990 0x7f02e006de50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f02ec007fd0 tx=0x7f02ec007900 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:03.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.569+0000 7f02f1ffb640 1 -- 172.21.15.47:0/667744652 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f02f80598b0 con 0x7f02fc0ce4b0 2024-04-14T23:36:03.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.749+0000 7f030331e640 1 -- 172.21.15.47:0/667744652 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02fc0cbfd0 con 0x7f02fc0ce4b0 2024-04-14T23:36:03.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.751+0000 7f02f1ffb640 1 -- 172.21.15.47:0/667744652 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16930 (secure 0 0 0) 0x7f02f80591b0 con 0x7f02fc0ce4b0 2024-04-14T23:36:03.754 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:36:03.755 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":39,"fsid":"4f54965e-64cf-4502-8b02-6c5af72b63aa","created":"2024-04-14T23:34:14.077848+0000","modified":"2024-04-14T23:35:48.125365+0000","last_up_change":"2024-04-14T23:34:24.844448+0000","last_in_change":"2024-04-14T23:34:16.336568+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T23:34:26.390241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-14T23:35:44.881683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-14T23:35:45.449906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"159e3b22-9f83-451b-bac4-25fdaab508e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6801","nonce":634215866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6803","nonce":634215866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6807","nonce":634215866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":634215866},{"type":"v1","addr":"172.21.15.47:6805","nonce":634215866}]},"public_addr":"172.21.15.47:6801/634215866","cluster_addr":"172.21.15.47:6803/634215866","heartbeat_back_addr":"172.21.15.47:6807/634215866","heartbeat_front_addr":"172.21.15.47:6805/634215866","state":["exists","up"]},{"osd":1,"uuid":"8833077b-5072-40e7-8944-cf46f9b92f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6825","nonce":3466488958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6827","nonce":3466488958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6831","nonce":3466488958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3466488958},{"type":"v1","addr":"172.21.15.47:6829","nonce":3466488958}]},"public_addr":"172.21.15.47:6825/3466488958","cluster_addr":"172.21.15.47:6827/3466488958","heartbeat_back_addr":"172.21.15.47:6831/3466488958","heartbeat_front_addr":"172.21.15.47:6829/3466488958","state":["exists","up"]},{"osd":2,"uuid":"793bed0d-8bfc-4f11-964c-910e5bd1b0a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6809","nonce":313696127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6811","nonce":313696127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6815","nonce":313696127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":313696127},{"type":"v1","addr":"172.21.15.47:6813","nonce":313696127}]},"public_addr":"172.21.15.47:6809/313696127","cluster_addr":"172.21.15.47:6811/313696127","heartbeat_back_addr":"172.21.15.47:6815/313696127","heartbeat_front_addr":"172.21.15.47:6813/313696127","state":["exists","up"]},{"osd":3,"uuid":"fb724059-a31c-464b-95a7-52ed0f16ac0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6817","nonce":4047754630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6819","nonce":4047754630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6823","nonce":4047754630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":4047754630},{"type":"v1","addr":"172.21.15.47:6821","nonce":4047754630}]},"public_addr":"172.21.15.47:6817/4047754630","cluster_addr":"172.21.15.47:6819/4047754630","heartbeat_back_addr":"172.21.15.47:6823/4047754630","heartbeat_front_addr":"172.21.15.47:6821/4047754630","state":["exists","up"]},{"osd":4,"uuid":"5c1187d8-f76f-4f8b-90c7-c70bd7b02c7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6801","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6802","nonce":2576967079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6805","nonce":2576967079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6812","nonce":2576967079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2576967079},{"type":"v1","addr":"172.21.15.191:6809","nonce":2576967079}]},"public_addr":"172.21.15.191:6802/2576967079","cluster_addr":"172.21.15.191:6805/2576967079","heartbeat_back_addr":"172.21.15.191:6812/2576967079","heartbeat_front_addr":"172.21.15.191:6809/2576967079","state":["exists","up"]},{"osd":5,"uuid":"d03ac0c0-5054-43d5-93ca-cb2f0a08e5ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6817","nonce":1990913951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6819","nonce":1990913951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6826","nonce":1990913951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":1990913951},{"type":"v1","addr":"172.21.15.191:6822","nonce":1990913951}]},"public_addr":"172.21.15.191:6817/1990913951","cluster_addr":"172.21.15.191:6819/1990913951","heartbeat_back_addr":"172.21.15.191:6826/1990913951","heartbeat_front_addr":"172.21.15.191:6822/1990913951","state":["exists","up"]},{"osd":6,"uuid":"35440fb9-9183-43f6-aded-5490aa4076ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6803","nonce":2802066933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6808","nonce":2802066933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6815","nonce":2802066933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2802066933},{"type":"v1","addr":"172.21.15.191:6813","nonce":2802066933}]},"public_addr":"172.21.15.191:6803/2802066933","cluster_addr":"172.21.15.191:6808/2802066933","heartbeat_back_addr":"172.21.15.191:6815/2802066933","heartbeat_front_addr":"172.21.15.191:6813/2802066933","state":["exists","up"]},{"osd":7,"uuid":"3b40b787-0eb0-4fe8-b1c0-bd24c42a700d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6823","nonce":4231525383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6825","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6827","nonce":4231525383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6831","nonce":4231525383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":4231525383},{"type":"v1","addr":"172.21.15.191:6829","nonce":4231525383}]},"public_addr":"172.21.15.191:6823/4231525383","cluster_addr":"172.21.15.191:6827/4231525383","heartbeat_back_addr":"172.21.15.191:6831/4231525383","heartbeat_front_addr":"172.21.15.191:6829/4231525383","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.418160+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.463750+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.479586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.493812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.498842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.481372+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.496611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T23:34:21.502600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T23:36:03.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.753+0000 7f030331e640 1 -- 172.21.15.47:0/667744652 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f02e006b990 msgr2=0x7f02e006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:03.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.753+0000 7f030331e640 1 --2- 172.21.15.47:0/667744652 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f02e006b990 0x7f02e006de50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f02ec007fd0 tx=0x7f02ec007900 comp rx=0 tx=0).stop 2024-04-14T23:36:03.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.753+0000 7f030331e640 1 -- 172.21.15.47:0/667744652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02fc0ce4b0 msgr2=0x7f02fc0af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:03.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.753+0000 7f030331e640 1 --2- 172.21.15.47:0/667744652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02fc0ce4b0 0x7f02fc0af990 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f02f800d620 tx=0x7f02f800dae0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.753+0000 7f030331e640 1 -- 172.21.15.47:0/667744652 shutdown_connections 2024-04-14T23:36:03.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.753+0000 7f030331e640 1 --2- 172.21.15.47:0/667744652 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f02e006b990 0x7f02e006de50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.753+0000 7f030331e640 1 --2- 172.21.15.47:0/667744652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02fc15e420 0x7f02fc0c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.753+0000 7f030331e640 1 --2- 172.21.15.47:0/667744652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02fc0cf020 0x7f02fc0afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.753+0000 7f030331e640 1 --2- 172.21.15.47:0/667744652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02fc0ce4b0 0x7f02fc0af990 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:03.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.753+0000 7f030331e640 1 -- 172.21.15.47:0/667744652 >> 172.21.15.47:0/667744652 conn(0x7f02fc0d1c30 msgr2=0x7f02fc0ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:03.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.753+0000 7f030331e640 1 -- 172.21.15.47:0/667744652 shutdown_connections 2024-04-14T23:36:03.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:03.753+0000 7f030331e640 1 -- 172.21.15.47:0/667744652 wait complete. 2024-04-14T23:36:04.767 INFO:tasks.ceph:Scrubbing osd.0 2024-04-14T23:36:04.768 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-14T23:36:04.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.885+0000 7f01460de640 1 Processor -- start 2024-04-14T23:36:04.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.885+0000 7f01460de640 1 -- start start 2024-04-14T23:36:04.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.885+0000 7f01460de640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f01400b53c0 0x7f01400cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:04.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.885+0000 7f01460de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01400d2ce0 0x7f01400b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:04.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.885+0000 7f01460de640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01400b7090 con 0x7f01400cfb30 2024-04-14T23:36:04.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.885+0000 7f01460de640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f01400b6e40 con 0x7f01400b53c0 2024-04-14T23:36:04.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.885+0000 7f01460de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f01400b7370 con 0x7f01400d2ce0 2024-04-14T23:36:04.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.886+0000 7f013f7fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f01400b53c0 0x7f01400cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:04.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.886+0000 7f013f7fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f01400b53c0 0x7f01400cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44266/0 (socket says 172.21.15.47:44266) 2024-04-14T23:36:04.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.886+0000 7f013f7fe640 1 -- 172.21.15.47:0/3456450100 learned_addr learned my addr 172.21.15.47:0/3456450100 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:04.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.886+0000 7f013ffff640 1 --2- 172.21.15.47:0/3456450100 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01400d2ce0 0x7f01400b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:04.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.886+0000 7f013f7fe640 1 -- 172.21.15.47:0/3456450100 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01400d2ce0 msgr2=0x7f01400b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:04.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.886+0000 7f013f7fe640 1 --2- 172.21.15.47:0/3456450100 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01400d2ce0 0x7f01400b7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:04.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.886+0000 7f013f7fe640 1 -- 172.21.15.47:0/3456450100 >> v1:172.21.15.191:6789/0 conn(0x7f01400cfb30 legacy=0x7f01400d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:04.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.886+0000 7f013f7fe640 1 -- 172.21.15.47:0/3456450100 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01400b7650 con 0x7f01400b53c0 2024-04-14T23:36:04.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.887+0000 7f013f7fe640 1 --2- 172.21.15.47:0/3456450100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01400b53c0 0x7f01400cf5f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0130009870 tx=0x7f013002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4a76ecfe6518ef server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:04.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.887+0000 7f013e7fc640 1 -- 172.21.15.47:0/3456450100 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130034070 con 0x7f01400b53c0 2024-04-14T23:36:04.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.887+0000 7f013e7fc640 1 -- 172.21.15.47:0/3456450100 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0130030840 con 0x7f01400b53c0 2024-04-14T23:36:04.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.887+0000 7f013e7fc640 1 -- 172.21.15.47:0/3456450100 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130030c10 con 0x7f01400b53c0 2024-04-14T23:36:04.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.887+0000 7f01460de640 1 -- 172.21.15.47:0/3456450100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01400b53c0 msgr2=0x7f01400cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:04.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.887+0000 7f01460de640 1 --2- 172.21.15.47:0/3456450100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01400b53c0 0x7f01400cf5f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0130009870 tx=0x7f013002b980 comp rx=0 tx=0).stop 2024-04-14T23:36:04.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.887+0000 7f01460de640 1 -- 172.21.15.47:0/3456450100 shutdown_connections 2024-04-14T23:36:04.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.887+0000 7f01460de640 1 --2- 172.21.15.47:0/3456450100 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01400d2ce0 0x7f01400b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:04.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.887+0000 7f01460de640 1 --2- 172.21.15.47:0/3456450100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01400b53c0 0x7f01400cf5f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:04.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.887+0000 7f01460de640 1 -- 172.21.15.47:0/3456450100 >> 172.21.15.47:0/3456450100 conn(0x7f014009d2c0 msgr2=0x7f01400d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:04.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.887+0000 7f01460de640 1 -- 172.21.15.47:0/3456450100 shutdown_connections 2024-04-14T23:36:04.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.888+0000 7f01460de640 1 -- 172.21.15.47:0/3456450100 wait complete. 2024-04-14T23:36:04.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.889+0000 7f01460de640 1 Processor -- start 2024-04-14T23:36:04.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.889+0000 7f01460de640 1 -- start start 2024-04-14T23:36:04.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f01460de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01400b53c0 0x7f01401503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:04.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f01460de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01400cfb30 0x7f01401540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:04.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f01460de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01400d2ce0 0x7f01400cee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:04.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f01460de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f01400b5920 con 0x7f01400b53c0 2024-04-14T23:36:04.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f01460de640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f01400b57a0 con 0x7f01400cfb30 2024-04-14T23:36:04.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f01460de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f01400d1f90 con 0x7f01400d2ce0 2024-04-14T23:36:04.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f013f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01400b53c0 0x7f01401503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:04.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f013f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01400b53c0 0x7f01401503c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44268/0 (socket says 172.21.15.47:44268) 2024-04-14T23:36:04.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f013f7fe640 1 -- 172.21.15.47:0/1944549875 learned_addr learned my addr 172.21.15.47:0/1944549875 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:04.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f013ffff640 1 --2- 172.21.15.47:0/1944549875 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01400d2ce0 0x7f01400cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:04.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f013effd640 1 --2- 172.21.15.47:0/1944549875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01400cfb30 0x7f01401540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:04.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f013f7fe640 1 -- 172.21.15.47:0/1944549875 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01400d2ce0 msgr2=0x7f01400cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:04.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f013f7fe640 1 --2- 172.21.15.47:0/1944549875 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f01400d2ce0 0x7f01400cee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:04.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f013f7fe640 1 -- 172.21.15.47:0/1944549875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01400cfb30 msgr2=0x7f01401540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:04.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f013f7fe640 1 --2- 172.21.15.47:0/1944549875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01400cfb30 0x7f01401540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:04.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f013f7fe640 1 -- 172.21.15.47:0/1944549875 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01400b1830 con 0x7f01400b53c0 2024-04-14T23:36:04.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f013f7fe640 1 --2- 172.21.15.47:0/1944549875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01400b53c0 0x7f01401503c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0130000c00 tx=0x7f0130004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:04.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f0127fff640 1 -- 172.21.15.47:0/1944549875 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130048070 con 0x7f01400b53c0 2024-04-14T23:36:04.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f0127fff640 1 -- 172.21.15.47:0/1944549875 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0130030640 con 0x7f01400b53c0 2024-04-14T23:36:04.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f01460de640 1 -- 172.21.15.47:0/1944549875 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01400b1b10 con 0x7f01400b53c0 2024-04-14T23:36:04.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f0127fff640 1 -- 172.21.15.47:0/1944549875 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130034040 con 0x7f01400b53c0 2024-04-14T23:36:04.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.890+0000 7f01460de640 1 -- 172.21.15.47:0/1944549875 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01400b20d0 con 0x7f01400b53c0 2024-04-14T23:36:04.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.891+0000 7f01460de640 1 -- 172.21.15.47:0/1944549875 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01400b24b0 con 0x7f01400b53c0 2024-04-14T23:36:04.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.892+0000 7f0127fff640 1 -- 172.21.15.47:0/1944549875 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f013004b070 con 0x7f01400b53c0 2024-04-14T23:36:04.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.892+0000 7f0127fff640 1 --2- 172.21.15.47:0/1944549875 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f012c06b990 0x7f012c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:04.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.893+0000 7f0127fff640 1 -- 172.21.15.47:0/1944549875 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f01300acab0 con 0x7f01400b53c0 2024-04-14T23:36:04.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.893+0000 7f0127fff640 1 --2- 172.21.15.47:0/1944549875 >> [v2:172.21.15.47:6800/634215866,v1:172.21.15.47:6801/634215866] conn(0x7f012c0741f0 0x7f012c076630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:04.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.893+0000 7f0127fff640 1 -- 172.21.15.47:0/1944549875 --> [v2:172.21.15.47:6800/634215866,v1:172.21.15.47:6801/634215866] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f013003be50 con 0x7f012c0741f0 2024-04-14T23:36:04.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.893+0000 7f0127fff640 1 -- 172.21.15.47:0/1944549875 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f01300b12a0 con 0x7f01400b53c0 2024-04-14T23:36:04.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.893+0000 7f013effd640 1 --2- 172.21.15.47:0/1944549875 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f012c06b990 0x7f012c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:04.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.893+0000 7f013ffff640 1 --2- 172.21.15.47:0/1944549875 >> [v2:172.21.15.47:6800/634215866,v1:172.21.15.47:6801/634215866] conn(0x7f012c0741f0 0x7f012c076630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:04.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.893+0000 7f013ffff640 1 --2- 172.21.15.47:0/1944549875 >> [v2:172.21.15.47:6800/634215866,v1:172.21.15.47:6801/634215866] conn(0x7f012c0741f0 0x7f012c076630 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:04.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.893+0000 7f013effd640 1 --2- 172.21.15.47:0/1944549875 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f012c06b990 0x7f012c06de50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f01401606d0 tx=0x7f0134009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:04.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.894+0000 7f0127fff640 1 -- 172.21.15.47:0/1944549875 <== osd.0 v2:172.21.15.47:6800/634215866 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f013003be50 con 0x7f012c0741f0 2024-04-14T23:36:04.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.907+0000 7f01460de640 1 -- 172.21.15.47:0/1944549875 --> [v2:172.21.15.47:6800/634215866,v1:172.21.15.47:6801/634215866] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0140073460 con 0x7f012c0741f0 2024-04-14T23:36:04.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.907+0000 7f0127fff640 1 -- 172.21.15.47:0/1944549875 <== osd.0 v2:172.21.15.47:6800/634215866 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0140073460 con 0x7f012c0741f0 2024-04-14T23:36:04.911 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-14T23:36:04.911 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T23:36:04.911 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-14T23:36:04.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.908+0000 7f01460de640 1 -- 172.21.15.47:0/1944549875 >> [v2:172.21.15.47:6800/634215866,v1:172.21.15.47:6801/634215866] conn(0x7f012c0741f0 msgr2=0x7f012c076630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:04.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.908+0000 7f01460de640 1 --2- 172.21.15.47:0/1944549875 >> [v2:172.21.15.47:6800/634215866,v1:172.21.15.47:6801/634215866] conn(0x7f012c0741f0 0x7f012c076630 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:04.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.908+0000 7f01460de640 1 -- 172.21.15.47:0/1944549875 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f012c06b990 msgr2=0x7f012c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:04.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.908+0000 7f01460de640 1 --2- 172.21.15.47:0/1944549875 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f012c06b990 0x7f012c06de50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f01401606d0 tx=0x7f0134009040 comp rx=0 tx=0).stop 2024-04-14T23:36:04.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.908+0000 7f01460de640 1 -- 172.21.15.47:0/1944549875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01400b53c0 msgr2=0x7f01401503c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:04.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.908+0000 7f01460de640 1 --2- 172.21.15.47:0/1944549875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01400b53c0 0x7f01401503c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0130000c00 tx=0x7f0130004730 comp rx=0 tx=0).stop 2024-04-14T23:36:04.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.908+0000 7f013ffff640 1 -- 172.21.15.47:0/1944549875 reap_dead start 2024-04-14T23:36:04.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.908+0000 7f01460de640 1 -- 172.21.15.47:0/1944549875 shutdown_connections 2024-04-14T23:36:04.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.908+0000 7f01460de640 1 -- 172.21.15.47:0/1944549875 >> 172.21.15.47:0/1944549875 conn(0x7f014009d2c0 msgr2=0x7f014006bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:04.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.908+0000 7f01460de640 1 -- 172.21.15.47:0/1944549875 shutdown_connections 2024-04-14T23:36:04.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:04.908+0000 7f01460de640 1 -- 172.21.15.47:0/1944549875 wait complete. 2024-04-14T23:36:04.922 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-14T23:36:05.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.021+0000 7f82eb0de640 1 Processor -- start 2024-04-14T23:36:05.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.021+0000 7f82eb0de640 1 -- start start 2024-04-14T23:36:05.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.022+0000 7f82eb0de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82e40d0980 0x7f82e40cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.022+0000 7f82eb0de640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f82e40cccd0 0x7f82e40cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.022+0000 7f82eb0de640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e40d1040 con 0x7f82e415e420 2024-04-14T23:36:05.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.022+0000 7f82eb0de640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f82e40cc280 con 0x7f82e40cccd0 2024-04-14T23:36:05.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.022+0000 7f82eb0de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f82e406d750 con 0x7f82e40d0980 2024-04-14T23:36:05.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.022+0000 7f82e967b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f82e40cccd0 0x7f82e40cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.022+0000 7f82e967b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f82e40cccd0 0x7f82e40cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44278/0 (socket says 172.21.15.47:44278) 2024-04-14T23:36:05.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.022+0000 7f82e967b640 1 -- 172.21.15.47:0/2906623168 learned_addr learned my addr 172.21.15.47:0/2906623168 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:05.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.022+0000 7f82e3fff640 1 --2- 172.21.15.47:0/2906623168 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82e40d0980 0x7f82e40cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.022+0000 7f82e967b640 1 -- 172.21.15.47:0/2906623168 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82e40d0980 msgr2=0x7f82e40cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.022+0000 7f82e967b640 1 --2- 172.21.15.47:0/2906623168 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82e40d0980 0x7f82e40cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.022+0000 7f82e967b640 1 -- 172.21.15.47:0/2906623168 >> v1:172.21.15.191:6789/0 conn(0x7f82e415e420 legacy=0x7f82e40ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.022+0000 7f82e967b640 1 -- 172.21.15.47:0/2906623168 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e40d1320 con 0x7f82e40cccd0 2024-04-14T23:36:05.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.023+0000 7f82e967b640 1 --2- 172.21.15.47:0/2906623168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e40cccd0 0x7f82e40cd160 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009870 tx=0x7f82cc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6823ffc6864c35f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.023+0000 7f82e37fe640 1 -- 172.21.15.47:0/2906623168 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc034070 con 0x7f82e40cccd0 2024-04-14T23:36:05.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.023+0000 7f82e37fe640 1 -- 172.21.15.47:0/2906623168 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82cc030840 con 0x7f82e40cccd0 2024-04-14T23:36:05.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.023+0000 7f82e37fe640 1 -- 172.21.15.47:0/2906623168 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc030c10 con 0x7f82e40cccd0 2024-04-14T23:36:05.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.024+0000 7f82eb0de640 1 -- 172.21.15.47:0/2906623168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e40cccd0 msgr2=0x7f82e40cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.024+0000 7f82eb0de640 1 --2- 172.21.15.47:0/2906623168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e40cccd0 0x7f82e40cd160 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009870 tx=0x7f82cc02b980 comp rx=0 tx=0).stop 2024-04-14T23:36:05.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.024+0000 7f82eb0de640 1 -- 172.21.15.47:0/2906623168 shutdown_connections 2024-04-14T23:36:05.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.024+0000 7f82eb0de640 1 --2- 172.21.15.47:0/2906623168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e40cccd0 0x7f82e40cd160 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.024+0000 7f82eb0de640 1 --2- 172.21.15.47:0/2906623168 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82e40d0980 0x7f82e40cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.024+0000 7f82eb0de640 1 -- 172.21.15.47:0/2906623168 >> 172.21.15.47:0/2906623168 conn(0x7f82e40d1c30 msgr2=0x7f82e40d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:05.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.024+0000 7f82eb0de640 1 -- 172.21.15.47:0/2906623168 shutdown_connections 2024-04-14T23:36:05.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.024+0000 7f82eb0de640 1 -- 172.21.15.47:0/2906623168 wait complete. 2024-04-14T23:36:05.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.025+0000 7f82eb0de640 1 Processor -- start 2024-04-14T23:36:05.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.025+0000 7f82eb0de640 1 -- start start 2024-04-14T23:36:05.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82eb0de640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82e40cccd0 0x7f82e414af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82eb0de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e40d0980 0x7f82e41586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82eb0de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82e415e420 0x7f82e406f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82eb0de640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f82e40cc7b0 con 0x7f82e40d0980 2024-04-14T23:36:05.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82eb0de640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f82e40d0de0 con 0x7f82e415e420 2024-04-14T23:36:05.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82eb0de640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f82e415e800 con 0x7f82e40cccd0 2024-04-14T23:36:05.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82e3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e40d0980 0x7f82e41586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82e3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e40d0980 0x7f82e41586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44280/0 (socket says 172.21.15.47:44280) 2024-04-14T23:36:05.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82e3fff640 1 -- 172.21.15.47:0/191925408 learned_addr learned my addr 172.21.15.47:0/191925408 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:05.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82e3fff640 1 -- 172.21.15.47:0/191925408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82e40cccd0 msgr2=0x7f82e414af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82e967b640 1 --2- 172.21.15.47:0/191925408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82e415e420 0x7f82e406f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82e8e7a640 1 --2- 172.21.15.47:0/191925408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82e40cccd0 0x7f82e414af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82e3fff640 1 --2- 172.21.15.47:0/191925408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82e40cccd0 0x7f82e414af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82e3fff640 1 -- 172.21.15.47:0/191925408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82e415e420 msgr2=0x7f82e406f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82e3fff640 1 --2- 172.21.15.47:0/191925408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82e415e420 0x7f82e406f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82e3fff640 1 -- 172.21.15.47:0/191925408 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e41595c0 con 0x7f82e40d0980 2024-04-14T23:36:05.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.026+0000 7f82e3fff640 1 --2- 172.21.15.47:0/191925408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e40d0980 0x7f82e41586b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f82d400ce40 tx=0x7f82d400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.027+0000 7f82e17fa640 1 -- 172.21.15.47:0/191925408 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4003b90 con 0x7f82e40d0980 2024-04-14T23:36:05.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.027+0000 7f82e17fa640 1 -- 172.21.15.47:0/191925408 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d4003d30 con 0x7f82e40d0980 2024-04-14T23:36:05.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.027+0000 7f82eb0de640 1 -- 172.21.15.47:0/191925408 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e4159000 con 0x7f82e40d0980 2024-04-14T23:36:05.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.027+0000 7f82e17fa640 1 -- 172.21.15.47:0/191925408 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4004240 con 0x7f82e40d0980 2024-04-14T23:36:05.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.027+0000 7f82eb0de640 1 -- 172.21.15.47:0/191925408 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e40c8da0 con 0x7f82e40d0980 2024-04-14T23:36:05.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.028+0000 7f82eb0de640 1 -- 172.21.15.47:0/191925408 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e4075430 con 0x7f82e40d0980 2024-04-14T23:36:05.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.028+0000 7f82e17fa640 1 -- 172.21.15.47:0/191925408 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f82d40043e0 con 0x7f82e40d0980 2024-04-14T23:36:05.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.028+0000 7f82e17fa640 1 --2- 172.21.15.47:0/191925408 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f82c406b990 0x7f82c406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.029+0000 7f82e17fa640 1 -- 172.21.15.47:0/191925408 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f82d408b520 con 0x7f82e40d0980 2024-04-14T23:36:05.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.029+0000 7f82e8e7a640 1 --2- 172.21.15.47:0/191925408 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f82c406b990 0x7f82c406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.029+0000 7f82e8e7a640 1 --2- 172.21.15.47:0/191925408 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f82c406b990 0x7f82c406de50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00a750 tx=0x7f82dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.033+0000 7f82e17fa640 1 -- 172.21.15.47:0/191925408 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f82d401d340 con 0x7f82e40d0980 2024-04-14T23:36:05.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.215+0000 7f82eb0de640 1 -- 172.21.15.47:0/191925408 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f82e406c310 con 0x7f82c406b990 2024-04-14T23:36:05.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.215+0000 7f82e17fa640 1 -- 172.21.15.47:0/191925408 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f82e406c310 con 0x7f82c406b990 2024-04-14T23:36:05.219 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 0 to deep-scrub 2024-04-14T23:36:05.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.217+0000 7f82eb0de640 1 -- 172.21.15.47:0/191925408 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f82c406b990 msgr2=0x7f82c406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.217+0000 7f82eb0de640 1 --2- 172.21.15.47:0/191925408 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f82c406b990 0x7f82c406de50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00a750 tx=0x7f82dc008040 comp rx=0 tx=0).stop 2024-04-14T23:36:05.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.217+0000 7f82eb0de640 1 -- 172.21.15.47:0/191925408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e40d0980 msgr2=0x7f82e41586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.217+0000 7f82eb0de640 1 --2- 172.21.15.47:0/191925408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e40d0980 0x7f82e41586b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f82d400ce40 tx=0x7f82d400a660 comp rx=0 tx=0).stop 2024-04-14T23:36:05.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.217+0000 7f82eb0de640 1 -- 172.21.15.47:0/191925408 shutdown_connections 2024-04-14T23:36:05.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.217+0000 7f82eb0de640 1 --2- 172.21.15.47:0/191925408 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f82c406b990 0x7f82c406de50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.217+0000 7f82eb0de640 1 --2- 172.21.15.47:0/191925408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82e415e420 0x7f82e406f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.217+0000 7f82eb0de640 1 --2- 172.21.15.47:0/191925408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e40d0980 0x7f82e41586b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.217+0000 7f82eb0de640 1 --2- 172.21.15.47:0/191925408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f82e40cccd0 0x7f82e414af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.217+0000 7f82eb0de640 1 -- 172.21.15.47:0/191925408 >> 172.21.15.47:0/191925408 conn(0x7f82e40d1c30 msgr2=0x7f82e40cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:05.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.217+0000 7f82eb0de640 1 -- 172.21.15.47:0/191925408 shutdown_connections 2024-04-14T23:36:05.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.217+0000 7f82eb0de640 1 -- 172.21.15.47:0/191925408 wait complete. 2024-04-14T23:36:05.231 INFO:tasks.ceph:Scrubbing osd.1 2024-04-14T23:36:05.232 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-14T23:36:05.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.337+0000 7f9f2ff1e640 1 Processor -- start 2024-04-14T23:36:05.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.338+0000 7f9f2ff1e640 1 -- start start 2024-04-14T23:36:05.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.338+0000 7f9f2ff1e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f2806e2d0 0x7f9f280cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.338+0000 7f9f2ff1e640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9f280b2ba0 0x7f9f280b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.338+0000 7f9f2ff1e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f280cde20 con 0x7f9f28144640 2024-04-14T23:36:05.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.338+0000 7f9f2ff1e640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f9f280b3510 con 0x7f9f280b2ba0 2024-04-14T23:36:05.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.338+0000 7f9f2ff1e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f9f280ce100 con 0x7f9f2806e2d0 2024-04-14T23:36:05.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2dcba640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9f28144640 0x7f9f280ceec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35638/0 (socket says 172.21.15.47:35638) 2024-04-14T23:36:05.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2dcba640 1 -- 172.21.15.47:0/717607388 learned_addr learned my addr 172.21.15.47:0/717607388 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:05.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2d4b9640 1 --2- 172.21.15.47:0/717607388 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f2806e2d0 0x7f9f280cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2e4bb640 1 --2- 172.21.15.47:0/717607388 >> v2:172.21.15.191:3300/0 conn(0x7f9f280b2ba0 0x7f9f280b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2ccb8640 1 -- 172.21.15.47:0/717607388 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 922626926 0 0) 0x7f9f280cde20 con 0x7f9f28144640 2024-04-14T23:36:05.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2ccb8640 1 -- 172.21.15.47:0/717607388 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f14005730 con 0x7f9f28144640 2024-04-14T23:36:05.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2ccb8640 1 -- 172.21.15.47:0/717607388 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3958616413 0 0) 0x7f9f14005730 con 0x7f9f28144640 2024-04-14T23:36:05.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2ccb8640 1 -- 172.21.15.47:0/717607388 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f2806e2d0 msgr2=0x7f9f280cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2ccb8640 1 --2- 172.21.15.47:0/717607388 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f2806e2d0 0x7f9f280cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2ccb8640 1 -- 172.21.15.47:0/717607388 >> v2:172.21.15.191:3300/0 conn(0x7f9f280b2ba0 msgr2=0x7f9f280b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2ccb8640 1 --2- 172.21.15.47:0/717607388 >> v2:172.21.15.191:3300/0 conn(0x7f9f280b2ba0 0x7f9f280b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2ccb8640 1 -- 172.21.15.47:0/717607388 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f280ce3e0 con 0x7f9f28144640 2024-04-14T23:36:05.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2ccb8640 1 -- 172.21.15.47:0/717607388 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f9f24001670 con 0x7f9f28144640 2024-04-14T23:36:05.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2ccb8640 1 -- 172.21.15.47:0/717607388 >> v1:172.21.15.47:6789/0 conn(0x7f9f28144640 legacy=0x7f9f280ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2ccb8640 1 --2- 172.21.15.47:0/717607388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f14005bc0 0x7f9f14005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2ccb8640 1 --2- 172.21.15.47:0/717607388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f14006a10 0x7f9f14006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2ccb8640 1 --2- 172.21.15.47:0/717607388 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f2806e2d0 0x7f9f140073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2ccb8640 1 -- 172.21.15.47:0/717607388 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9f280b3510 con 0x7f9f14005bc0 2024-04-14T23:36:05.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2ccb8640 1 -- 172.21.15.47:0/717607388 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9f280ce100 con 0x7f9f14006a10 2024-04-14T23:36:05.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2ccb8640 1 -- 172.21.15.47:0/717607388 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f9f1400dbd0 con 0x7f9f2806e2d0 2024-04-14T23:36:05.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2dcba640 1 --2- 172.21.15.47:0/717607388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f14005bc0 0x7f9f14005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.339+0000 7f9f2d4b9640 1 --2- 172.21.15.47:0/717607388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f14006a10 0x7f9f14006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.340+0000 7f9f2e4bb640 1 --2- 172.21.15.47:0/717607388 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f2806e2d0 0x7f9f140073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.340+0000 7f9f2dcba640 1 -- 172.21.15.47:0/717607388 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f2806e2d0 msgr2=0x7f9f140073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.340+0000 7f9f2dcba640 1 --2- 172.21.15.47:0/717607388 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f2806e2d0 0x7f9f140073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.340+0000 7f9f2dcba640 1 -- 172.21.15.47:0/717607388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f14006a10 msgr2=0x7f9f14006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.340+0000 7f9f2dcba640 1 --2- 172.21.15.47:0/717607388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f14006a10 0x7f9f14006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.340+0000 7f9f2dcba640 1 -- 172.21.15.47:0/717607388 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f14005730 con 0x7f9f14005bc0 2024-04-14T23:36:05.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.340+0000 7f9f2e4bb640 1 --2- 172.21.15.47:0/717607388 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f2806e2d0 0x7f9f140073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:36:05.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.340+0000 7f9f2dcba640 1 --2- 172.21.15.47:0/717607388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f14005bc0 0x7f9f14005fe0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400c240 tx=0x7f9f14007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5deea86d472e1f1a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.341+0000 7f9f2ccb8640 1 -- 172.21.15.47:0/717607388 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f24007d30 con 0x7f9f14005bc0 2024-04-14T23:36:05.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.341+0000 7f9f2ccb8640 1 -- 172.21.15.47:0/717607388 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f24030070 con 0x7f9f14005bc0 2024-04-14T23:36:05.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.341+0000 7f9f2ccb8640 1 -- 172.21.15.47:0/717607388 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2402cd60 con 0x7f9f14005bc0 2024-04-14T23:36:05.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.341+0000 7f9f2ff1e640 1 -- 172.21.15.47:0/717607388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f14005bc0 msgr2=0x7f9f14005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.341+0000 7f9f2ff1e640 1 --2- 172.21.15.47:0/717607388 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f14005bc0 0x7f9f14005fe0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400c240 tx=0x7f9f14007a40 comp rx=0 tx=0).stop 2024-04-14T23:36:05.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.341+0000 7f9f2e4bb640 1 -- 172.21.15.47:0/717607388 reap_dead start 2024-04-14T23:36:05.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.341+0000 7f9f2ff1e640 1 -- 172.21.15.47:0/717607388 shutdown_connections 2024-04-14T23:36:05.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.341+0000 7f9f2ff1e640 1 -- 172.21.15.47:0/717607388 >> 172.21.15.47:0/717607388 conn(0x7f9f2806b200 msgr2=0x7f9f2806b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:05.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.341+0000 7f9f2ff1e640 1 -- 172.21.15.47:0/717607388 shutdown_connections 2024-04-14T23:36:05.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.341+0000 7f9f2ff1e640 1 -- 172.21.15.47:0/717607388 wait complete. 2024-04-14T23:36:05.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.342+0000 7f9f2ff1e640 1 Processor -- start 2024-04-14T23:36:05.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.342+0000 7f9f2ff1e640 1 -- start start 2024-04-14T23:36:05.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2ff1e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f14005bc0 0x7f9f281f2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2ff1e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f281f0ad0 0x7f9f28141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2ff1e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f28142440 0x7f9f2809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2ff1e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9f28144a20 con 0x7f9f28142440 2024-04-14T23:36:05.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2ff1e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9f280ce9a0 con 0x7f9f281f0ad0 2024-04-14T23:36:05.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2ff1e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f9f280cd720 con 0x7f9f14005bc0 2024-04-14T23:36:05.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2e4bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f28142440 0x7f9f2809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2e4bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f28142440 0x7f9f2809aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44298/0 (socket says 172.21.15.47:44298) 2024-04-14T23:36:05.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2e4bb640 1 -- 172.21.15.47:0/232069064 learned_addr learned my addr 172.21.15.47:0/232069064 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:05.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2d4b9640 1 --2- 172.21.15.47:0/232069064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f281f0ad0 0x7f9f28141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2dcba640 1 --2- 172.21.15.47:0/232069064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f14005bc0 0x7f9f281f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2e4bb640 1 -- 172.21.15.47:0/232069064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f14005bc0 msgr2=0x7f9f281f2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2e4bb640 1 --2- 172.21.15.47:0/232069064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f14005bc0 0x7f9f281f2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2e4bb640 1 -- 172.21.15.47:0/232069064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f281f0ad0 msgr2=0x7f9f28141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2e4bb640 1 --2- 172.21.15.47:0/232069064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f281f0ad0 0x7f9f28141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2e4bb640 1 -- 172.21.15.47:0/232069064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2809bfc0 con 0x7f9f28142440 2024-04-14T23:36:05.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2d4b9640 1 --2- 172.21.15.47:0/232069064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f281f0ad0 0x7f9f28141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:36:05.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.343+0000 7f9f2dcba640 1 --2- 172.21.15.47:0/232069064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f14005bc0 0x7f9f281f2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:36:05.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.344+0000 7f9f2e4bb640 1 --2- 172.21.15.47:0/232069064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f28142440 0x7f9f2809aa30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9f2806efd0 tx=0x7f9f20010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.344+0000 7f9f1e7fc640 1 -- 172.21.15.47:0/232069064 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f20003990 con 0x7f9f28142440 2024-04-14T23:36:05.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.344+0000 7f9f1e7fc640 1 -- 172.21.15.47:0/232069064 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f20003b50 con 0x7f9f28142440 2024-04-14T23:36:05.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.344+0000 7f9f2ff1e640 1 -- 172.21.15.47:0/232069064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f281f2c90 con 0x7f9f28142440 2024-04-14T23:36:05.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.344+0000 7f9f1e7fc640 1 -- 172.21.15.47:0/232069064 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f20004020 con 0x7f9f28142440 2024-04-14T23:36:05.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.344+0000 7f9f2ff1e640 1 -- 172.21.15.47:0/232069064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2809c230 con 0x7f9f28142440 2024-04-14T23:36:05.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.345+0000 7f9f2ff1e640 1 -- 172.21.15.47:0/232069064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9f280b5e60 con 0x7f9f28142440 2024-04-14T23:36:05.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.345+0000 7f9f1e7fc640 1 -- 172.21.15.47:0/232069064 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9f2001e030 con 0x7f9f28142440 2024-04-14T23:36:05.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.345+0000 7f9f1e7fc640 1 --2- 172.21.15.47:0/232069064 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9f0c06b9c0 0x7f9f0c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.346+0000 7f9f1e7fc640 1 -- 172.21.15.47:0/232069064 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f9f2008b1b0 con 0x7f9f28142440 2024-04-14T23:36:05.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.346+0000 7f9f1e7fc640 1 --2- 172.21.15.47:0/232069064 >> [v2:172.21.15.47:6824/3466488958,v1:172.21.15.47:6825/3466488958] conn(0x7f9f0c074220 0x7f9f0c076660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.346+0000 7f9f1e7fc640 1 -- 172.21.15.47:0/232069064 --> [v2:172.21.15.47:6824/3466488958,v1:172.21.15.47:6825/3466488958] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f2000dea0 con 0x7f9f0c074220 2024-04-14T23:36:05.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.346+0000 7f9f1e7fc640 1 -- 172.21.15.47:0/232069064 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f9f20092050 con 0x7f9f28142440 2024-04-14T23:36:05.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.346+0000 7f9f2d4b9640 1 --2- 172.21.15.47:0/232069064 >> [v2:172.21.15.47:6824/3466488958,v1:172.21.15.47:6825/3466488958] conn(0x7f9f0c074220 0x7f9f0c076660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.346+0000 7f9f2dcba640 1 --2- 172.21.15.47:0/232069064 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9f0c06b9c0 0x7f9f0c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.346+0000 7f9f2d4b9640 1 --2- 172.21.15.47:0/232069064 >> [v2:172.21.15.47:6824/3466488958,v1:172.21.15.47:6825/3466488958] conn(0x7f9f0c074220 0x7f9f0c076660 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.346+0000 7f9f2dcba640 1 --2- 172.21.15.47:0/232069064 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9f0c06b9c0 0x7f9f0c06de80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9f24034000 tx=0x7f9f24007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.347+0000 7f9f1e7fc640 1 -- 172.21.15.47:0/232069064 <== osd.1 v2:172.21.15.47:6824/3466488958 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9f2000dea0 con 0x7f9f0c074220 2024-04-14T23:36:05.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.360+0000 7f9f2ff1e640 1 -- 172.21.15.47:0/232069064 --> [v2:172.21.15.47:6824/3466488958,v1:172.21.15.47:6825/3466488958] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9f280754a0 con 0x7f9f0c074220 2024-04-14T23:36:05.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.360+0000 7f9f1e7fc640 1 -- 172.21.15.47:0/232069064 <== osd.1 v2:172.21.15.47:6824/3466488958 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9f280754a0 con 0x7f9f0c074220 2024-04-14T23:36:05.377 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-14T23:36:05.377 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T23:36:05.377 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-14T23:36:05.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.360+0000 7f9f2ff1e640 1 -- 172.21.15.47:0/232069064 >> [v2:172.21.15.47:6824/3466488958,v1:172.21.15.47:6825/3466488958] conn(0x7f9f0c074220 msgr2=0x7f9f0c076660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.361+0000 7f9f2ff1e640 1 --2- 172.21.15.47:0/232069064 >> [v2:172.21.15.47:6824/3466488958,v1:172.21.15.47:6825/3466488958] conn(0x7f9f0c074220 0x7f9f0c076660 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.361+0000 7f9f2ff1e640 1 -- 172.21.15.47:0/232069064 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9f0c06b9c0 msgr2=0x7f9f0c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.361+0000 7f9f2ff1e640 1 --2- 172.21.15.47:0/232069064 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f9f0c06b9c0 0x7f9f0c06de80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9f24034000 tx=0x7f9f24007000 comp rx=0 tx=0).stop 2024-04-14T23:36:05.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.361+0000 7f9f2ff1e640 1 -- 172.21.15.47:0/232069064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f28142440 msgr2=0x7f9f2809aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.361+0000 7f9f2ff1e640 1 --2- 172.21.15.47:0/232069064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f28142440 0x7f9f2809aa30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9f2806efd0 tx=0x7f9f20010590 comp rx=0 tx=0).stop 2024-04-14T23:36:05.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.361+0000 7f9f2e4bb640 1 -- 172.21.15.47:0/232069064 reap_dead start 2024-04-14T23:36:05.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.361+0000 7f9f2ff1e640 1 -- 172.21.15.47:0/232069064 shutdown_connections 2024-04-14T23:36:05.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.361+0000 7f9f2ff1e640 1 -- 172.21.15.47:0/232069064 >> 172.21.15.47:0/232069064 conn(0x7f9f2806b200 msgr2=0x7f9f2806d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:05.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.361+0000 7f9f2ff1e640 1 -- 172.21.15.47:0/232069064 shutdown_connections 2024-04-14T23:36:05.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.361+0000 7f9f2ff1e640 1 -- 172.21.15.47:0/232069064 wait complete. 2024-04-14T23:36:05.381 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-14T23:36:05.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.486+0000 7f763cdf0640 1 Processor -- start 2024-04-14T23:36:05.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.486+0000 7f763cdf0640 1 -- start start 2024-04-14T23:36:05.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f763cdf0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f763815e420 0x7f76380d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f763cdf0640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f76380cf020 0x7f76380cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f763cdf0640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76380d1040 con 0x7f76380ce4b0 2024-04-14T23:36:05.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f763cdf0640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f76380cc280 con 0x7f76380cf020 2024-04-14T23:36:05.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f763cdf0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f763806d750 con 0x7f763815e420 2024-04-14T23:36:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f762ffff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f76380ce4b0 0x7f76380ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35640/0 (socket says 172.21.15.47:35640) 2024-04-14T23:36:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f762ffff640 1 -- 172.21.15.47:0/920500626 learned_addr learned my addr 172.21.15.47:0/920500626 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7635d9b640 1 -- 172.21.15.47:0/920500626 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3240022572 0 0) 0x7f76380d1040 con 0x7f76380ce4b0 2024-04-14T23:36:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7635d9b640 1 -- 172.21.15.47:0/920500626 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7624003520 con 0x7f76380ce4b0 2024-04-14T23:36:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7636d9d640 1 --2- 172.21.15.47:0/920500626 >> v2:172.21.15.191:3300/0 conn(0x7f76380cf020 0x7f76380cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f763659c640 1 --2- 172.21.15.47:0/920500626 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f763815e420 0x7f76380d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7635d9b640 1 -- 172.21.15.47:0/920500626 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3624574396 0 0) 0x7f7624003520 con 0x7f76380ce4b0 2024-04-14T23:36:05.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7635d9b640 1 -- 172.21.15.47:0/920500626 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f763815e420 msgr2=0x7f76380d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7635d9b640 1 --2- 172.21.15.47:0/920500626 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f763815e420 0x7f76380d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7635d9b640 1 -- 172.21.15.47:0/920500626 >> v2:172.21.15.191:3300/0 conn(0x7f76380cf020 msgr2=0x7f76380cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7635d9b640 1 --2- 172.21.15.47:0/920500626 >> v2:172.21.15.191:3300/0 conn(0x7f76380cf020 0x7f76380cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7635d9b640 1 -- 172.21.15.47:0/920500626 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76380d1320 con 0x7f76380ce4b0 2024-04-14T23:36:05.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7635d9b640 1 -- 172.21.15.47:0/920500626 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f7620001670 con 0x7f76380ce4b0 2024-04-14T23:36:05.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7636d9d640 1 --2- 172.21.15.47:0/920500626 >> v2:172.21.15.191:3300/0 conn(0x7f76380cf020 0x7f76380cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:36:05.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7635d9b640 1 -- 172.21.15.47:0/920500626 >> v1:172.21.15.47:6789/0 conn(0x7f76380ce4b0 legacy=0x7f76380ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7635d9b640 1 --2- 172.21.15.47:0/920500626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76240039b0 0x7f7624003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7635d9b640 1 --2- 172.21.15.47:0/920500626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7624004800 0x7f7624004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7635d9b640 1 --2- 172.21.15.47:0/920500626 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f763815e420 0x7f76240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7635d9b640 1 -- 172.21.15.47:0/920500626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f76380cc280 con 0x7f76240039b0 2024-04-14T23:36:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7635d9b640 1 -- 172.21.15.47:0/920500626 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f763806d750 con 0x7f7624004800 2024-04-14T23:36:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.487+0000 7f7635d9b640 1 -- 172.21.15.47:0/920500626 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f762400ba70 con 0x7f763815e420 2024-04-14T23:36:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.488+0000 7f763659c640 1 --2- 172.21.15.47:0/920500626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76240039b0 0x7f7624003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.488+0000 7f762ffff640 1 --2- 172.21.15.47:0/920500626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7624004800 0x7f7624004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.488+0000 7f7636d9d640 1 --2- 172.21.15.47:0/920500626 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f763815e420 0x7f76240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.488+0000 7f763659c640 1 -- 172.21.15.47:0/920500626 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f763815e420 msgr2=0x7f76240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.488+0000 7f763659c640 1 --2- 172.21.15.47:0/920500626 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f763815e420 0x7f76240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.488+0000 7f763659c640 1 -- 172.21.15.47:0/920500626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7624004800 msgr2=0x7f7624004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.488+0000 7f763659c640 1 --2- 172.21.15.47:0/920500626 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7624004800 0x7f7624004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.488+0000 7f763659c640 1 -- 172.21.15.47:0/920500626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7624003520 con 0x7f76240039b0 2024-04-14T23:36:05.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.489+0000 7f763659c640 1 --2- 172.21.15.47:0/920500626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76240039b0 0x7f7624003dd0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7628009ac0 tx=0x7f7624005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b556ae05c61e26ef server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.489+0000 7f7635d9b640 1 -- 172.21.15.47:0/920500626 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628039070 con 0x7f76240039b0 2024-04-14T23:36:05.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.489+0000 7f7635d9b640 1 -- 172.21.15.47:0/920500626 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f762802c6b0 con 0x7f76240039b0 2024-04-14T23:36:05.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.489+0000 7f7635d9b640 1 -- 172.21.15.47:0/920500626 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628009690 con 0x7f76240039b0 2024-04-14T23:36:05.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.489+0000 7f763cdf0640 1 -- 172.21.15.47:0/920500626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76240039b0 msgr2=0x7f7624003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.489+0000 7f763cdf0640 1 --2- 172.21.15.47:0/920500626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76240039b0 0x7f7624003dd0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7628009ac0 tx=0x7f7624005830 comp rx=0 tx=0).stop 2024-04-14T23:36:05.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.489+0000 7f7636d9d640 1 -- 172.21.15.47:0/920500626 reap_dead start 2024-04-14T23:36:05.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.489+0000 7f763cdf0640 1 -- 172.21.15.47:0/920500626 shutdown_connections 2024-04-14T23:36:05.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.489+0000 7f763cdf0640 1 -- 172.21.15.47:0/920500626 >> 172.21.15.47:0/920500626 conn(0x7f76380d1c30 msgr2=0x7f76380d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:05.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.489+0000 7f763cdf0640 1 -- 172.21.15.47:0/920500626 shutdown_connections 2024-04-14T23:36:05.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.489+0000 7f763cdf0640 1 -- 172.21.15.47:0/920500626 wait complete. 2024-04-14T23:36:05.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.491+0000 7f763cdf0640 1 Processor -- start 2024-04-14T23:36:05.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.491+0000 7f763cdf0640 1 -- start start 2024-04-14T23:36:05.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.491+0000 7f763cdf0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76240039b0 0x7f7638160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.491+0000 7f763cdf0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7638151050 0x7f76380ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.491+0000 7f763cdf0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763806ff80 0x7f7638070400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.491+0000 7f763cdf0640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f763815e800 con 0x7f763806ff80 2024-04-14T23:36:05.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.491+0000 7f763cdf0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f76380cc7b0 con 0x7f76240039b0 2024-04-14T23:36:05.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.491+0000 7f763cdf0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f76380d0980 con 0x7f7638151050 2024-04-14T23:36:05.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.491+0000 7f7636d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763806ff80 0x7f7638070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.491+0000 7f7636d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763806ff80 0x7f7638070400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44322/0 (socket says 172.21.15.47:44322) 2024-04-14T23:36:05.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.491+0000 7f7636d9d640 1 -- 172.21.15.47:0/3817799096 learned_addr learned my addr 172.21.15.47:0/3817799096 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:05.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.492+0000 7f763659c640 1 --2- 172.21.15.47:0/3817799096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76240039b0 0x7f7638160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.492+0000 7f762ffff640 1 --2- 172.21.15.47:0/3817799096 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7638151050 0x7f76380ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.492+0000 7f7636d9d640 1 -- 172.21.15.47:0/3817799096 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7638151050 msgr2=0x7f76380ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.492+0000 7f7636d9d640 1 --2- 172.21.15.47:0/3817799096 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7638151050 0x7f76380ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.492+0000 7f7636d9d640 1 -- 172.21.15.47:0/3817799096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76240039b0 msgr2=0x7f7638160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.492+0000 7f7636d9d640 1 --2- 172.21.15.47:0/3817799096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76240039b0 0x7f7638160cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.492+0000 7f7636d9d640 1 -- 172.21.15.47:0/3817799096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f763815fc20 con 0x7f763806ff80 2024-04-14T23:36:05.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.492+0000 7f763659c640 1 --2- 172.21.15.47:0/3817799096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76240039b0 0x7f7638160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:36:05.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.492+0000 7f762ffff640 1 --2- 172.21.15.47:0/3817799096 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7638151050 0x7f76380ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:36:05.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.492+0000 7f7636d9d640 1 --2- 172.21.15.47:0/3817799096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763806ff80 0x7f7638070400 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f76380720a0 tx=0x7f7630007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.492+0000 7f762effd640 1 -- 172.21.15.47:0/3817799096 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7630014410 con 0x7f763806ff80 2024-04-14T23:36:05.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.492+0000 7f762effd640 1 -- 172.21.15.47:0/3817799096 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7630019070 con 0x7f763806ff80 2024-04-14T23:36:05.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.492+0000 7f763cdf0640 1 -- 172.21.15.47:0/3817799096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f763815ff00 con 0x7f763806ff80 2024-04-14T23:36:05.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.492+0000 7f762effd640 1 -- 172.21.15.47:0/3817799096 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76300147d0 con 0x7f763806ff80 2024-04-14T23:36:05.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.492+0000 7f763cdf0640 1 -- 172.21.15.47:0/3817799096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76381604c0 con 0x7f763806ff80 2024-04-14T23:36:05.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.493+0000 7f763cdf0640 1 -- 172.21.15.47:0/3817799096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7638075430 con 0x7f763806ff80 2024-04-14T23:36:05.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.493+0000 7f762effd640 1 -- 172.21.15.47:0/3817799096 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f7630014970 con 0x7f763806ff80 2024-04-14T23:36:05.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.494+0000 7f762effd640 1 --2- 172.21.15.47:0/3817799096 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f761806b9c0 0x7f761806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.494+0000 7f762effd640 1 -- 172.21.15.47:0/3817799096 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f763008af10 con 0x7f763806ff80 2024-04-14T23:36:05.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.494+0000 7f763659c640 1 --2- 172.21.15.47:0/3817799096 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f761806b9c0 0x7f761806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.495+0000 7f763659c640 1 --2- 172.21.15.47:0/3817799096 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f761806b9c0 0x7f761806de80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7628036000 tx=0x7f7628030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.498+0000 7f762effd640 1 -- 172.21.15.47:0/3817799096 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7630059900 con 0x7f763806ff80 2024-04-14T23:36:05.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.681+0000 7f763cdf0640 1 -- 172.21.15.47:0/3817799096 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f763815f9d0 con 0x7f761806b9c0 2024-04-14T23:36:05.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.682+0000 7f762effd640 1 -- 172.21.15.47:0/3817799096 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f763815f9d0 con 0x7f761806b9c0 2024-04-14T23:36:05.685 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 1 to deep-scrub 2024-04-14T23:36:05.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.684+0000 7f763cdf0640 1 -- 172.21.15.47:0/3817799096 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f761806b9c0 msgr2=0x7f761806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.684+0000 7f763cdf0640 1 --2- 172.21.15.47:0/3817799096 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f761806b9c0 0x7f761806de80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7628036000 tx=0x7f7628030000 comp rx=0 tx=0).stop 2024-04-14T23:36:05.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.684+0000 7f763cdf0640 1 -- 172.21.15.47:0/3817799096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763806ff80 msgr2=0x7f7638070400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.684+0000 7f763cdf0640 1 --2- 172.21.15.47:0/3817799096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763806ff80 0x7f7638070400 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f76380720a0 tx=0x7f7630007700 comp rx=0 tx=0).stop 2024-04-14T23:36:05.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.684+0000 7f763cdf0640 1 -- 172.21.15.47:0/3817799096 shutdown_connections 2024-04-14T23:36:05.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.684+0000 7f763cdf0640 1 --2- 172.21.15.47:0/3817799096 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f761806b9c0 0x7f761806de80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.684+0000 7f763cdf0640 1 --2- 172.21.15.47:0/3817799096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763806ff80 0x7f7638070400 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.684+0000 7f763cdf0640 1 --2- 172.21.15.47:0/3817799096 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7638151050 0x7f76380ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.684+0000 7f763cdf0640 1 --2- 172.21.15.47:0/3817799096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76240039b0 0x7f7638160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.684+0000 7f763cdf0640 1 -- 172.21.15.47:0/3817799096 >> 172.21.15.47:0/3817799096 conn(0x7f76380d1c30 msgr2=0x7f763806eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:05.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.684+0000 7f763cdf0640 1 -- 172.21.15.47:0/3817799096 shutdown_connections 2024-04-14T23:36:05.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.684+0000 7f763cdf0640 1 -- 172.21.15.47:0/3817799096 wait complete. 2024-04-14T23:36:05.698 INFO:tasks.ceph:Scrubbing osd.2 2024-04-14T23:36:05.698 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-14T23:36:05.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.801+0000 7f903c02d640 1 Processor -- start 2024-04-14T23:36:05.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.801+0000 7f903c02d640 1 -- start start 2024-04-14T23:36:05.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.802+0000 7f903c02d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f90340b53c0 0x7f90340cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.802+0000 7f903c02d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90340d2ce0 0x7f90340b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.802+0000 7f903c02d640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90340b7090 con 0x7f90340cfb30 2024-04-14T23:36:05.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.802+0000 7f903c02d640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f90340b6e40 con 0x7f90340b53c0 2024-04-14T23:36:05.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.802+0000 7f903c02d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f90340b7370 con 0x7f90340d2ce0 2024-04-14T23:36:05.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.802+0000 7f90395c8640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f90340cfb30 0x7f90340d25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35648/0 (socket says 172.21.15.47:35648) 2024-04-14T23:36:05.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.802+0000 7f90395c8640 1 -- 172.21.15.47:0/4262204456 learned_addr learned my addr 172.21.15.47:0/4262204456 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:05.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f903a5ca640 1 --2- 172.21.15.47:0/4262204456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90340d2ce0 0x7f90340b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9039dc9640 1 --2- 172.21.15.47:0/4262204456 >> v2:172.21.15.191:3300/0 conn(0x7f90340b53c0 0x7f90340cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9038dc7640 1 -- 172.21.15.47:0/4262204456 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1249690449 0 0) 0x7f90340b7090 con 0x7f90340cfb30 2024-04-14T23:36:05.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9038dc7640 1 -- 172.21.15.47:0/4262204456 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f901c003520 con 0x7f90340cfb30 2024-04-14T23:36:05.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9038dc7640 1 -- 172.21.15.47:0/4262204456 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3804229323 0 0) 0x7f901c003520 con 0x7f90340cfb30 2024-04-14T23:36:05.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9038dc7640 1 -- 172.21.15.47:0/4262204456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90340d2ce0 msgr2=0x7f90340b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9038dc7640 1 --2- 172.21.15.47:0/4262204456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90340d2ce0 0x7f90340b7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9038dc7640 1 -- 172.21.15.47:0/4262204456 >> v2:172.21.15.191:3300/0 conn(0x7f90340b53c0 msgr2=0x7f90340cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9038dc7640 1 --2- 172.21.15.47:0/4262204456 >> v2:172.21.15.191:3300/0 conn(0x7f90340b53c0 0x7f90340cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9038dc7640 1 -- 172.21.15.47:0/4262204456 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90340b7650 con 0x7f90340cfb30 2024-04-14T23:36:05.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9038dc7640 1 -- 172.21.15.47:0/4262204456 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f9028001690 con 0x7f90340cfb30 2024-04-14T23:36:05.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9038dc7640 1 -- 172.21.15.47:0/4262204456 >> v1:172.21.15.47:6789/0 conn(0x7f90340cfb30 legacy=0x7f90340d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9038dc7640 1 --2- 172.21.15.47:0/4262204456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f901c0039b0 0x7f901c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9038dc7640 1 --2- 172.21.15.47:0/4262204456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f901c004800 0x7f901c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9038dc7640 1 --2- 172.21.15.47:0/4262204456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90340d2ce0 0x7f901c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9038dc7640 1 -- 172.21.15.47:0/4262204456 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f90340b6e40 con 0x7f901c0039b0 2024-04-14T23:36:05.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9038dc7640 1 -- 172.21.15.47:0/4262204456 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f90340b7370 con 0x7f901c004800 2024-04-14T23:36:05.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9038dc7640 1 -- 172.21.15.47:0/4262204456 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f901c00b9c0 con 0x7f90340d2ce0 2024-04-14T23:36:05.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9039dc9640 1 --2- 172.21.15.47:0/4262204456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f901c0039b0 0x7f901c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f90395c8640 1 --2- 172.21.15.47:0/4262204456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f901c004800 0x7f901c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f903a5ca640 1 --2- 172.21.15.47:0/4262204456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90340d2ce0 0x7f901c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9039dc9640 1 -- 172.21.15.47:0/4262204456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90340d2ce0 msgr2=0x7f901c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9039dc9640 1 --2- 172.21.15.47:0/4262204456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90340d2ce0 0x7f901c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9039dc9640 1 -- 172.21.15.47:0/4262204456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f901c004800 msgr2=0x7f901c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9039dc9640 1 --2- 172.21.15.47:0/4262204456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f901c004800 0x7f901c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.803+0000 7f9039dc9640 1 -- 172.21.15.47:0/4262204456 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901c003520 con 0x7f901c0039b0 2024-04-14T23:36:05.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.804+0000 7f9039dc9640 1 --2- 172.21.15.47:0/4262204456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f901c0039b0 0x7f901c003dd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f902c009ac0 tx=0x7f901c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ee763b2b722753 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.804+0000 7f9038dc7640 1 -- 172.21.15.47:0/4262204456 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c039070 con 0x7f901c0039b0 2024-04-14T23:36:05.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.804+0000 7f9038dc7640 1 -- 172.21.15.47:0/4262204456 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f902c02c710 con 0x7f901c0039b0 2024-04-14T23:36:05.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.804+0000 7f9038dc7640 1 -- 172.21.15.47:0/4262204456 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c009690 con 0x7f901c0039b0 2024-04-14T23:36:05.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.805+0000 7f903c02d640 1 -- 172.21.15.47:0/4262204456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f901c0039b0 msgr2=0x7f901c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.805+0000 7f903c02d640 1 --2- 172.21.15.47:0/4262204456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f901c0039b0 0x7f901c003dd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f902c009ac0 tx=0x7f901c005830 comp rx=0 tx=0).stop 2024-04-14T23:36:05.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.805+0000 7f903a5ca640 1 -- 172.21.15.47:0/4262204456 reap_dead start 2024-04-14T23:36:05.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.805+0000 7f903c02d640 1 -- 172.21.15.47:0/4262204456 shutdown_connections 2024-04-14T23:36:05.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.805+0000 7f903c02d640 1 -- 172.21.15.47:0/4262204456 >> 172.21.15.47:0/4262204456 conn(0x7f903409d2c0 msgr2=0x7f90340d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:05.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.805+0000 7f903c02d640 1 -- 172.21.15.47:0/4262204456 shutdown_connections 2024-04-14T23:36:05.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.805+0000 7f903c02d640 1 -- 172.21.15.47:0/4262204456 wait complete. 2024-04-14T23:36:05.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.806+0000 7f903c02d640 1 Processor -- start 2024-04-14T23:36:05.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.806+0000 7f903c02d640 1 -- start start 2024-04-14T23:36:05.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f903c02d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f901c0039b0 0x7f90341564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f903c02d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f903409ff80 0x7f90340ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f903c02d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90340ca710 0x7f90340a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f903c02d640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f90340b5920 con 0x7f90340ca710 2024-04-14T23:36:05.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f903c02d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f90340b57a0 con 0x7f901c0039b0 2024-04-14T23:36:05.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f903c02d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f90340d1f90 con 0x7f903409ff80 2024-04-14T23:36:05.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f903a5ca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90340ca710 0x7f90340a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f903a5ca640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90340ca710 0x7f90340a0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44338/0 (socket says 172.21.15.47:44338) 2024-04-14T23:36:05.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f903a5ca640 1 -- 172.21.15.47:0/4134609929 learned_addr learned my addr 172.21.15.47:0/4134609929 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:05.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f9039dc9640 1 --2- 172.21.15.47:0/4134609929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f901c0039b0 0x7f90341564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f90395c8640 1 --2- 172.21.15.47:0/4134609929 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f903409ff80 0x7f90340ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f903a5ca640 1 -- 172.21.15.47:0/4134609929 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f903409ff80 msgr2=0x7f90340ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f903a5ca640 1 --2- 172.21.15.47:0/4134609929 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f903409ff80 0x7f90340ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f903a5ca640 1 -- 172.21.15.47:0/4134609929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f901c0039b0 msgr2=0x7f90341564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f903a5ca640 1 --2- 172.21.15.47:0/4134609929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f901c0039b0 0x7f90341564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f903a5ca640 1 -- 172.21.15.47:0/4134609929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903409eee0 con 0x7f90340ca710 2024-04-14T23:36:05.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f9039dc9640 1 --2- 172.21.15.47:0/4134609929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f901c0039b0 0x7f90341564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:36:05.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.807+0000 7f903a5ca640 1 --2- 172.21.15.47:0/4134609929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90340ca710 0x7f90340a0c20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9034161e30 tx=0x7f90240115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.808+0000 7f90327fc640 1 -- 172.21.15.47:0/4134609929 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024003990 con 0x7f90340ca710 2024-04-14T23:36:05.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.808+0000 7f90327fc640 1 -- 172.21.15.47:0/4134609929 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f902401b070 con 0x7f90340ca710 2024-04-14T23:36:05.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.808+0000 7f903c02d640 1 -- 172.21.15.47:0/4134609929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903409f1c0 con 0x7f90340ca710 2024-04-14T23:36:05.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.808+0000 7f90327fc640 1 -- 172.21.15.47:0/4134609929 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024003b70 con 0x7f90340ca710 2024-04-14T23:36:05.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.808+0000 7f903c02d640 1 -- 172.21.15.47:0/4134609929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f903409f780 con 0x7f90340ca710 2024-04-14T23:36:05.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.809+0000 7f903c02d640 1 -- 172.21.15.47:0/4134609929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f90340754a0 con 0x7f90340ca710 2024-04-14T23:36:05.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.809+0000 7f90327fc640 1 -- 172.21.15.47:0/4134609929 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f9024005d10 con 0x7f90340ca710 2024-04-14T23:36:05.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.809+0000 7f90327fc640 1 --2- 172.21.15.47:0/4134609929 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f902006b990 0x7f902006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.810+0000 7f90327fc640 1 -- 172.21.15.47:0/4134609929 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f902408b120 con 0x7f90340ca710 2024-04-14T23:36:05.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.810+0000 7f90327fc640 1 --2- 172.21.15.47:0/4134609929 >> [v2:172.21.15.47:6808/313696127,v1:172.21.15.47:6809/313696127] conn(0x7f9020074200 0x7f9020076640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.810+0000 7f90327fc640 1 -- 172.21.15.47:0/4134609929 --> [v2:172.21.15.47:6808/313696127,v1:172.21.15.47:6809/313696127] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9024016e50 con 0x7f9020074200 2024-04-14T23:36:05.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.810+0000 7f9039dc9640 1 --2- 172.21.15.47:0/4134609929 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f902006b990 0x7f902006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.810+0000 7f90327fc640 1 -- 172.21.15.47:0/4134609929 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f9024092050 con 0x7f90340ca710 2024-04-14T23:36:05.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.810+0000 7f90395c8640 1 --2- 172.21.15.47:0/4134609929 >> [v2:172.21.15.47:6808/313696127,v1:172.21.15.47:6809/313696127] conn(0x7f9020074200 0x7f9020076640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.810+0000 7f90395c8640 1 --2- 172.21.15.47:0/4134609929 >> [v2:172.21.15.47:6808/313696127,v1:172.21.15.47:6809/313696127] conn(0x7f9020074200 0x7f9020076640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.810+0000 7f9039dc9640 1 --2- 172.21.15.47:0/4134609929 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f902006b990 0x7f902006de50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f902c036000 tx=0x7f902c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.811+0000 7f90327fc640 1 -- 172.21.15.47:0/4134609929 <== osd.2 v2:172.21.15.47:6808/313696127 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9024016e50 con 0x7f9020074200 2024-04-14T23:36:05.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.824+0000 7f903c02d640 1 -- 172.21.15.47:0/4134609929 --> [v2:172.21.15.47:6808/313696127,v1:172.21.15.47:6809/313696127] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f90340cab50 con 0x7f9020074200 2024-04-14T23:36:05.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.824+0000 7f90327fc640 1 -- 172.21.15.47:0/4134609929 <== osd.2 v2:172.21.15.47:6808/313696127 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f90340cab50 con 0x7f9020074200 2024-04-14T23:36:05.828 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-14T23:36:05.828 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T23:36:05.828 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-14T23:36:05.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.825+0000 7f903c02d640 1 -- 172.21.15.47:0/4134609929 >> [v2:172.21.15.47:6808/313696127,v1:172.21.15.47:6809/313696127] conn(0x7f9020074200 msgr2=0x7f9020076640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.825+0000 7f903c02d640 1 --2- 172.21.15.47:0/4134609929 >> [v2:172.21.15.47:6808/313696127,v1:172.21.15.47:6809/313696127] conn(0x7f9020074200 0x7f9020076640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.825+0000 7f903c02d640 1 -- 172.21.15.47:0/4134609929 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f902006b990 msgr2=0x7f902006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.825+0000 7f903c02d640 1 --2- 172.21.15.47:0/4134609929 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f902006b990 0x7f902006de50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f902c036000 tx=0x7f902c030000 comp rx=0 tx=0).stop 2024-04-14T23:36:05.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.825+0000 7f903c02d640 1 -- 172.21.15.47:0/4134609929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90340ca710 msgr2=0x7f90340a0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.825+0000 7f903c02d640 1 --2- 172.21.15.47:0/4134609929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90340ca710 0x7f90340a0c20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9034161e30 tx=0x7f90240115a0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.825+0000 7f903a5ca640 1 -- 172.21.15.47:0/4134609929 reap_dead start 2024-04-14T23:36:05.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.825+0000 7f903c02d640 1 -- 172.21.15.47:0/4134609929 shutdown_connections 2024-04-14T23:36:05.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.825+0000 7f903c02d640 1 -- 172.21.15.47:0/4134609929 >> 172.21.15.47:0/4134609929 conn(0x7f903409d2c0 msgr2=0x7f90340cd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:05.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.825+0000 7f903c02d640 1 -- 172.21.15.47:0/4134609929 shutdown_connections 2024-04-14T23:36:05.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.825+0000 7f903c02d640 1 -- 172.21.15.47:0/4134609929 wait complete. 2024-04-14T23:36:05.838 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-14T23:36:05.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.942+0000 7f4c7ce0f640 1 Processor -- start 2024-04-14T23:36:05.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.942+0000 7f4c7ce0f640 1 -- start start 2024-04-14T23:36:05.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c7ce0f640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c780cf6c0 0x7f4c780cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c7ce0f640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c78072130 con 0x7f4c780cd460 2024-04-14T23:36:05.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c7ce0f640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c780cffe0 con 0x7f4c780cdf00 2024-04-14T23:36:05.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c7ce0f640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4c780cc5d0 con 0x7f4c780cf6c0 2024-04-14T23:36:05.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c76d9d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4c780cd460 0x7f4c780c7b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35652/0 (socket says 172.21.15.47:35652) 2024-04-14T23:36:05.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c76d9d640 1 -- 172.21.15.47:0/4060251639 learned_addr learned my addr 172.21.15.47:0/4060251639 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:05.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c75d9b640 1 -- 172.21.15.47:0/4060251639 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506975820 0 0) 0x7f4c78072130 con 0x7f4c780cd460 2024-04-14T23:36:05.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c7659c640 1 --2- 172.21.15.47:0/4060251639 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c780cf6c0 0x7f4c780cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c75d9b640 1 -- 172.21.15.47:0/4060251639 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c64003520 con 0x7f4c780cd460 2024-04-14T23:36:05.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c75d9b640 1 -- 172.21.15.47:0/4060251639 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2941279619 0 0) 0x7f4c64003520 con 0x7f4c780cd460 2024-04-14T23:36:05.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c75d9b640 1 -- 172.21.15.47:0/4060251639 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c780cf6c0 msgr2=0x7f4c780cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c75d9b640 1 --2- 172.21.15.47:0/4060251639 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c780cf6c0 0x7f4c780cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c75d9b640 1 -- 172.21.15.47:0/4060251639 >> v1:172.21.15.191:6789/0 conn(0x7f4c780cdf00 legacy=0x7f4c780c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c75d9b640 1 -- 172.21.15.47:0/4060251639 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c78074730 con 0x7f4c780cd460 2024-04-14T23:36:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c75d9b640 1 -- 172.21.15.47:0/4060251639 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f4c700019f0 con 0x7f4c780cd460 2024-04-14T23:36:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c75d9b640 1 -- 172.21.15.47:0/4060251639 >> v1:172.21.15.47:6789/0 conn(0x7f4c780cd460 legacy=0x7f4c780c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c75d9b640 1 --2- 172.21.15.47:0/4060251639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c640039e0 0x7f4c64003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c75d9b640 1 --2- 172.21.15.47:0/4060251639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c64004800 0x7f4c64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c75d9b640 1 --2- 172.21.15.47:0/4060251639 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c780cf6c0 0x7f4c64005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c75d9b640 1 -- 172.21.15.47:0/4060251639 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4c780cc5d0 con 0x7f4c64004800 2024-04-14T23:36:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c75d9b640 1 -- 172.21.15.47:0/4060251639 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6400baf0 con 0x7f4c640039e0 2024-04-14T23:36:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c75d9b640 1 -- 172.21.15.47:0/4060251639 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4c6400bcf0 con 0x7f4c780cf6c0 2024-04-14T23:36:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.943+0000 7f4c6dd9b640 1 --2- 172.21.15.47:0/4060251639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c64004800 0x7f4c64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.944+0000 7f4c7659c640 1 --2- 172.21.15.47:0/4060251639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c640039e0 0x7f4c64003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.944+0000 7f4c76d9d640 1 --2- 172.21.15.47:0/4060251639 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c780cf6c0 0x7f4c64005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.944+0000 7f4c6dd9b640 1 -- 172.21.15.47:0/4060251639 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c780cf6c0 msgr2=0x7f4c64005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.944+0000 7f4c6dd9b640 1 --2- 172.21.15.47:0/4060251639 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c780cf6c0 0x7f4c64005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.944+0000 7f4c6dd9b640 1 -- 172.21.15.47:0/4060251639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c640039e0 msgr2=0x7f4c64003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.944+0000 7f4c6dd9b640 1 --2- 172.21.15.47:0/4060251639 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c640039e0 0x7f4c64003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.944+0000 7f4c6dd9b640 1 -- 172.21.15.47:0/4060251639 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c64003520 con 0x7f4c64004800 2024-04-14T23:36:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.944+0000 7f4c6dd9b640 1 --2- 172.21.15.47:0/4060251639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c64004800 0x7f4c64004c80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4c60001750 tx=0x7f4c64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1925469fd7eaa5b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.945+0000 7f4c75d9b640 1 -- 172.21.15.47:0/4060251639 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c60001370 con 0x7f4c64004800 2024-04-14T23:36:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.945+0000 7f4c75d9b640 1 -- 172.21.15.47:0/4060251639 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c600052d0 con 0x7f4c64004800 2024-04-14T23:36:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.945+0000 7f4c75d9b640 1 -- 172.21.15.47:0/4060251639 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c60003830 con 0x7f4c64004800 2024-04-14T23:36:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.945+0000 7f4c7ce0f640 1 -- 172.21.15.47:0/4060251639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c64004800 msgr2=0x7f4c64004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.945+0000 7f4c7ce0f640 1 --2- 172.21.15.47:0/4060251639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c64004800 0x7f4c64004c80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4c60001750 tx=0x7f4c64005830 comp rx=0 tx=0).stop 2024-04-14T23:36:05.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.945+0000 7f4c76d9d640 1 -- 172.21.15.47:0/4060251639 reap_dead start 2024-04-14T23:36:05.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.945+0000 7f4c7ce0f640 1 -- 172.21.15.47:0/4060251639 shutdown_connections 2024-04-14T23:36:05.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.945+0000 7f4c7ce0f640 1 -- 172.21.15.47:0/4060251639 >> 172.21.15.47:0/4060251639 conn(0x7f4c780d0330 msgr2=0x7f4c780d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:05.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.945+0000 7f4c7ce0f640 1 -- 172.21.15.47:0/4060251639 shutdown_connections 2024-04-14T23:36:05.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.945+0000 7f4c7ce0f640 1 -- 172.21.15.47:0/4060251639 wait complete. 2024-04-14T23:36:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.947+0000 7f4c7ce0f640 1 Processor -- start 2024-04-14T23:36:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.947+0000 7f4c7ce0f640 1 -- start start 2024-04-14T23:36:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.947+0000 7f4c7ce0f640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c64004800 0x7f4c781f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.947+0000 7f4c7ce0f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c781f38e0 0x7f4c7809d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.947+0000 7f4c7ce0f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c7809bf90 0x7f4c780c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.947+0000 7f4c7ce0f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7815e4e0 con 0x7f4c7809bf90 2024-04-14T23:36:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.947+0000 7f4c7ce0f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4c780d1180 con 0x7f4c781f38e0 2024-04-14T23:36:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.947+0000 7f4c7ce0f640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7815e660 con 0x7f4c64004800 2024-04-14T23:36:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.947+0000 7f4c76d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c7809bf90 0x7f4c780c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c76d9d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c7809bf90 0x7f4c780c5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44354/0 (socket says 172.21.15.47:44354) 2024-04-14T23:36:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c76d9d640 1 -- 172.21.15.47:0/3843612588 learned_addr learned my addr 172.21.15.47:0/3843612588 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c7659c640 1 --2- 172.21.15.47:0/3843612588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c64004800 0x7f4c781f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c6dd9b640 1 --2- 172.21.15.47:0/3843612588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c781f38e0 0x7f4c7809d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c76d9d640 1 -- 172.21.15.47:0/3843612588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c64004800 msgr2=0x7f4c781f4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c76d9d640 1 --2- 172.21.15.47:0/3843612588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c64004800 0x7f4c781f4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c76d9d640 1 -- 172.21.15.47:0/3843612588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c781f38e0 msgr2=0x7f4c7809d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:05.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c76d9d640 1 --2- 172.21.15.47:0/3843612588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c781f38e0 0x7f4c7809d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:05.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c76d9d640 1 -- 172.21.15.47:0/3843612588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7809c8e0 con 0x7f4c7809bf90 2024-04-14T23:36:05.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c6dd9b640 1 --2- 172.21.15.47:0/3843612588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c781f38e0 0x7f4c7809d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:36:05.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c7659c640 1 --2- 172.21.15.47:0/3843612588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c64004800 0x7f4c781f4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:36:05.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c76d9d640 1 --2- 172.21.15.47:0/3843612588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c7809bf90 0x7f4c780c5e70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4c780ca930 tx=0x7f4c70007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c6f7fe640 1 -- 172.21.15.47:0/3843612588 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7000ac80 con 0x7f4c7809bf90 2024-04-14T23:36:05.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c6f7fe640 1 -- 172.21.15.47:0/3843612588 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c70018070 con 0x7f4c7809bf90 2024-04-14T23:36:05.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c7ce0f640 1 -- 172.21.15.47:0/3843612588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7809cbc0 con 0x7f4c7809bf90 2024-04-14T23:36:05.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c6f7fe640 1 -- 172.21.15.47:0/3843612588 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70013630 con 0x7f4c7809bf90 2024-04-14T23:36:05.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.948+0000 7f4c7ce0f640 1 -- 172.21.15.47:0/3843612588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7809d180 con 0x7f4c7809bf90 2024-04-14T23:36:05.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.949+0000 7f4c7ce0f640 1 -- 172.21.15.47:0/3843612588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c781f3cc0 con 0x7f4c7809bf90 2024-04-14T23:36:05.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.950+0000 7f4c6f7fe640 1 -- 172.21.15.47:0/3843612588 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f4c700137d0 con 0x7f4c7809bf90 2024-04-14T23:36:05.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.950+0000 7f4c6f7fe640 1 --2- 172.21.15.47:0/3843612588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4c5806b990 0x7f4c5806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:05.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.950+0000 7f4c6f7fe640 1 -- 172.21.15.47:0/3843612588 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4c7008b0c0 con 0x7f4c7809bf90 2024-04-14T23:36:05.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.950+0000 7f4c7659c640 1 --2- 172.21.15.47:0/3843612588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4c5806b990 0x7f4c5806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:05.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.951+0000 7f4c7659c640 1 --2- 172.21.15.47:0/3843612588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4c5806b990 0x7f4c5806de50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009b40 tx=0x7f4c68008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:05.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:05.954+0000 7f4c6f7fe640 1 -- 172.21.15.47:0/3843612588 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4c70059bd0 con 0x7f4c7809bf90 2024-04-14T23:36:06.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.134+0000 7f4c7ce0f640 1 -- 172.21.15.47:0/3843612588 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f4c78075410 con 0x7f4c5806b990 2024-04-14T23:36:06.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.134+0000 7f4c6f7fe640 1 -- 172.21.15.47:0/3843612588 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4c78075410 con 0x7f4c5806b990 2024-04-14T23:36:06.138 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 2 to deep-scrub 2024-04-14T23:36:06.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.136+0000 7f4c7ce0f640 1 -- 172.21.15.47:0/3843612588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4c5806b990 msgr2=0x7f4c5806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.137+0000 7f4c7ce0f640 1 --2- 172.21.15.47:0/3843612588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4c5806b990 0x7f4c5806de50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009b40 tx=0x7f4c68008040 comp rx=0 tx=0).stop 2024-04-14T23:36:06.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.137+0000 7f4c7ce0f640 1 -- 172.21.15.47:0/3843612588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c7809bf90 msgr2=0x7f4c780c5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.137+0000 7f4c7ce0f640 1 --2- 172.21.15.47:0/3843612588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c7809bf90 0x7f4c780c5e70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4c780ca930 tx=0x7f4c70007bd0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.137+0000 7f4c7ce0f640 1 -- 172.21.15.47:0/3843612588 shutdown_connections 2024-04-14T23:36:06.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.137+0000 7f4c7ce0f640 1 --2- 172.21.15.47:0/3843612588 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f4c5806b990 0x7f4c5806de50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.137+0000 7f4c7ce0f640 1 --2- 172.21.15.47:0/3843612588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c7809bf90 0x7f4c780c5e70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.137+0000 7f4c7ce0f640 1 --2- 172.21.15.47:0/3843612588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c781f38e0 0x7f4c7809d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.137+0000 7f4c7ce0f640 1 --2- 172.21.15.47:0/3843612588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c64004800 0x7f4c781f4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.137+0000 7f4c7ce0f640 1 -- 172.21.15.47:0/3843612588 >> 172.21.15.47:0/3843612588 conn(0x7f4c780d0330 msgr2=0x7f4c7815cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:06.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.137+0000 7f4c7ce0f640 1 -- 172.21.15.47:0/3843612588 shutdown_connections 2024-04-14T23:36:06.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.137+0000 7f4c7ce0f640 1 -- 172.21.15.47:0/3843612588 wait complete. 2024-04-14T23:36:06.151 INFO:tasks.ceph:Scrubbing osd.3 2024-04-14T23:36:06.151 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-14T23:36:06.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.253+0000 7fbc9cf1e640 1 Processor -- start 2024-04-14T23:36:06.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.254+0000 7fbc9cf1e640 1 -- start start 2024-04-14T23:36:06.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.254+0000 7fbc9cf1e640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbc980b53c0 0x7fbc980cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.254+0000 7fbc9cf1e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc980cfb30 0x7fbc980d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.254+0000 7fbc9cf1e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc980d2fa0 con 0x7fbc980d2b10 2024-04-14T23:36:06.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.254+0000 7fbc9cf1e640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fbc980b6e40 con 0x7fbc980b53c0 2024-04-14T23:36:06.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.254+0000 7fbc9cf1e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbc980b7090 con 0x7fbc980cfb30 2024-04-14T23:36:06.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.255+0000 7fbc96d9d640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fbc980d2b10 0x7fbc980d0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.47:42638/0 (socket says 172.21.15.47:42638) 2024-04-14T23:36:06.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.255+0000 7fbc8ffff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc980cfb30 0x7fbc980d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.255+0000 7fbc9659c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbc980b53c0 0x7fbc980cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.255+0000 7fbc96d9d640 1 -- 172.21.15.47:0/2671024025 learned_addr learned my addr 172.21.15.47:0/2671024025 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:06.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.255+0000 7fbc95d9b640 1 -- 172.21.15.47:0/2671024025 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1096738576 0 0) 0x7fbc980d2fa0 con 0x7fbc980d2b10 2024-04-14T23:36:06.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.255+0000 7fbc95d9b640 1 -- 172.21.15.47:0/2671024025 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc84003520 con 0x7fbc980d2b10 2024-04-14T23:36:06.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.255+0000 7fbc9659c640 1 -- 172.21.15.47:0/2671024025 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc980cfb30 msgr2=0x7fbc980d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:06.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.255+0000 7fbc9659c640 1 --2- 172.21.15.47:0/2671024025 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc980cfb30 0x7fbc980d25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.255+0000 7fbc9659c640 1 -- 172.21.15.47:0/2671024025 >> v1:172.21.15.191:6789/0 conn(0x7fbc980d2b10 legacy=0x7fbc980d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.255+0000 7fbc9659c640 1 -- 172.21.15.47:0/2671024025 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc980b7370 con 0x7fbc980b53c0 2024-04-14T23:36:06.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.256+0000 7fbc9659c640 1 --2- 172.21.15.47:0/2671024025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc980b53c0 0x7fbc980cf5f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbc880097a0 tx=0x7fbc8802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=493d1fce72f32eea server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:06.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.256+0000 7fbc95d9b640 1 -- 172.21.15.47:0/2671024025 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88034070 con 0x7fbc980b53c0 2024-04-14T23:36:06.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.256+0000 7fbc95d9b640 1 -- 172.21.15.47:0/2671024025 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc88030610 con 0x7fbc980b53c0 2024-04-14T23:36:06.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.256+0000 7fbc95d9b640 1 -- 172.21.15.47:0/2671024025 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc880309e0 con 0x7fbc980b53c0 2024-04-14T23:36:06.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.257+0000 7fbc9cf1e640 1 -- 172.21.15.47:0/2671024025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc980b53c0 msgr2=0x7fbc980cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.257+0000 7fbc9cf1e640 1 --2- 172.21.15.47:0/2671024025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc980b53c0 0x7fbc980cf5f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbc880097a0 tx=0x7fbc8802b960 comp rx=0 tx=0).stop 2024-04-14T23:36:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.257+0000 7fbc9cf1e640 1 -- 172.21.15.47:0/2671024025 shutdown_connections 2024-04-14T23:36:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.257+0000 7fbc9cf1e640 1 --2- 172.21.15.47:0/2671024025 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc980cfb30 0x7fbc980d25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.257+0000 7fbc9cf1e640 1 --2- 172.21.15.47:0/2671024025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc980b53c0 0x7fbc980cf5f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.257+0000 7fbc9cf1e640 1 -- 172.21.15.47:0/2671024025 >> 172.21.15.47:0/2671024025 conn(0x7fbc9809d2c0 msgr2=0x7fbc980d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.257+0000 7fbc9cf1e640 1 -- 172.21.15.47:0/2671024025 shutdown_connections 2024-04-14T23:36:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.257+0000 7fbc9cf1e640 1 -- 172.21.15.47:0/2671024025 wait complete. 2024-04-14T23:36:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.258+0000 7fbc9cf1e640 1 Processor -- start 2024-04-14T23:36:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.258+0000 7fbc9cf1e640 1 -- start start 2024-04-14T23:36:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc9cf1e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc980b53c0 0x7fbc980cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc9cf1e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc980cfb30 0x7fbc98156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc9cf1e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc980d2b10 0x7fbc98156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc9cf1e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbc980b57a0 con 0x7fbc980b53c0 2024-04-14T23:36:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc9cf1e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbc980b7930 con 0x7fbc980d2b10 2024-04-14T23:36:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc9cf1e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbc980b5920 con 0x7fbc980cfb30 2024-04-14T23:36:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc9659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc980b53c0 0x7fbc980cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc9659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc980b53c0 0x7fbc980cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44356/0 (socket says 172.21.15.47:44356) 2024-04-14T23:36:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc9659c640 1 -- 172.21.15.47:0/3102568983 learned_addr learned my addr 172.21.15.47:0/3102568983 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc8ffff640 1 --2- 172.21.15.47:0/3102568983 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc980cfb30 0x7fbc98156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc96d9d640 1 --2- 172.21.15.47:0/3102568983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc980d2b10 0x7fbc98156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc9659c640 1 -- 172.21.15.47:0/3102568983 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc980cfb30 msgr2=0x7fbc98156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc9659c640 1 --2- 172.21.15.47:0/3102568983 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc980cfb30 0x7fbc98156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc9659c640 1 -- 172.21.15.47:0/3102568983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc980d2b10 msgr2=0x7fbc98156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc9659c640 1 --2- 172.21.15.47:0/3102568983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc980d2b10 0x7fbc98156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc9659c640 1 -- 172.21.15.47:0/3102568983 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9815bbc0 con 0x7fbc980b53c0 2024-04-14T23:36:06.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc96d9d640 1 --2- 172.21.15.47:0/3102568983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc980d2b10 0x7fbc98156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:36:06.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.259+0000 7fbc9659c640 1 --2- 172.21.15.47:0/3102568983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc980b53c0 0x7fbc980cdb60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbc8802bf70 tx=0x7fbc880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:06.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.260+0000 7fbc8effd640 1 -- 172.21.15.47:0/3102568983 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88034040 con 0x7fbc980b53c0 2024-04-14T23:36:06.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.260+0000 7fbc8effd640 1 -- 172.21.15.47:0/3102568983 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc88030410 con 0x7fbc980b53c0 2024-04-14T23:36:06.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.260+0000 7fbc9cf1e640 1 -- 172.21.15.47:0/3102568983 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc9815bea0 con 0x7fbc980b53c0 2024-04-14T23:36:06.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.260+0000 7fbc8effd640 1 -- 172.21.15.47:0/3102568983 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88006e10 con 0x7fbc980b53c0 2024-04-14T23:36:06.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.260+0000 7fbc9cf1e640 1 -- 172.21.15.47:0/3102568983 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc9815c460 con 0x7fbc980b53c0 2024-04-14T23:36:06.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.260+0000 7fbc9cf1e640 1 -- 172.21.15.47:0/3102568983 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbc980754a0 con 0x7fbc980b53c0 2024-04-14T23:36:06.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.261+0000 7fbc8effd640 1 -- 172.21.15.47:0/3102568983 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fbc88037070 con 0x7fbc980b53c0 2024-04-14T23:36:06.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.261+0000 7fbc8effd640 1 --2- 172.21.15.47:0/3102568983 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbc7806b9c0 0x7fbc7806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.261+0000 7fbc8effd640 1 -- 172.21.15.47:0/3102568983 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fbc880ac7d0 con 0x7fbc980b53c0 2024-04-14T23:36:06.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.262+0000 7fbc8effd640 1 --2- 172.21.15.47:0/3102568983 >> [v2:172.21.15.47:6816/4047754630,v1:172.21.15.47:6817/4047754630] conn(0x7fbc78074220 0x7fbc78076660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.262+0000 7fbc8effd640 1 -- 172.21.15.47:0/3102568983 --> [v2:172.21.15.47:6816/4047754630,v1:172.21.15.47:6817/4047754630] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc88004490 con 0x7fbc78074220 2024-04-14T23:36:06.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.262+0000 7fbc8effd640 1 -- 172.21.15.47:0/3102568983 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fbc880b12c0 con 0x7fbc980b53c0 2024-04-14T23:36:06.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.262+0000 7fbc8ffff640 1 --2- 172.21.15.47:0/3102568983 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbc7806b9c0 0x7fbc7806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.262+0000 7fbc96d9d640 1 --2- 172.21.15.47:0/3102568983 >> [v2:172.21.15.47:6816/4047754630,v1:172.21.15.47:6817/4047754630] conn(0x7fbc78074220 0x7fbc78076660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.262+0000 7fbc96d9d640 1 --2- 172.21.15.47:0/3102568983 >> [v2:172.21.15.47:6816/4047754630,v1:172.21.15.47:6817/4047754630] conn(0x7fbc78074220 0x7fbc78076660 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:06.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.262+0000 7fbc8ffff640 1 --2- 172.21.15.47:0/3102568983 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbc7806b9c0 0x7fbc7806de80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbc980d47e0 tx=0x7fbc80009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:06.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.263+0000 7fbc8effd640 1 -- 172.21.15.47:0/3102568983 <== osd.3 v2:172.21.15.47:6816/4047754630 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbc88004490 con 0x7fbc78074220 2024-04-14T23:36:06.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.276+0000 7fbc9cf1e640 1 -- 172.21.15.47:0/3102568983 --> [v2:172.21.15.47:6816/4047754630,v1:172.21.15.47:6817/4047754630] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbc980d0bd0 con 0x7fbc78074220 2024-04-14T23:36:06.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.276+0000 7fbc8effd640 1 -- 172.21.15.47:0/3102568983 <== osd.3 v2:172.21.15.47:6816/4047754630 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbc980d0bd0 con 0x7fbc78074220 2024-04-14T23:36:06.280 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-14T23:36:06.280 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T23:36:06.280 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-14T23:36:06.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.276+0000 7fbc9cf1e640 1 -- 172.21.15.47:0/3102568983 >> [v2:172.21.15.47:6816/4047754630,v1:172.21.15.47:6817/4047754630] conn(0x7fbc78074220 msgr2=0x7fbc78076660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.276+0000 7fbc9cf1e640 1 --2- 172.21.15.47:0/3102568983 >> [v2:172.21.15.47:6816/4047754630,v1:172.21.15.47:6817/4047754630] conn(0x7fbc78074220 0x7fbc78076660 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.276+0000 7fbc9cf1e640 1 -- 172.21.15.47:0/3102568983 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbc7806b9c0 msgr2=0x7fbc7806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.276+0000 7fbc9cf1e640 1 --2- 172.21.15.47:0/3102568983 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fbc7806b9c0 0x7fbc7806de80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbc980d47e0 tx=0x7fbc80009190 comp rx=0 tx=0).stop 2024-04-14T23:36:06.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.276+0000 7fbc9cf1e640 1 -- 172.21.15.47:0/3102568983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc980b53c0 msgr2=0x7fbc980cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.276+0000 7fbc9cf1e640 1 --2- 172.21.15.47:0/3102568983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc980b53c0 0x7fbc980cdb60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbc8802bf70 tx=0x7fbc880046c0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.276+0000 7fbc96d9d640 1 -- 172.21.15.47:0/3102568983 reap_dead start 2024-04-14T23:36:06.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.276+0000 7fbc9cf1e640 1 -- 172.21.15.47:0/3102568983 shutdown_connections 2024-04-14T23:36:06.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.276+0000 7fbc9cf1e640 1 -- 172.21.15.47:0/3102568983 >> 172.21.15.47:0/3102568983 conn(0x7fbc9809d2c0 msgr2=0x7fbc9806d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:06.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.277+0000 7fbc9cf1e640 1 -- 172.21.15.47:0/3102568983 shutdown_connections 2024-04-14T23:36:06.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.277+0000 7fbc9cf1e640 1 -- 172.21.15.47:0/3102568983 wait complete. 2024-04-14T23:36:06.290 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-14T23:36:06.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.395+0000 7f44ce38c640 1 Processor -- start 2024-04-14T23:36:06.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.395+0000 7f44ce38c640 1 -- start start 2024-04-14T23:36:06.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.396+0000 7f44ce38c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44c815e420 0x7f44c80d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.396+0000 7f44ce38c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f44c80cf020 0x7f44c80cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.396+0000 7f44ce38c640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c80d1040 con 0x7f44c80ce4b0 2024-04-14T23:36:06.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.396+0000 7f44ce38c640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f44c80cc280 con 0x7f44c80cf020 2024-04-14T23:36:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.396+0000 7f44ce38c640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f44c806d750 con 0x7f44c815e420 2024-04-14T23:36:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.396+0000 7f44cc929640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f44c80cf020 0x7f44c80cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.396+0000 7f44cc929640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f44c80cf020 0x7f44c80cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44364/0 (socket says 172.21.15.47:44364) 2024-04-14T23:36:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.396+0000 7f44cc929640 1 -- 172.21.15.47:0/2390657647 learned_addr learned my addr 172.21.15.47:0/2390657647 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.396+0000 7f44c7fff640 1 --2- 172.21.15.47:0/2390657647 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44c815e420 0x7f44c80d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.397+0000 7f44cc929640 1 -- 172.21.15.47:0/2390657647 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44c815e420 msgr2=0x7f44c80d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.397+0000 7f44cc929640 1 --2- 172.21.15.47:0/2390657647 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44c815e420 0x7f44c80d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.397+0000 7f44cc929640 1 -- 172.21.15.47:0/2390657647 >> v1:172.21.15.191:6789/0 conn(0x7f44c80ce4b0 legacy=0x7f44c80ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:06.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.397+0000 7f44cc929640 1 -- 172.21.15.47:0/2390657647 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c80d1320 con 0x7f44c80cf020 2024-04-14T23:36:06.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.397+0000 7f44cc929640 1 --2- 172.21.15.47:0/2390657647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44c80cf020 0x7f44c80cccd0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f44c0009e50 tx=0x7f44c002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b06fefd0499734 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:06.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.397+0000 7f44c6ffd640 1 -- 172.21.15.47:0/2390657647 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c002cb00 con 0x7f44c80cf020 2024-04-14T23:36:06.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.398+0000 7f44c6ffd640 1 -- 172.21.15.47:0/2390657647 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c002cca0 con 0x7f44c80cf020 2024-04-14T23:36:06.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.398+0000 7f44c6ffd640 1 -- 172.21.15.47:0/2390657647 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0034610 con 0x7f44c80cf020 2024-04-14T23:36:06.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.398+0000 7f44ce38c640 1 -- 172.21.15.47:0/2390657647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44c80cf020 msgr2=0x7f44c80cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.398+0000 7f44ce38c640 1 --2- 172.21.15.47:0/2390657647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44c80cf020 0x7f44c80cccd0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f44c0009e50 tx=0x7f44c002bf60 comp rx=0 tx=0).stop 2024-04-14T23:36:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.398+0000 7f44ce38c640 1 -- 172.21.15.47:0/2390657647 shutdown_connections 2024-04-14T23:36:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.398+0000 7f44ce38c640 1 --2- 172.21.15.47:0/2390657647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44c80cf020 0x7f44c80cccd0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.398+0000 7f44ce38c640 1 --2- 172.21.15.47:0/2390657647 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44c815e420 0x7f44c80d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.398+0000 7f44ce38c640 1 -- 172.21.15.47:0/2390657647 >> 172.21.15.47:0/2390657647 conn(0x7f44c80d1c30 msgr2=0x7f44c80d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.398+0000 7f44ce38c640 1 -- 172.21.15.47:0/2390657647 shutdown_connections 2024-04-14T23:36:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.398+0000 7f44ce38c640 1 -- 172.21.15.47:0/2390657647 wait complete. 2024-04-14T23:36:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.399+0000 7f44ce38c640 1 Processor -- start 2024-04-14T23:36:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.399+0000 7f44ce38c640 1 -- start start 2024-04-14T23:36:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.400+0000 7f44ce38c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44c80ce4b0 0x7f44c8157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.400+0000 7f44ce38c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44c80cf020 0x7f44c80b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.400+0000 7f44ce38c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44c815e420 0x7f44c80b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.400+0000 7f44ce38c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f44c815e800 con 0x7f44c80ce4b0 2024-04-14T23:36:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.400+0000 7f44ce38c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f44c80cc7b0 con 0x7f44c80cf020 2024-04-14T23:36:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.400+0000 7f44ce38c640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f44c80cd210 con 0x7f44c815e420 2024-04-14T23:36:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.400+0000 7f44c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44c80ce4b0 0x7f44c8157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.400+0000 7f44c7fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44c80ce4b0 0x7f44c8157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44368/0 (socket says 172.21.15.47:44368) 2024-04-14T23:36:06.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.400+0000 7f44c7fff640 1 -- 172.21.15.47:0/2904770237 learned_addr learned my addr 172.21.15.47:0/2904770237 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:06.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.400+0000 7f44c77fe640 1 --2- 172.21.15.47:0/2904770237 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44c80cf020 0x7f44c80b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.400+0000 7f44c7fff640 1 -- 172.21.15.47:0/2904770237 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44c815e420 msgr2=0x7f44c80b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.400+0000 7f44c7fff640 1 --2- 172.21.15.47:0/2904770237 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44c815e420 0x7f44c80b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.400+0000 7f44c7fff640 1 -- 172.21.15.47:0/2904770237 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44c80cf020 msgr2=0x7f44c80b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.400+0000 7f44c7fff640 1 --2- 172.21.15.47:0/2904770237 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44c80cf020 0x7f44c80b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.401+0000 7f44c7fff640 1 -- 172.21.15.47:0/2904770237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c8158290 con 0x7f44c80ce4b0 2024-04-14T23:36:06.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.401+0000 7f44c7fff640 1 --2- 172.21.15.47:0/2904770237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44c80ce4b0 0x7f44c8157d50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f44b800d5f0 tx=0x7f44b800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:06.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.401+0000 7f44c4ff9640 1 -- 172.21.15.47:0/2904770237 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b80125f0 con 0x7f44c80ce4b0 2024-04-14T23:36:06.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.401+0000 7f44c4ff9640 1 -- 172.21.15.47:0/2904770237 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b8019070 con 0x7f44c80ce4b0 2024-04-14T23:36:06.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.401+0000 7f44ce38c640 1 -- 172.21.15.47:0/2904770237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c81f3f10 con 0x7f44c80ce4b0 2024-04-14T23:36:06.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.401+0000 7f44c4ff9640 1 -- 172.21.15.47:0/2904770237 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b80129d0 con 0x7f44c80ce4b0 2024-04-14T23:36:06.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.401+0000 7f44ce38c640 1 -- 172.21.15.47:0/2904770237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c81f44d0 con 0x7f44c80ce4b0 2024-04-14T23:36:06.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.402+0000 7f44ce38c640 1 -- 172.21.15.47:0/2904770237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44c8075430 con 0x7f44c80ce4b0 2024-04-14T23:36:06.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.402+0000 7f44c4ff9640 1 -- 172.21.15.47:0/2904770237 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f44b8012b70 con 0x7f44c80ce4b0 2024-04-14T23:36:06.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.402+0000 7f44c4ff9640 1 --2- 172.21.15.47:0/2904770237 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f44b406b9c0 0x7f44b406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.403+0000 7f44c4ff9640 1 -- 172.21.15.47:0/2904770237 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f44b808ad60 con 0x7f44c80ce4b0 2024-04-14T23:36:06.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.403+0000 7f44c77fe640 1 --2- 172.21.15.47:0/2904770237 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f44b406b9c0 0x7f44b406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.403+0000 7f44c77fe640 1 --2- 172.21.15.47:0/2904770237 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f44b406b9c0 0x7f44b406de80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f44c80b7a80 tx=0x7f44bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:06.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.407+0000 7f44c4ff9640 1 -- 172.21.15.47:0/2904770237 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f44c8158290 con 0x7f44c80ce4b0 2024-04-14T23:36:06.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.590+0000 7f44ce38c640 1 -- 172.21.15.47:0/2904770237 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f44c80b0c20 con 0x7f44b406b9c0 2024-04-14T23:36:06.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.591+0000 7f44c4ff9640 1 -- 172.21.15.47:0/2904770237 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f44c80b0c20 con 0x7f44b406b9c0 2024-04-14T23:36:06.594 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 3 to deep-scrub 2024-04-14T23:36:06.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.593+0000 7f44ce38c640 1 -- 172.21.15.47:0/2904770237 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f44b406b9c0 msgr2=0x7f44b406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.593+0000 7f44ce38c640 1 --2- 172.21.15.47:0/2904770237 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f44b406b9c0 0x7f44b406de80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f44c80b7a80 tx=0x7f44bc009040 comp rx=0 tx=0).stop 2024-04-14T23:36:06.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.593+0000 7f44ce38c640 1 -- 172.21.15.47:0/2904770237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44c80ce4b0 msgr2=0x7f44c8157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.593+0000 7f44ce38c640 1 --2- 172.21.15.47:0/2904770237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44c80ce4b0 0x7f44c8157d50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f44b800d5f0 tx=0x7f44b800dab0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.593+0000 7f44ce38c640 1 -- 172.21.15.47:0/2904770237 shutdown_connections 2024-04-14T23:36:06.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.593+0000 7f44ce38c640 1 --2- 172.21.15.47:0/2904770237 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f44b406b9c0 0x7f44b406de80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.593+0000 7f44ce38c640 1 --2- 172.21.15.47:0/2904770237 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44c815e420 0x7f44c80b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.593+0000 7f44ce38c640 1 --2- 172.21.15.47:0/2904770237 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44c80cf020 0x7f44c80b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.593+0000 7f44ce38c640 1 --2- 172.21.15.47:0/2904770237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f44c80ce4b0 0x7f44c8157d50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.593+0000 7f44ce38c640 1 -- 172.21.15.47:0/2904770237 >> 172.21.15.47:0/2904770237 conn(0x7f44c80d1c30 msgr2=0x7f44c806eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:06.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.593+0000 7f44ce38c640 1 -- 172.21.15.47:0/2904770237 shutdown_connections 2024-04-14T23:36:06.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.593+0000 7f44ce38c640 1 -- 172.21.15.47:0/2904770237 wait complete. 2024-04-14T23:36:06.607 INFO:tasks.ceph:Scrubbing osd.4 2024-04-14T23:36:06.607 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-14T23:36:06.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.711+0000 7fd6104c8640 1 Processor -- start 2024-04-14T23:36:06.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.711+0000 7fd6104c8640 1 -- start start 2024-04-14T23:36:06.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.712+0000 7fd6104c8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd60806ef30 0x7fd6080ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.712+0000 7fd6104c8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6080cece0 0x7fd60815da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.712+0000 7fd6104c8640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd60806f480 con 0x7fd60806de30 2024-04-14T23:36:06.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.712+0000 7fd6104c8640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd6080cf130 con 0x7fd60806ef30 2024-04-14T23:36:06.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.712+0000 7fd6104c8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd60806f760 con 0x7fd6080cece0 2024-04-14T23:36:06.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.712+0000 7fd60da63640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd60806ef30 0x7fd6080ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.712+0000 7fd60da63640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd60806ef30 0x7fd6080ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44382/0 (socket says 172.21.15.47:44382) 2024-04-14T23:36:06.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.712+0000 7fd60e264640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd60806de30 0x7fd60806fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35660/0 (socket says 172.21.15.47:35660) 2024-04-14T23:36:06.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.712+0000 7fd60da63640 1 -- 172.21.15.47:0/3951481821 learned_addr learned my addr 172.21.15.47:0/3951481821 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:06.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.712+0000 7fd60ea65640 1 --2- 172.21.15.47:0/3951481821 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6080cece0 0x7fd60815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.712+0000 7fd60da63640 1 -- 172.21.15.47:0/3951481821 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6080cece0 msgr2=0x7fd60815da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:06.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.712+0000 7fd60da63640 1 --2- 172.21.15.47:0/3951481821 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6080cece0 0x7fd60815da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.712+0000 7fd60da63640 1 -- 172.21.15.47:0/3951481821 >> v1:172.21.15.47:6789/0 conn(0x7fd60806de30 legacy=0x7fd60806fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.712+0000 7fd60da63640 1 -- 172.21.15.47:0/3951481821 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6080d0ca0 con 0x7fd60806ef30 2024-04-14T23:36:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.713+0000 7fd60da63640 1 --2- 172.21.15.47:0/3951481821 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd60806ef30 0x7fd6080ce7a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009870 tx=0x7fd5fc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b444c33f4bccb4f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.713+0000 7fd60d262640 1 -- 172.21.15.47:0/3951481821 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc035020 con 0x7fd60806ef30 2024-04-14T23:36:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.713+0000 7fd60d262640 1 -- 172.21.15.47:0/3951481821 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5fc031640 con 0x7fd60806ef30 2024-04-14T23:36:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.713+0000 7fd60d262640 1 -- 172.21.15.47:0/3951481821 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc02d040 con 0x7fd60806ef30 2024-04-14T23:36:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.714+0000 7fd6104c8640 1 -- 172.21.15.47:0/3951481821 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd60806ef30 msgr2=0x7fd6080ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.714+0000 7fd6104c8640 1 --2- 172.21.15.47:0/3951481821 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd60806ef30 0x7fd6080ce7a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009870 tx=0x7fd5fc02b8f0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.714+0000 7fd6104c8640 1 -- 172.21.15.47:0/3951481821 shutdown_connections 2024-04-14T23:36:06.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.714+0000 7fd6104c8640 1 --2- 172.21.15.47:0/3951481821 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6080cece0 0x7fd60815da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.714+0000 7fd6104c8640 1 --2- 172.21.15.47:0/3951481821 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd60806ef30 0x7fd6080ce7a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.714+0000 7fd6104c8640 1 -- 172.21.15.47:0/3951481821 >> 172.21.15.47:0/3951481821 conn(0x7fd6080d1d90 msgr2=0x7fd6080d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:06.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.714+0000 7fd6104c8640 1 -- 172.21.15.47:0/3951481821 shutdown_connections 2024-04-14T23:36:06.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.714+0000 7fd6104c8640 1 -- 172.21.15.47:0/3951481821 wait complete. 2024-04-14T23:36:06.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.715+0000 7fd6104c8640 1 Processor -- start 2024-04-14T23:36:06.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.715+0000 7fd6104c8640 1 -- start start 2024-04-14T23:36:06.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd6104c8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd60806de30 0x7fd6081f8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd6104c8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd60806ef30 0x7fd6080ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd6104c8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6080cece0 0x7fd6080c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd6104c8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd60806e210 con 0x7fd60806ef30 2024-04-14T23:36:06.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd6104c8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd6080d1260 con 0x7fd60806de30 2024-04-14T23:36:06.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd6104c8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd6080b7a20 con 0x7fd6080cece0 2024-04-14T23:36:06.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd60da63640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd60806ef30 0x7fd6080ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd60da63640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd60806ef30 0x7fd6080ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44392/0 (socket says 172.21.15.47:44392) 2024-04-14T23:36:06.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd60da63640 1 -- 172.21.15.47:0/3431975541 learned_addr learned my addr 172.21.15.47:0/3431975541 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:06.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd60da63640 1 -- 172.21.15.47:0/3431975541 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6080cece0 msgr2=0x7fd6080c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd60da63640 1 --2- 172.21.15.47:0/3431975541 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6080cece0 0x7fd6080c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd60da63640 1 -- 172.21.15.47:0/3431975541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd60806de30 msgr2=0x7fd6081f8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd60da63640 1 --2- 172.21.15.47:0/3431975541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd60806de30 0x7fd6081f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd60da63640 1 -- 172.21.15.47:0/3431975541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6081f7890 con 0x7fd60806ef30 2024-04-14T23:36:06.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd60da63640 1 --2- 172.21.15.47:0/3431975541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd60806ef30 0x7fd6080ca950 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc000c00 tx=0x7fd5fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:06.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd606ffd640 1 -- 172.21.15.47:0/3431975541 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc040070 con 0x7fd60806ef30 2024-04-14T23:36:06.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd606ffd640 1 -- 172.21.15.47:0/3431975541 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5fc0399f0 con 0x7fd60806ef30 2024-04-14T23:36:06.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd6104c8640 1 -- 172.21.15.47:0/3431975541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6080c7fd0 con 0x7fd60806ef30 2024-04-14T23:36:06.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd606ffd640 1 -- 172.21.15.47:0/3431975541 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc035040 con 0x7fd60806ef30 2024-04-14T23:36:06.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.716+0000 7fd6104c8640 1 -- 172.21.15.47:0/3431975541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6081f7e10 con 0x7fd60806ef30 2024-04-14T23:36:06.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.717+0000 7fd6104c8640 1 -- 172.21.15.47:0/3431975541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6080754a0 con 0x7fd60806ef30 2024-04-14T23:36:06.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.718+0000 7fd606ffd640 1 -- 172.21.15.47:0/3431975541 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fd5fc04b060 con 0x7fd60806ef30 2024-04-14T23:36:06.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.718+0000 7fd606ffd640 1 --2- 172.21.15.47:0/3431975541 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd5f406b990 0x7fd5f406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.718+0000 7fd606ffd640 1 -- 172.21.15.47:0/3431975541 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd5fc0ac260 con 0x7fd60806ef30 2024-04-14T23:36:06.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.718+0000 7fd606ffd640 1 --2- 172.21.15.47:0/3431975541 >> [v2:172.21.15.191:6801/2576967079,v1:172.21.15.191:6802/2576967079] conn(0x7fd5f4074170 0x7fd5f40765b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.719+0000 7fd606ffd640 1 -- 172.21.15.47:0/3431975541 --> [v2:172.21.15.191:6801/2576967079,v1:172.21.15.191:6802/2576967079] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5fc04ee50 con 0x7fd5f4074170 2024-04-14T23:36:06.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.719+0000 7fd60e264640 1 --2- 172.21.15.47:0/3431975541 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd5f406b990 0x7fd5f406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.719+0000 7fd606ffd640 1 -- 172.21.15.47:0/3431975541 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fd5fc0b3050 con 0x7fd60806ef30 2024-04-14T23:36:06.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.719+0000 7fd60ea65640 1 --2- 172.21.15.47:0/3431975541 >> [v2:172.21.15.191:6801/2576967079,v1:172.21.15.191:6802/2576967079] conn(0x7fd5f4074170 0x7fd5f40765b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.719+0000 7fd60e264640 1 --2- 172.21.15.47:0/3431975541 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd5f406b990 0x7fd5f406de50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd600000f60 tx=0x7fd600007a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:06.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.719+0000 7fd60ea65640 1 --2- 172.21.15.47:0/3431975541 >> [v2:172.21.15.191:6801/2576967079,v1:172.21.15.191:6802/2576967079] conn(0x7fd5f4074170 0x7fd5f40765b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:06.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.720+0000 7fd606ffd640 1 -- 172.21.15.47:0/3431975541 <== osd.4 v2:172.21.15.191:6801/2576967079 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5fc04ee50 con 0x7fd5f4074170 2024-04-14T23:36:06.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.733+0000 7fd6104c8640 1 -- 172.21.15.47:0/3431975541 --> [v2:172.21.15.191:6801/2576967079,v1:172.21.15.191:6802/2576967079] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd60806ccc0 con 0x7fd5f4074170 2024-04-14T23:36:06.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.734+0000 7fd606ffd640 1 -- 172.21.15.47:0/3431975541 <== osd.4 v2:172.21.15.191:6801/2576967079 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd60806ccc0 con 0x7fd5f4074170 2024-04-14T23:36:06.737 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-14T23:36:06.737 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T23:36:06.737 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-14T23:36:06.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.734+0000 7fd6104c8640 1 -- 172.21.15.47:0/3431975541 >> [v2:172.21.15.191:6801/2576967079,v1:172.21.15.191:6802/2576967079] conn(0x7fd5f4074170 msgr2=0x7fd5f40765b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.734+0000 7fd6104c8640 1 --2- 172.21.15.47:0/3431975541 >> [v2:172.21.15.191:6801/2576967079,v1:172.21.15.191:6802/2576967079] conn(0x7fd5f4074170 0x7fd5f40765b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.734+0000 7fd6104c8640 1 -- 172.21.15.47:0/3431975541 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd5f406b990 msgr2=0x7fd5f406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.734+0000 7fd6104c8640 1 --2- 172.21.15.47:0/3431975541 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fd5f406b990 0x7fd5f406de50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd600000f60 tx=0x7fd600007a00 comp rx=0 tx=0).stop 2024-04-14T23:36:06.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.734+0000 7fd6104c8640 1 -- 172.21.15.47:0/3431975541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd60806ef30 msgr2=0x7fd6080ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.734+0000 7fd6104c8640 1 --2- 172.21.15.47:0/3431975541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd60806ef30 0x7fd6080ca950 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc000c00 tx=0x7fd5fc0046c0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.734+0000 7fd60ea65640 1 -- 172.21.15.47:0/3431975541 reap_dead start 2024-04-14T23:36:06.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.734+0000 7fd6104c8640 1 -- 172.21.15.47:0/3431975541 shutdown_connections 2024-04-14T23:36:06.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.734+0000 7fd6104c8640 1 -- 172.21.15.47:0/3431975541 >> 172.21.15.47:0/3431975541 conn(0x7fd6080d1d90 msgr2=0x7fd6080cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:06.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.734+0000 7fd6104c8640 1 -- 172.21.15.47:0/3431975541 shutdown_connections 2024-04-14T23:36:06.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.734+0000 7fd6104c8640 1 -- 172.21.15.47:0/3431975541 wait complete. 2024-04-14T23:36:06.748 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-14T23:36:06.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.850+0000 7ff9524a2640 1 Processor -- start 2024-04-14T23:36:06.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.850+0000 7ff9524a2640 1 -- start start 2024-04-14T23:36:06.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.850+0000 7ff9524a2640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff94c0cdce0 0x7ff94c168fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.850+0000 7ff9524a2640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff94c0cf2d0 con 0x7ff94c15e420 2024-04-14T23:36:06.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.850+0000 7ff9524a2640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff94c0d1040 con 0x7ff94c0d0980 2024-04-14T23:36:06.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.850+0000 7ff9524a2640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7ff94c0d0e10 con 0x7ff94c0cdce0 2024-04-14T23:36:06.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff94c15e420 0x7ff94c0ce4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35664/0 (socket says 172.21.15.47:35664) 2024-04-14T23:36:06.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94bfff640 1 -- 172.21.15.47:0/2082675177 learned_addr learned my addr 172.21.15.47:0/2082675177 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:06.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff950a3f640 1 --2- 172.21.15.47:0/2082675177 >> v2:172.21.15.191:3300/0 conn(0x7ff94c0cdce0 0x7ff94c168fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94affd640 1 -- 172.21.15.47:0/2082675177 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3169966034 0 0) 0x7ff94c0cf2d0 con 0x7ff94c15e420 2024-04-14T23:36:06.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94affd640 1 -- 172.21.15.47:0/2082675177 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff934003520 con 0x7ff94c15e420 2024-04-14T23:36:06.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94affd640 1 -- 172.21.15.47:0/2082675177 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3079788395 0 0) 0x7ff934003520 con 0x7ff94c15e420 2024-04-14T23:36:06.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94affd640 1 -- 172.21.15.47:0/2082675177 >> v2:172.21.15.191:3300/0 conn(0x7ff94c0cdce0 msgr2=0x7ff94c168fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:06.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94affd640 1 --2- 172.21.15.47:0/2082675177 >> v2:172.21.15.191:3300/0 conn(0x7ff94c0cdce0 0x7ff94c168fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94affd640 1 -- 172.21.15.47:0/2082675177 >> v1:172.21.15.191:6789/0 conn(0x7ff94c0d0980 legacy=0x7ff94c0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94affd640 1 -- 172.21.15.47:0/2082675177 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94c0d1320 con 0x7ff94c15e420 2024-04-14T23:36:06.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94affd640 1 -- 172.21.15.47:0/2082675177 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7ff93c001670 con 0x7ff94c15e420 2024-04-14T23:36:06.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94affd640 1 -- 172.21.15.47:0/2082675177 >> v1:172.21.15.47:6789/0 conn(0x7ff94c15e420 legacy=0x7ff94c0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94affd640 1 --2- 172.21.15.47:0/2082675177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9340039b0 0x7ff934003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94affd640 1 --2- 172.21.15.47:0/2082675177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff934004800 0x7ff934004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94affd640 1 --2- 172.21.15.47:0/2082675177 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9340051c0 0x7ff93400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94affd640 1 -- 172.21.15.47:0/2082675177 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff93400c040 con 0x7ff934004800 2024-04-14T23:36:06.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94affd640 1 -- 172.21.15.47:0/2082675177 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff93400c1f0 con 0x7ff9340039b0 2024-04-14T23:36:06.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94affd640 1 -- 172.21.15.47:0/2082675177 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff93400c3f0 con 0x7ff9340051c0 2024-04-14T23:36:06.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94b7fe640 1 --2- 172.21.15.47:0/2082675177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff934004800 0x7ff934004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff94bfff640 1 --2- 172.21.15.47:0/2082675177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9340039b0 0x7ff934003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.851+0000 7ff950a3f640 1 --2- 172.21.15.47:0/2082675177 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9340051c0 0x7ff93400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.852+0000 7ff94b7fe640 1 -- 172.21.15.47:0/2082675177 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9340051c0 msgr2=0x7ff93400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:06.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.852+0000 7ff94b7fe640 1 --2- 172.21.15.47:0/2082675177 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9340051c0 0x7ff93400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.852+0000 7ff94b7fe640 1 -- 172.21.15.47:0/2082675177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9340039b0 msgr2=0x7ff934003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:06.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.852+0000 7ff94b7fe640 1 --2- 172.21.15.47:0/2082675177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9340039b0 0x7ff934003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.852+0000 7ff94b7fe640 1 -- 172.21.15.47:0/2082675177 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff934003520 con 0x7ff934004800 2024-04-14T23:36:06.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.852+0000 7ff94bfff640 1 --2- 172.21.15.47:0/2082675177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9340039b0 0x7ff934003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:36:06.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.852+0000 7ff950a3f640 1 --2- 172.21.15.47:0/2082675177 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9340051c0 0x7ff93400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:36:06.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.852+0000 7ff950a3f640 1 -- 172.21.15.47:0/2082675177 reap_dead start 2024-04-14T23:36:06.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.852+0000 7ff94b7fe640 1 --2- 172.21.15.47:0/2082675177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff934004800 0x7ff934004c80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff940001750 tx=0x7ff934005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb39f94c49580972 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:06.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.852+0000 7ff94affd640 1 -- 172.21.15.47:0/2082675177 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940001370 con 0x7ff934004800 2024-04-14T23:36:06.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.852+0000 7ff94affd640 1 -- 172.21.15.47:0/2082675177 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9400052d0 con 0x7ff934004800 2024-04-14T23:36:06.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.852+0000 7ff94affd640 1 -- 172.21.15.47:0/2082675177 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940003830 con 0x7ff934004800 2024-04-14T23:36:06.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.853+0000 7ff9524a2640 1 -- 172.21.15.47:0/2082675177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff934004800 msgr2=0x7ff934004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.853+0000 7ff9524a2640 1 --2- 172.21.15.47:0/2082675177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff934004800 0x7ff934004c80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff940001750 tx=0x7ff934005830 comp rx=0 tx=0).stop 2024-04-14T23:36:06.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.853+0000 7ff9524a2640 1 -- 172.21.15.47:0/2082675177 shutdown_connections 2024-04-14T23:36:06.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.853+0000 7ff9524a2640 1 --2- 172.21.15.47:0/2082675177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff934004800 0x7ff934004c80 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.853+0000 7ff9524a2640 1 -- 172.21.15.47:0/2082675177 >> 172.21.15.47:0/2082675177 conn(0x7ff94c0d1c30 msgr2=0x7ff94c0d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:06.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.853+0000 7ff9524a2640 1 -- 172.21.15.47:0/2082675177 shutdown_connections 2024-04-14T23:36:06.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.853+0000 7ff9524a2640 1 -- 172.21.15.47:0/2082675177 wait complete. 2024-04-14T23:36:06.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.854+0000 7ff9524a2640 1 Processor -- start 2024-04-14T23:36:06.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.854+0000 7ff9524a2640 1 -- start start 2024-04-14T23:36:06.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.855+0000 7ff9524a2640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff934004800 0x7ff94c0c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.855+0000 7ff9524a2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff94c0c6e80 0x7ff94c157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.855+0000 7ff9524a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff94c158470 0x7ff94c160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.855+0000 7ff9524a2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c0cc7b0 con 0x7ff94c158470 2024-04-14T23:36:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.855+0000 7ff9524a2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c0cc280 con 0x7ff94c0c6e80 2024-04-14T23:36:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.855+0000 7ff9524a2640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff94c15e800 con 0x7ff934004800 2024-04-14T23:36:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.855+0000 7ff950a3f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff94c158470 0x7ff94c160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.855+0000 7ff950a3f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff94c158470 0x7ff94c160e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44416/0 (socket says 172.21.15.47:44416) 2024-04-14T23:36:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.855+0000 7ff950a3f640 1 -- 172.21.15.47:0/3507854867 learned_addr learned my addr 172.21.15.47:0/3507854867 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.855+0000 7ff950a3f640 1 -- 172.21.15.47:0/3507854867 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff934004800 msgr2=0x7ff94c0c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.855+0000 7ff950a3f640 1 --2- 172.21.15.47:0/3507854867 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff934004800 0x7ff94c0c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.855+0000 7ff950a3f640 1 -- 172.21.15.47:0/3507854867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff94c0c6e80 msgr2=0x7ff94c157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.855+0000 7ff950a3f640 1 --2- 172.21.15.47:0/3507854867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff94c0c6e80 0x7ff94c157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.855+0000 7ff950a3f640 1 -- 172.21.15.47:0/3507854867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94c0c6100 con 0x7ff94c158470 2024-04-14T23:36:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.856+0000 7ff950a3f640 1 --2- 172.21.15.47:0/3507854867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff94c158470 0x7ff94c160e10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff94c071f10 tx=0x7ff944010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.856+0000 7ff948ff9640 1 -- 172.21.15.47:0/3507854867 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff944010e60 con 0x7ff94c158470 2024-04-14T23:36:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.856+0000 7ff948ff9640 1 -- 172.21.15.47:0/3507854867 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff944003990 con 0x7ff94c158470 2024-04-14T23:36:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.856+0000 7ff9524a2640 1 -- 172.21.15.47:0/3507854867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94c15fd50 con 0x7ff94c158470 2024-04-14T23:36:06.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.856+0000 7ff948ff9640 1 -- 172.21.15.47:0/3507854867 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff944003da0 con 0x7ff94c158470 2024-04-14T23:36:06.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.856+0000 7ff9524a2640 1 -- 172.21.15.47:0/3507854867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff94c0c63a0 con 0x7ff94c158470 2024-04-14T23:36:06.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.857+0000 7ff9524a2640 1 -- 172.21.15.47:0/3507854867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff94c0cdad0 con 0x7ff94c158470 2024-04-14T23:36:06.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.857+0000 7ff948ff9640 1 -- 172.21.15.47:0/3507854867 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ff94401e020 con 0x7ff94c158470 2024-04-14T23:36:06.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.858+0000 7ff948ff9640 1 --2- 172.21.15.47:0/3507854867 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff93806b990 0x7ff93806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:06.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.858+0000 7ff948ff9640 1 -- 172.21.15.47:0/3507854867 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff94408b110 con 0x7ff94c158470 2024-04-14T23:36:06.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.858+0000 7ff94bfff640 1 --2- 172.21.15.47:0/3507854867 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff93806b990 0x7ff93806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:06.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.858+0000 7ff94bfff640 1 --2- 172.21.15.47:0/3507854867 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff93806b990 0x7ff93806de50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff93c001b80 tx=0x7ff93c001110 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:06.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:06.862+0000 7ff948ff9640 1 -- 172.21.15.47:0/3507854867 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff94c0cdad0 con 0x7ff94c158470 2024-04-14T23:36:07.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.043+0000 7ff9524a2640 1 -- 172.21.15.47:0/3507854867 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7ff94c075430 con 0x7ff93806b990 2024-04-14T23:36:07.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.044+0000 7ff948ff9640 1 -- 172.21.15.47:0/3507854867 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff94c075430 con 0x7ff93806b990 2024-04-14T23:36:07.047 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 4 to deep-scrub 2024-04-14T23:36:07.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.046+0000 7ff9524a2640 1 -- 172.21.15.47:0/3507854867 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff93806b990 msgr2=0x7ff93806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.046+0000 7ff9524a2640 1 --2- 172.21.15.47:0/3507854867 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff93806b990 0x7ff93806de50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff93c001b80 tx=0x7ff93c001110 comp rx=0 tx=0).stop 2024-04-14T23:36:07.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.046+0000 7ff9524a2640 1 -- 172.21.15.47:0/3507854867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff94c158470 msgr2=0x7ff94c160e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.046+0000 7ff9524a2640 1 --2- 172.21.15.47:0/3507854867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff94c158470 0x7ff94c160e10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff94c071f10 tx=0x7ff944010590 comp rx=0 tx=0).stop 2024-04-14T23:36:07.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.046+0000 7ff9524a2640 1 -- 172.21.15.47:0/3507854867 shutdown_connections 2024-04-14T23:36:07.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.046+0000 7ff9524a2640 1 --2- 172.21.15.47:0/3507854867 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff93806b990 0x7ff93806de50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.046+0000 7ff9524a2640 1 --2- 172.21.15.47:0/3507854867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff94c158470 0x7ff94c160e10 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.046+0000 7ff9524a2640 1 --2- 172.21.15.47:0/3507854867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff94c0c6e80 0x7ff94c157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.046+0000 7ff9524a2640 1 --2- 172.21.15.47:0/3507854867 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff934004800 0x7ff94c0c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.046+0000 7ff9524a2640 1 -- 172.21.15.47:0/3507854867 >> 172.21.15.47:0/3507854867 conn(0x7ff94c0d1c30 msgr2=0x7ff94c06f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:07.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.046+0000 7ff9524a2640 1 -- 172.21.15.47:0/3507854867 shutdown_connections 2024-04-14T23:36:07.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.046+0000 7ff9524a2640 1 -- 172.21.15.47:0/3507854867 wait complete. 2024-04-14T23:36:07.060 INFO:tasks.ceph:Scrubbing osd.5 2024-04-14T23:36:07.060 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-14T23:36:07.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.163+0000 7f762c155640 1 Processor -- start 2024-04-14T23:36:07.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.163+0000 7f762c155640 1 -- start start 2024-04-14T23:36:07.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.164+0000 7f762c155640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f76240d0a60 0x7f7624070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.164+0000 7f762c155640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76240ccc80 con 0x7f762415c030 2024-04-14T23:36:07.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.164+0000 7f762c155640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76240ccf60 con 0x7f76241608b0 2024-04-14T23:36:07.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.164+0000 7f762c155640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f76240d0070 con 0x7f76240d0a60 2024-04-14T23:36:07.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.164+0000 7f762a6f2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f76240d0a60 0x7f7624070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.164+0000 7f7629ef1640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f762415c030 0x7f76240cf960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35678/0 (socket says 172.21.15.47:35678) 2024-04-14T23:36:07.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.164+0000 7f762a6f2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f76240d0a60 0x7f7624070070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44418/0 (socket says 172.21.15.47:44418) 2024-04-14T23:36:07.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.164+0000 7f7629ef1640 1 -- 172.21.15.47:0/119056343 learned_addr learned my addr 172.21.15.47:0/119056343 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:07.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.164+0000 7f762a6f2640 1 -- 172.21.15.47:0/119056343 >> v1:172.21.15.191:6789/0 conn(0x7f76241608b0 legacy=0x7f76240d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:07.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.164+0000 7f762a6f2640 1 -- 172.21.15.47:0/119056343 >> v1:172.21.15.47:6789/0 conn(0x7f762415c030 legacy=0x7f76240cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.164+0000 7f762a6f2640 1 -- 172.21.15.47:0/119056343 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76240cd240 con 0x7f76240d0a60 2024-04-14T23:36:07.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.164+0000 7f7628eef640 1 -- 172.21.15.47:0/119056343 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2060861327 0 0) 0x7f76240ccc80 con 0x7f762415c030 2024-04-14T23:36:07.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.165+0000 7f762a6f2640 1 --2- 172.21.15.47:0/119056343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76240d0a60 0x7f7624070070 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f761c009d90 tx=0x7f761c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef5fea1b46a9d5e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:07.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.165+0000 7f7628eef640 1 -- 172.21.15.47:0/119056343 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c039070 con 0x7f76240d0a60 2024-04-14T23:36:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.165+0000 7f7628eef640 1 -- 172.21.15.47:0/119056343 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761c02cbd0 con 0x7f76240d0a60 2024-04-14T23:36:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.165+0000 7f7628eef640 1 -- 172.21.15.47:0/119056343 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c034440 con 0x7f76240d0a60 2024-04-14T23:36:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.165+0000 7f762c155640 1 -- 172.21.15.47:0/119056343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76240d0a60 msgr2=0x7f7624070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.165+0000 7f762c155640 1 --2- 172.21.15.47:0/119056343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76240d0a60 0x7f7624070070 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f761c009d90 tx=0x7f761c02be20 comp rx=0 tx=0).stop 2024-04-14T23:36:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.166+0000 7f762c155640 1 -- 172.21.15.47:0/119056343 shutdown_connections 2024-04-14T23:36:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.166+0000 7f762c155640 1 --2- 172.21.15.47:0/119056343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76240d0a60 0x7f7624070070 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.166+0000 7f762c155640 1 -- 172.21.15.47:0/119056343 >> 172.21.15.47:0/119056343 conn(0x7f76240d1d90 msgr2=0x7f76240d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:07.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.166+0000 7f762c155640 1 -- 172.21.15.47:0/119056343 shutdown_connections 2024-04-14T23:36:07.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.166+0000 7f762c155640 1 -- 172.21.15.47:0/119056343 wait complete. 2024-04-14T23:36:07.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.167+0000 7f762c155640 1 Processor -- start 2024-04-14T23:36:07.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.167+0000 7f762c155640 1 -- start start 2024-04-14T23:36:07.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.167+0000 7f762c155640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76240d0a60 0x7f762406c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.167+0000 7f762c155640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f762415c030 0x7f762406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.167+0000 7f762c155640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f76241608b0 0x7f76240c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.167+0000 7f762c155640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f762415c410 con 0x7f76240d0a60 2024-04-14T23:36:07.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.167+0000 7f762c155640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f76240cc930 con 0x7f762415c030 2024-04-14T23:36:07.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.167+0000 7f762c155640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f76240cda40 con 0x7f76241608b0 2024-04-14T23:36:07.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.168+0000 7f7629ef1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76240d0a60 0x7f762406c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.168+0000 7f7629ef1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76240d0a60 0x7f762406c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44430/0 (socket says 172.21.15.47:44430) 2024-04-14T23:36:07.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.168+0000 7f7629ef1640 1 -- 172.21.15.47:0/3985352062 learned_addr learned my addr 172.21.15.47:0/3985352062 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:07.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.168+0000 7f762a6f2640 1 --2- 172.21.15.47:0/3985352062 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f76241608b0 0x7f76240c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.168+0000 7f7629ef1640 1 -- 172.21.15.47:0/3985352062 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f76241608b0 msgr2=0x7f76240c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.168+0000 7f7629ef1640 1 --2- 172.21.15.47:0/3985352062 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f76241608b0 0x7f76240c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.168+0000 7f7629ef1640 1 -- 172.21.15.47:0/3985352062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f762415c030 msgr2=0x7f762406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.168+0000 7f7629ef1640 1 --2- 172.21.15.47:0/3985352062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f762415c030 0x7f762406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.168+0000 7f7629ef1640 1 -- 172.21.15.47:0/3985352062 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762406d780 con 0x7f76240d0a60 2024-04-14T23:36:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.168+0000 7f762a6f2640 1 --2- 172.21.15.47:0/3985352062 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f76241608b0 0x7f76240c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:36:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.168+0000 7f7629ef1640 1 --2- 172.21.15.47:0/3985352062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76240d0a60 0x7f762406c310 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f762000c4d0 tx=0x7f762000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.168+0000 7f761a7fc640 1 -- 172.21.15.47:0/3985352062 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7620018070 con 0x7f76240d0a60 2024-04-14T23:36:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.168+0000 7f761a7fc640 1 -- 172.21.15.47:0/3985352062 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7620007500 con 0x7f76240d0a60 2024-04-14T23:36:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.168+0000 7f761a7fc640 1 -- 172.21.15.47:0/3985352062 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7620004a20 con 0x7f76240d0a60 2024-04-14T23:36:07.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.168+0000 7f762c155640 1 -- 172.21.15.47:0/3985352062 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f762406d1d0 con 0x7f76240d0a60 2024-04-14T23:36:07.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.168+0000 7f762c155640 1 -- 172.21.15.47:0/3985352062 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f762406cc10 con 0x7f76240d0a60 2024-04-14T23:36:07.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.169+0000 7f762c155640 1 -- 172.21.15.47:0/3985352062 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f76240cfd00 con 0x7f76240d0a60 2024-04-14T23:36:07.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.170+0000 7f761a7fc640 1 -- 172.21.15.47:0/3985352062 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f762001b070 con 0x7f76240d0a60 2024-04-14T23:36:07.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.170+0000 7f761a7fc640 1 --2- 172.21.15.47:0/3985352062 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f760806b990 0x7f760806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.170+0000 7f761a7fc640 1 -- 172.21.15.47:0/3985352062 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f7620089c80 con 0x7f76240d0a60 2024-04-14T23:36:07.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.170+0000 7f761a7fc640 1 --2- 172.21.15.47:0/3985352062 >> [v2:172.21.15.191:6816/1990913951,v1:172.21.15.191:6817/1990913951] conn(0x7f7608074200 0x7f7608076640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.170+0000 7f761a7fc640 1 -- 172.21.15.47:0/3985352062 --> [v2:172.21.15.191:6816/1990913951,v1:172.21.15.191:6817/1990913951] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7608076d10 con 0x7f7608074200 2024-04-14T23:36:07.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.170+0000 7f761a7fc640 1 -- 172.21.15.47:0/3985352062 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f762008c380 con 0x7f76240d0a60 2024-04-14T23:36:07.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.170+0000 7f76296f0640 1 --2- 172.21.15.47:0/3985352062 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f760806b990 0x7f760806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.170+0000 7f762a6f2640 1 --2- 172.21.15.47:0/3985352062 >> [v2:172.21.15.191:6816/1990913951,v1:172.21.15.191:6817/1990913951] conn(0x7f7608074200 0x7f7608076640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.171+0000 7f76296f0640 1 --2- 172.21.15.47:0/3985352062 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f760806b990 0x7f760806de50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7614006fd0 tx=0x7f7614006bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:07.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.171+0000 7f762a6f2640 1 --2- 172.21.15.47:0/3985352062 >> [v2:172.21.15.191:6816/1990913951,v1:172.21.15.191:6817/1990913951] conn(0x7f7608074200 0x7f7608076640 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:07.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.172+0000 7f761a7fc640 1 -- 172.21.15.47:0/3985352062 <== osd.5 v2:172.21.15.191:6816/1990913951 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7608076d10 con 0x7f7608074200 2024-04-14T23:36:07.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.185+0000 7f762c155640 1 -- 172.21.15.47:0/3985352062 --> [v2:172.21.15.191:6816/1990913951,v1:172.21.15.191:6817/1990913951] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f76240754a0 con 0x7f7608074200 2024-04-14T23:36:07.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.186+0000 7f761a7fc640 1 -- 172.21.15.47:0/3985352062 <== osd.5 v2:172.21.15.191:6816/1990913951 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f76240754a0 con 0x7f7608074200 2024-04-14T23:36:07.189 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-14T23:36:07.189 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T23:36:07.189 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-14T23:36:07.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.186+0000 7f762c155640 1 -- 172.21.15.47:0/3985352062 >> [v2:172.21.15.191:6816/1990913951,v1:172.21.15.191:6817/1990913951] conn(0x7f7608074200 msgr2=0x7f7608076640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.186+0000 7f762c155640 1 --2- 172.21.15.47:0/3985352062 >> [v2:172.21.15.191:6816/1990913951,v1:172.21.15.191:6817/1990913951] conn(0x7f7608074200 0x7f7608076640 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.186+0000 7f762c155640 1 -- 172.21.15.47:0/3985352062 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f760806b990 msgr2=0x7f760806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.186+0000 7f762c155640 1 --2- 172.21.15.47:0/3985352062 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f760806b990 0x7f760806de50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7614006fd0 tx=0x7f7614006bc0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.186+0000 7f762c155640 1 -- 172.21.15.47:0/3985352062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76240d0a60 msgr2=0x7f762406c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.186+0000 7f762c155640 1 --2- 172.21.15.47:0/3985352062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76240d0a60 0x7f762406c310 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f762000c4d0 tx=0x7f762000c990 comp rx=0 tx=0).stop 2024-04-14T23:36:07.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.186+0000 7f762a6f2640 1 -- 172.21.15.47:0/3985352062 reap_dead start 2024-04-14T23:36:07.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.186+0000 7f762c155640 1 -- 172.21.15.47:0/3985352062 shutdown_connections 2024-04-14T23:36:07.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.186+0000 7f762c155640 1 -- 172.21.15.47:0/3985352062 >> 172.21.15.47:0/3985352062 conn(0x7f76240d1d90 msgr2=0x7f7624159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:07.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.186+0000 7f762c155640 1 -- 172.21.15.47:0/3985352062 shutdown_connections 2024-04-14T23:36:07.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.186+0000 7f762c155640 1 -- 172.21.15.47:0/3985352062 wait complete. 2024-04-14T23:36:07.199 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-14T23:36:07.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.298+0000 7fc813084640 1 Processor -- start 2024-04-14T23:36:07.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.298+0000 7fc813084640 1 -- start start 2024-04-14T23:36:07.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.299+0000 7fc813084640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc80c144a80 0x7fc80c06ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.299+0000 7fc813084640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80c0b35d0 0x7fc80c0ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.299+0000 7fc813084640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc80c06d970 con 0x7fc80c0b2a70 2024-04-14T23:36:07.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.299+0000 7fc813084640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fc80c06d720 con 0x7fc80c144a80 2024-04-14T23:36:07.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.299+0000 7fc813084640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc80c06dc50 con 0x7fc80c0b35d0 2024-04-14T23:36:07.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.299+0000 7fc80bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc80c0b2a70 0x7fc80c0b2ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35688/0 (socket says 172.21.15.47:35688) 2024-04-14T23:36:07.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.299+0000 7fc80bfff640 1 -- 172.21.15.47:0/1087565906 learned_addr learned my addr 172.21.15.47:0/1087565906 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:07.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc811621640 1 --2- 172.21.15.47:0/1087565906 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80c0b35d0 0x7fc80c0ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc810e20640 1 --2- 172.21.15.47:0/1087565906 >> v2:172.21.15.191:3300/0 conn(0x7fc80c144a80 0x7fc80c06ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80b7fe640 1 -- 172.21.15.47:0/1087565906 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2637549787 0 0) 0x7fc80c06d970 con 0x7fc80c0b2a70 2024-04-14T23:36:07.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80b7fe640 1 -- 172.21.15.47:0/1087565906 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7fc003520 con 0x7fc80c0b2a70 2024-04-14T23:36:07.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80b7fe640 1 -- 172.21.15.47:0/1087565906 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2217714552 0 0) 0x7fc7fc003520 con 0x7fc80c0b2a70 2024-04-14T23:36:07.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80b7fe640 1 -- 172.21.15.47:0/1087565906 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80c0b35d0 msgr2=0x7fc80c0ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:07.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80b7fe640 1 --2- 172.21.15.47:0/1087565906 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80c0b35d0 0x7fc80c0ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80b7fe640 1 -- 172.21.15.47:0/1087565906 >> v2:172.21.15.191:3300/0 conn(0x7fc80c144a80 msgr2=0x7fc80c06ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:07.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80b7fe640 1 --2- 172.21.15.47:0/1087565906 >> v2:172.21.15.191:3300/0 conn(0x7fc80c144a80 0x7fc80c06ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80b7fe640 1 -- 172.21.15.47:0/1087565906 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80c06df30 con 0x7fc80c0b2a70 2024-04-14T23:36:07.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80b7fe640 1 -- 172.21.15.47:0/1087565906 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7fc7f8001670 con 0x7fc80c0b2a70 2024-04-14T23:36:07.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80b7fe640 1 -- 172.21.15.47:0/1087565906 >> v1:172.21.15.47:6789/0 conn(0x7fc80c0b2a70 legacy=0x7fc80c0b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80b7fe640 1 --2- 172.21.15.47:0/1087565906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7fc0039b0 0x7fc7fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80b7fe640 1 --2- 172.21.15.47:0/1087565906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7fc004800 0x7fc7fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80b7fe640 1 --2- 172.21.15.47:0/1087565906 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80c0b35d0 0x7fc7fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80b7fe640 1 -- 172.21.15.47:0/1087565906 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c06d720 con 0x7fc7fc0039b0 2024-04-14T23:36:07.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80b7fe640 1 -- 172.21.15.47:0/1087565906 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c06dc50 con 0x7fc7fc004800 2024-04-14T23:36:07.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80b7fe640 1 -- 172.21.15.47:0/1087565906 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc7fc00b9c0 con 0x7fc80c0b35d0 2024-04-14T23:36:07.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc810e20640 1 --2- 172.21.15.47:0/1087565906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7fc0039b0 0x7fc7fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc811621640 1 --2- 172.21.15.47:0/1087565906 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80c0b35d0 0x7fc7fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc80bfff640 1 --2- 172.21.15.47:0/1087565906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7fc004800 0x7fc7fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc810e20640 1 -- 172.21.15.47:0/1087565906 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80c0b35d0 msgr2=0x7fc7fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:07.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc810e20640 1 --2- 172.21.15.47:0/1087565906 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80c0b35d0 0x7fc7fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc810e20640 1 -- 172.21.15.47:0/1087565906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7fc004800 msgr2=0x7fc7fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:07.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc810e20640 1 --2- 172.21.15.47:0/1087565906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7fc004800 0x7fc7fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc810e20640 1 -- 172.21.15.47:0/1087565906 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7fc003520 con 0x7fc7fc0039b0 2024-04-14T23:36:07.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.300+0000 7fc811621640 1 --2- 172.21.15.47:0/1087565906 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80c0b35d0 0x7fc7fc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:36:07.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.301+0000 7fc810e20640 1 --2- 172.21.15.47:0/1087565906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7fc0039b0 0x7fc7fc003dd0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc800009ac0 tx=0x7fc7fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed2aa99d632d1d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:07.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.301+0000 7fc80b7fe640 1 -- 172.21.15.47:0/1087565906 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800039070 con 0x7fc7fc0039b0 2024-04-14T23:36:07.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.301+0000 7fc80b7fe640 1 -- 172.21.15.47:0/1087565906 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80002c710 con 0x7fc7fc0039b0 2024-04-14T23:36:07.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.301+0000 7fc80b7fe640 1 -- 172.21.15.47:0/1087565906 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800009690 con 0x7fc7fc0039b0 2024-04-14T23:36:07.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.302+0000 7fc813084640 1 -- 172.21.15.47:0/1087565906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7fc0039b0 msgr2=0x7fc7fc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.302+0000 7fc813084640 1 --2- 172.21.15.47:0/1087565906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7fc0039b0 0x7fc7fc003dd0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc800009ac0 tx=0x7fc7fc005830 comp rx=0 tx=0).stop 2024-04-14T23:36:07.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.302+0000 7fc811621640 1 -- 172.21.15.47:0/1087565906 reap_dead start 2024-04-14T23:36:07.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.302+0000 7fc813084640 1 -- 172.21.15.47:0/1087565906 shutdown_connections 2024-04-14T23:36:07.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.302+0000 7fc813084640 1 -- 172.21.15.47:0/1087565906 >> 172.21.15.47:0/1087565906 conn(0x7fc80c06b200 msgr2=0x7fc80c06b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:07.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.302+0000 7fc813084640 1 -- 172.21.15.47:0/1087565906 shutdown_connections 2024-04-14T23:36:07.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.302+0000 7fc813084640 1 -- 172.21.15.47:0/1087565906 wait complete. 2024-04-14T23:36:07.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.303+0000 7fc813084640 1 Processor -- start 2024-04-14T23:36:07.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.303+0000 7fc813084640 1 -- start start 2024-04-14T23:36:07.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc813084640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7fc0039b0 0x7fc80c1f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc813084640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc80c0c6fc0 0x7fc80c0c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc813084640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80c0c61b0 0x7fc80c0c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc813084640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c0ce410 con 0x7fc80c0c6fc0 2024-04-14T23:36:07.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc813084640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c144e60 con 0x7fc7fc0039b0 2024-04-14T23:36:07.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc813084640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc80c0ce590 con 0x7fc80c0c61b0 2024-04-14T23:36:07.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc80bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc80c0c6fc0 0x7fc80c0c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc80bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc80c0c6fc0 0x7fc80c0c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44450/0 (socket says 172.21.15.47:44450) 2024-04-14T23:36:07.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc80bfff640 1 -- 172.21.15.47:0/3673304458 learned_addr learned my addr 172.21.15.47:0/3673304458 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:07.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc810e20640 1 --2- 172.21.15.47:0/3673304458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7fc0039b0 0x7fc80c1f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc811621640 1 --2- 172.21.15.47:0/3673304458 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80c0c61b0 0x7fc80c0c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc80bfff640 1 -- 172.21.15.47:0/3673304458 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80c0c61b0 msgr2=0x7fc80c0c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc80bfff640 1 --2- 172.21.15.47:0/3673304458 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80c0c61b0 0x7fc80c0c6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc80bfff640 1 -- 172.21.15.47:0/3673304458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7fc0039b0 msgr2=0x7fc80c1f2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc80bfff640 1 --2- 172.21.15.47:0/3673304458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7fc0039b0 0x7fc80c1f2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc80bfff640 1 -- 172.21.15.47:0/3673304458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80c0c53f0 con 0x7fc80c0c6fc0 2024-04-14T23:36:07.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc811621640 1 --2- 172.21.15.47:0/3673304458 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80c0c61b0 0x7fc80c0c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:36:07.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.304+0000 7fc80bfff640 1 --2- 172.21.15.47:0/3673304458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc80c0c6fc0 0x7fc80c0c7440 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800e840 tx=0x7fc7f800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:07.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.305+0000 7fc8097fa640 1 -- 172.21.15.47:0/3673304458 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f800c8d0 con 0x7fc80c0c6fc0 2024-04-14T23:36:07.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.305+0000 7fc8097fa640 1 -- 172.21.15.47:0/3673304458 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f8018070 con 0x7fc80c0c6fc0 2024-04-14T23:36:07.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.305+0000 7fc813084640 1 -- 172.21.15.47:0/3673304458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc80c0c56d0 con 0x7fc80c0c6fc0 2024-04-14T23:36:07.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.305+0000 7fc8097fa640 1 -- 172.21.15.47:0/3673304458 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f800ccd0 con 0x7fc80c0c6fc0 2024-04-14T23:36:07.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.305+0000 7fc813084640 1 -- 172.21.15.47:0/3673304458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc80c0c6ba0 con 0x7fc80c0c6fc0 2024-04-14T23:36:07.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.306+0000 7fc813084640 1 -- 172.21.15.47:0/3673304458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc80c075430 con 0x7fc80c0c6fc0 2024-04-14T23:36:07.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.306+0000 7fc8097fa640 1 -- 172.21.15.47:0/3673304458 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fc7f801d460 con 0x7fc80c0c6fc0 2024-04-14T23:36:07.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.306+0000 7fc8097fa640 1 --2- 172.21.15.47:0/3673304458 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc7f006b990 0x7fc7f006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.306+0000 7fc8097fa640 1 -- 172.21.15.47:0/3673304458 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fc7f808a850 con 0x7fc80c0c6fc0 2024-04-14T23:36:07.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.307+0000 7fc810e20640 1 --2- 172.21.15.47:0/3673304458 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc7f006b990 0x7fc7f006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.307+0000 7fc810e20640 1 --2- 172.21.15.47:0/3673304458 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc7f006b990 0x7fc7f006de50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc800036000 tx=0x7fc800030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:07.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.311+0000 7fc8097fa640 1 -- 172.21.15.47:0/3673304458 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc7f8059360 con 0x7fc80c0c6fc0 2024-04-14T23:36:07.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.492+0000 7fc813084640 1 -- 172.21.15.47:0/3673304458 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fc80c0b46d0 con 0x7fc7f006b990 2024-04-14T23:36:07.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.492+0000 7fc8097fa640 1 -- 172.21.15.47:0/3673304458 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc80c0b46d0 con 0x7fc7f006b990 2024-04-14T23:36:07.496 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 5 to deep-scrub 2024-04-14T23:36:07.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.494+0000 7fc813084640 1 -- 172.21.15.47:0/3673304458 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc7f006b990 msgr2=0x7fc7f006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.494+0000 7fc813084640 1 --2- 172.21.15.47:0/3673304458 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc7f006b990 0x7fc7f006de50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc800036000 tx=0x7fc800030000 comp rx=0 tx=0).stop 2024-04-14T23:36:07.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.494+0000 7fc813084640 1 -- 172.21.15.47:0/3673304458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc80c0c6fc0 msgr2=0x7fc80c0c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.494+0000 7fc813084640 1 --2- 172.21.15.47:0/3673304458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc80c0c6fc0 0x7fc80c0c7440 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800e840 tx=0x7fc7f800ed00 comp rx=0 tx=0).stop 2024-04-14T23:36:07.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.494+0000 7fc813084640 1 -- 172.21.15.47:0/3673304458 shutdown_connections 2024-04-14T23:36:07.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.494+0000 7fc813084640 1 --2- 172.21.15.47:0/3673304458 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fc7f006b990 0x7fc7f006de50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.494+0000 7fc813084640 1 --2- 172.21.15.47:0/3673304458 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc80c0c61b0 0x7fc80c0c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.494+0000 7fc813084640 1 --2- 172.21.15.47:0/3673304458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc80c0c6fc0 0x7fc80c0c7440 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.494+0000 7fc813084640 1 --2- 172.21.15.47:0/3673304458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7fc0039b0 0x7fc80c1f2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.494+0000 7fc813084640 1 -- 172.21.15.47:0/3673304458 >> 172.21.15.47:0/3673304458 conn(0x7fc80c06b200 msgr2=0x7fc80c15db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:07.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.494+0000 7fc813084640 1 -- 172.21.15.47:0/3673304458 shutdown_connections 2024-04-14T23:36:07.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.494+0000 7fc813084640 1 -- 172.21.15.47:0/3673304458 wait complete. 2024-04-14T23:36:07.508 INFO:tasks.ceph:Scrubbing osd.6 2024-04-14T23:36:07.508 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-14T23:36:07.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.610+0000 7f158d51e640 1 Processor -- start 2024-04-14T23:36:07.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.610+0000 7f158d51e640 1 -- start start 2024-04-14T23:36:07.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.611+0000 7f158d51e640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f15880b6c10 0x7f15880d0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.611+0000 7f158d51e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15880b4b60 con 0x7f15880b30d0 2024-04-14T23:36:07.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.611+0000 7f158d51e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15880b4e40 con 0x7f15880d0250 2024-04-14T23:36:07.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.611+0000 7f158d51e640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f15880d0bd0 con 0x7f15880b6c10 2024-04-14T23:36:07.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.611+0000 7f1586ffd640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f15880b30d0 0x7f15880cd290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35704/0 (socket says 172.21.15.47:35704) 2024-04-14T23:36:07.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.611+0000 7f1586ffd640 1 -- 172.21.15.47:0/3299938775 learned_addr learned my addr 172.21.15.47:0/3299938775 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:07.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f1585ffb640 1 -- 172.21.15.47:0/3299938775 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2869299087 0 0) 0x7f15880b4b60 con 0x7f15880b30d0 2024-04-14T23:36:07.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f15877fe640 1 --2- 172.21.15.47:0/3299938775 >> v2:172.21.15.191:3300/0 conn(0x7f15880b6c10 0x7f15880d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f1585ffb640 1 -- 172.21.15.47:0/3299938775 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1570003520 con 0x7f15880b30d0 2024-04-14T23:36:07.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f1585ffb640 1 -- 172.21.15.47:0/3299938775 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 909645973 0 0) 0x7f1570003520 con 0x7f15880b30d0 2024-04-14T23:36:07.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f1585ffb640 1 -- 172.21.15.47:0/3299938775 >> v2:172.21.15.191:3300/0 conn(0x7f15880b6c10 msgr2=0x7f15880d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:07.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f1585ffb640 1 --2- 172.21.15.47:0/3299938775 >> v2:172.21.15.191:3300/0 conn(0x7f15880b6c10 0x7f15880d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f1585ffb640 1 -- 172.21.15.47:0/3299938775 >> v1:172.21.15.191:6789/0 conn(0x7f15880d0250 legacy=0x7f158815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f1585ffb640 1 -- 172.21.15.47:0/3299938775 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15880b5120 con 0x7f15880b30d0 2024-04-14T23:36:07.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f1585ffb640 1 -- 172.21.15.47:0/3299938775 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f1580001670 con 0x7f15880b30d0 2024-04-14T23:36:07.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f1585ffb640 1 -- 172.21.15.47:0/3299938775 >> v1:172.21.15.47:6789/0 conn(0x7f15880b30d0 legacy=0x7f15880cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f1585ffb640 1 --2- 172.21.15.47:0/3299938775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15700039b0 0x7f1570003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f1585ffb640 1 --2- 172.21.15.47:0/3299938775 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1570004800 0x7f1570004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f1585ffb640 1 --2- 172.21.15.47:0/3299938775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15700051c0 0x7f157000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f1585ffb640 1 -- 172.21.15.47:0/3299938775 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f15880d0bd0 con 0x7f15700051c0 2024-04-14T23:36:07.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f1585ffb640 1 -- 172.21.15.47:0/3299938775 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f157000c070 con 0x7f15700039b0 2024-04-14T23:36:07.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f1585ffb640 1 -- 172.21.15.47:0/3299938775 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f157000c270 con 0x7f1570004800 2024-04-14T23:36:07.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f1586ffd640 1 --2- 172.21.15.47:0/3299938775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15700039b0 0x7f1570003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f15877fe640 1 --2- 172.21.15.47:0/3299938775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15700051c0 0x7f157000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f15867fc640 1 --2- 172.21.15.47:0/3299938775 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1570004800 0x7f1570004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f15877fe640 1 -- 172.21.15.47:0/3299938775 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1570004800 msgr2=0x7f1570004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:07.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f15877fe640 1 --2- 172.21.15.47:0/3299938775 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1570004800 0x7f1570004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f15877fe640 1 -- 172.21.15.47:0/3299938775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15700039b0 msgr2=0x7f1570003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:07.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f15877fe640 1 --2- 172.21.15.47:0/3299938775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15700039b0 0x7f1570003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f15877fe640 1 -- 172.21.15.47:0/3299938775 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1570003520 con 0x7f15700051c0 2024-04-14T23:36:07.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.612+0000 7f15867fc640 1 --2- 172.21.15.47:0/3299938775 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1570004800 0x7f1570004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:36:07.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.613+0000 7f15877fe640 1 -- 172.21.15.47:0/3299938775 reap_dead start 2024-04-14T23:36:07.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.613+0000 7f15877fe640 1 --2- 172.21.15.47:0/3299938775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15700051c0 0x7f157000b9c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1578009f90 tx=0x7f1570005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94699918f0199fa server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:07.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.613+0000 7f1585ffb640 1 -- 172.21.15.47:0/3299938775 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578039070 con 0x7f15700051c0 2024-04-14T23:36:07.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.613+0000 7f1585ffb640 1 -- 172.21.15.47:0/3299938775 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157802cc20 con 0x7f15700051c0 2024-04-14T23:36:07.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.613+0000 7f1585ffb640 1 -- 172.21.15.47:0/3299938775 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578009c10 con 0x7f15700051c0 2024-04-14T23:36:07.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.614+0000 7f158d51e640 1 -- 172.21.15.47:0/3299938775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15700051c0 msgr2=0x7f157000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.614+0000 7f158d51e640 1 --2- 172.21.15.47:0/3299938775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15700051c0 0x7f157000b9c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1578009f90 tx=0x7f1570005830 comp rx=0 tx=0).stop 2024-04-14T23:36:07.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.614+0000 7f158d51e640 1 -- 172.21.15.47:0/3299938775 shutdown_connections 2024-04-14T23:36:07.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.614+0000 7f158d51e640 1 --2- 172.21.15.47:0/3299938775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15700051c0 0x7f157000b9c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.614+0000 7f158d51e640 1 -- 172.21.15.47:0/3299938775 >> 172.21.15.47:0/3299938775 conn(0x7f15880d1c70 msgr2=0x7f15880d2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:07.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.614+0000 7f158d51e640 1 -- 172.21.15.47:0/3299938775 shutdown_connections 2024-04-14T23:36:07.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.614+0000 7f158d51e640 1 -- 172.21.15.47:0/3299938775 wait complete. 2024-04-14T23:36:07.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.615+0000 7f158d51e640 1 Processor -- start 2024-04-14T23:36:07.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.615+0000 7f158d51e640 1 -- start start 2024-04-14T23:36:07.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f158d51e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f15700051c0 0x7f158815dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f158d51e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f158809e770 0x7f15880af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f158d51e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15880b1550 0x7f15880b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f158d51e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f15880cfd10 con 0x7f158809e770 2024-04-14T23:36:07.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f158d51e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f15880b56e0 con 0x7f15880b1550 2024-04-14T23:36:07.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f158d51e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f15880b34b0 con 0x7f15700051c0 2024-04-14T23:36:07.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f15867fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f158809e770 0x7f15880af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f15867fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f158809e770 0x7f15880af620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44474/0 (socket says 172.21.15.47:44474) 2024-04-14T23:36:07.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f15867fc640 1 -- 172.21.15.47:0/87922904 learned_addr learned my addr 172.21.15.47:0/87922904 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:07.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f15877fe640 1 --2- 172.21.15.47:0/87922904 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15880b1550 0x7f15880b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f1586ffd640 1 --2- 172.21.15.47:0/87922904 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f15700051c0 0x7f158815dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f15867fc640 1 -- 172.21.15.47:0/87922904 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f15700051c0 msgr2=0x7f158815dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f15867fc640 1 --2- 172.21.15.47:0/87922904 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f15700051c0 0x7f158815dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f15867fc640 1 -- 172.21.15.47:0/87922904 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15880b1550 msgr2=0x7f15880b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f15867fc640 1 --2- 172.21.15.47:0/87922904 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15880b1550 0x7f15880b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f15867fc640 1 -- 172.21.15.47:0/87922904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15881f2080 con 0x7f158809e770 2024-04-14T23:36:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.616+0000 7f15867fc640 1 --2- 172.21.15.47:0/87922904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f158809e770 0x7f15880af620 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f157c000c00 tx=0x7f157c00e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.617+0000 7f156f7fe640 1 -- 172.21.15.47:0/87922904 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c019070 con 0x7f158809e770 2024-04-14T23:36:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.617+0000 7f156f7fe640 1 -- 172.21.15.47:0/87922904 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157c0052e0 con 0x7f158809e770 2024-04-14T23:36:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.617+0000 7f158d51e640 1 -- 172.21.15.47:0/87922904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15880aff00 con 0x7f158809e770 2024-04-14T23:36:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.617+0000 7f156f7fe640 1 -- 172.21.15.47:0/87922904 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c003830 con 0x7f158809e770 2024-04-14T23:36:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.617+0000 7f158d51e640 1 -- 172.21.15.47:0/87922904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15880b04c0 con 0x7f158809e770 2024-04-14T23:36:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.617+0000 7f158d51e640 1 -- 172.21.15.47:0/87922904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1588068900 con 0x7f158809e770 2024-04-14T23:36:07.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.618+0000 7f156f7fe640 1 -- 172.21.15.47:0/87922904 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f157c01c070 con 0x7f158809e770 2024-04-14T23:36:07.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.618+0000 7f156f7fe640 1 --2- 172.21.15.47:0/87922904 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f157406b990 0x7f157406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.619+0000 7f156f7fe640 1 -- 172.21.15.47:0/87922904 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f157c089eb0 con 0x7f158809e770 2024-04-14T23:36:07.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.619+0000 7f156f7fe640 1 --2- 172.21.15.47:0/87922904 >> [v2:172.21.15.191:6800/2802066933,v1:172.21.15.191:6803/2802066933] conn(0x7f1574074200 0x7f1574076640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.619+0000 7f156f7fe640 1 -- 172.21.15.47:0/87922904 --> [v2:172.21.15.191:6800/2802066933,v1:172.21.15.191:6803/2802066933] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f157c017e50 con 0x7f1574074200 2024-04-14T23:36:07.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.619+0000 7f156f7fe640 1 -- 172.21.15.47:0/87922904 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f157c08c5b0 con 0x7f158809e770 2024-04-14T23:36:07.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.619+0000 7f1586ffd640 1 --2- 172.21.15.47:0/87922904 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f157406b990 0x7f157406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.619+0000 7f15877fe640 1 --2- 172.21.15.47:0/87922904 >> [v2:172.21.15.191:6800/2802066933,v1:172.21.15.191:6803/2802066933] conn(0x7f1574074200 0x7f1574076640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.619+0000 7f1586ffd640 1 --2- 172.21.15.47:0/87922904 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f157406b990 0x7f157406de50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1580001eb0 tx=0x7f1580009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:07.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.619+0000 7f15877fe640 1 --2- 172.21.15.47:0/87922904 >> [v2:172.21.15.191:6800/2802066933,v1:172.21.15.191:6803/2802066933] conn(0x7f1574074200 0x7f1574076640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:07.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.620+0000 7f156f7fe640 1 -- 172.21.15.47:0/87922904 <== osd.6 v2:172.21.15.191:6800/2802066933 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f157c017e50 con 0x7f1574074200 2024-04-14T23:36:07.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.633+0000 7f158d51e640 1 -- 172.21.15.47:0/87922904 --> [v2:172.21.15.191:6800/2802066933,v1:172.21.15.191:6803/2802066933] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1588068b40 con 0x7f1574074200 2024-04-14T23:36:07.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.634+0000 7f156f7fe640 1 -- 172.21.15.47:0/87922904 <== osd.6 v2:172.21.15.191:6800/2802066933 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1588068b40 con 0x7f1574074200 2024-04-14T23:36:07.637 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-14T23:36:07.637 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T23:36:07.637 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-14T23:36:07.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.634+0000 7f158d51e640 1 -- 172.21.15.47:0/87922904 >> [v2:172.21.15.191:6800/2802066933,v1:172.21.15.191:6803/2802066933] conn(0x7f1574074200 msgr2=0x7f1574076640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.634+0000 7f158d51e640 1 --2- 172.21.15.47:0/87922904 >> [v2:172.21.15.191:6800/2802066933,v1:172.21.15.191:6803/2802066933] conn(0x7f1574074200 0x7f1574076640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.634+0000 7f158d51e640 1 -- 172.21.15.47:0/87922904 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f157406b990 msgr2=0x7f157406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.634+0000 7f158d51e640 1 --2- 172.21.15.47:0/87922904 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f157406b990 0x7f157406de50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1580001eb0 tx=0x7f1580009040 comp rx=0 tx=0).stop 2024-04-14T23:36:07.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.634+0000 7f158d51e640 1 -- 172.21.15.47:0/87922904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f158809e770 msgr2=0x7f15880af620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.634+0000 7f158d51e640 1 --2- 172.21.15.47:0/87922904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f158809e770 0x7f15880af620 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f157c000c00 tx=0x7f157c00e8f0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.634+0000 7f15877fe640 1 -- 172.21.15.47:0/87922904 reap_dead start 2024-04-14T23:36:07.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.634+0000 7f158d51e640 1 -- 172.21.15.47:0/87922904 shutdown_connections 2024-04-14T23:36:07.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.634+0000 7f158d51e640 1 -- 172.21.15.47:0/87922904 >> 172.21.15.47:0/87922904 conn(0x7f15880d1c70 msgr2=0x7f15880b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:07.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.634+0000 7f158d51e640 1 -- 172.21.15.47:0/87922904 shutdown_connections 2024-04-14T23:36:07.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.634+0000 7f158d51e640 1 -- 172.21.15.47:0/87922904 wait complete. 2024-04-14T23:36:07.647 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-14T23:36:07.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.746+0000 7ff6ef95e640 1 Processor -- start 2024-04-14T23:36:07.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.746+0000 7ff6ef95e640 1 -- start start 2024-04-14T23:36:07.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.747+0000 7ff6ef95e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff6e815e2b0 0x7ff6e80d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.747+0000 7ff6ef95e640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff6e80cf4c0 0x7ff6e80c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.747+0000 7ff6ef95e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e815e690 con 0x7ff6e80d2be0 2024-04-14T23:36:07.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.747+0000 7ff6ef95e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e80cfb20 con 0x7ff6e815e2b0 2024-04-14T23:36:07.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.747+0000 7ff6ef95e640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e80cfe00 con 0x7ff6e80cf4c0 2024-04-14T23:36:07.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.747+0000 7ff6ed6fa640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff6e815e2b0 0x7ff6e80d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.747+0000 7ff6ed6fa640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff6e815e2b0 0x7ff6e80d26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44482/0 (socket says 172.21.15.47:44482) 2024-04-14T23:36:07.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.747+0000 7ff6ecef9640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff6e80d2be0 0x7ff6e80cedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35706/0 (socket says 172.21.15.47:35706) 2024-04-14T23:36:07.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.747+0000 7ff6ed6fa640 1 -- 172.21.15.47:0/140986199 learned_addr learned my addr 172.21.15.47:0/140986199 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:07.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.748+0000 7ff6edefb640 1 --2- 172.21.15.47:0/140986199 >> v2:172.21.15.191:3300/0 conn(0x7ff6e80cf4c0 0x7ff6e80c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.748+0000 7ff6ed6fa640 1 -- 172.21.15.47:0/140986199 >> v2:172.21.15.191:3300/0 conn(0x7ff6e80cf4c0 msgr2=0x7ff6e80c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:07.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.748+0000 7ff6ed6fa640 1 --2- 172.21.15.47:0/140986199 >> v2:172.21.15.191:3300/0 conn(0x7ff6e80cf4c0 0x7ff6e80c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.748+0000 7ff6ed6fa640 1 -- 172.21.15.47:0/140986199 >> v1:172.21.15.47:6789/0 conn(0x7ff6e80d2be0 legacy=0x7ff6e80cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.748+0000 7ff6ed6fa640 1 -- 172.21.15.47:0/140986199 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e80d00e0 con 0x7ff6e815e2b0 2024-04-14T23:36:07.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.748+0000 7ff6ed6fa640 1 --2- 172.21.15.47:0/140986199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e815e2b0 0x7ff6e80d26a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80d1b70 tx=0x7ff6e002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7e5fc6718d1271 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:07.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.748+0000 7ff6e7fff640 1 -- 172.21.15.47:0/140986199 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0034070 con 0x7ff6e815e2b0 2024-04-14T23:36:07.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.749+0000 7ff6e7fff640 1 -- 172.21.15.47:0/140986199 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e0030860 con 0x7ff6e815e2b0 2024-04-14T23:36:07.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.749+0000 7ff6e7fff640 1 -- 172.21.15.47:0/140986199 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0030c30 con 0x7ff6e815e2b0 2024-04-14T23:36:07.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.749+0000 7ff6ef95e640 1 -- 172.21.15.47:0/140986199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e815e2b0 msgr2=0x7ff6e80d26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.749+0000 7ff6ef95e640 1 --2- 172.21.15.47:0/140986199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e815e2b0 0x7ff6e80d26a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80d1b70 tx=0x7ff6e002b9a0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.749+0000 7ff6ef95e640 1 -- 172.21.15.47:0/140986199 shutdown_connections 2024-04-14T23:36:07.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.749+0000 7ff6ef95e640 1 --2- 172.21.15.47:0/140986199 >> v2:172.21.15.191:3300/0 conn(0x7ff6e80cf4c0 0x7ff6e80c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.749+0000 7ff6ef95e640 1 --2- 172.21.15.47:0/140986199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e815e2b0 0x7ff6e80d26a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.749+0000 7ff6ef95e640 1 -- 172.21.15.47:0/140986199 >> 172.21.15.47:0/140986199 conn(0x7ff6e8067940 msgr2=0x7ff6e809d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:07.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.749+0000 7ff6ef95e640 1 -- 172.21.15.47:0/140986199 shutdown_connections 2024-04-14T23:36:07.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.749+0000 7ff6ef95e640 1 -- 172.21.15.47:0/140986199 wait complete. 2024-04-14T23:36:07.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.750+0000 7ff6ef95e640 1 Processor -- start 2024-04-14T23:36:07.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.750+0000 7ff6ef95e640 1 -- start start 2024-04-14T23:36:07.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6ef95e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e80cf4c0 0x7ff6e81f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6ef95e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e80d2be0 0x7ff6e806c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6ef95e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6e815e2b0 0x7ff6e806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6ef95e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e80c84a0 con 0x7ff6e80cf4c0 2024-04-14T23:36:07.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6ef95e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e80d06a0 con 0x7ff6e80d2be0 2024-04-14T23:36:07.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6ef95e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e80c8620 con 0x7ff6e815e2b0 2024-04-14T23:36:07.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6ed6fa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e80cf4c0 0x7ff6e81f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6ed6fa640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e80cf4c0 0x7ff6e81f3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44492/0 (socket says 172.21.15.47:44492) 2024-04-14T23:36:07.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6ed6fa640 1 -- 172.21.15.47:0/3626966447 learned_addr learned my addr 172.21.15.47:0/3626966447 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:07.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6edefb640 1 --2- 172.21.15.47:0/3626966447 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6e815e2b0 0x7ff6e806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6ecef9640 1 --2- 172.21.15.47:0/3626966447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e80d2be0 0x7ff6e806c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6ed6fa640 1 -- 172.21.15.47:0/3626966447 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6e815e2b0 msgr2=0x7ff6e806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6ed6fa640 1 --2- 172.21.15.47:0/3626966447 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6e815e2b0 0x7ff6e806cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6ed6fa640 1 -- 172.21.15.47:0/3626966447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e80d2be0 msgr2=0x7ff6e806c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6ed6fa640 1 --2- 172.21.15.47:0/3626966447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e80d2be0 0x7ff6e806c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6ed6fa640 1 -- 172.21.15.47:0/3626966447 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e815f720 con 0x7ff6e80cf4c0 2024-04-14T23:36:07.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6edefb640 1 --2- 172.21.15.47:0/3626966447 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6e815e2b0 0x7ff6e806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:36:07.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.751+0000 7ff6ecef9640 1 --2- 172.21.15.47:0/3626966447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e80d2be0 0x7ff6e806c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:36:07.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.752+0000 7ff6ed6fa640 1 --2- 172.21.15.47:0/3626966447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e80cf4c0 0x7ff6e81f3320 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0000c00 tx=0x7ff6e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:07.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.752+0000 7ff6e5ffb640 1 -- 172.21.15.47:0/3626966447 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0034040 con 0x7ff6e80cf4c0 2024-04-14T23:36:07.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.752+0000 7ff6e5ffb640 1 -- 172.21.15.47:0/3626966447 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e0039d90 con 0x7ff6e80cf4c0 2024-04-14T23:36:07.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.752+0000 7ff6ef95e640 1 -- 172.21.15.47:0/3626966447 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e81f3b40 con 0x7ff6e80cf4c0 2024-04-14T23:36:07.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.752+0000 7ff6e5ffb640 1 -- 172.21.15.47:0/3626966447 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0043610 con 0x7ff6e80cf4c0 2024-04-14T23:36:07.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.752+0000 7ff6ef95e640 1 -- 172.21.15.47:0/3626966447 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e81f4100 con 0x7ff6e80cf4c0 2024-04-14T23:36:07.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.753+0000 7ff6ef95e640 1 -- 172.21.15.47:0/3626966447 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e8075430 con 0x7ff6e80cf4c0 2024-04-14T23:36:07.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.753+0000 7ff6e5ffb640 1 -- 172.21.15.47:0/3626966447 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7ff6e0037070 con 0x7ff6e80cf4c0 2024-04-14T23:36:07.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.754+0000 7ff6e5ffb640 1 --2- 172.21.15.47:0/3626966447 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6d406b990 0x7ff6d406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:07.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.754+0000 7ff6e5ffb640 1 -- 172.21.15.47:0/3626966447 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff6e00acb20 con 0x7ff6e80cf4c0 2024-04-14T23:36:07.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.754+0000 7ff6ecef9640 1 --2- 172.21.15.47:0/3626966447 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6d406b990 0x7ff6d406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:07.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.755+0000 7ff6ecef9640 1 --2- 172.21.15.47:0/3626966447 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6d406b990 0x7ff6d406de50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80caa00 tx=0x7ff6dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:07.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.758+0000 7ff6e5ffb640 1 -- 172.21.15.47:0/3626966447 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff6e003e070 con 0x7ff6e80cf4c0 2024-04-14T23:36:07.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.939+0000 7ff6ef95e640 1 -- 172.21.15.47:0/3626966447 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7ff6e81f3860 con 0x7ff6d406b990 2024-04-14T23:36:07.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.941+0000 7ff6e5ffb640 1 -- 172.21.15.47:0/3626966447 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff6e81f3860 con 0x7ff6d406b990 2024-04-14T23:36:07.943 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 6 to deep-scrub 2024-04-14T23:36:07.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.941+0000 7ff6ef95e640 1 -- 172.21.15.47:0/3626966447 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6d406b990 msgr2=0x7ff6d406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.941+0000 7ff6ef95e640 1 --2- 172.21.15.47:0/3626966447 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6d406b990 0x7ff6d406de50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80caa00 tx=0x7ff6dc009040 comp rx=0 tx=0).stop 2024-04-14T23:36:07.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.942+0000 7ff6ef95e640 1 -- 172.21.15.47:0/3626966447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e80cf4c0 msgr2=0x7ff6e81f3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:07.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.942+0000 7ff6ef95e640 1 --2- 172.21.15.47:0/3626966447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e80cf4c0 0x7ff6e81f3320 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0000c00 tx=0x7ff6e00046c0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.942+0000 7ff6ef95e640 1 -- 172.21.15.47:0/3626966447 shutdown_connections 2024-04-14T23:36:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.942+0000 7ff6ef95e640 1 --2- 172.21.15.47:0/3626966447 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7ff6d406b990 0x7ff6d406de50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.942+0000 7ff6ef95e640 1 --2- 172.21.15.47:0/3626966447 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6e815e2b0 0x7ff6e806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.942+0000 7ff6ef95e640 1 --2- 172.21.15.47:0/3626966447 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e80d2be0 0x7ff6e806c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.942+0000 7ff6ef95e640 1 --2- 172.21.15.47:0/3626966447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6e80cf4c0 0x7ff6e81f3320 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.942+0000 7ff6ef95e640 1 -- 172.21.15.47:0/3626966447 >> 172.21.15.47:0/3626966447 conn(0x7ff6e8067940 msgr2=0x7ff6e80ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.942+0000 7ff6ef95e640 1 -- 172.21.15.47:0/3626966447 shutdown_connections 2024-04-14T23:36:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:07.942+0000 7ff6ef95e640 1 -- 172.21.15.47:0/3626966447 wait complete. 2024-04-14T23:36:07.956 INFO:tasks.ceph:Scrubbing osd.7 2024-04-14T23:36:07.956 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-14T23:36:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.058+0000 7f6da5b7b640 1 Processor -- start 2024-04-14T23:36:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.058+0000 7f6da5b7b640 1 -- start start 2024-04-14T23:36:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.059+0000 7f6da5b7b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6da00ccc50 0x7f6da00b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.059+0000 7f6da5b7b640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6da015f6d0 con 0x7f6da015ac40 2024-04-14T23:36:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.059+0000 7f6da5b7b640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6da00cecb0 con 0x7f6da00cf690 2024-04-14T23:36:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.059+0000 7f6da5b7b640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6da015e850 con 0x7f6da00ccc50 2024-04-14T23:36:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.059+0000 7f6d9ffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6da00ccc50 0x7f6da00b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.059+0000 7f6d9f7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6da015ac40 0x7f6da015efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35716/0 (socket says 172.21.15.47:35716) 2024-04-14T23:36:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.059+0000 7f6d9ffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6da00ccc50 0x7f6da00b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44506/0 (socket says 172.21.15.47:44506) 2024-04-14T23:36:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.059+0000 7f6d9f7fe640 1 -- 172.21.15.47:0/2886817862 learned_addr learned my addr 172.21.15.47:0/2886817862 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.060+0000 7f6d9ffff640 1 -- 172.21.15.47:0/2886817862 >> v1:172.21.15.191:6789/0 conn(0x7f6da00cf690 legacy=0x7f6da00cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.060+0000 7f6d9ffff640 1 -- 172.21.15.47:0/2886817862 >> v1:172.21.15.47:6789/0 conn(0x7f6da015ac40 legacy=0x7f6da015efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.060+0000 7f6d9ffff640 1 -- 172.21.15.47:0/2886817862 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da00cef90 con 0x7f6da00ccc50 2024-04-14T23:36:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.060+0000 7f6d9e7fc640 1 -- 172.21.15.47:0/2886817862 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2944657462 0 0) 0x7f6da015f6d0 con 0x7f6da015ac40 2024-04-14T23:36:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.060+0000 7f6d9ffff640 1 --2- 172.21.15.47:0/2886817862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da00ccc50 0x7f6da00b4980 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6da015e9d0 tx=0x7f6d9802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9db34ac2569b4e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.060+0000 7f6d9e7fc640 1 -- 172.21.15.47:0/2886817862 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98039070 con 0x7f6da00ccc50 2024-04-14T23:36:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.060+0000 7f6d9e7fc640 1 -- 172.21.15.47:0/2886817862 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9802cbc0 con 0x7f6da00ccc50 2024-04-14T23:36:08.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.060+0000 7f6d9e7fc640 1 -- 172.21.15.47:0/2886817862 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98034440 con 0x7f6da00ccc50 2024-04-14T23:36:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.061+0000 7f6da5b7b640 1 -- 172.21.15.47:0/2886817862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da00ccc50 msgr2=0x7f6da00b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.061+0000 7f6da5b7b640 1 --2- 172.21.15.47:0/2886817862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da00ccc50 0x7f6da00b4980 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6da015e9d0 tx=0x7f6d9802be10 comp rx=0 tx=0).stop 2024-04-14T23:36:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.061+0000 7f6da5b7b640 1 -- 172.21.15.47:0/2886817862 shutdown_connections 2024-04-14T23:36:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.061+0000 7f6da5b7b640 1 --2- 172.21.15.47:0/2886817862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da00ccc50 0x7f6da00b4980 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.061+0000 7f6da5b7b640 1 -- 172.21.15.47:0/2886817862 >> 172.21.15.47:0/2886817862 conn(0x7f6da006b200 msgr2=0x7f6da006b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.061+0000 7f6da5b7b640 1 -- 172.21.15.47:0/2886817862 shutdown_connections 2024-04-14T23:36:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.061+0000 7f6da5b7b640 1 -- 172.21.15.47:0/2886817862 wait complete. 2024-04-14T23:36:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.062+0000 7f6da5b7b640 1 Processor -- start 2024-04-14T23:36:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.062+0000 7f6da5b7b640 1 -- start start 2024-04-14T23:36:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.063+0000 7f6da5b7b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da00ccc50 0x7f6da01443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.063+0000 7f6da5b7b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6da00cf690 0x7f6da0156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.063+0000 7f6da5b7b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6da015ac40 0x7f6da00ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.063+0000 7f6da5b7b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6da00ce940 con 0x7f6da00ccc50 2024-04-14T23:36:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.063+0000 7f6da5b7b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6da015eaa0 con 0x7f6da00cf690 2024-04-14T23:36:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.063+0000 7f6da5b7b640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6da015b020 con 0x7f6da015ac40 2024-04-14T23:36:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.063+0000 7f6d9f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da00ccc50 0x7f6da01443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.063+0000 7f6d9f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da00ccc50 0x7f6da01443f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44522/0 (socket says 172.21.15.47:44522) 2024-04-14T23:36:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.063+0000 7f6d9f7fe640 1 -- 172.21.15.47:0/2531526199 learned_addr learned my addr 172.21.15.47:0/2531526199 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:08.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.064+0000 7f6d9ffff640 1 --2- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6da015ac40 0x7f6da00ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.064+0000 7f6d9effd640 1 --2- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6da00cf690 0x7f6da0156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.064+0000 7f6d9f7fe640 1 -- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6da015ac40 msgr2=0x7f6da00ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.064+0000 7f6d9f7fe640 1 --2- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6da015ac40 0x7f6da00ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.064+0000 7f6d9f7fe640 1 -- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6da00cf690 msgr2=0x7f6da0156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.064+0000 7f6d9f7fe640 1 --2- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6da00cf690 0x7f6da0156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.064+0000 7f6d9f7fe640 1 -- 172.21.15.47:0/2531526199 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da0143800 con 0x7f6da00ccc50 2024-04-14T23:36:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.064+0000 7f6d9ffff640 1 --2- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6da015ac40 0x7f6da00ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:36:08.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.064+0000 7f6d9effd640 1 --2- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6da00cf690 0x7f6da0156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T23:36:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.064+0000 7f6d9f7fe640 1 --2- 172.21.15.47:0/2531526199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da00ccc50 0x7f6da01443f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6d9000c430 tx=0x7f6d9000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.064+0000 7f6d87fff640 1 -- 172.21.15.47:0/2531526199 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d900074e0 con 0x7f6da00ccc50 2024-04-14T23:36:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.064+0000 7f6d87fff640 1 -- 172.21.15.47:0/2531526199 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d900047e0 con 0x7f6da00ccc50 2024-04-14T23:36:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.064+0000 7f6da5b7b640 1 -- 172.21.15.47:0/2531526199 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da0156a50 con 0x7f6da00ccc50 2024-04-14T23:36:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.064+0000 7f6d87fff640 1 -- 172.21.15.47:0/2531526199 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d90004bd0 con 0x7f6da00ccc50 2024-04-14T23:36:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.064+0000 7f6da5b7b640 1 -- 172.21.15.47:0/2531526199 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da0157010 con 0x7f6da00ccc50 2024-04-14T23:36:08.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.065+0000 7f6da5b7b640 1 -- 172.21.15.47:0/2531526199 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6da00754a0 con 0x7f6da00ccc50 2024-04-14T23:36:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.066+0000 7f6d87fff640 1 -- 172.21.15.47:0/2531526199 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f6d90011070 con 0x7f6da00ccc50 2024-04-14T23:36:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.066+0000 7f6d87fff640 1 --2- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6d8c06b990 0x7f6d8c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.066+0000 7f6d87fff640 1 -- 172.21.15.47:0/2531526199 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6d9008a700 con 0x7f6da00ccc50 2024-04-14T23:36:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.066+0000 7f6d87fff640 1 --2- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:6820/4231525383,v1:172.21.15.191:6823/4231525383] conn(0x7f6d8c074200 0x7f6d8c076640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.066+0000 7f6d87fff640 1 -- 172.21.15.47:0/2531526199 --> [v2:172.21.15.191:6820/4231525383,v1:172.21.15.191:6823/4231525383] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d9001ce80 con 0x7f6d8c074200 2024-04-14T23:36:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.066+0000 7f6d87fff640 1 -- 172.21.15.47:0/2531526199 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f6d90091050 con 0x7f6da00ccc50 2024-04-14T23:36:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.066+0000 7f6d9effd640 1 --2- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6d8c06b990 0x7f6d8c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.066+0000 7f6d9ffff640 1 --2- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:6820/4231525383,v1:172.21.15.191:6823/4231525383] conn(0x7f6d8c074200 0x7f6d8c076640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.067+0000 7f6d9effd640 1 --2- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6d8c06b990 0x7f6d8c06de50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6da0144930 tx=0x7f6d94009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:08.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.067+0000 7f6d9ffff640 1 --2- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:6820/4231525383,v1:172.21.15.191:6823/4231525383] conn(0x7f6d8c074200 0x7f6d8c076640 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:08.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.068+0000 7f6d87fff640 1 -- 172.21.15.47:0/2531526199 <== osd.7 v2:172.21.15.191:6820/4231525383 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6d9001ce80 con 0x7f6d8c074200 2024-04-14T23:36:08.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.081+0000 7f6da5b7b640 1 -- 172.21.15.47:0/2531526199 --> [v2:172.21.15.191:6820/4231525383,v1:172.21.15.191:6823/4231525383] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6da00ce1f0 con 0x7f6d8c074200 2024-04-14T23:36:08.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.081+0000 7f6d87fff640 1 -- 172.21.15.47:0/2531526199 <== osd.7 v2:172.21.15.191:6820/4231525383 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6da00ce1f0 con 0x7f6d8c074200 2024-04-14T23:36:08.085 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-14T23:36:08.085 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T23:36:08.085 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-14T23:36:08.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.082+0000 7f6da5b7b640 1 -- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:6820/4231525383,v1:172.21.15.191:6823/4231525383] conn(0x7f6d8c074200 msgr2=0x7f6d8c076640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.082+0000 7f6da5b7b640 1 --2- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:6820/4231525383,v1:172.21.15.191:6823/4231525383] conn(0x7f6d8c074200 0x7f6d8c076640 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.082+0000 7f6da5b7b640 1 -- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6d8c06b990 msgr2=0x7f6d8c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.082+0000 7f6da5b7b640 1 --2- 172.21.15.47:0/2531526199 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f6d8c06b990 0x7f6d8c06de50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6da0144930 tx=0x7f6d94009040 comp rx=0 tx=0).stop 2024-04-14T23:36:08.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.082+0000 7f6da5b7b640 1 -- 172.21.15.47:0/2531526199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da00ccc50 msgr2=0x7f6da01443f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.082+0000 7f6da5b7b640 1 --2- 172.21.15.47:0/2531526199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da00ccc50 0x7f6da01443f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6d9000c430 tx=0x7f6d9000c8f0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.082+0000 7f6d9ffff640 1 -- 172.21.15.47:0/2531526199 reap_dead start 2024-04-14T23:36:08.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.082+0000 7f6da5b7b640 1 -- 172.21.15.47:0/2531526199 shutdown_connections 2024-04-14T23:36:08.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.082+0000 7f6da5b7b640 1 -- 172.21.15.47:0/2531526199 >> 172.21.15.47:0/2531526199 conn(0x7f6da006b200 msgr2=0x7f6da00cc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:08.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.082+0000 7f6da5b7b640 1 -- 172.21.15.47:0/2531526199 shutdown_connections 2024-04-14T23:36:08.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.082+0000 7f6da5b7b640 1 -- 172.21.15.47:0/2531526199 wait complete. 2024-04-14T23:36:08.095 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-14T23:36:08.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.194+0000 7f2691599640 1 Processor -- start 2024-04-14T23:36:08.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.194+0000 7f2691599640 1 -- start start 2024-04-14T23:36:08.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.195+0000 7f2691599640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f268c0d0140 0x7f268c15b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.195+0000 7f2691599640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f268c15baf0 0x7f268c071a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.195+0000 7f2691599640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268c15c370 con 0x7f268c06e340 2024-04-14T23:36:08.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.195+0000 7f2691599640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f268c15ead0 con 0x7f268c15baf0 2024-04-14T23:36:08.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.195+0000 7f2691599640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f268c15edb0 con 0x7f268c0d0140 2024-04-14T23:36:08.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.195+0000 7f268b7fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f268c15baf0 0x7f268c071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.195+0000 7f268b7fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f268c15baf0 0x7f268c071a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44538/0 (socket says 172.21.15.47:44538) 2024-04-14T23:36:08.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.195+0000 7f268b7fe640 1 -- 172.21.15.47:0/2212215408 learned_addr learned my addr 172.21.15.47:0/2212215408 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:08.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.195+0000 7f268a7fc640 1 --2- 172.21.15.47:0/2212215408 >> v2:172.21.15.191:3300/0 conn(0x7f268c0d0140 0x7f268c15b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.195+0000 7f268b7fe640 1 -- 172.21.15.47:0/2212215408 >> v2:172.21.15.191:3300/0 conn(0x7f268c0d0140 msgr2=0x7f268c15b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:08.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.195+0000 7f268b7fe640 1 --2- 172.21.15.47:0/2212215408 >> v2:172.21.15.191:3300/0 conn(0x7f268c0d0140 0x7f268c15b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.195+0000 7f268b7fe640 1 -- 172.21.15.47:0/2212215408 >> v1:172.21.15.191:6789/0 conn(0x7f268c06e340 legacy=0x7f268c0cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.195+0000 7f268b7fe640 1 -- 172.21.15.47:0/2212215408 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268c15f090 con 0x7f268c15baf0 2024-04-14T23:36:08.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.196+0000 7f268b7fe640 1 --2- 172.21.15.47:0/2212215408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f268c15baf0 0x7f268c071a40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f268c0b4d40 tx=0x7f267c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a5ca53f677e067 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:08.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.196+0000 7f2689ffb640 1 -- 172.21.15.47:0/2212215408 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c02ca80 con 0x7f268c15baf0 2024-04-14T23:36:08.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.196+0000 7f2689ffb640 1 -- 172.21.15.47:0/2212215408 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f267c02cc20 con 0x7f268c15baf0 2024-04-14T23:36:08.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.196+0000 7f2689ffb640 1 -- 172.21.15.47:0/2212215408 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c0343f0 con 0x7f268c15baf0 2024-04-14T23:36:08.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.196+0000 7f2691599640 1 -- 172.21.15.47:0/2212215408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f268c15baf0 msgr2=0x7f268c071a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.196+0000 7f2691599640 1 --2- 172.21.15.47:0/2212215408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f268c15baf0 0x7f268c071a40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f268c0b4d40 tx=0x7f267c02bee0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.197+0000 7f2691599640 1 -- 172.21.15.47:0/2212215408 shutdown_connections 2024-04-14T23:36:08.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.197+0000 7f2691599640 1 --2- 172.21.15.47:0/2212215408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f268c15baf0 0x7f268c071a40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.197+0000 7f2691599640 1 --2- 172.21.15.47:0/2212215408 >> v2:172.21.15.191:3300/0 conn(0x7f268c0d0140 0x7f268c15b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.197+0000 7f2691599640 1 -- 172.21.15.47:0/2212215408 >> 172.21.15.47:0/2212215408 conn(0x7f268c06b200 msgr2=0x7f268c06b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:08.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.197+0000 7f2691599640 1 -- 172.21.15.47:0/2212215408 shutdown_connections 2024-04-14T23:36:08.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.197+0000 7f2691599640 1 -- 172.21.15.47:0/2212215408 wait complete. 2024-04-14T23:36:08.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.198+0000 7f2691599640 1 Processor -- start 2024-04-14T23:36:08.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.198+0000 7f2691599640 1 -- start start 2024-04-14T23:36:08.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f2691599640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f268c06e340 0x7f268c159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f2691599640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f268c0d0140 0x7f268c1f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f2691599640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f268c15baf0 0x7f268c1f4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f2691599640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f268c15bf40 con 0x7f268c0d0140 2024-04-14T23:36:08.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f2691599640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f268c15f890 con 0x7f268c15baf0 2024-04-14T23:36:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f2691599640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f268c15c0c0 con 0x7f268c06e340 2024-04-14T23:36:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f268a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f268c0d0140 0x7f268c1f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f268a7fc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f268c0d0140 0x7f268c1f3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44554/0 (socket says 172.21.15.47:44554) 2024-04-14T23:36:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f268a7fc640 1 -- 172.21.15.47:0/3420995043 learned_addr learned my addr 172.21.15.47:0/3420995043 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f268affd640 1 --2- 172.21.15.47:0/3420995043 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f268c06e340 0x7f268c159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f268b7fe640 1 --2- 172.21.15.47:0/3420995043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f268c15baf0 0x7f268c1f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f268a7fc640 1 -- 172.21.15.47:0/3420995043 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f268c06e340 msgr2=0x7f268c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f268a7fc640 1 --2- 172.21.15.47:0/3420995043 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f268c06e340 0x7f268c159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f268a7fc640 1 -- 172.21.15.47:0/3420995043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f268c15baf0 msgr2=0x7f268c1f4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f268a7fc640 1 --2- 172.21.15.47:0/3420995043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f268c15baf0 0x7f268c1f4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f268a7fc640 1 -- 172.21.15.47:0/3420995043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268c0cdd80 con 0x7f268c0d0140 2024-04-14T23:36:08.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f268a7fc640 1 --2- 172.21.15.47:0/3420995043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f268c0d0140 0x7f268c1f3dd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f267400d830 tx=0x7f267400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:08.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f26837fe640 1 -- 172.21.15.47:0/3420995043 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267400b6c0 con 0x7f268c0d0140 2024-04-14T23:36:08.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f26837fe640 1 -- 172.21.15.47:0/3420995043 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2674019070 con 0x7f268c0d0140 2024-04-14T23:36:08.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f2691599640 1 -- 172.21.15.47:0/3420995043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f268c1f49b0 con 0x7f268c0d0140 2024-04-14T23:36:08.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f26837fe640 1 -- 172.21.15.47:0/3420995043 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267400ba80 con 0x7f268c0d0140 2024-04-14T23:36:08.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.199+0000 7f2691599640 1 -- 172.21.15.47:0/3420995043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f268c0c90d0 con 0x7f268c0d0140 2024-04-14T23:36:08.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.200+0000 7f2691599640 1 -- 172.21.15.47:0/3420995043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f268c075430 con 0x7f268c0d0140 2024-04-14T23:36:08.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.201+0000 7f26837fe640 1 -- 172.21.15.47:0/3420995043 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f267401e460 con 0x7f268c0d0140 2024-04-14T23:36:08.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.201+0000 7f26837fe640 1 --2- 172.21.15.47:0/3420995043 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f266c06b990 0x7f266c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.201+0000 7f26837fe640 1 -- 172.21.15.47:0/3420995043 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f267408b100 con 0x7f268c0d0140 2024-04-14T23:36:08.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.201+0000 7f268affd640 1 --2- 172.21.15.47:0/3420995043 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f266c06b990 0x7f266c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.202+0000 7f268affd640 1 --2- 172.21.15.47:0/3420995043 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f266c06b990 0x7f266c06de50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2684007fd0 tx=0x7f2684009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:08.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.205+0000 7f26837fe640 1 -- 172.21.15.47:0/3420995043 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2674059b80 con 0x7f268c0d0140 2024-04-14T23:36:08.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.385+0000 7f2691599640 1 -- 172.21.15.47:0/3420995043 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f268c071820 con 0x7f266c06b990 2024-04-14T23:36:08.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.385+0000 7f26837fe640 1 -- 172.21.15.47:0/3420995043 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f268c071820 con 0x7f266c06b990 2024-04-14T23:36:08.389 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 7 to deep-scrub 2024-04-14T23:36:08.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.387+0000 7f2691599640 1 -- 172.21.15.47:0/3420995043 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f266c06b990 msgr2=0x7f266c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.387+0000 7f2691599640 1 --2- 172.21.15.47:0/3420995043 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f266c06b990 0x7f266c06de50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2684007fd0 tx=0x7f2684009040 comp rx=0 tx=0).stop 2024-04-14T23:36:08.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.387+0000 7f2691599640 1 -- 172.21.15.47:0/3420995043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f268c0d0140 msgr2=0x7f268c1f3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.387+0000 7f2691599640 1 --2- 172.21.15.47:0/3420995043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f268c0d0140 0x7f268c1f3dd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f267400d830 tx=0x7f267400dcf0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.387+0000 7f2691599640 1 -- 172.21.15.47:0/3420995043 shutdown_connections 2024-04-14T23:36:08.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.387+0000 7f2691599640 1 --2- 172.21.15.47:0/3420995043 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f266c06b990 0x7f266c06de50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.387+0000 7f2691599640 1 --2- 172.21.15.47:0/3420995043 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f268c15baf0 0x7f268c1f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.387+0000 7f2691599640 1 --2- 172.21.15.47:0/3420995043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f268c0d0140 0x7f268c1f3dd0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.387+0000 7f2691599640 1 --2- 172.21.15.47:0/3420995043 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f268c06e340 0x7f268c159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.387+0000 7f2691599640 1 -- 172.21.15.47:0/3420995043 >> 172.21.15.47:0/3420995043 conn(0x7f268c06b200 msgr2=0x7f268c0722d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:08.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.387+0000 7f2691599640 1 -- 172.21.15.47:0/3420995043 shutdown_connections 2024-04-14T23:36:08.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.387+0000 7f2691599640 1 -- 172.21.15.47:0/3420995043 wait complete. 2024-04-14T23:36:08.402 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T23:36:08.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.501+0000 7fbaa8a76640 1 Processor -- start 2024-04-14T23:36:08.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.501+0000 7fbaa8a76640 1 -- start start 2024-04-14T23:36:08.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.502+0000 7fbaa8a76640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbaa415e4a0 0x7fbaa40d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.502+0000 7fbaa8a76640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbaa40d1c40 0x7fbaa40d2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.502+0000 7fbaa8a76640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa40c83c0 con 0x7fbaa40c9460 2024-04-14T23:36:08.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.502+0000 7fbaa8a76640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa415e880 con 0x7fbaa40d1c40 2024-04-14T23:36:08.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.502+0000 7fbaa8a76640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa40c86a0 con 0x7fbaa415e4a0 2024-04-14T23:36:08.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.502+0000 7fbaa1d9b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbaa40d1c40 0x7fbaa40d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.502+0000 7fbaa1d9b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbaa40d1c40 0x7fbaa40d2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44566/0 (socket says 172.21.15.47:44566) 2024-04-14T23:36:08.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.502+0000 7fbaa1d9b640 1 -- 172.21.15.47:0/449655472 learned_addr learned my addr 172.21.15.47:0/449655472 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:08.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.502+0000 7fbaa2d9d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbaa40c9460 0x7fbaa40c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35718/0 (socket says 172.21.15.47:35718) 2024-04-14T23:36:08.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.503+0000 7fbaa1d9b640 1 -- 172.21.15.47:0/449655472 >> v2:172.21.15.191:3300/0 conn(0x7fbaa415e4a0 msgr2=0x7fbaa40d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:08.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.503+0000 7fbaa1d9b640 1 --2- 172.21.15.47:0/449655472 >> v2:172.21.15.191:3300/0 conn(0x7fbaa415e4a0 0x7fbaa40d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.503+0000 7fbaa1d9b640 1 -- 172.21.15.47:0/449655472 >> v1:172.21.15.47:6789/0 conn(0x7fbaa40c9460 legacy=0x7fbaa40c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.503+0000 7fbaa1d9b640 1 -- 172.21.15.47:0/449655472 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa40c8980 con 0x7fbaa40d1c40 2024-04-14T23:36:08.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.503+0000 7fbaa159a640 1 -- 172.21.15.47:0/449655472 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649319347 0 0) 0x7fbaa40c83c0 con 0x7fbaa40c9460 2024-04-14T23:36:08.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.503+0000 7fbaa1d9b640 1 --2- 172.21.15.47:0/449655472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbaa40d1c40 0x7fbaa40d2960 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fbaa408e600 tx=0x7fba8c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43d27b004ffe2a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:08.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.503+0000 7fbaa159a640 1 -- 172.21.15.47:0/449655472 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c034070 con 0x7fbaa40d1c40 2024-04-14T23:36:08.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.503+0000 7fbaa159a640 1 -- 172.21.15.47:0/449655472 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba8c030860 con 0x7fbaa40d1c40 2024-04-14T23:36:08.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.503+0000 7fbaa159a640 1 -- 172.21.15.47:0/449655472 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c030c30 con 0x7fbaa40d1c40 2024-04-14T23:36:08.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.504+0000 7fbaa8a76640 1 -- 172.21.15.47:0/449655472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbaa40d1c40 msgr2=0x7fbaa40d2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.504+0000 7fbaa8a76640 1 --2- 172.21.15.47:0/449655472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbaa40d1c40 0x7fbaa40d2960 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fbaa408e600 tx=0x7fba8c02b9a0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.504+0000 7fbaa8a76640 1 -- 172.21.15.47:0/449655472 shutdown_connections 2024-04-14T23:36:08.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.504+0000 7fbaa8a76640 1 --2- 172.21.15.47:0/449655472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbaa40d1c40 0x7fbaa40d2960 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.504+0000 7fbaa8a76640 1 --2- 172.21.15.47:0/449655472 >> v2:172.21.15.191:3300/0 conn(0x7fbaa415e4a0 0x7fbaa40d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.504+0000 7fbaa8a76640 1 -- 172.21.15.47:0/449655472 >> 172.21.15.47:0/449655472 conn(0x7fbaa40d3ef0 msgr2=0x7fbaa40d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:08.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.504+0000 7fbaa8a76640 1 -- 172.21.15.47:0/449655472 shutdown_connections 2024-04-14T23:36:08.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.504+0000 7fbaa8a76640 1 -- 172.21.15.47:0/449655472 wait complete. 2024-04-14T23:36:08.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.505+0000 7fbaa8a76640 1 Processor -- start 2024-04-14T23:36:08.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.505+0000 7fbaa8a76640 1 -- start start 2024-04-14T23:36:08.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.506+0000 7fbaa8a76640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbaa40c9460 0x7fbaa40b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.506+0000 7fbaa8a76640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbaa40d1c40 0x7fbaa414b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.506+0000 7fbaa8a76640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbaa415e4a0 0x7fbaa415b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.506+0000 7fbaa8a76640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa4067bb0 con 0x7fbaa40c9460 2024-04-14T23:36:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.506+0000 7fbaa8a76640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa40c8f40 con 0x7fbaa415e4a0 2024-04-14T23:36:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.506+0000 7fbaa8a76640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa4067d30 con 0x7fbaa40d1c40 2024-04-14T23:36:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.506+0000 7fbaa259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbaa40c9460 0x7fbaa40b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.506+0000 7fbaa259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbaa40c9460 0x7fbaa40b7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44580/0 (socket says 172.21.15.47:44580) 2024-04-14T23:36:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.506+0000 7fbaa259c640 1 -- 172.21.15.47:0/2761898270 learned_addr learned my addr 172.21.15.47:0/2761898270 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:08.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.506+0000 7fbaa1d9b640 1 --2- 172.21.15.47:0/2761898270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbaa40d1c40 0x7fbaa414b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.506+0000 7fbaa2d9d640 1 --2- 172.21.15.47:0/2761898270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbaa415e4a0 0x7fbaa415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.507+0000 7fbaa259c640 1 -- 172.21.15.47:0/2761898270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbaa40d1c40 msgr2=0x7fbaa414b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.507+0000 7fbaa259c640 1 --2- 172.21.15.47:0/2761898270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbaa40d1c40 0x7fbaa414b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.507+0000 7fbaa259c640 1 -- 172.21.15.47:0/2761898270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbaa415e4a0 msgr2=0x7fbaa415b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.507+0000 7fbaa259c640 1 --2- 172.21.15.47:0/2761898270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbaa415e4a0 0x7fbaa415b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.507+0000 7fbaa259c640 1 -- 172.21.15.47:0/2761898270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa41f4160 con 0x7fbaa40c9460 2024-04-14T23:36:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.507+0000 7fbaa259c640 1 --2- 172.21.15.47:0/2761898270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbaa40c9460 0x7fbaa40b7da0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00b4d0 tx=0x7fba9c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:08.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.507+0000 7fba9affd640 1 -- 172.21.15.47:0/2761898270 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c014070 con 0x7fbaa40c9460 2024-04-14T23:36:08.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.507+0000 7fba9affd640 1 -- 172.21.15.47:0/2761898270 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba9c010870 con 0x7fbaa40c9460 2024-04-14T23:36:08.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.507+0000 7fba9affd640 1 -- 172.21.15.47:0/2761898270 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c010c60 con 0x7fbaa40c9460 2024-04-14T23:36:08.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.507+0000 7fbaa8a76640 1 -- 172.21.15.47:0/2761898270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa41f4440 con 0x7fbaa40c9460 2024-04-14T23:36:08.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.507+0000 7fbaa8a76640 1 -- 172.21.15.47:0/2761898270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa41f4a00 con 0x7fbaa40c9460 2024-04-14T23:36:08.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.508+0000 7fbaa8a76640 1 -- 172.21.15.47:0/2761898270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa4075430 con 0x7fbaa40c9460 2024-04-14T23:36:08.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.509+0000 7fba9affd640 1 -- 172.21.15.47:0/2761898270 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7fba9c017070 con 0x7fbaa40c9460 2024-04-14T23:36:08.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.509+0000 7fba9affd640 1 --2- 172.21.15.47:0/2761898270 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fba8406b990 0x7fba8406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:08.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.509+0000 7fba9affd640 1 -- 172.21.15.47:0/2761898270 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fba9c08a770 con 0x7fbaa40c9460 2024-04-14T23:36:08.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.509+0000 7fbaa1d9b640 1 --2- 172.21.15.47:0/2761898270 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fba8406b990 0x7fba8406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:08.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.510+0000 7fbaa1d9b640 1 --2- 172.21.15.47:0/2761898270 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fba8406b990 0x7fba8406de50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fba8c036000 tx=0x7fba8c03b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:08.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.514+0000 7fba9affd640 1 -- 172.21.15.47:0/2761898270 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fba9c059280 con 0x7fbaa40c9460 2024-04-14T23:36:08.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.693+0000 7fbaa8a76640 1 -- 172.21.15.47:0/2761898270 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbaa40686e0 con 0x7fba8406b990 2024-04-14T23:36:08.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.700+0000 7fba9affd640 1 -- 172.21.15.47:0/2761898270 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251441 (secure 0 0 0) 0x7fba8c030a40 con 0x7fba8406b990 2024-04-14T23:36:08.705 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:36:08.706 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-14T23:36:08.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.702+0000 7fbaa8a76640 1 -- 172.21.15.47:0/2761898270 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fba8406b990 msgr2=0x7fba8406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.702+0000 7fbaa8a76640 1 --2- 172.21.15.47:0/2761898270 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fba8406b990 0x7fba8406de50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fba8c036000 tx=0x7fba8c03b040 comp rx=0 tx=0).stop 2024-04-14T23:36:08.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.702+0000 7fbaa8a76640 1 -- 172.21.15.47:0/2761898270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbaa40c9460 msgr2=0x7fbaa40b7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:08.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.702+0000 7fbaa8a76640 1 --2- 172.21.15.47:0/2761898270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbaa40c9460 0x7fbaa40b7da0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00b4d0 tx=0x7fba9c00b990 comp rx=0 tx=0).stop 2024-04-14T23:36:08.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.703+0000 7fbaa8a76640 1 -- 172.21.15.47:0/2761898270 shutdown_connections 2024-04-14T23:36:08.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.703+0000 7fbaa8a76640 1 --2- 172.21.15.47:0/2761898270 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7fba8406b990 0x7fba8406de50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.703+0000 7fbaa8a76640 1 --2- 172.21.15.47:0/2761898270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbaa415e4a0 0x7fbaa415b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.703+0000 7fbaa8a76640 1 --2- 172.21.15.47:0/2761898270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbaa40d1c40 0x7fbaa414b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.703+0000 7fbaa8a76640 1 --2- 172.21.15.47:0/2761898270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbaa40c9460 0x7fbaa40b7da0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:08.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.703+0000 7fbaa8a76640 1 -- 172.21.15.47:0/2761898270 >> 172.21.15.47:0/2761898270 conn(0x7fbaa40d3ef0 msgr2=0x7fbaa406bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:08.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.703+0000 7fbaa8a76640 1 -- 172.21.15.47:0/2761898270 shutdown_connections 2024-04-14T23:36:08.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:08.703+0000 7fbaa8a76640 1 -- 172.21.15.47:0/2761898270 wait complete. 2024-04-14T23:36:08.716 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-04-14T23:36:08.379560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237536,"kb_used_data":4752,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737184,"statfs":{"total":773094113280,"available":772850876416,"internally_reserved":0,"allocated":4866048,"data_stored":2774006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5533,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003401"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128934+0000","last_change":"2024-04-14T23:35:47.145996+0000","last_active":"2024-04-14T23:35:48.128934+0000","last_peered":"2024-04-14T23:35:48.128934+0000","last_clean":"2024-04-14T23:35:48.128934+0000","last_became_active":"2024-04-14T23:35:47.145716+0000","last_became_peered":"2024-04-14T23:35:47.145716+0000","last_unstale":"2024-04-14T23:35:48.128934+0000","last_undegraded":"2024-04-14T23:35:48.128934+0000","last_fullsized":"2024-04-14T23:35:48.128934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:17:32.571374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128951+0000","last_change":"2024-04-14T23:35:47.154551+0000","last_active":"2024-04-14T23:35:48.128951+0000","last_peered":"2024-04-14T23:35:48.128951+0000","last_clean":"2024-04-14T23:35:48.128951+0000","last_became_active":"2024-04-14T23:35:47.154286+0000","last_became_peered":"2024-04-14T23:35:47.154286+0000","last_unstale":"2024-04-14T23:35:48.128951+0000","last_undegraded":"2024-04-14T23:35:48.128951+0000","last_fullsized":"2024-04-14T23:35:48.128951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:07:06.644232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:50.385170+0000","last_change":"2024-04-14T23:35:47.160513+0000","last_active":"2024-04-14T23:35:50.385170+0000","last_peered":"2024-04-14T23:35:50.385170+0000","last_clean":"2024-04-14T23:35:50.385170+0000","last_became_active":"2024-04-14T23:35:47.160208+0000","last_became_peered":"2024-04-14T23:35:47.160208+0000","last_unstale":"2024-04-14T23:35:50.385170+0000","last_undegraded":"2024-04-14T23:35:50.385170+0000","last_fullsized":"2024-04-14T23:35:50.385170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930879+0000","last_change":"2024-04-14T23:35:47.153454+0000","last_active":"2024-04-14T23:35:48.930879+0000","last_peered":"2024-04-14T23:35:48.930879+0000","last_clean":"2024-04-14T23:35:48.930879+0000","last_became_active":"2024-04-14T23:35:47.153133+0000","last_became_peered":"2024-04-14T23:35:47.153133+0000","last_unstale":"2024-04-14T23:35:48.930879+0000","last_undegraded":"2024-04-14T23:35:48.930879+0000","last_fullsized":"2024-04-14T23:35:48.930879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:58:36.176049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930648+0000","last_change":"2024-04-14T23:35:47.154211+0000","last_active":"2024-04-14T23:35:48.930648+0000","last_peered":"2024-04-14T23:35:48.930648+0000","last_clean":"2024-04-14T23:35:48.930648+0000","last_became_active":"2024-04-14T23:35:47.153936+0000","last_became_peered":"2024-04-14T23:35:47.153936+0000","last_unstale":"2024-04-14T23:35:48.930648+0000","last_undegraded":"2024-04-14T23:35:48.930648+0000","last_fullsized":"2024-04-14T23:35:48.930648+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:07:13.534770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929869+0000","last_change":"2024-04-14T23:35:47.143406+0000","last_active":"2024-04-14T23:35:48.929869+0000","last_peered":"2024-04-14T23:35:48.929869+0000","last_clean":"2024-04-14T23:35:48.929869+0000","last_became_active":"2024-04-14T23:35:47.143142+0000","last_became_peered":"2024-04-14T23:35:47.143142+0000","last_unstale":"2024-04-14T23:35:48.929869+0000","last_undegraded":"2024-04-14T23:35:48.929869+0000","last_fullsized":"2024-04-14T23:35:48.929869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:49.647834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129403+0000","last_change":"2024-04-14T23:35:47.159443+0000","last_active":"2024-04-14T23:35:48.129403+0000","last_peered":"2024-04-14T23:35:48.129403+0000","last_clean":"2024-04-14T23:35:48.129403+0000","last_became_active":"2024-04-14T23:35:47.157644+0000","last_became_peered":"2024-04-14T23:35:47.157644+0000","last_unstale":"2024-04-14T23:35:48.129403+0000","last_undegraded":"2024-04-14T23:35:48.129403+0000","last_fullsized":"2024-04-14T23:35:48.129403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128520+0000","last_change":"2024-04-14T23:35:47.150895+0000","last_active":"2024-04-14T23:35:48.128520+0000","last_peered":"2024-04-14T23:35:48.128520+0000","last_clean":"2024-04-14T23:35:48.128520+0000","last_became_active":"2024-04-14T23:35:47.150520+0000","last_became_peered":"2024-04-14T23:35:47.150520+0000","last_unstale":"2024-04-14T23:35:48.128520+0000","last_undegraded":"2024-04-14T23:35:48.128520+0000","last_fullsized":"2024-04-14T23:35:48.128520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:00.141829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:50.385188+0000","last_change":"2024-04-14T23:35:47.160830+0000","last_active":"2024-04-14T23:35:50.385188+0000","last_peered":"2024-04-14T23:35:50.385188+0000","last_clean":"2024-04-14T23:35:50.385188+0000","last_became_active":"2024-04-14T23:35:47.160554+0000","last_became_peered":"2024-04-14T23:35:47.160554+0000","last_unstale":"2024-04-14T23:35:50.385188+0000","last_undegraded":"2024-04-14T23:35:50.385188+0000","last_fullsized":"2024-04-14T23:35:50.385188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130272+0000","last_change":"2024-04-14T23:35:47.157661+0000","last_active":"2024-04-14T23:35:48.130272+0000","last_peered":"2024-04-14T23:35:48.130272+0000","last_clean":"2024-04-14T23:35:48.130272+0000","last_became_active":"2024-04-14T23:35:47.157377+0000","last_became_peered":"2024-04-14T23:35:47.157377+0000","last_unstale":"2024-04-14T23:35:48.130272+0000","last_undegraded":"2024-04-14T23:35:48.130272+0000","last_fullsized":"2024-04-14T23:35:48.130272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:54:50.487935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130985+0000","last_change":"2024-04-14T23:35:47.153073+0000","last_active":"2024-04-14T23:35:48.130985+0000","last_peered":"2024-04-14T23:35:48.130985+0000","last_clean":"2024-04-14T23:35:48.130985+0000","last_became_active":"2024-04-14T23:35:47.152649+0000","last_became_peered":"2024-04-14T23:35:47.152649+0000","last_unstale":"2024-04-14T23:35:48.130985+0000","last_undegraded":"2024-04-14T23:35:48.130985+0000","last_fullsized":"2024-04-14T23:35:48.130985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:47:32.718724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:50.385164+0000","last_change":"2024-04-14T23:35:47.149389+0000","last_active":"2024-04-14T23:35:50.385164+0000","last_peered":"2024-04-14T23:35:50.385164+0000","last_clean":"2024-04-14T23:35:50.385164+0000","last_became_active":"2024-04-14T23:35:47.149130+0000","last_became_peered":"2024-04-14T23:35:47.149130+0000","last_unstale":"2024-04-14T23:35:50.385164+0000","last_undegraded":"2024-04-14T23:35:50.385164+0000","last_fullsized":"2024-04-14T23:35:50.385164+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129857+0000","last_change":"2024-04-14T23:35:47.153273+0000","last_active":"2024-04-14T23:35:48.129857+0000","last_peered":"2024-04-14T23:35:48.129857+0000","last_clean":"2024-04-14T23:35:48.129857+0000","last_became_active":"2024-04-14T23:35:47.153005+0000","last_became_peered":"2024-04-14T23:35:47.153005+0000","last_unstale":"2024-04-14T23:35:48.129857+0000","last_undegraded":"2024-04-14T23:35:48.129857+0000","last_fullsized":"2024-04-14T23:35:48.129857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:33:25.414410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390635+0000","last_change":"2024-04-14T23:35:47.152798+0000","last_active":"2024-04-14T23:35:48.390635+0000","last_peered":"2024-04-14T23:35:48.390635+0000","last_clean":"2024-04-14T23:35:48.390635+0000","last_became_active":"2024-04-14T23:35:47.152530+0000","last_became_peered":"2024-04-14T23:35:47.152530+0000","last_unstale":"2024-04-14T23:35:48.390635+0000","last_undegraded":"2024-04-14T23:35:48.390635+0000","last_fullsized":"2024-04-14T23:35:48.390635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129640+0000","last_change":"2024-04-14T23:35:47.157364+0000","last_active":"2024-04-14T23:35:48.129640+0000","last_peered":"2024-04-14T23:35:48.129640+0000","last_clean":"2024-04-14T23:35:48.129640+0000","last_became_active":"2024-04-14T23:35:47.157069+0000","last_became_peered":"2024-04-14T23:35:47.157069+0000","last_unstale":"2024-04-14T23:35:48.129640+0000","last_undegraded":"2024-04-14T23:35:48.129640+0000","last_fullsized":"2024-04-14T23:35:48.129640+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929628+0000","last_change":"2024-04-14T23:35:47.157646+0000","last_active":"2024-04-14T23:35:48.929628+0000","last_peered":"2024-04-14T23:35:48.929628+0000","last_clean":"2024-04-14T23:35:48.929628+0000","last_became_active":"2024-04-14T23:35:47.157374+0000","last_became_peered":"2024-04-14T23:35:47.157374+0000","last_unstale":"2024-04-14T23:35:48.929628+0000","last_undegraded":"2024-04-14T23:35:48.929628+0000","last_fullsized":"2024-04-14T23:35:48.929628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:02:49.647834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930137+0000","last_change":"2024-04-14T23:35:47.160288+0000","last_active":"2024-04-14T23:35:48.930137+0000","last_peered":"2024-04-14T23:35:48.930137+0000","last_clean":"2024-04-14T23:35:48.930137+0000","last_became_active":"2024-04-14T23:35:47.160045+0000","last_became_peered":"2024-04-14T23:35:47.160045+0000","last_unstale":"2024-04-14T23:35:48.930137+0000","last_undegraded":"2024-04-14T23:35:48.930137+0000","last_fullsized":"2024-04-14T23:35:48.930137+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:33:25.414410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130094+0000","last_change":"2024-04-14T23:35:47.150954+0000","last_active":"2024-04-14T23:35:48.130094+0000","last_peered":"2024-04-14T23:35:48.130094+0000","last_clean":"2024-04-14T23:35:48.130094+0000","last_became_active":"2024-04-14T23:35:47.150606+0000","last_became_peered":"2024-04-14T23:35:47.150606+0000","last_unstale":"2024-04-14T23:35:48.130094+0000","last_undegraded":"2024-04-14T23:35:48.130094+0000","last_fullsized":"2024-04-14T23:35:48.130094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:39.427143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930862+0000","last_change":"2024-04-14T23:35:47.137492+0000","last_active":"2024-04-14T23:35:48.930862+0000","last_peered":"2024-04-14T23:35:48.930862+0000","last_clean":"2024-04-14T23:35:48.930862+0000","last_became_active":"2024-04-14T23:35:47.137234+0000","last_became_peered":"2024-04-14T23:35:47.137234+0000","last_unstale":"2024-04-14T23:35:48.930862+0000","last_undegraded":"2024-04-14T23:35:48.930862+0000","last_fullsized":"2024-04-14T23:35:48.930862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:30:05.284391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129997+0000","last_change":"2024-04-14T23:35:47.150013+0000","last_active":"2024-04-14T23:35:48.129997+0000","last_peered":"2024-04-14T23:35:48.129997+0000","last_clean":"2024-04-14T23:35:48.129997+0000","last_became_active":"2024-04-14T23:35:47.149754+0000","last_became_peered":"2024-04-14T23:35:47.149754+0000","last_unstale":"2024-04-14T23:35:48.129997+0000","last_undegraded":"2024-04-14T23:35:48.129997+0000","last_fullsized":"2024-04-14T23:35:48.129997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:12.344810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129783+0000","last_change":"2024-04-14T23:35:47.149073+0000","last_active":"2024-04-14T23:35:48.129783+0000","last_peered":"2024-04-14T23:35:48.129783+0000","last_clean":"2024-04-14T23:35:48.129783+0000","last_became_active":"2024-04-14T23:35:47.148806+0000","last_became_peered":"2024-04-14T23:35:47.148806+0000","last_unstale":"2024-04-14T23:35:48.129783+0000","last_undegraded":"2024-04-14T23:35:48.129783+0000","last_fullsized":"2024-04-14T23:35:48.129783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:18.147979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391033+0000","last_change":"2024-04-14T23:35:47.154397+0000","last_active":"2024-04-14T23:35:48.391033+0000","last_peered":"2024-04-14T23:35:48.391033+0000","last_clean":"2024-04-14T23:35:48.391033+0000","last_became_active":"2024-04-14T23:35:47.154054+0000","last_became_peered":"2024-04-14T23:35:47.154054+0000","last_unstale":"2024-04-14T23:35:48.391033+0000","last_undegraded":"2024-04-14T23:35:48.391033+0000","last_fullsized":"2024-04-14T23:35:48.391033+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:13:37.995199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929730+0000","last_change":"2024-04-14T23:35:47.135157+0000","last_active":"2024-04-14T23:35:48.929730+0000","last_peered":"2024-04-14T23:35:48.929730+0000","last_clean":"2024-04-14T23:35:48.929730+0000","last_became_active":"2024-04-14T23:35:47.134846+0000","last_became_peered":"2024-04-14T23:35:47.134846+0000","last_unstale":"2024-04-14T23:35:48.929730+0000","last_undegraded":"2024-04-14T23:35:48.929730+0000","last_fullsized":"2024-04-14T23:35:48.929730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:38.502135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930226+0000","last_change":"2024-04-14T23:35:47.134176+0000","last_active":"2024-04-14T23:35:48.930226+0000","last_peered":"2024-04-14T23:35:48.930226+0000","last_clean":"2024-04-14T23:35:48.930226+0000","last_became_active":"2024-04-14T23:35:47.133837+0000","last_became_peered":"2024-04-14T23:35:47.133837+0000","last_unstale":"2024-04-14T23:35:48.930226+0000","last_undegraded":"2024-04-14T23:35:48.930226+0000","last_fullsized":"2024-04-14T23:35:48.930226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:13:32.134259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130962+0000","last_change":"2024-04-14T23:35:47.141736+0000","last_active":"2024-04-14T23:35:48.130962+0000","last_peered":"2024-04-14T23:35:48.130962+0000","last_clean":"2024-04-14T23:35:48.130962+0000","last_became_active":"2024-04-14T23:35:47.141474+0000","last_became_peered":"2024-04-14T23:35:47.141474+0000","last_unstale":"2024-04-14T23:35:48.130962+0000","last_undegraded":"2024-04-14T23:35:48.130962+0000","last_fullsized":"2024-04-14T23:35:48.130962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:31:38.223026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930267+0000","last_change":"2024-04-14T23:35:47.151371+0000","last_active":"2024-04-14T23:35:48.930267+0000","last_peered":"2024-04-14T23:35:48.930267+0000","last_clean":"2024-04-14T23:35:48.930267+0000","last_became_active":"2024-04-14T23:35:47.151113+0000","last_became_peered":"2024-04-14T23:35:47.151113+0000","last_unstale":"2024-04-14T23:35:48.930267+0000","last_undegraded":"2024-04-14T23:35:48.930267+0000","last_fullsized":"2024-04-14T23:35:48.930267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:26.044901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130325+0000","last_change":"2024-04-14T23:35:47.144676+0000","last_active":"2024-04-14T23:35:48.130325+0000","last_peered":"2024-04-14T23:35:48.130325+0000","last_clean":"2024-04-14T23:35:48.130325+0000","last_became_active":"2024-04-14T23:35:47.144429+0000","last_became_peered":"2024-04-14T23:35:47.144429+0000","last_unstale":"2024-04-14T23:35:48.130325+0000","last_undegraded":"2024-04-14T23:35:48.130325+0000","last_fullsized":"2024-04-14T23:35:48.130325+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:40.857176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130449+0000","last_change":"2024-04-14T23:35:47.149677+0000","last_active":"2024-04-14T23:35:48.130449+0000","last_peered":"2024-04-14T23:35:48.130449+0000","last_clean":"2024-04-14T23:35:48.130449+0000","last_became_active":"2024-04-14T23:35:47.149370+0000","last_became_peered":"2024-04-14T23:35:47.149370+0000","last_unstale":"2024-04-14T23:35:48.130449+0000","last_undegraded":"2024-04-14T23:35:48.130449+0000","last_fullsized":"2024-04-14T23:35:48.130449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:56:02.290384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130652+0000","last_change":"2024-04-14T23:35:47.138179+0000","last_active":"2024-04-14T23:35:48.130652+0000","last_peered":"2024-04-14T23:35:48.130652+0000","last_clean":"2024-04-14T23:35:48.130652+0000","last_became_active":"2024-04-14T23:35:47.137917+0000","last_became_peered":"2024-04-14T23:35:47.137917+0000","last_unstale":"2024-04-14T23:35:48.130652+0000","last_undegraded":"2024-04-14T23:35:48.130652+0000","last_fullsized":"2024-04-14T23:35:48.130652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:10:16.379713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130246+0000","last_change":"2024-04-14T23:35:47.140281+0000","last_active":"2024-04-14T23:35:48.130246+0000","last_peered":"2024-04-14T23:35:48.130246+0000","last_clean":"2024-04-14T23:35:48.130246+0000","last_became_active":"2024-04-14T23:35:47.140018+0000","last_became_peered":"2024-04-14T23:35:47.140018+0000","last_unstale":"2024-04-14T23:35:48.130246+0000","last_undegraded":"2024-04-14T23:35:48.130246+0000","last_fullsized":"2024-04-14T23:35:48.130246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:12.833964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929754+0000","last_change":"2024-04-14T23:35:47.150510+0000","last_active":"2024-04-14T23:35:48.929754+0000","last_peered":"2024-04-14T23:35:48.929754+0000","last_clean":"2024-04-14T23:35:48.929754+0000","last_became_active":"2024-04-14T23:35:47.150210+0000","last_became_peered":"2024-04-14T23:35:47.150210+0000","last_unstale":"2024-04-14T23:35:48.929754+0000","last_undegraded":"2024-04-14T23:35:48.929754+0000","last_fullsized":"2024-04-14T23:35:48.929754+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:27.967946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929546+0000","last_change":"2024-04-14T23:35:47.154478+0000","last_active":"2024-04-14T23:35:48.929546+0000","last_peered":"2024-04-14T23:35:48.929546+0000","last_clean":"2024-04-14T23:35:48.929546+0000","last_became_active":"2024-04-14T23:35:47.154196+0000","last_became_peered":"2024-04-14T23:35:47.154196+0000","last_unstale":"2024-04-14T23:35:48.929546+0000","last_undegraded":"2024-04-14T23:35:48.929546+0000","last_fullsized":"2024-04-14T23:35:48.929546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:47:00.159204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929959+0000","last_change":"2024-04-14T23:35:47.157634+0000","last_active":"2024-04-14T23:35:48.929959+0000","last_peered":"2024-04-14T23:35:48.929959+0000","last_clean":"2024-04-14T23:35:48.929959+0000","last_became_active":"2024-04-14T23:35:47.157342+0000","last_became_peered":"2024-04-14T23:35:47.157342+0000","last_unstale":"2024-04-14T23:35:48.929959+0000","last_undegraded":"2024-04-14T23:35:48.929959+0000","last_fullsized":"2024-04-14T23:35:48.929959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130857+0000","last_change":"2024-04-14T23:35:46.130076+0000","last_active":"2024-04-14T23:35:48.130857+0000","last_peered":"2024-04-14T23:35:48.130857+0000","last_clean":"2024-04-14T23:35:48.130857+0000","last_became_active":"2024-04-14T23:35:46.129786+0000","last_became_peered":"2024-04-14T23:35:46.129786+0000","last_unstale":"2024-04-14T23:35:48.130857+0000","last_undegraded":"2024-04-14T23:35:48.130857+0000","last_fullsized":"2024-04-14T23:35:48.130857+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:55:49.584788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930680+0000","last_change":"2024-04-14T23:35:47.157788+0000","last_active":"2024-04-14T23:35:48.930680+0000","last_peered":"2024-04-14T23:35:48.930680+0000","last_clean":"2024-04-14T23:35:48.930680+0000","last_became_active":"2024-04-14T23:35:47.157538+0000","last_became_peered":"2024-04-14T23:35:47.157538+0000","last_unstale":"2024-04-14T23:35:48.930680+0000","last_undegraded":"2024-04-14T23:35:48.930680+0000","last_fullsized":"2024-04-14T23:35:48.930680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929984+0000","last_change":"2024-04-14T23:35:46.136432+0000","last_active":"2024-04-14T23:35:48.929984+0000","last_peered":"2024-04-14T23:35:48.929984+0000","last_clean":"2024-04-14T23:35:48.929984+0000","last_became_active":"2024-04-14T23:35:46.136168+0000","last_became_peered":"2024-04-14T23:35:46.136168+0000","last_unstale":"2024-04-14T23:35:48.929984+0000","last_undegraded":"2024-04-14T23:35:48.929984+0000","last_fullsized":"2024-04-14T23:35:48.929984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391012+0000","last_change":"2024-04-14T23:35:47.149283+0000","last_active":"2024-04-14T23:35:48.391012+0000","last_peered":"2024-04-14T23:35:48.391012+0000","last_clean":"2024-04-14T23:35:48.391012+0000","last_became_active":"2024-04-14T23:35:47.148963+0000","last_became_peered":"2024-04-14T23:35:47.148963+0000","last_unstale":"2024-04-14T23:35:48.391012+0000","last_undegraded":"2024-04-14T23:35:48.391012+0000","last_fullsized":"2024-04-14T23:35:48.391012+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:33:25.414410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930741+0000","last_change":"2024-04-14T23:35:46.137540+0000","last_active":"2024-04-14T23:35:48.930741+0000","last_peered":"2024-04-14T23:35:48.930741+0000","last_clean":"2024-04-14T23:35:48.930741+0000","last_became_active":"2024-04-14T23:35:46.137096+0000","last_became_peered":"2024-04-14T23:35:46.137096+0000","last_unstale":"2024-04-14T23:35:48.930741+0000","last_undegraded":"2024-04-14T23:35:48.930741+0000","last_fullsized":"2024-04-14T23:35:48.930741+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128931+0000","last_change":"2024-04-14T23:35:47.146618+0000","last_active":"2024-04-14T23:35:48.128931+0000","last_peered":"2024-04-14T23:35:48.128931+0000","last_clean":"2024-04-14T23:35:48.128931+0000","last_became_active":"2024-04-14T23:35:47.146329+0000","last_became_peered":"2024-04-14T23:35:47.146329+0000","last_unstale":"2024-04-14T23:35:48.128931+0000","last_undegraded":"2024-04-14T23:35:48.128931+0000","last_fullsized":"2024-04-14T23:35:48.128931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:59:58.258654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390798+0000","last_change":"2024-04-14T23:35:46.133465+0000","last_active":"2024-04-14T23:35:48.390798+0000","last_peered":"2024-04-14T23:35:48.390798+0000","last_clean":"2024-04-14T23:35:48.390798+0000","last_became_active":"2024-04-14T23:35:46.133188+0000","last_became_peered":"2024-04-14T23:35:46.133188+0000","last_unstale":"2024-04-14T23:35:48.390798+0000","last_undegraded":"2024-04-14T23:35:48.390798+0000","last_fullsized":"2024-04-14T23:35:48.390798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:38.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:50.385124+0000","last_change":"2024-04-14T23:35:47.142488+0000","last_active":"2024-04-14T23:35:50.385124+0000","last_peered":"2024-04-14T23:35:50.385124+0000","last_clean":"2024-04-14T23:35:50.385124+0000","last_became_active":"2024-04-14T23:35:47.142140+0000","last_became_peered":"2024-04-14T23:35:47.142140+0000","last_unstale":"2024-04-14T23:35:50.385124+0000","last_undegraded":"2024-04-14T23:35:50.385124+0000","last_fullsized":"2024-04-14T23:35:50.385124+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129923+0000","last_change":"2024-04-14T23:35:46.135150+0000","last_active":"2024-04-14T23:35:48.129923+0000","last_peered":"2024-04-14T23:35:48.129923+0000","last_clean":"2024-04-14T23:35:48.129923+0000","last_became_active":"2024-04-14T23:35:46.134786+0000","last_became_peered":"2024-04-14T23:35:46.134786+0000","last_unstale":"2024-04-14T23:35:48.129923+0000","last_undegraded":"2024-04-14T23:35:48.129923+0000","last_fullsized":"2024-04-14T23:35:48.129923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:28.026305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130028+0000","last_change":"2024-04-14T23:35:47.159541+0000","last_active":"2024-04-14T23:35:48.130028+0000","last_peered":"2024-04-14T23:35:48.130028+0000","last_clean":"2024-04-14T23:35:48.130028+0000","last_became_active":"2024-04-14T23:35:47.158355+0000","last_became_peered":"2024-04-14T23:35:47.158355+0000","last_unstale":"2024-04-14T23:35:48.130028+0000","last_undegraded":"2024-04-14T23:35:48.130028+0000","last_fullsized":"2024-04-14T23:35:48.130028+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:13:37.995199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929626+0000","last_change":"2024-04-14T23:35:46.139410+0000","last_active":"2024-04-14T23:35:48.929626+0000","last_peered":"2024-04-14T23:35:48.929626+0000","last_clean":"2024-04-14T23:35:48.929626+0000","last_became_active":"2024-04-14T23:35:46.138931+0000","last_became_peered":"2024-04-14T23:35:46.138931+0000","last_unstale":"2024-04-14T23:35:48.929626+0000","last_undegraded":"2024-04-14T23:35:48.929626+0000","last_fullsized":"2024-04-14T23:35:48.929626+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:28.026305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390862+0000","last_change":"2024-04-14T23:35:47.158537+0000","last_active":"2024-04-14T23:35:48.390862+0000","last_peered":"2024-04-14T23:35:48.390862+0000","last_clean":"2024-04-14T23:35:48.390862+0000","last_became_active":"2024-04-14T23:35:47.158238+0000","last_became_peered":"2024-04-14T23:35:47.158238+0000","last_unstale":"2024-04-14T23:35:48.390862+0000","last_undegraded":"2024-04-14T23:35:48.390862+0000","last_fullsized":"2024-04-14T23:35:48.390862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929960+0000","last_change":"2024-04-14T23:35:46.134765+0000","last_active":"2024-04-14T23:35:48.929960+0000","last_peered":"2024-04-14T23:35:48.929960+0000","last_clean":"2024-04-14T23:35:48.929960+0000","last_became_active":"2024-04-14T23:35:46.134477+0000","last_became_peered":"2024-04-14T23:35:46.134477+0000","last_unstale":"2024-04-14T23:35:48.929960+0000","last_undegraded":"2024-04-14T23:35:48.929960+0000","last_fullsized":"2024-04-14T23:35:48.929960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:38.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128703+0000","last_change":"2024-04-14T23:35:47.153332+0000","last_active":"2024-04-14T23:35:48.128703+0000","last_peered":"2024-04-14T23:35:48.128703+0000","last_clean":"2024-04-14T23:35:48.128703+0000","last_became_active":"2024-04-14T23:35:47.152701+0000","last_became_peered":"2024-04-14T23:35:47.152701+0000","last_unstale":"2024-04-14T23:35:48.128703+0000","last_undegraded":"2024-04-14T23:35:48.128703+0000","last_fullsized":"2024-04-14T23:35:48.128703+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:45:43.060746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390464+0000","last_change":"2024-04-14T23:35:46.132189+0000","last_active":"2024-04-14T23:35:48.390464+0000","last_peered":"2024-04-14T23:35:48.390464+0000","last_clean":"2024-04-14T23:35:48.390464+0000","last_became_active":"2024-04-14T23:35:46.131898+0000","last_became_peered":"2024-04-14T23:35:46.131898+0000","last_unstale":"2024-04-14T23:35:48.390464+0000","last_undegraded":"2024-04-14T23:35:48.390464+0000","last_fullsized":"2024-04-14T23:35:48.390464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:39.852879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930999+0000","last_change":"2024-04-14T23:35:47.151785+0000","last_active":"2024-04-14T23:35:48.930999+0000","last_peered":"2024-04-14T23:35:48.930999+0000","last_clean":"2024-04-14T23:35:48.930999+0000","last_became_active":"2024-04-14T23:35:47.151273+0000","last_became_peered":"2024-04-14T23:35:47.151273+0000","last_unstale":"2024-04-14T23:35:48.930999+0000","last_undegraded":"2024-04-14T23:35:48.930999+0000","last_fullsized":"2024-04-14T23:35:48.930999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:51.707591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128964+0000","last_change":"2024-04-14T23:35:46.130128+0000","last_active":"2024-04-14T23:35:48.128964+0000","last_peered":"2024-04-14T23:35:48.128964+0000","last_clean":"2024-04-14T23:35:48.128964+0000","last_became_active":"2024-04-14T23:35:46.129848+0000","last_became_peered":"2024-04-14T23:35:46.129848+0000","last_unstale":"2024-04-14T23:35:48.128964+0000","last_undegraded":"2024-04-14T23:35:48.128964+0000","last_fullsized":"2024-04-14T23:35:48.128964+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:25.040605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930239+0000","last_change":"2024-04-14T23:35:47.135501+0000","last_active":"2024-04-14T23:35:48.930239+0000","last_peered":"2024-04-14T23:35:48.930239+0000","last_clean":"2024-04-14T23:35:48.930239+0000","last_became_active":"2024-04-14T23:35:47.135240+0000","last_became_peered":"2024-04-14T23:35:47.135240+0000","last_unstale":"2024-04-14T23:35:48.930239+0000","last_undegraded":"2024-04-14T23:35:48.930239+0000","last_fullsized":"2024-04-14T23:35:48.930239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130481+0000","last_change":"2024-04-14T23:35:46.132005+0000","last_active":"2024-04-14T23:35:48.130481+0000","last_peered":"2024-04-14T23:35:48.130481+0000","last_clean":"2024-04-14T23:35:48.130481+0000","last_became_active":"2024-04-14T23:35:46.131640+0000","last_became_peered":"2024-04-14T23:35:46.131640+0000","last_unstale":"2024-04-14T23:35:48.130481+0000","last_undegraded":"2024-04-14T23:35:48.130481+0000","last_fullsized":"2024-04-14T23:35:48.130481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:11.340513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:50.385178+0000","last_change":"2024-04-14T23:35:47.153756+0000","last_active":"2024-04-14T23:35:50.385178+0000","last_peered":"2024-04-14T23:35:50.385178+0000","last_clean":"2024-04-14T23:35:50.385178+0000","last_became_active":"2024-04-14T23:35:47.153494+0000","last_became_peered":"2024-04-14T23:35:47.153494+0000","last_unstale":"2024-04-14T23:35:50.385178+0000","last_undegraded":"2024-04-14T23:35:50.385178+0000","last_fullsized":"2024-04-14T23:35:50.385178+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.131064+0000","last_change":"2024-04-14T23:35:46.129168+0000","last_active":"2024-04-14T23:35:48.131064+0000","last_peered":"2024-04-14T23:35:48.131064+0000","last_clean":"2024-04-14T23:35:48.131064+0000","last_became_active":"2024-04-14T23:35:46.128883+0000","last_became_peered":"2024-04-14T23:35:46.128883+0000","last_unstale":"2024-04-14T23:35:48.131064+0000","last_undegraded":"2024-04-14T23:35:48.131064+0000","last_fullsized":"2024-04-14T23:35:48.131064+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391075+0000","last_change":"2024-04-14T23:35:47.154541+0000","last_active":"2024-04-14T23:35:48.391075+0000","last_peered":"2024-04-14T23:35:48.391075+0000","last_clean":"2024-04-14T23:35:48.391075+0000","last_became_active":"2024-04-14T23:35:47.154276+0000","last_became_peered":"2024-04-14T23:35:47.154276+0000","last_unstale":"2024-04-14T23:35:48.391075+0000","last_undegraded":"2024-04-14T23:35:48.391075+0000","last_fullsized":"2024-04-14T23:35:48.391075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:54:50.487935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'10","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:36:00.060121+0000","last_change":"2024-04-14T23:35:46.136620+0000","last_active":"2024-04-14T23:36:00.060121+0000","last_peered":"2024-04-14T23:36:00.060121+0000","last_clean":"2024-04-14T23:36:00.060121+0000","last_became_active":"2024-04-14T23:35:46.136185+0000","last_became_peered":"2024-04-14T23:35:46.136185+0000","last_unstale":"2024-04-14T23:36:00.060121+0000","last_undegraded":"2024-04-14T23:36:00.060121+0000","last_fullsized":"2024-04-14T23:36:00.060121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:26.963649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:50.385140+0000","last_change":"2024-04-14T23:35:47.158305+0000","last_active":"2024-04-14T23:35:50.385140+0000","last_peered":"2024-04-14T23:35:50.385140+0000","last_clean":"2024-04-14T23:35:50.385140+0000","last_became_active":"2024-04-14T23:35:47.157745+0000","last_became_peered":"2024-04-14T23:35:47.157745+0000","last_unstale":"2024-04-14T23:35:50.385140+0000","last_undegraded":"2024-04-14T23:35:50.385140+0000","last_fullsized":"2024-04-14T23:35:50.385140+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128763+0000","last_change":"2024-04-14T23:35:46.133651+0000","last_active":"2024-04-14T23:35:48.128763+0000","last_peered":"2024-04-14T23:35:48.128763+0000","last_clean":"2024-04-14T23:35:48.128763+0000","last_became_active":"2024-04-14T23:35:46.133356+0000","last_became_peered":"2024-04-14T23:35:46.133356+0000","last_unstale":"2024-04-14T23:35:48.128763+0000","last_undegraded":"2024-04-14T23:35:48.128763+0000","last_fullsized":"2024-04-14T23:35:48.128763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:39.741647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128618+0000","last_change":"2024-04-14T23:35:47.143315+0000","last_active":"2024-04-14T23:35:48.128618+0000","last_peered":"2024-04-14T23:35:48.128618+0000","last_clean":"2024-04-14T23:35:48.128618+0000","last_became_active":"2024-04-14T23:35:47.143045+0000","last_became_peered":"2024-04-14T23:35:47.143045+0000","last_unstale":"2024-04-14T23:35:48.128618+0000","last_undegraded":"2024-04-14T23:35:48.128618+0000","last_fullsized":"2024-04-14T23:35:48.128618+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:10:25.940509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929923+0000","last_change":"2024-04-14T23:35:46.134679+0000","last_active":"2024-04-14T23:35:48.929923+0000","last_peered":"2024-04-14T23:35:48.929923+0000","last_clean":"2024-04-14T23:35:48.929923+0000","last_became_active":"2024-04-14T23:35:46.134400+0000","last_became_peered":"2024-04-14T23:35:46.134400+0000","last_unstale":"2024-04-14T23:35:48.929923+0000","last_undegraded":"2024-04-14T23:35:48.929923+0000","last_fullsized":"2024-04-14T23:35:48.929923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:11.829667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929760+0000","last_change":"2024-04-14T23:35:47.135899+0000","last_active":"2024-04-14T23:35:48.929760+0000","last_peered":"2024-04-14T23:35:48.929760+0000","last_clean":"2024-04-14T23:35:48.929760+0000","last_became_active":"2024-04-14T23:35:47.134733+0000","last_became_peered":"2024-04-14T23:35:47.134733+0000","last_unstale":"2024-04-14T23:35:48.929760+0000","last_undegraded":"2024-04-14T23:35:48.929760+0000","last_fullsized":"2024-04-14T23:35:48.929760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:26.044901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129540+0000","last_change":"2024-04-14T23:35:46.128127+0000","last_active":"2024-04-14T23:35:48.129540+0000","last_peered":"2024-04-14T23:35:48.129540+0000","last_clean":"2024-04-14T23:35:48.129540+0000","last_became_active":"2024-04-14T23:35:46.127852+0000","last_became_peered":"2024-04-14T23:35:46.127852+0000","last_unstale":"2024-04-14T23:35:48.129540+0000","last_undegraded":"2024-04-14T23:35:48.129540+0000","last_fullsized":"2024-04-14T23:35:48.129540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:28:27.338198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128687+0000","last_change":"2024-04-14T23:35:47.147302+0000","last_active":"2024-04-14T23:35:48.128687+0000","last_peered":"2024-04-14T23:35:48.128687+0000","last_clean":"2024-04-14T23:35:48.128687+0000","last_became_active":"2024-04-14T23:35:47.147022+0000","last_became_peered":"2024-04-14T23:35:47.147022+0000","last_unstale":"2024-04-14T23:35:48.128687+0000","last_undegraded":"2024-04-14T23:35:48.128687+0000","last_fullsized":"2024-04-14T23:35:48.128687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:29:11.592779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929556+0000","last_change":"2024-04-14T23:35:46.139301+0000","last_active":"2024-04-14T23:35:48.929556+0000","last_peered":"2024-04-14T23:35:48.929556+0000","last_clean":"2024-04-14T23:35:48.929556+0000","last_became_active":"2024-04-14T23:35:46.138922+0000","last_became_peered":"2024-04-14T23:35:46.138922+0000","last_unstale":"2024-04-14T23:35:48.929556+0000","last_undegraded":"2024-04-14T23:35:48.929556+0000","last_fullsized":"2024-04-14T23:35:48.929556+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:30:04.280095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128762+0000","last_change":"2024-04-14T23:35:47.143210+0000","last_active":"2024-04-14T23:35:48.128762+0000","last_peered":"2024-04-14T23:35:48.128762+0000","last_clean":"2024-04-14T23:35:48.128762+0000","last_became_active":"2024-04-14T23:35:47.142925+0000","last_became_peered":"2024-04-14T23:35:47.142925+0000","last_unstale":"2024-04-14T23:35:48.128762+0000","last_undegraded":"2024-04-14T23:35:48.128762+0000","last_fullsized":"2024-04-14T23:35:48.128762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:19:31.536395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130578+0000","last_change":"2024-04-14T23:35:46.130896+0000","last_active":"2024-04-14T23:35:48.130578+0000","last_peered":"2024-04-14T23:35:48.130578+0000","last_clean":"2024-04-14T23:35:48.130578+0000","last_became_active":"2024-04-14T23:35:46.130423+0000","last_became_peered":"2024-04-14T23:35:46.130423+0000","last_unstale":"2024-04-14T23:35:48.130578+0000","last_undegraded":"2024-04-14T23:35:48.130578+0000","last_fullsized":"2024-04-14T23:35:48.130578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:22:38.422847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.131117+0000","last_change":"2024-04-14T23:35:47.149269+0000","last_active":"2024-04-14T23:35:48.131117+0000","last_peered":"2024-04-14T23:35:48.131117+0000","last_clean":"2024-04-14T23:35:48.131117+0000","last_became_active":"2024-04-14T23:35:47.148964+0000","last_became_peered":"2024-04-14T23:35:47.148964+0000","last_unstale":"2024-04-14T23:35:48.131117+0000","last_undegraded":"2024-04-14T23:35:48.131117+0000","last_fullsized":"2024-04-14T23:35:48.131117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:16:06.767783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.391019+0000","last_change":"2024-04-14T23:35:46.137019+0000","last_active":"2024-04-14T23:35:48.391019+0000","last_peered":"2024-04-14T23:35:48.391019+0000","last_clean":"2024-04-14T23:35:48.391019+0000","last_became_active":"2024-04-14T23:35:46.136718+0000","last_became_peered":"2024-04-14T23:35:46.136718+0000","last_unstale":"2024-04-14T23:35:48.391019+0000","last_undegraded":"2024-04-14T23:35:48.391019+0000","last_fullsized":"2024-04-14T23:35:48.391019+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:11.829667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390937+0000","last_change":"2024-04-14T23:35:47.149376+0000","last_active":"2024-04-14T23:35:48.390937+0000","last_peered":"2024-04-14T23:35:48.390937+0000","last_clean":"2024-04-14T23:35:48.390937+0000","last_became_active":"2024-04-14T23:35:47.149067+0000","last_became_peered":"2024-04-14T23:35:47.149067+0000","last_unstale":"2024-04-14T23:35:48.390937+0000","last_undegraded":"2024-04-14T23:35:48.390937+0000","last_fullsized":"2024-04-14T23:35:48.390937+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:18.147979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930844+0000","last_change":"2024-04-14T23:35:46.136557+0000","last_active":"2024-04-14T23:35:48.930844+0000","last_peered":"2024-04-14T23:35:48.930844+0000","last_clean":"2024-04-14T23:35:48.930844+0000","last_became_active":"2024-04-14T23:35:46.136236+0000","last_became_peered":"2024-04-14T23:35:46.136236+0000","last_unstale":"2024-04-14T23:35:48.930844+0000","last_undegraded":"2024-04-14T23:35:48.930844+0000","last_fullsized":"2024-04-14T23:35:48.930844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:08:47.351218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930975+0000","last_change":"2024-04-14T23:35:47.150822+0000","last_active":"2024-04-14T23:35:48.930975+0000","last_peered":"2024-04-14T23:35:48.930975+0000","last_clean":"2024-04-14T23:35:48.930975+0000","last_became_active":"2024-04-14T23:35:47.150517+0000","last_became_peered":"2024-04-14T23:35:47.150517+0000","last_unstale":"2024-04-14T23:35:48.930975+0000","last_undegraded":"2024-04-14T23:35:48.930975+0000","last_fullsized":"2024-04-14T23:35:48.930975+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:02:29.030602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930275+0000","last_change":"2024-04-14T23:35:46.136475+0000","last_active":"2024-04-14T23:35:48.930275+0000","last_peered":"2024-04-14T23:35:48.930275+0000","last_clean":"2024-04-14T23:35:48.930275+0000","last_became_active":"2024-04-14T23:35:46.136103+0000","last_became_peered":"2024-04-14T23:35:46.136103+0000","last_unstale":"2024-04-14T23:35:48.930275+0000","last_undegraded":"2024-04-14T23:35:48.930275+0000","last_fullsized":"2024-04-14T23:35:48.930275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:33:11.340513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929988+0000","last_change":"2024-04-14T23:35:47.146919+0000","last_active":"2024-04-14T23:35:48.929988+0000","last_peered":"2024-04-14T23:35:48.929988+0000","last_clean":"2024-04-14T23:35:48.929988+0000","last_became_active":"2024-04-14T23:35:47.146080+0000","last_became_peered":"2024-04-14T23:35:47.146080+0000","last_unstale":"2024-04-14T23:35:48.929988+0000","last_undegraded":"2024-04-14T23:35:48.929988+0000","last_fullsized":"2024-04-14T23:35:48.929988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:46:40.745944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930583+0000","last_change":"2024-04-14T23:35:46.132858+0000","last_active":"2024-04-14T23:35:48.930583+0000","last_peered":"2024-04-14T23:35:48.930583+0000","last_clean":"2024-04-14T23:35:48.930583+0000","last_became_active":"2024-04-14T23:35:46.132542+0000","last_became_peered":"2024-04-14T23:35:46.132542+0000","last_unstale":"2024-04-14T23:35:48.930583+0000","last_undegraded":"2024-04-14T23:35:48.930583+0000","last_fullsized":"2024-04-14T23:35:48.930583+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:51:12.197819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:50.385154+0000","last_change":"2024-04-14T23:35:47.154850+0000","last_active":"2024-04-14T23:35:50.385154+0000","last_peered":"2024-04-14T23:35:50.385154+0000","last_clean":"2024-04-14T23:35:50.385154+0000","last_became_active":"2024-04-14T23:35:47.154568+0000","last_became_peered":"2024-04-14T23:35:47.154568+0000","last_unstale":"2024-04-14T23:35:50.385154+0000","last_undegraded":"2024-04-14T23:35:50.385154+0000","last_fullsized":"2024-04-14T23:35:50.385154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930191+0000","last_change":"2024-04-14T23:35:46.131620+0000","last_active":"2024-04-14T23:35:48.930191+0000","last_peered":"2024-04-14T23:35:48.930191+0000","last_clean":"2024-04-14T23:35:48.930191+0000","last_became_active":"2024-04-14T23:35:46.131245+0000","last_became_peered":"2024-04-14T23:35:46.131245+0000","last_unstale":"2024-04-14T23:35:48.930191+0000","last_undegraded":"2024-04-14T23:35:48.930191+0000","last_fullsized":"2024-04-14T23:35:48.930191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:43:31.510170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.129762+0000","last_change":"2024-04-14T23:35:47.149519+0000","last_active":"2024-04-14T23:35:48.129762+0000","last_peered":"2024-04-14T23:35:48.129762+0000","last_clean":"2024-04-14T23:35:48.129762+0000","last_became_active":"2024-04-14T23:35:47.149206+0000","last_became_peered":"2024-04-14T23:35:47.149206+0000","last_unstale":"2024-04-14T23:35:48.129762+0000","last_undegraded":"2024-04-14T23:35:48.129762+0000","last_fullsized":"2024-04-14T23:35:48.129762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:58:12.447703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929811+0000","last_change":"2024-04-14T23:35:46.136409+0000","last_active":"2024-04-14T23:35:48.929811+0000","last_peered":"2024-04-14T23:35:48.929811+0000","last_clean":"2024-04-14T23:35:48.929811+0000","last_became_active":"2024-04-14T23:35:46.136141+0000","last_became_peered":"2024-04-14T23:35:46.136141+0000","last_unstale":"2024-04-14T23:35:48.929811+0000","last_undegraded":"2024-04-14T23:35:48.929811+0000","last_fullsized":"2024-04-14T23:35:48.929811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:44:50.703294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128851+0000","last_change":"2024-04-14T23:35:47.152792+0000","last_active":"2024-04-14T23:35:48.128851+0000","last_peered":"2024-04-14T23:35:48.128851+0000","last_clean":"2024-04-14T23:35:48.128851+0000","last_became_active":"2024-04-14T23:35:47.152529+0000","last_became_peered":"2024-04-14T23:35:47.152529+0000","last_unstale":"2024-04-14T23:35:48.128851+0000","last_undegraded":"2024-04-14T23:35:48.128851+0000","last_fullsized":"2024-04-14T23:35:48.128851+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:26:37.825904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930189+0000","last_change":"2024-04-14T23:35:46.131128+0000","last_active":"2024-04-14T23:35:48.930189+0000","last_peered":"2024-04-14T23:35:48.930189+0000","last_clean":"2024-04-14T23:35:48.930189+0000","last_became_active":"2024-04-14T23:35:46.130829+0000","last_became_peered":"2024-04-14T23:35:46.130829+0000","last_unstale":"2024-04-14T23:35:48.930189+0000","last_undegraded":"2024-04-14T23:35:48.930189+0000","last_fullsized":"2024-04-14T23:35:48.930189+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:26:22.509424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930226+0000","last_change":"2024-04-14T23:35:47.157604+0000","last_active":"2024-04-14T23:35:48.930226+0000","last_peered":"2024-04-14T23:35:48.930226+0000","last_clean":"2024-04-14T23:35:48.930226+0000","last_became_active":"2024-04-14T23:35:47.157332+0000","last_became_peered":"2024-04-14T23:35:47.157332+0000","last_unstale":"2024-04-14T23:35:48.930226+0000","last_undegraded":"2024-04-14T23:35:48.930226+0000","last_fullsized":"2024-04-14T23:35:48.930226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:27.967946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130676+0000","last_change":"2024-04-14T23:35:46.130670+0000","last_active":"2024-04-14T23:35:48.130676+0000","last_peered":"2024-04-14T23:35:48.130676+0000","last_clean":"2024-04-14T23:35:48.130676+0000","last_became_active":"2024-04-14T23:35:46.130053+0000","last_became_peered":"2024-04-14T23:35:46.130053+0000","last_unstale":"2024-04-14T23:35:48.130676+0000","last_undegraded":"2024-04-14T23:35:48.130676+0000","last_fullsized":"2024-04-14T23:35:48.130676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:16:11.829667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930021+0000","last_change":"2024-04-14T23:35:47.135664+0000","last_active":"2024-04-14T23:35:48.930021+0000","last_peered":"2024-04-14T23:35:48.930021+0000","last_clean":"2024-04-14T23:35:48.930021+0000","last_became_active":"2024-04-14T23:35:47.135290+0000","last_became_peered":"2024-04-14T23:35:47.135290+0000","last_unstale":"2024-04-14T23:35:48.930021+0000","last_undegraded":"2024-04-14T23:35:48.930021+0000","last_fullsized":"2024-04-14T23:35:48.930021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:18.147979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:59.132486+0000","last_change":"2024-04-14T23:35:46.133201+0000","last_active":"2024-04-14T23:35:59.132486+0000","last_peered":"2024-04-14T23:35:59.132486+0000","last_clean":"2024-04-14T23:35:59.132486+0000","last_became_active":"2024-04-14T23:35:46.132894+0000","last_became_peered":"2024-04-14T23:35:46.132894+0000","last_unstale":"2024-04-14T23:35:59.132486+0000","last_undegraded":"2024-04-14T23:35:59.132486+0000","last_fullsized":"2024-04-14T23:35:59.132486+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:23:21.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128887+0000","last_change":"2024-04-14T23:35:47.153255+0000","last_active":"2024-04-14T23:35:48.128887+0000","last_peered":"2024-04-14T23:35:48.128887+0000","last_clean":"2024-04-14T23:35:48.128887+0000","last_became_active":"2024-04-14T23:35:47.152994+0000","last_became_peered":"2024-04-14T23:35:47.152994+0000","last_unstale":"2024-04-14T23:35:48.128887+0000","last_undegraded":"2024-04-14T23:35:48.128887+0000","last_fullsized":"2024-04-14T23:35:48.128887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:32:36.376204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930019+0000","last_change":"2024-04-14T23:35:46.129019+0000","last_active":"2024-04-14T23:35:48.930019+0000","last_peered":"2024-04-14T23:35:48.930019+0000","last_clean":"2024-04-14T23:35:48.930019+0000","last_became_active":"2024-04-14T23:35:46.128736+0000","last_became_peered":"2024-04-14T23:35:46.128736+0000","last_unstale":"2024-04-14T23:35:48.930019+0000","last_undegraded":"2024-04-14T23:35:48.930019+0000","last_fullsized":"2024-04-14T23:35:48.930019+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:50.385147+0000","last_change":"2024-04-14T23:35:47.146466+0000","last_active":"2024-04-14T23:35:50.385147+0000","last_peered":"2024-04-14T23:35:50.385147+0000","last_clean":"2024-04-14T23:35:50.385147+0000","last_became_active":"2024-04-14T23:35:47.146038+0000","last_became_peered":"2024-04-14T23:35:47.146038+0000","last_unstale":"2024-04-14T23:35:50.385147+0000","last_undegraded":"2024-04-14T23:35:50.385147+0000","last_fullsized":"2024-04-14T23:35:50.385147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929869+0000","last_change":"2024-04-14T23:35:46.137505+0000","last_active":"2024-04-14T23:35:48.929869+0000","last_peered":"2024-04-14T23:35:48.929869+0000","last_clean":"2024-04-14T23:35:48.929869+0000","last_became_active":"2024-04-14T23:35:46.137073+0000","last_became_peered":"2024-04-14T23:35:46.137073+0000","last_unstale":"2024-04-14T23:35:48.929869+0000","last_undegraded":"2024-04-14T23:35:48.929869+0000","last_fullsized":"2024-04-14T23:35:48.929869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929904+0000","last_change":"2024-04-14T23:35:47.144646+0000","last_active":"2024-04-14T23:35:48.929904+0000","last_peered":"2024-04-14T23:35:48.929904+0000","last_clean":"2024-04-14T23:35:48.929904+0000","last_became_active":"2024-04-14T23:35:47.144302+0000","last_became_peered":"2024-04-14T23:35:47.144302+0000","last_unstale":"2024-04-14T23:35:48.929904+0000","last_undegraded":"2024-04-14T23:35:48.929904+0000","last_fullsized":"2024-04-14T23:35:48.929904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:38.502135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130300+0000","last_change":"2024-04-14T23:35:46.132200+0000","last_active":"2024-04-14T23:35:48.130300+0000","last_peered":"2024-04-14T23:35:48.130300+0000","last_clean":"2024-04-14T23:35:48.130300+0000","last_became_active":"2024-04-14T23:35:46.131951+0000","last_became_peered":"2024-04-14T23:35:46.131951+0000","last_unstale":"2024-04-14T23:35:48.130300+0000","last_undegraded":"2024-04-14T23:35:48.130300+0000","last_fullsized":"2024-04-14T23:35:48.130300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:50:42.618031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390704+0000","last_change":"2024-04-14T23:35:47.152240+0000","last_active":"2024-04-14T23:35:48.390704+0000","last_peered":"2024-04-14T23:35:48.390704+0000","last_clean":"2024-04-14T23:35:48.390704+0000","last_became_active":"2024-04-14T23:35:47.151949+0000","last_became_peered":"2024-04-14T23:35:47.151949+0000","last_unstale":"2024-04-14T23:35:48.390704+0000","last_undegraded":"2024-04-14T23:35:48.390704+0000","last_fullsized":"2024-04-14T23:35:48.390704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:24:55.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.390467+0000","last_change":"2024-04-14T23:35:46.133774+0000","last_active":"2024-04-14T23:35:48.390467+0000","last_peered":"2024-04-14T23:35:48.390467+0000","last_clean":"2024-04-14T23:35:48.390467+0000","last_became_active":"2024-04-14T23:35:46.133248+0000","last_became_peered":"2024-04-14T23:35:46.133248+0000","last_unstale":"2024-04-14T23:35:48.390467+0000","last_undegraded":"2024-04-14T23:35:48.390467+0000","last_fullsized":"2024-04-14T23:35:48.390467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:10:15.375417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.930207+0000","last_change":"2024-04-14T23:35:47.137101+0000","last_active":"2024-04-14T23:35:48.930207+0000","last_peered":"2024-04-14T23:35:48.930207+0000","last_clean":"2024-04-14T23:35:48.930207+0000","last_became_active":"2024-04-14T23:35:47.135299+0000","last_became_peered":"2024-04-14T23:35:47.135299+0000","last_unstale":"2024-04-14T23:35:48.930207+0000","last_undegraded":"2024-04-14T23:35:48.930207+0000","last_fullsized":"2024-04-14T23:35:48.930207+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:13:37.995199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.128481+0000","last_change":"2024-04-14T23:35:46.130340+0000","last_active":"2024-04-14T23:35:48.128481+0000","last_peered":"2024-04-14T23:35:48.128481+0000","last_clean":"2024-04-14T23:35:48.128481+0000","last_became_active":"2024-04-14T23:35:46.129730+0000","last_became_peered":"2024-04-14T23:35:46.129730+0000","last_unstale":"2024-04-14T23:35:48.128481+0000","last_undegraded":"2024-04-14T23:35:48.128481+0000","last_fullsized":"2024-04-14T23:35:48.128481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:13:37.497838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.130505+0000","last_change":"2024-04-14T23:35:47.158482+0000","last_active":"2024-04-14T23:35:48.130505+0000","last_peered":"2024-04-14T23:35:48.130505+0000","last_clean":"2024-04-14T23:35:48.130505+0000","last_became_active":"2024-04-14T23:35:47.158231+0000","last_became_peered":"2024-04-14T23:35:47.158231+0000","last_unstale":"2024-04-14T23:35:48.130505+0000","last_undegraded":"2024-04-14T23:35:48.130505+0000","last_fullsized":"2024-04-14T23:35:48.130505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:46.111685+0000","last_clean_scrub_stamp":"2024-04-14T23:35:46.111685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:28:35.505841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929927+0000","last_change":"2024-04-14T23:35:46.136429+0000","last_active":"2024-04-14T23:35:48.929927+0000","last_peered":"2024-04-14T23:35:48.929927+0000","last_clean":"2024-04-14T23:35:48.929927+0000","last_became_active":"2024-04-14T23:35:46.136181+0000","last_became_peered":"2024-04-14T23:35:46.136181+0000","last_unstale":"2024-04-14T23:35:48.929927+0000","last_undegraded":"2024-04-14T23:35:48.929927+0000","last_fullsized":"2024-04-14T23:35:48.929927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:35:45.107388+0000","last_clean_scrub_stamp":"2024-04-14T23:35:45.107388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:58:35.171753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T23:35:48.929803+0000","last_change":"2024-04-14T23:34:27.438796+0000","last_active":"2024-04-14T23:35:48.929803+0000","last_peered":"2024-04-14T23:35:48.929803+0000","last_clean":"2024-04-14T23:35:48.929803+0000","last_became_active":"2024-04-14T23:34:27.437932+0000","last_became_peered":"2024-04-14T23:34:27.437932+0000","last_unstale":"2024-04-14T23:35:48.929803+0000","last_undegraded":"2024-04-14T23:35:48.929803+0000","last_fullsized":"2024-04-14T23:35:48.929803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:34:26.390323+0000","last_clean_scrub_stamp":"2024-04-14T23:34:26.390323+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:11:13.484245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1064960,"data_stored":794756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":458752,"data_stored":197285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":471040,"data_stored":204352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":454656,"data_stored":197243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":197263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":787575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T23:36:08.722 INFO:tasks.ceph:pgid 6.3f last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.723 INFO:tasks.ceph:pgid 6.3e last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.723 INFO:tasks.ceph:pgid 6.3d last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.723 INFO:tasks.ceph:pgid 6.3c last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.723 INFO:tasks.ceph:pgid 6.3b last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.723 INFO:tasks.ceph:pgid 6.3a last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.723 INFO:tasks.ceph:pgid 6.39 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.724 INFO:tasks.ceph:pgid 6.38 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.724 INFO:tasks.ceph:pgid 6.37 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.724 INFO:tasks.ceph:pgid 6.36 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.724 INFO:tasks.ceph:pgid 6.35 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.724 INFO:tasks.ceph:pgid 6.34 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.724 INFO:tasks.ceph:pgid 6.33 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.724 INFO:tasks.ceph:pgid 6.32 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.725 INFO:tasks.ceph:pgid 6.31 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.725 INFO:tasks.ceph:pgid 6.30 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.725 INFO:tasks.ceph:pgid 6.2f last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.725 INFO:tasks.ceph:pgid 6.2e last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.725 INFO:tasks.ceph:pgid 6.2d last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.725 INFO:tasks.ceph:pgid 6.2c last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.726 INFO:tasks.ceph:pgid 6.2b last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.726 INFO:tasks.ceph:pgid 6.2a last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.726 INFO:tasks.ceph:pgid 6.29 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.726 INFO:tasks.ceph:pgid 6.28 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.726 INFO:tasks.ceph:pgid 6.27 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.726 INFO:tasks.ceph:pgid 6.26 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.726 INFO:tasks.ceph:pgid 6.25 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.727 INFO:tasks.ceph:pgid 6.24 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.727 INFO:tasks.ceph:pgid 6.23 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.727 INFO:tasks.ceph:pgid 6.22 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.727 INFO:tasks.ceph:pgid 6.21 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.727 INFO:tasks.ceph:pgid 6.20 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.727 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.727 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.728 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.728 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.728 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.728 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.728 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.728 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.728 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.729 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.729 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.729 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.729 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.729 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.729 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.729 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.730 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.730 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.730 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.730 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.730 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.730 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.730 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.731 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.731 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.731 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.731 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.731 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.731 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.732 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.732 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.732 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.732 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.732 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.732 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.732 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.733 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.733 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.733 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.733 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.733 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.733 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.733 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.734 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.734 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.734 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.734 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.734 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.734 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.735 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.735 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.735 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.735 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.735 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.735 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.735 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.736 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.736 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.736 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.736 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.736 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.736 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.737 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-14T23:35:46.111685+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=46, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.737 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-14T23:35:45.107388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=35, tm_sec=45, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.737 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-14T23:34:26.390323+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=34, tm_sec=26, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=23, tm_min=36, tm_sec=3, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T23:36:08.737 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-14T23:36:10.083 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T23:36:10.087 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T23:36:28.738 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T23:36:28.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.849+0000 7f5de8d55640 1 Processor -- start 2024-04-14T23:36:28.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.849+0000 7f5de8d55640 1 -- start start 2024-04-14T23:36:28.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.850+0000 7f5de8d55640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5de4144a80 0x7f5de406ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:28.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.850+0000 7f5de8d55640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de406d970 con 0x7f5de40b2a70 2024-04-14T23:36:28.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.850+0000 7f5de8d55640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de406dc50 con 0x7f5de40b35d0 2024-04-14T23:36:28.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.850+0000 7f5de8d55640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f5de406d720 con 0x7f5de4144a80 2024-04-14T23:36:28.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.850+0000 7f5de1d9b640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5de40b2a70 0x7f5de40b2ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:39832/0 (socket says 172.21.15.47:39832) 2024-04-14T23:36:28.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.850+0000 7f5de1d9b640 1 -- 172.21.15.47:0/2379205077 learned_addr learned my addr 172.21.15.47:0/2379205077 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:28.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.850+0000 7f5de259c640 1 --2- 172.21.15.47:0/2379205077 >> v2:172.21.15.191:3300/0 conn(0x7f5de4144a80 0x7f5de406ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:28.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.850+0000 7f5de159a640 1 -- 172.21.15.47:0/2379205077 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787487915 0 0) 0x7f5de406d970 con 0x7f5de40b2a70 2024-04-14T23:36:28.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.850+0000 7f5de159a640 1 -- 172.21.15.47:0/2379205077 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dcc003520 con 0x7f5de40b2a70 2024-04-14T23:36:28.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de159a640 1 -- 172.21.15.47:0/2379205077 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3960431106 0 0) 0x7f5dcc003520 con 0x7f5de40b2a70 2024-04-14T23:36:28.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de159a640 1 -- 172.21.15.47:0/2379205077 >> v2:172.21.15.191:3300/0 conn(0x7f5de4144a80 msgr2=0x7f5de406ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:28.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de159a640 1 --2- 172.21.15.47:0/2379205077 >> v2:172.21.15.191:3300/0 conn(0x7f5de4144a80 0x7f5de406ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:28.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de159a640 1 -- 172.21.15.47:0/2379205077 >> v1:172.21.15.191:6789/0 conn(0x7f5de40b35d0 legacy=0x7f5de40ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:28.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de159a640 1 -- 172.21.15.47:0/2379205077 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de406df30 con 0x7f5de40b2a70 2024-04-14T23:36:28.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de159a640 1 -- 172.21.15.47:0/2379205077 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f5dd8001670 con 0x7f5de40b2a70 2024-04-14T23:36:28.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de159a640 1 -- 172.21.15.47:0/2379205077 >> v1:172.21.15.47:6789/0 conn(0x7f5de40b2a70 legacy=0x7f5de40b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:28.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de159a640 1 --2- 172.21.15.47:0/2379205077 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5dcc0039b0 0x7f5dcc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:28.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de159a640 1 --2- 172.21.15.47:0/2379205077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5dcc0043b0 0x7f5dcc004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:28.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de159a640 1 --2- 172.21.15.47:0/2379205077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5dcc005080 0x7f5dcc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:28.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de159a640 1 -- 172.21.15.47:0/2379205077 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5de406d720 con 0x7f5dcc005080 2024-04-14T23:36:28.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de159a640 1 -- 172.21.15.47:0/2379205077 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc00bfe0 con 0x7f5dcc0043b0 2024-04-14T23:36:28.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de159a640 1 -- 172.21.15.47:0/2379205077 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5dcc00c1e0 con 0x7f5dcc0039b0 2024-04-14T23:36:28.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de2d9d640 1 --2- 172.21.15.47:0/2379205077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5dcc005080 0x7f5dcc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:28.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de1d9b640 1 --2- 172.21.15.47:0/2379205077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5dcc0043b0 0x7f5dcc004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:28.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de259c640 1 --2- 172.21.15.47:0/2379205077 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5dcc0039b0 0x7f5dcc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:28.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de2d9d640 1 -- 172.21.15.47:0/2379205077 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5dcc0039b0 msgr2=0x7f5dcc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:28.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de2d9d640 1 --2- 172.21.15.47:0/2379205077 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5dcc0039b0 0x7f5dcc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:28.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de2d9d640 1 -- 172.21.15.47:0/2379205077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5dcc0043b0 msgr2=0x7f5dcc004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:28.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de2d9d640 1 --2- 172.21.15.47:0/2379205077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5dcc0043b0 0x7f5dcc004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:28.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.851+0000 7f5de2d9d640 1 -- 172.21.15.47:0/2379205077 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc003520 con 0x7f5dcc005080 2024-04-14T23:36:28.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.852+0000 7f5de2d9d640 1 -- 172.21.15.47:0/2379205077 reap_dead start 2024-04-14T23:36:28.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.852+0000 7f5de2d9d640 1 --2- 172.21.15.47:0/2379205077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5dcc005080 0x7f5dcc00b9c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4001f60 tx=0x7f5dcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34d55aea736792c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:28.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.852+0000 7f5de159a640 1 -- 172.21.15.47:0/2379205077 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4001b30 con 0x7f5dcc005080 2024-04-14T23:36:28.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.852+0000 7f5de159a640 1 -- 172.21.15.47:0/2379205077 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd4003b90 con 0x7f5dcc005080 2024-04-14T23:36:28.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.852+0000 7f5de159a640 1 -- 172.21.15.47:0/2379205077 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4005070 con 0x7f5dcc005080 2024-04-14T23:36:28.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.853+0000 7f5de8d55640 1 -- 172.21.15.47:0/2379205077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5dcc005080 msgr2=0x7f5dcc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:28.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.853+0000 7f5de8d55640 1 --2- 172.21.15.47:0/2379205077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5dcc005080 0x7f5dcc00b9c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4001f60 tx=0x7f5dcc005830 comp rx=0 tx=0).stop 2024-04-14T23:36:28.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.853+0000 7f5de8d55640 1 -- 172.21.15.47:0/2379205077 shutdown_connections 2024-04-14T23:36:28.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.853+0000 7f5de8d55640 1 --2- 172.21.15.47:0/2379205077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5dcc005080 0x7f5dcc00b9c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:28.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.853+0000 7f5de8d55640 1 -- 172.21.15.47:0/2379205077 >> 172.21.15.47:0/2379205077 conn(0x7f5de406b200 msgr2=0x7f5de406b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:28.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.853+0000 7f5de8d55640 1 -- 172.21.15.47:0/2379205077 shutdown_connections 2024-04-14T23:36:28.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.853+0000 7f5de8d55640 1 -- 172.21.15.47:0/2379205077 wait complete. 2024-04-14T23:36:28.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.854+0000 7f5de8d55640 1 Processor -- start 2024-04-14T23:36:28.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.854+0000 7f5de8d55640 1 -- start start 2024-04-14T23:36:28.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.855+0000 7f5de8d55640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5dcc005080 0x7f5de415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:28.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.855+0000 7f5de8d55640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5de41361d0 0x7f5de40b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:28.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.855+0000 7f5de8d55640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5de4136650 0x7f5de40b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:28.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.855+0000 7f5de8d55640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5de406ea80 con 0x7f5dcc005080 2024-04-14T23:36:28.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.855+0000 7f5de8d55640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5de4144e60 con 0x7f5de4136650 2024-04-14T23:36:28.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.855+0000 7f5de8d55640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5de406ec00 con 0x7f5de41361d0 2024-04-14T23:36:28.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.855+0000 7f5de259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5dcc005080 0x7f5de415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:28.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.855+0000 7f5de259c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5dcc005080 0x7f5de415b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37706/0 (socket says 172.21.15.47:37706) 2024-04-14T23:36:28.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.855+0000 7f5de259c640 1 -- 172.21.15.47:0/994253351 learned_addr learned my addr 172.21.15.47:0/994253351 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:28.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.855+0000 7f5de1d9b640 1 --2- 172.21.15.47:0/994253351 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5de41361d0 0x7f5de40b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:28.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.855+0000 7f5de2d9d640 1 --2- 172.21.15.47:0/994253351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5de4136650 0x7f5de40b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:28.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.855+0000 7f5de259c640 1 -- 172.21.15.47:0/994253351 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5de41361d0 msgr2=0x7f5de40b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:28.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.856+0000 7f5de259c640 1 --2- 172.21.15.47:0/994253351 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5de41361d0 0x7f5de40b06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:28.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.856+0000 7f5de259c640 1 -- 172.21.15.47:0/994253351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5de4136650 msgr2=0x7f5de40b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:28.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.856+0000 7f5de259c640 1 --2- 172.21.15.47:0/994253351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5de4136650 0x7f5de40b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:28.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.856+0000 7f5de259c640 1 -- 172.21.15.47:0/994253351 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de4137170 con 0x7f5dcc005080 2024-04-14T23:36:28.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.856+0000 7f5de2d9d640 1 --2- 172.21.15.47:0/994253351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5de4136650 0x7f5de40b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:36:28.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.856+0000 7f5de259c640 1 --2- 172.21.15.47:0/994253351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5dcc005080 0x7f5de415b5e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc011910 tx=0x7f5ddc011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:28.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.856+0000 7f5dd2ffd640 1 -- 172.21.15.47:0/994253351 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc00fa30 con 0x7f5dcc005080 2024-04-14T23:36:28.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.856+0000 7f5dd2ffd640 1 -- 172.21.15.47:0/994253351 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ddc00fbd0 con 0x7f5dcc005080 2024-04-14T23:36:28.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.856+0000 7f5de8d55640 1 -- 172.21.15.47:0/994253351 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de4136bb0 con 0x7f5dcc005080 2024-04-14T23:36:28.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.856+0000 7f5dd2ffd640 1 -- 172.21.15.47:0/994253351 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc014440 con 0x7f5dcc005080 2024-04-14T23:36:28.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.856+0000 7f5de8d55640 1 -- 172.21.15.47:0/994253351 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de41378c0 con 0x7f5dcc005080 2024-04-14T23:36:28.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.857+0000 7f5de8d55640 1 -- 172.21.15.47:0/994253351 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de4075430 con 0x7f5dcc005080 2024-04-14T23:36:28.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.858+0000 7f5dd2ffd640 1 -- 172.21.15.47:0/994253351 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f5ddc012040 con 0x7f5dcc005080 2024-04-14T23:36:28.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.858+0000 7f5dd2ffd640 1 --2- 172.21.15.47:0/994253351 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5dc406b990 0x7f5dc406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:28.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.858+0000 7f5dd2ffd640 1 -- 172.21.15.47:0/994253351 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f5ddc08af60 con 0x7f5dcc005080 2024-04-14T23:36:28.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.858+0000 7f5de1d9b640 1 --2- 172.21.15.47:0/994253351 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5dc406b990 0x7f5dc406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:28.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.859+0000 7f5de1d9b640 1 --2- 172.21.15.47:0/994253351 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5dc406b990 0x7f5dc406de50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8001050 tx=0x7f5dd80078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:28.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:28.863+0000 7f5dd2ffd640 1 -- 172.21.15.47:0/994253351 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5ddc019030 con 0x7f5dcc005080 2024-04-14T23:36:29.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.040+0000 7f5de8d55640 1 -- 172.21.15.47:0/994253351 --> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5de406b780 con 0x7f5dc406b990 2024-04-14T23:36:29.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.047+0000 7f5dd2ffd640 1 -- 172.21.15.47:0/994253351 <== mgr.4102 v2:172.21.15.191:6832/2137390424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251932 (secure 0 0 0) 0x7f5de406b780 con 0x7f5dc406b990 2024-04-14T23:36:29.054 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:36:29.055 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-14T23:36:29.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.050+0000 7f5de8d55640 1 -- 172.21.15.47:0/994253351 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5dc406b990 msgr2=0x7f5dc406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:29.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.050+0000 7f5de8d55640 1 --2- 172.21.15.47:0/994253351 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5dc406b990 0x7f5dc406de50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8001050 tx=0x7f5dd80078f0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.050+0000 7f5de8d55640 1 -- 172.21.15.47:0/994253351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5dcc005080 msgr2=0x7f5de415b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:29.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.050+0000 7f5de8d55640 1 --2- 172.21.15.47:0/994253351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5dcc005080 0x7f5de415b5e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc011910 tx=0x7f5ddc011d10 comp rx=0 tx=0).stop 2024-04-14T23:36:29.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.050+0000 7f5de8d55640 1 -- 172.21.15.47:0/994253351 shutdown_connections 2024-04-14T23:36:29.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.050+0000 7f5de8d55640 1 --2- 172.21.15.47:0/994253351 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f5dc406b990 0x7f5dc406de50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.050+0000 7f5de8d55640 1 --2- 172.21.15.47:0/994253351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5de4136650 0x7f5de40b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.050+0000 7f5de8d55640 1 --2- 172.21.15.47:0/994253351 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5de41361d0 0x7f5de40b06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.050+0000 7f5de8d55640 1 --2- 172.21.15.47:0/994253351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5dcc005080 0x7f5de415b5e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.050+0000 7f5de8d55640 1 -- 172.21.15.47:0/994253351 >> 172.21.15.47:0/994253351 conn(0x7f5de406b200 msgr2=0x7f5de40ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:29.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.050+0000 7f5de8d55640 1 -- 172.21.15.47:0/994253351 shutdown_connections 2024-04-14T23:36:29.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.050+0000 7f5de8d55640 1 -- 172.21.15.47:0/994253351 wait complete. 2024-04-14T23:36:29.067 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-04-14T23:36:28.384390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237760,"kb_used_data":4944,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736960,"statfs":{"total":773094113280,"available":772850647040,"internally_reserved":0,"allocated":5062656,"data_stored":2875582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.879930"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.515011+0000","last_change":"2024-04-14T23:36:13.029370+0000","last_active":"2024-04-14T23:36:20.515011+0000","last_peered":"2024-04-14T23:36:20.515011+0000","last_clean":"2024-04-14T23:36:20.515011+0000","last_became_active":"2024-04-14T23:35:47.145716+0000","last_became_peered":"2024-04-14T23:35:47.145716+0000","last_unstale":"2024-04-14T23:36:20.515011+0000","last_undegraded":"2024-04-14T23:36:20.515011+0000","last_fullsized":"2024-04-14T23:36:20.515011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:13.029213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:13.029213+0000","last_clean_scrub_stamp":"2024-04-14T23:36:13.029213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:40:39.309360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.514897+0000","last_change":"2024-04-14T23:36:20.218215+0000","last_active":"2024-04-14T23:36:20.514897+0000","last_peered":"2024-04-14T23:36:20.514897+0000","last_clean":"2024-04-14T23:36:20.514897+0000","last_became_active":"2024-04-14T23:35:47.154286+0000","last_became_peered":"2024-04-14T23:35:47.154286+0000","last_unstale":"2024-04-14T23:36:20.514897+0000","last_undegraded":"2024-04-14T23:36:20.514897+0000","last_fullsized":"2024-04-14T23:36:20.514897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:20.218058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:20.218058+0000","last_clean_scrub_stamp":"2024-04-14T23:36:20.218058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:00:15.872122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.629295+0000","last_change":"2024-04-14T23:36:20.629295+0000","last_active":"2024-04-14T23:36:20.629295+0000","last_peered":"2024-04-14T23:36:20.629295+0000","last_clean":"2024-04-14T23:36:20.629295+0000","last_became_active":"2024-04-14T23:36:20.628941+0000","last_became_peered":"2024-04-14T23:36:20.628941+0000","last_unstale":"2024-04-14T23:36:20.629295+0000","last_undegraded":"2024-04-14T23:36:20.629295+0000","last_fullsized":"2024-04-14T23:36:20.629295+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:14.956813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:14.956813+0000","last_clean_scrub_stamp":"2024-04-14T23:36:14.956813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:18:55.315435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627707+0000","last_change":"2024-04-14T23:36:15.870566+0000","last_active":"2024-04-14T23:36:20.627707+0000","last_peered":"2024-04-14T23:36:20.627707+0000","last_clean":"2024-04-14T23:36:20.627707+0000","last_became_active":"2024-04-14T23:35:47.153133+0000","last_became_peered":"2024-04-14T23:35:47.153133+0000","last_unstale":"2024-04-14T23:36:20.627707+0000","last_undegraded":"2024-04-14T23:36:20.627707+0000","last_fullsized":"2024-04-14T23:36:20.627707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:15.870447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:15.870447+0000","last_clean_scrub_stamp":"2024-04-14T23:36:15.870447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:29:41.351541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627579+0000","last_change":"2024-04-14T23:36:16.846778+0000","last_active":"2024-04-14T23:36:20.627579+0000","last_peered":"2024-04-14T23:36:20.627579+0000","last_clean":"2024-04-14T23:36:20.627579+0000","last_became_active":"2024-04-14T23:35:47.153936+0000","last_became_peered":"2024-04-14T23:35:47.153936+0000","last_unstale":"2024-04-14T23:36:20.627579+0000","last_undegraded":"2024-04-14T23:36:20.627579+0000","last_fullsized":"2024-04-14T23:36:20.627579+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:16.846670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:16.846670+0000","last_clean_scrub_stamp":"2024-04-14T23:36:16.846670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:20:02.271380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627732+0000","last_change":"2024-04-14T23:36:10.522461+0000","last_active":"2024-04-14T23:36:20.627732+0000","last_peered":"2024-04-14T23:36:20.627732+0000","last_clean":"2024-04-14T23:36:20.627732+0000","last_became_active":"2024-04-14T23:35:47.143142+0000","last_became_peered":"2024-04-14T23:35:47.143142+0000","last_unstale":"2024-04-14T23:36:20.627732+0000","last_undegraded":"2024-04-14T23:36:20.627732+0000","last_fullsized":"2024-04-14T23:36:20.627732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:10.522349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:10.522349+0000","last_clean_scrub_stamp":"2024-04-14T23:36:10.522349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:46:07.471410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:22.275152+0000","last_change":"2024-04-14T23:36:22.275180+0000","last_active":"2024-04-14T23:36:22.275152+0000","last_peered":"2024-04-14T23:36:22.275152+0000","last_clean":"2024-04-14T23:36:22.275152+0000","last_became_active":"2024-04-14T23:35:47.157644+0000","last_became_peered":"2024-04-14T23:35:47.157644+0000","last_unstale":"2024-04-14T23:36:22.275152+0000","last_undegraded":"2024-04-14T23:36:22.275152+0000","last_fullsized":"2024-04-14T23:36:22.275152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:22.275075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:22.275075+0000","last_clean_scrub_stamp":"2024-04-14T23:36:22.275075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:02:16.868957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.514432+0000","last_change":"2024-04-14T23:36:16.067089+0000","last_active":"2024-04-14T23:36:20.514432+0000","last_peered":"2024-04-14T23:36:20.514432+0000","last_clean":"2024-04-14T23:36:20.514432+0000","last_became_active":"2024-04-14T23:35:47.150520+0000","last_became_peered":"2024-04-14T23:35:47.150520+0000","last_unstale":"2024-04-14T23:36:20.514432+0000","last_undegraded":"2024-04-14T23:36:20.514432+0000","last_fullsized":"2024-04-14T23:36:20.514432+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:16.066954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:16.066954+0000","last_clean_scrub_stamp":"2024-04-14T23:36:16.066954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:02:10.660836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.517120+0000","last_change":"2024-04-14T23:36:15.959869+0000","last_active":"2024-04-14T23:36:20.517120+0000","last_peered":"2024-04-14T23:36:20.517120+0000","last_clean":"2024-04-14T23:36:20.517120+0000","last_became_active":"2024-04-14T23:35:47.160554+0000","last_became_peered":"2024-04-14T23:35:47.160554+0000","last_unstale":"2024-04-14T23:36:20.517120+0000","last_undegraded":"2024-04-14T23:36:20.517120+0000","last_fullsized":"2024-04-14T23:36:20.517120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:15.959735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:15.959735+0000","last_clean_scrub_stamp":"2024-04-14T23:36:15.959735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:21:17.015653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:21.239817+0000","last_change":"2024-04-14T23:36:21.239842+0000","last_active":"2024-04-14T23:36:21.239817+0000","last_peered":"2024-04-14T23:36:21.239817+0000","last_clean":"2024-04-14T23:36:21.239817+0000","last_became_active":"2024-04-14T23:35:47.157377+0000","last_became_peered":"2024-04-14T23:35:47.157377+0000","last_unstale":"2024-04-14T23:36:21.239817+0000","last_undegraded":"2024-04-14T23:36:21.239817+0000","last_fullsized":"2024-04-14T23:36:21.239817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:21.239723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:21.239723+0000","last_clean_scrub_stamp":"2024-04-14T23:36:21.239723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:38:03.686657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627930+0000","last_change":"2024-04-14T23:36:17.207507+0000","last_active":"2024-04-14T23:36:20.627930+0000","last_peered":"2024-04-14T23:36:20.627930+0000","last_clean":"2024-04-14T23:36:20.627930+0000","last_became_active":"2024-04-14T23:35:47.152649+0000","last_became_peered":"2024-04-14T23:35:47.152649+0000","last_unstale":"2024-04-14T23:36:20.627930+0000","last_undegraded":"2024-04-14T23:36:20.627930+0000","last_fullsized":"2024-04-14T23:36:20.627930+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:17.207362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:17.207362+0000","last_clean_scrub_stamp":"2024-04-14T23:36:17.207362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:39:13.744704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516916+0000","last_change":"2024-04-14T23:36:10.874260+0000","last_active":"2024-04-14T23:36:20.516916+0000","last_peered":"2024-04-14T23:36:20.516916+0000","last_clean":"2024-04-14T23:36:20.516916+0000","last_became_active":"2024-04-14T23:35:47.149130+0000","last_became_peered":"2024-04-14T23:35:47.149130+0000","last_unstale":"2024-04-14T23:36:20.516916+0000","last_undegraded":"2024-04-14T23:36:20.516916+0000","last_fullsized":"2024-04-14T23:36:20.516916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:10.874092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:10.874092+0000","last_clean_scrub_stamp":"2024-04-14T23:36:10.874092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:07:31.406639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627476+0000","last_change":"2024-04-14T23:36:18.248508+0000","last_active":"2024-04-14T23:36:20.627476+0000","last_peered":"2024-04-14T23:36:20.627476+0000","last_clean":"2024-04-14T23:36:20.627476+0000","last_became_active":"2024-04-14T23:35:47.153005+0000","last_became_peered":"2024-04-14T23:35:47.153005+0000","last_unstale":"2024-04-14T23:36:20.627476+0000","last_undegraded":"2024-04-14T23:36:20.627476+0000","last_fullsized":"2024-04-14T23:36:20.627476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:18.248406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:18.248406+0000","last_clean_scrub_stamp":"2024-04-14T23:36:18.248406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:19:35.441845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627674+0000","last_change":"2024-04-14T23:36:14.825315+0000","last_active":"2024-04-14T23:36:20.627674+0000","last_peered":"2024-04-14T23:36:20.627674+0000","last_clean":"2024-04-14T23:36:20.627674+0000","last_became_active":"2024-04-14T23:35:47.152530+0000","last_became_peered":"2024-04-14T23:35:47.152530+0000","last_unstale":"2024-04-14T23:36:20.627674+0000","last_undegraded":"2024-04-14T23:36:20.627674+0000","last_fullsized":"2024-04-14T23:36:20.627674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:14.825168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:14.825168+0000","last_clean_scrub_stamp":"2024-04-14T23:36:14.825168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:14:09.421329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627501+0000","last_change":"2024-04-14T23:36:19.284084+0000","last_active":"2024-04-14T23:36:20.627501+0000","last_peered":"2024-04-14T23:36:20.627501+0000","last_clean":"2024-04-14T23:36:20.627501+0000","last_became_active":"2024-04-14T23:35:47.157069+0000","last_became_peered":"2024-04-14T23:35:47.157069+0000","last_unstale":"2024-04-14T23:36:20.627501+0000","last_undegraded":"2024-04-14T23:36:20.627501+0000","last_fullsized":"2024-04-14T23:36:20.627501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:19.283974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:19.283974+0000","last_clean_scrub_stamp":"2024-04-14T23:36:19.283974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:40:45.564121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:21.979663+0000","last_change":"2024-04-14T23:36:21.979707+0000","last_active":"2024-04-14T23:36:21.979663+0000","last_peered":"2024-04-14T23:36:21.979663+0000","last_clean":"2024-04-14T23:36:21.979663+0000","last_became_active":"2024-04-14T23:35:47.157374+0000","last_became_peered":"2024-04-14T23:35:47.157374+0000","last_unstale":"2024-04-14T23:36:21.979663+0000","last_undegraded":"2024-04-14T23:36:21.979663+0000","last_fullsized":"2024-04-14T23:36:21.979663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:21.979543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:21.979543+0000","last_clean_scrub_stamp":"2024-04-14T23:36:21.979543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:19:39.172983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:23.015984+0000","last_change":"2024-04-14T23:36:23.016012+0000","last_active":"2024-04-14T23:36:23.015984+0000","last_peered":"2024-04-14T23:36:23.015984+0000","last_clean":"2024-04-14T23:36:23.015984+0000","last_became_active":"2024-04-14T23:35:47.160045+0000","last_became_peered":"2024-04-14T23:35:47.160045+0000","last_unstale":"2024-04-14T23:36:23.015984+0000","last_undegraded":"2024-04-14T23:36:23.015984+0000","last_fullsized":"2024-04-14T23:36:23.015984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:23.015895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:23.015895+0000","last_clean_scrub_stamp":"2024-04-14T23:36:23.015895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:54:20.038138+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516299+0000","last_change":"2024-04-14T23:36:16.665581+0000","last_active":"2024-04-14T23:36:20.516299+0000","last_peered":"2024-04-14T23:36:20.516299+0000","last_clean":"2024-04-14T23:36:20.516299+0000","last_became_active":"2024-04-14T23:35:47.150606+0000","last_became_peered":"2024-04-14T23:35:47.150606+0000","last_unstale":"2024-04-14T23:36:20.516299+0000","last_undegraded":"2024-04-14T23:36:20.516299+0000","last_fullsized":"2024-04-14T23:36:20.516299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:16.665463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:16.665463+0000","last_clean_scrub_stamp":"2024-04-14T23:36:16.665463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:27:08.379682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627871+0000","last_change":"2024-04-14T23:36:12.893955+0000","last_active":"2024-04-14T23:36:20.627871+0000","last_peered":"2024-04-14T23:36:20.627871+0000","last_clean":"2024-04-14T23:36:20.627871+0000","last_became_active":"2024-04-14T23:35:47.137234+0000","last_became_peered":"2024-04-14T23:35:47.137234+0000","last_unstale":"2024-04-14T23:36:20.627871+0000","last_undegraded":"2024-04-14T23:36:20.627871+0000","last_fullsized":"2024-04-14T23:36:20.627871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:12.893800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:12.893800+0000","last_clean_scrub_stamp":"2024-04-14T23:36:12.893800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:56:29.072499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.515924+0000","last_change":"2024-04-14T23:36:15.635012+0000","last_active":"2024-04-14T23:36:20.515924+0000","last_peered":"2024-04-14T23:36:20.515924+0000","last_clean":"2024-04-14T23:36:20.515924+0000","last_became_active":"2024-04-14T23:35:47.149754+0000","last_became_peered":"2024-04-14T23:35:47.149754+0000","last_unstale":"2024-04-14T23:36:20.515924+0000","last_undegraded":"2024-04-14T23:36:20.515924+0000","last_fullsized":"2024-04-14T23:36:20.515924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:15.634863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:15.634863+0000","last_clean_scrub_stamp":"2024-04-14T23:36:15.634863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:46:12.583924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627589+0000","last_change":"2024-04-14T23:36:13.168133+0000","last_active":"2024-04-14T23:36:20.627589+0000","last_peered":"2024-04-14T23:36:20.627589+0000","last_clean":"2024-04-14T23:36:20.627589+0000","last_became_active":"2024-04-14T23:35:47.148806+0000","last_became_peered":"2024-04-14T23:35:47.148806+0000","last_unstale":"2024-04-14T23:36:20.627589+0000","last_undegraded":"2024-04-14T23:36:20.627589+0000","last_fullsized":"2024-04-14T23:36:20.627589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:13.168032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:13.168032+0000","last_clean_scrub_stamp":"2024-04-14T23:36:13.168032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:26:39.737832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627965+0000","last_change":"2024-04-14T23:36:15.855731+0000","last_active":"2024-04-14T23:36:20.627965+0000","last_peered":"2024-04-14T23:36:20.627965+0000","last_clean":"2024-04-14T23:36:20.627965+0000","last_became_active":"2024-04-14T23:35:47.154054+0000","last_became_peered":"2024-04-14T23:35:47.154054+0000","last_unstale":"2024-04-14T23:36:20.627965+0000","last_undegraded":"2024-04-14T23:36:20.627965+0000","last_fullsized":"2024-04-14T23:36:20.627965+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:15.855621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:15.855621+0000","last_clean_scrub_stamp":"2024-04-14T23:36:15.855621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:26:42.425421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516044+0000","last_change":"2024-04-14T23:36:13.831619+0000","last_active":"2024-04-14T23:36:20.516044+0000","last_peered":"2024-04-14T23:36:20.516044+0000","last_clean":"2024-04-14T23:36:20.516044+0000","last_became_active":"2024-04-14T23:35:47.134846+0000","last_became_peered":"2024-04-14T23:35:47.134846+0000","last_unstale":"2024-04-14T23:36:20.516044+0000","last_undegraded":"2024-04-14T23:36:20.516044+0000","last_fullsized":"2024-04-14T23:36:20.516044+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:13.831507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:13.831507+0000","last_clean_scrub_stamp":"2024-04-14T23:36:13.831507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:44:56.931942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627448+0000","last_change":"2024-04-14T23:36:11.924936+0000","last_active":"2024-04-14T23:36:20.627448+0000","last_peered":"2024-04-14T23:36:20.627448+0000","last_clean":"2024-04-14T23:36:20.627448+0000","last_became_active":"2024-04-14T23:35:47.133837+0000","last_became_peered":"2024-04-14T23:35:47.133837+0000","last_unstale":"2024-04-14T23:36:20.627448+0000","last_undegraded":"2024-04-14T23:36:20.627448+0000","last_fullsized":"2024-04-14T23:36:20.627448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:11.924829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:11.924829+0000","last_clean_scrub_stamp":"2024-04-14T23:36:11.924829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:14:03.808343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516398+0000","last_change":"2024-04-14T23:36:13.651671+0000","last_active":"2024-04-14T23:36:20.516398+0000","last_peered":"2024-04-14T23:36:20.516398+0000","last_clean":"2024-04-14T23:36:20.516398+0000","last_became_active":"2024-04-14T23:35:47.141474+0000","last_became_peered":"2024-04-14T23:35:47.141474+0000","last_unstale":"2024-04-14T23:36:20.516398+0000","last_undegraded":"2024-04-14T23:36:20.516398+0000","last_fullsized":"2024-04-14T23:36:20.516398+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:13.651553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:13.651553+0000","last_clean_scrub_stamp":"2024-04-14T23:36:13.651553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:16:34.307651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.628035+0000","last_change":"2024-04-14T23:36:12.557389+0000","last_active":"2024-04-14T23:36:20.628035+0000","last_peered":"2024-04-14T23:36:20.628035+0000","last_clean":"2024-04-14T23:36:20.628035+0000","last_became_active":"2024-04-14T23:35:47.151113+0000","last_became_peered":"2024-04-14T23:35:47.151113+0000","last_unstale":"2024-04-14T23:36:20.628035+0000","last_undegraded":"2024-04-14T23:36:20.628035+0000","last_fullsized":"2024-04-14T23:36:20.628035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:12.557221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:12.557221+0000","last_clean_scrub_stamp":"2024-04-14T23:36:12.557221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:17:59.016910+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516128+0000","last_change":"2024-04-14T23:36:14.614781+0000","last_active":"2024-04-14T23:36:20.516128+0000","last_peered":"2024-04-14T23:36:20.516128+0000","last_clean":"2024-04-14T23:36:20.516128+0000","last_became_active":"2024-04-14T23:35:47.144429+0000","last_became_peered":"2024-04-14T23:35:47.144429+0000","last_unstale":"2024-04-14T23:36:20.516128+0000","last_undegraded":"2024-04-14T23:36:20.516128+0000","last_fullsized":"2024-04-14T23:36:20.516128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:14.614666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:14.614666+0000","last_clean_scrub_stamp":"2024-04-14T23:36:14.614666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:10:54.443490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627810+0000","last_change":"2024-04-14T23:36:16.211926+0000","last_active":"2024-04-14T23:36:20.627810+0000","last_peered":"2024-04-14T23:36:20.627810+0000","last_clean":"2024-04-14T23:36:20.627810+0000","last_became_active":"2024-04-14T23:35:47.149370+0000","last_became_peered":"2024-04-14T23:35:47.149370+0000","last_unstale":"2024-04-14T23:36:20.627810+0000","last_undegraded":"2024-04-14T23:36:20.627810+0000","last_fullsized":"2024-04-14T23:36:20.627810+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:16.211815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:16.211815+0000","last_clean_scrub_stamp":"2024-04-14T23:36:16.211815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:27:01.001167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.515973+0000","last_change":"2024-04-14T23:36:11.643928+0000","last_active":"2024-04-14T23:36:20.515973+0000","last_peered":"2024-04-14T23:36:20.515973+0000","last_clean":"2024-04-14T23:36:20.515973+0000","last_became_active":"2024-04-14T23:35:47.137917+0000","last_became_peered":"2024-04-14T23:35:47.137917+0000","last_unstale":"2024-04-14T23:36:20.515973+0000","last_undegraded":"2024-04-14T23:36:20.515973+0000","last_fullsized":"2024-04-14T23:36:20.515973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:11.643837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:11.643837+0000","last_clean_scrub_stamp":"2024-04-14T23:36:11.643837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:55:16.020086+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.515830+0000","last_change":"2024-04-14T23:36:12.650513+0000","last_active":"2024-04-14T23:36:20.515830+0000","last_peered":"2024-04-14T23:36:20.515830+0000","last_clean":"2024-04-14T23:36:20.515830+0000","last_became_active":"2024-04-14T23:35:47.140018+0000","last_became_peered":"2024-04-14T23:35:47.140018+0000","last_unstale":"2024-04-14T23:36:20.515830+0000","last_undegraded":"2024-04-14T23:36:20.515830+0000","last_fullsized":"2024-04-14T23:36:20.515830+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:12.650423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:12.650423+0000","last_clean_scrub_stamp":"2024-04-14T23:36:12.650423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:29:02.044579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516103+0000","last_change":"2024-04-14T23:36:19.892271+0000","last_active":"2024-04-14T23:36:20.516103+0000","last_peered":"2024-04-14T23:36:20.516103+0000","last_clean":"2024-04-14T23:36:20.516103+0000","last_became_active":"2024-04-14T23:35:47.150210+0000","last_became_peered":"2024-04-14T23:35:47.150210+0000","last_unstale":"2024-04-14T23:36:20.516103+0000","last_undegraded":"2024-04-14T23:36:20.516103+0000","last_fullsized":"2024-04-14T23:36:20.516103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:19.892146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:19.892146+0000","last_clean_scrub_stamp":"2024-04-14T23:36:19.892146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:45:45.535110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627720+0000","last_change":"2024-04-14T23:36:13.540445+0000","last_active":"2024-04-14T23:36:20.627720+0000","last_peered":"2024-04-14T23:36:20.627720+0000","last_clean":"2024-04-14T23:36:20.627720+0000","last_became_active":"2024-04-14T23:35:47.154196+0000","last_became_peered":"2024-04-14T23:35:47.154196+0000","last_unstale":"2024-04-14T23:36:20.627720+0000","last_undegraded":"2024-04-14T23:36:20.627720+0000","last_fullsized":"2024-04-14T23:36:20.627720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:13.540338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:13.540338+0000","last_clean_scrub_stamp":"2024-04-14T23:36:13.540338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:47:09.745784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.929669+0000","last_change":"2024-04-14T23:36:20.929695+0000","last_active":"2024-04-14T23:36:20.929669+0000","last_peered":"2024-04-14T23:36:20.929669+0000","last_clean":"2024-04-14T23:36:20.929669+0000","last_became_active":"2024-04-14T23:35:47.157342+0000","last_became_peered":"2024-04-14T23:35:47.157342+0000","last_unstale":"2024-04-14T23:36:20.929669+0000","last_undegraded":"2024-04-14T23:36:20.929669+0000","last_fullsized":"2024-04-14T23:36:20.929669+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:20.929585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:20.929585+0000","last_clean_scrub_stamp":"2024-04-14T23:36:20.929585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:19:55.113073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516408+0000","last_change":"2024-04-14T23:36:09.636874+0000","last_active":"2024-04-14T23:36:20.516408+0000","last_peered":"2024-04-14T23:36:20.516408+0000","last_clean":"2024-04-14T23:36:20.516408+0000","last_became_active":"2024-04-14T23:35:46.129786+0000","last_became_peered":"2024-04-14T23:35:46.129786+0000","last_unstale":"2024-04-14T23:36:20.516408+0000","last_undegraded":"2024-04-14T23:36:20.516408+0000","last_fullsized":"2024-04-14T23:36:20.516408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-04-14T23:36:09.636745+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-04-14T23:36:09.636745+0000","last_clean_scrub_stamp":"2024-04-14T23:36:09.636745+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:25:18.583436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627987+0000","last_change":"2024-04-14T23:36:15.551601+0000","last_active":"2024-04-14T23:36:20.627987+0000","last_peered":"2024-04-14T23:36:20.627987+0000","last_clean":"2024-04-14T23:36:20.627987+0000","last_became_active":"2024-04-14T23:35:47.157538+0000","last_became_peered":"2024-04-14T23:35:47.157538+0000","last_unstale":"2024-04-14T23:36:20.627987+0000","last_undegraded":"2024-04-14T23:36:20.627987+0000","last_fullsized":"2024-04-14T23:36:20.627987+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:15.551485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:15.551485+0000","last_clean_scrub_stamp":"2024-04-14T23:36:15.551485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:12:02.188069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.517060+0000","last_change":"2024-04-14T23:36:06.969862+0000","last_active":"2024-04-14T23:36:20.517060+0000","last_peered":"2024-04-14T23:36:20.517060+0000","last_clean":"2024-04-14T23:36:20.517060+0000","last_became_active":"2024-04-14T23:35:46.136168+0000","last_became_peered":"2024-04-14T23:35:46.136168+0000","last_unstale":"2024-04-14T23:36:20.517060+0000","last_undegraded":"2024-04-14T23:36:20.517060+0000","last_fullsized":"2024-04-14T23:36:20.517060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T23:36:06.969776+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T23:36:06.969776+0000","last_clean_scrub_stamp":"2024-04-14T23:36:06.969776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:20.999920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.628240+0000","last_change":"2024-04-14T23:36:11.763842+0000","last_active":"2024-04-14T23:36:20.628240+0000","last_peered":"2024-04-14T23:36:20.628240+0000","last_clean":"2024-04-14T23:36:20.628240+0000","last_became_active":"2024-04-14T23:35:47.148963+0000","last_became_peered":"2024-04-14T23:35:47.148963+0000","last_unstale":"2024-04-14T23:36:20.628240+0000","last_undegraded":"2024-04-14T23:36:20.628240+0000","last_fullsized":"2024-04-14T23:36:20.628240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:11.763741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:11.763741+0000","last_clean_scrub_stamp":"2024-04-14T23:36:11.763741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:07:32.296288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.628132+0000","last_change":"2024-04-14T23:36:09.549210+0000","last_active":"2024-04-14T23:36:20.628132+0000","last_peered":"2024-04-14T23:36:20.628132+0000","last_clean":"2024-04-14T23:36:20.628132+0000","last_became_active":"2024-04-14T23:35:46.137096+0000","last_became_peered":"2024-04-14T23:35:46.137096+0000","last_unstale":"2024-04-14T23:36:20.628132+0000","last_undegraded":"2024-04-14T23:36:20.628132+0000","last_fullsized":"2024-04-14T23:36:20.628132+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T23:36:09.549079+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T23:36:09.549079+0000","last_clean_scrub_stamp":"2024-04-14T23:36:09.549079+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:10:49.377903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.514990+0000","last_change":"2024-04-14T23:36:14.010895+0000","last_active":"2024-04-14T23:36:20.514990+0000","last_peered":"2024-04-14T23:36:20.514990+0000","last_clean":"2024-04-14T23:36:20.514990+0000","last_became_active":"2024-04-14T23:35:47.146329+0000","last_became_peered":"2024-04-14T23:35:47.146329+0000","last_unstale":"2024-04-14T23:36:20.514990+0000","last_undegraded":"2024-04-14T23:36:20.514990+0000","last_fullsized":"2024-04-14T23:36:20.514990+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:14.010743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:14.010743+0000","last_clean_scrub_stamp":"2024-04-14T23:36:14.010743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:43:49.092076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627993+0000","last_change":"2024-04-14T23:36:08.755700+0000","last_active":"2024-04-14T23:36:20.627993+0000","last_peered":"2024-04-14T23:36:20.627993+0000","last_clean":"2024-04-14T23:36:20.627993+0000","last_became_active":"2024-04-14T23:35:46.133188+0000","last_became_peered":"2024-04-14T23:35:46.133188+0000","last_unstale":"2024-04-14T23:36:20.627993+0000","last_undegraded":"2024-04-14T23:36:20.627993+0000","last_fullsized":"2024-04-14T23:36:20.627993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T23:36:08.755539+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T23:36:08.755539+0000","last_clean_scrub_stamp":"2024-04-14T23:36:08.755539+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:29:34.236634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516649+0000","last_change":"2024-04-14T23:36:08.942583+0000","last_active":"2024-04-14T23:36:20.516649+0000","last_peered":"2024-04-14T23:36:20.516649+0000","last_clean":"2024-04-14T23:36:20.516649+0000","last_became_active":"2024-04-14T23:35:47.142140+0000","last_became_peered":"2024-04-14T23:35:47.142140+0000","last_unstale":"2024-04-14T23:36:20.516649+0000","last_undegraded":"2024-04-14T23:36:20.516649+0000","last_fullsized":"2024-04-14T23:36:20.516649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:08.942506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:08.942506+0000","last_clean_scrub_stamp":"2024-04-14T23:36:08.942506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:19:54.367216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627690+0000","last_change":"2024-04-14T23:36:12.215518+0000","last_active":"2024-04-14T23:36:20.627690+0000","last_peered":"2024-04-14T23:36:20.627690+0000","last_clean":"2024-04-14T23:36:20.627690+0000","last_became_active":"2024-04-14T23:35:46.134786+0000","last_became_peered":"2024-04-14T23:35:46.134786+0000","last_unstale":"2024-04-14T23:36:20.627690+0000","last_undegraded":"2024-04-14T23:36:20.627690+0000","last_fullsized":"2024-04-14T23:36:20.627690+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T23:36:12.215415+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T23:36:12.215415+0000","last_clean_scrub_stamp":"2024-04-14T23:36:12.215415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:11:58.851999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:23.247631+0000","last_change":"2024-04-14T23:36:23.247656+0000","last_active":"2024-04-14T23:36:23.247631+0000","last_peered":"2024-04-14T23:36:23.247631+0000","last_clean":"2024-04-14T23:36:23.247631+0000","last_became_active":"2024-04-14T23:35:47.158355+0000","last_became_peered":"2024-04-14T23:35:47.158355+0000","last_unstale":"2024-04-14T23:36:23.247631+0000","last_undegraded":"2024-04-14T23:36:23.247631+0000","last_fullsized":"2024-04-14T23:36:23.247631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:23.247552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:23.247552+0000","last_clean_scrub_stamp":"2024-04-14T23:36:23.247552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:18:57.273806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516081+0000","last_change":"2024-04-14T23:36:12.804890+0000","last_active":"2024-04-14T23:36:20.516081+0000","last_peered":"2024-04-14T23:36:20.516081+0000","last_clean":"2024-04-14T23:36:20.516081+0000","last_became_active":"2024-04-14T23:35:46.138931+0000","last_became_peered":"2024-04-14T23:35:46.138931+0000","last_unstale":"2024-04-14T23:36:20.516081+0000","last_undegraded":"2024-04-14T23:36:20.516081+0000","last_fullsized":"2024-04-14T23:36:20.516081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T23:36:12.804795+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T23:36:12.804795+0000","last_clean_scrub_stamp":"2024-04-14T23:36:12.804795+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:07:33.337342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627792+0000","last_change":"2024-04-14T23:36:17.888324+0000","last_active":"2024-04-14T23:36:20.627792+0000","last_peered":"2024-04-14T23:36:20.627792+0000","last_clean":"2024-04-14T23:36:20.627792+0000","last_became_active":"2024-04-14T23:35:47.158238+0000","last_became_peered":"2024-04-14T23:35:47.158238+0000","last_unstale":"2024-04-14T23:36:20.627792+0000","last_undegraded":"2024-04-14T23:36:20.627792+0000","last_fullsized":"2024-04-14T23:36:20.627792+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:17.888228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:17.888228+0000","last_clean_scrub_stamp":"2024-04-14T23:36:17.888228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:18:58.246851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.628304+0000","last_change":"2024-04-14T23:36:07.518283+0000","last_active":"2024-04-14T23:36:20.628304+0000","last_peered":"2024-04-14T23:36:20.628304+0000","last_clean":"2024-04-14T23:36:20.628304+0000","last_became_active":"2024-04-14T23:35:46.134477+0000","last_became_peered":"2024-04-14T23:35:46.134477+0000","last_unstale":"2024-04-14T23:36:20.628304+0000","last_undegraded":"2024-04-14T23:36:20.628304+0000","last_fullsized":"2024-04-14T23:36:20.628304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:07.518141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:07.518141+0000","last_clean_scrub_stamp":"2024-04-14T23:36:07.518141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:28:56.912298+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.514628+0000","last_change":"2024-04-14T23:36:19.169630+0000","last_active":"2024-04-14T23:36:20.514628+0000","last_peered":"2024-04-14T23:36:20.514628+0000","last_clean":"2024-04-14T23:36:20.514628+0000","last_became_active":"2024-04-14T23:35:47.152701+0000","last_became_peered":"2024-04-14T23:35:47.152701+0000","last_unstale":"2024-04-14T23:36:20.514628+0000","last_undegraded":"2024-04-14T23:36:20.514628+0000","last_fullsized":"2024-04-14T23:36:20.514628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:19.169510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:19.169510+0000","last_clean_scrub_stamp":"2024-04-14T23:36:19.169510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:22:20.227413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627489+0000","last_change":"2024-04-14T23:36:07.782072+0000","last_active":"2024-04-14T23:36:20.627489+0000","last_peered":"2024-04-14T23:36:20.627489+0000","last_clean":"2024-04-14T23:36:20.627489+0000","last_became_active":"2024-04-14T23:35:46.131898+0000","last_became_peered":"2024-04-14T23:35:46.131898+0000","last_unstale":"2024-04-14T23:36:20.627489+0000","last_undegraded":"2024-04-14T23:36:20.627489+0000","last_fullsized":"2024-04-14T23:36:20.627489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:07.781960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:07.781960+0000","last_clean_scrub_stamp":"2024-04-14T23:36:07.781960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:21.812104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627819+0000","last_change":"2024-04-14T23:36:14.889874+0000","last_active":"2024-04-14T23:36:20.627819+0000","last_peered":"2024-04-14T23:36:20.627819+0000","last_clean":"2024-04-14T23:36:20.627819+0000","last_became_active":"2024-04-14T23:35:47.151273+0000","last_became_peered":"2024-04-14T23:35:47.151273+0000","last_unstale":"2024-04-14T23:36:20.627819+0000","last_undegraded":"2024-04-14T23:36:20.627819+0000","last_fullsized":"2024-04-14T23:36:20.627819+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:14.889769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:14.889769+0000","last_clean_scrub_stamp":"2024-04-14T23:36:14.889769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:06:50.306499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.515098+0000","last_change":"2024-04-14T23:36:06.916297+0000","last_active":"2024-04-14T23:36:20.515098+0000","last_peered":"2024-04-14T23:36:20.515098+0000","last_clean":"2024-04-14T23:36:20.515098+0000","last_became_active":"2024-04-14T23:35:46.129848+0000","last_became_peered":"2024-04-14T23:35:46.129848+0000","last_unstale":"2024-04-14T23:36:20.515098+0000","last_undegraded":"2024-04-14T23:36:20.515098+0000","last_fullsized":"2024-04-14T23:36:20.515098+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:06.916189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:06.916189+0000","last_clean_scrub_stamp":"2024-04-14T23:36:06.916189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:31:59.025416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516550+0000","last_change":"2024-04-14T23:36:14.837783+0000","last_active":"2024-04-14T23:36:20.516550+0000","last_peered":"2024-04-14T23:36:20.516550+0000","last_clean":"2024-04-14T23:36:20.516550+0000","last_became_active":"2024-04-14T23:35:47.135240+0000","last_became_peered":"2024-04-14T23:35:47.135240+0000","last_unstale":"2024-04-14T23:36:20.516550+0000","last_undegraded":"2024-04-14T23:36:20.516550+0000","last_fullsized":"2024-04-14T23:36:20.516550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:14.837660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:14.837660+0000","last_clean_scrub_stamp":"2024-04-14T23:36:14.837660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:58:25.090646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.628164+0000","last_change":"2024-04-14T23:36:11.246029+0000","last_active":"2024-04-14T23:36:20.628164+0000","last_peered":"2024-04-14T23:36:20.628164+0000","last_clean":"2024-04-14T23:36:20.628164+0000","last_became_active":"2024-04-14T23:35:46.131640+0000","last_became_peered":"2024-04-14T23:35:46.131640+0000","last_unstale":"2024-04-14T23:36:20.628164+0000","last_undegraded":"2024-04-14T23:36:20.628164+0000","last_fullsized":"2024-04-14T23:36:20.628164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:11.245892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:11.245892+0000","last_clean_scrub_stamp":"2024-04-14T23:36:11.245892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:13.451604+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.517035+0000","last_change":"2024-04-14T23:36:11.880044+0000","last_active":"2024-04-14T23:36:20.517035+0000","last_peered":"2024-04-14T23:36:20.517035+0000","last_clean":"2024-04-14T23:36:20.517035+0000","last_became_active":"2024-04-14T23:35:47.153494+0000","last_became_peered":"2024-04-14T23:35:47.153494+0000","last_unstale":"2024-04-14T23:36:20.517035+0000","last_undegraded":"2024-04-14T23:36:20.517035+0000","last_fullsized":"2024-04-14T23:36:20.517035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:11.879930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:11.879930+0000","last_clean_scrub_stamp":"2024-04-14T23:36:11.879930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:47:08.085377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.628179+0000","last_change":"2024-04-14T23:36:08.213287+0000","last_active":"2024-04-14T23:36:20.628179+0000","last_peered":"2024-04-14T23:36:20.628179+0000","last_clean":"2024-04-14T23:36:20.628179+0000","last_became_active":"2024-04-14T23:35:46.128883+0000","last_became_peered":"2024-04-14T23:35:46.128883+0000","last_unstale":"2024-04-14T23:36:20.628179+0000","last_undegraded":"2024-04-14T23:36:20.628179+0000","last_fullsized":"2024-04-14T23:36:20.628179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-04-14T23:36:08.213166+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-04-14T23:36:08.213166+0000","last_clean_scrub_stamp":"2024-04-14T23:36:08.213166+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:32:58.477685+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.628083+0000","last_change":"2024-04-14T23:36:16.898825+0000","last_active":"2024-04-14T23:36:20.628083+0000","last_peered":"2024-04-14T23:36:20.628083+0000","last_clean":"2024-04-14T23:36:20.628083+0000","last_became_active":"2024-04-14T23:35:47.154276+0000","last_became_peered":"2024-04-14T23:35:47.154276+0000","last_unstale":"2024-04-14T23:36:20.628083+0000","last_undegraded":"2024-04-14T23:36:20.628083+0000","last_fullsized":"2024-04-14T23:36:20.628083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:16.898666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:16.898666+0000","last_clean_scrub_stamp":"2024-04-14T23:36:16.898666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:21:17.954584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'10","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.514855+0000","last_change":"2024-04-14T23:36:10.000489+0000","last_active":"2024-04-14T23:36:20.514855+0000","last_peered":"2024-04-14T23:36:20.514855+0000","last_clean":"2024-04-14T23:36:20.514855+0000","last_became_active":"2024-04-14T23:35:46.136185+0000","last_became_peered":"2024-04-14T23:35:46.136185+0000","last_unstale":"2024-04-14T23:36:20.514855+0000","last_undegraded":"2024-04-14T23:36:20.514855+0000","last_fullsized":"2024-04-14T23:36:20.514855+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-04-14T23:36:10.000354+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-04-14T23:36:10.000354+0000","last_clean_scrub_stamp":"2024-04-14T23:36:10.000354+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:26:54.789706+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516678+0000","last_change":"2024-04-14T23:36:13.945466+0000","last_active":"2024-04-14T23:36:20.516678+0000","last_peered":"2024-04-14T23:36:20.516678+0000","last_clean":"2024-04-14T23:36:20.516678+0000","last_became_active":"2024-04-14T23:35:47.157745+0000","last_became_peered":"2024-04-14T23:35:47.157745+0000","last_unstale":"2024-04-14T23:36:20.516678+0000","last_undegraded":"2024-04-14T23:36:20.516678+0000","last_fullsized":"2024-04-14T23:36:20.516678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:13.945335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:13.945335+0000","last_clean_scrub_stamp":"2024-04-14T23:36:13.945335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:14:08.541496+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.514765+0000","last_change":"2024-04-14T23:36:08.979246+0000","last_active":"2024-04-14T23:36:20.514765+0000","last_peered":"2024-04-14T23:36:20.514765+0000","last_clean":"2024-04-14T23:36:20.514765+0000","last_became_active":"2024-04-14T23:35:46.133356+0000","last_became_peered":"2024-04-14T23:35:46.133356+0000","last_unstale":"2024-04-14T23:36:20.514765+0000","last_undegraded":"2024-04-14T23:36:20.514765+0000","last_fullsized":"2024-04-14T23:36:20.514765+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T23:36:08.979137+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T23:36:08.979137+0000","last_clean_scrub_stamp":"2024-04-14T23:36:08.979137+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:30.245852+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.514574+0000","last_change":"2024-04-14T23:36:12.015797+0000","last_active":"2024-04-14T23:36:20.514574+0000","last_peered":"2024-04-14T23:36:20.514574+0000","last_clean":"2024-04-14T23:36:20.514574+0000","last_became_active":"2024-04-14T23:35:47.143045+0000","last_became_peered":"2024-04-14T23:35:47.143045+0000","last_unstale":"2024-04-14T23:36:20.514574+0000","last_undegraded":"2024-04-14T23:36:20.514574+0000","last_fullsized":"2024-04-14T23:36:20.514574+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:12.015686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:12.015686+0000","last_clean_scrub_stamp":"2024-04-14T23:36:12.015686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:19:29.209125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627973+0000","last_change":"2024-04-14T23:36:06.498478+0000","last_active":"2024-04-14T23:36:20.627973+0000","last_peered":"2024-04-14T23:36:20.627973+0000","last_clean":"2024-04-14T23:36:20.627973+0000","last_became_active":"2024-04-14T23:35:46.134400+0000","last_became_peered":"2024-04-14T23:35:46.134400+0000","last_unstale":"2024-04-14T23:36:20.627973+0000","last_undegraded":"2024-04-14T23:36:20.627973+0000","last_fullsized":"2024-04-14T23:36:20.627973+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:06.498391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:06.498391+0000","last_clean_scrub_stamp":"2024-04-14T23:36:06.498391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:55:10.874641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.515842+0000","last_change":"2024-04-14T23:36:16.815503+0000","last_active":"2024-04-14T23:36:20.515842+0000","last_peered":"2024-04-14T23:36:20.515842+0000","last_clean":"2024-04-14T23:36:20.515842+0000","last_became_active":"2024-04-14T23:35:47.134733+0000","last_became_peered":"2024-04-14T23:35:47.134733+0000","last_unstale":"2024-04-14T23:36:20.515842+0000","last_undegraded":"2024-04-14T23:36:20.515842+0000","last_fullsized":"2024-04-14T23:36:20.515842+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:16.815355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:16.815355+0000","last_clean_scrub_stamp":"2024-04-14T23:36:16.815355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T09:26:43.385155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.515679+0000","last_change":"2024-04-14T23:36:08.671722+0000","last_active":"2024-04-14T23:36:20.515679+0000","last_peered":"2024-04-14T23:36:20.515679+0000","last_clean":"2024-04-14T23:36:20.515679+0000","last_became_active":"2024-04-14T23:35:46.127852+0000","last_became_peered":"2024-04-14T23:35:46.127852+0000","last_unstale":"2024-04-14T23:36:20.515679+0000","last_undegraded":"2024-04-14T23:36:20.515679+0000","last_fullsized":"2024-04-14T23:36:20.515679+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:08.671607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:08.671607+0000","last_clean_scrub_stamp":"2024-04-14T23:36:08.671607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:50:48.604823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.514615+0000","last_change":"2024-04-14T23:36:15.052845+0000","last_active":"2024-04-14T23:36:20.514615+0000","last_peered":"2024-04-14T23:36:20.514615+0000","last_clean":"2024-04-14T23:36:20.514615+0000","last_became_active":"2024-04-14T23:35:47.147022+0000","last_became_peered":"2024-04-14T23:35:47.147022+0000","last_unstale":"2024-04-14T23:36:20.514615+0000","last_undegraded":"2024-04-14T23:36:20.514615+0000","last_fullsized":"2024-04-14T23:36:20.514615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:15.052725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:15.052725+0000","last_clean_scrub_stamp":"2024-04-14T23:36:15.052725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:37:57.499658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516035+0000","last_change":"2024-04-14T23:36:11.831588+0000","last_active":"2024-04-14T23:36:20.516035+0000","last_peered":"2024-04-14T23:36:20.516035+0000","last_clean":"2024-04-14T23:36:20.516035+0000","last_became_active":"2024-04-14T23:35:46.138922+0000","last_became_peered":"2024-04-14T23:35:46.138922+0000","last_unstale":"2024-04-14T23:36:20.516035+0000","last_undegraded":"2024-04-14T23:36:20.516035+0000","last_fullsized":"2024-04-14T23:36:20.516035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'8","last_scrub_stamp":"2024-04-14T23:36:11.831498+0000","last_deep_scrub":"38'8","last_deep_scrub_stamp":"2024-04-14T23:36:11.831498+0000","last_clean_scrub_stamp":"2024-04-14T23:36:11.831498+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:00:23.978467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.514824+0000","last_change":"2024-04-14T23:36:11.017917+0000","last_active":"2024-04-14T23:36:20.514824+0000","last_peered":"2024-04-14T23:36:20.514824+0000","last_clean":"2024-04-14T23:36:20.514824+0000","last_became_active":"2024-04-14T23:35:47.142925+0000","last_became_peered":"2024-04-14T23:35:47.142925+0000","last_unstale":"2024-04-14T23:36:20.514824+0000","last_undegraded":"2024-04-14T23:36:20.514824+0000","last_fullsized":"2024-04-14T23:36:20.514824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:11.017815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:11.017815+0000","last_clean_scrub_stamp":"2024-04-14T23:36:11.017815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:39:07.555156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.628132+0000","last_change":"2024-04-14T23:36:10.284205+0000","last_active":"2024-04-14T23:36:20.628132+0000","last_peered":"2024-04-14T23:36:20.628132+0000","last_clean":"2024-04-14T23:36:20.628132+0000","last_became_active":"2024-04-14T23:35:46.130423+0000","last_became_peered":"2024-04-14T23:35:46.130423+0000","last_unstale":"2024-04-14T23:36:20.628132+0000","last_undegraded":"2024-04-14T23:36:20.628132+0000","last_fullsized":"2024-04-14T23:36:20.628132+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T23:36:10.284087+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T23:36:10.284087+0000","last_clean_scrub_stamp":"2024-04-14T23:36:10.284087+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:56:14.542377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.628029+0000","last_change":"2024-04-14T23:36:14.161317+0000","last_active":"2024-04-14T23:36:20.628029+0000","last_peered":"2024-04-14T23:36:20.628029+0000","last_clean":"2024-04-14T23:36:20.628029+0000","last_became_active":"2024-04-14T23:35:47.148964+0000","last_became_peered":"2024-04-14T23:35:47.148964+0000","last_unstale":"2024-04-14T23:36:20.628029+0000","last_undegraded":"2024-04-14T23:36:20.628029+0000","last_fullsized":"2024-04-14T23:36:20.628029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:14.161182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:14.161182+0000","last_clean_scrub_stamp":"2024-04-14T23:36:14.161182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:21:15.217100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.628305+0000","last_change":"2024-04-14T23:36:10.779598+0000","last_active":"2024-04-14T23:36:20.628305+0000","last_peered":"2024-04-14T23:36:20.628305+0000","last_clean":"2024-04-14T23:36:20.628305+0000","last_became_active":"2024-04-14T23:35:46.136718+0000","last_became_peered":"2024-04-14T23:35:46.136718+0000","last_unstale":"2024-04-14T23:36:20.628305+0000","last_undegraded":"2024-04-14T23:36:20.628305+0000","last_fullsized":"2024-04-14T23:36:20.628305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T23:36:10.779460+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T23:36:10.779460+0000","last_clean_scrub_stamp":"2024-04-14T23:36:10.779460+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:00:22.926429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.628132+0000","last_change":"2024-04-14T23:36:12.790649+0000","last_active":"2024-04-14T23:36:20.628132+0000","last_peered":"2024-04-14T23:36:20.628132+0000","last_clean":"2024-04-14T23:36:20.628132+0000","last_became_active":"2024-04-14T23:35:47.149067+0000","last_became_peered":"2024-04-14T23:35:47.149067+0000","last_unstale":"2024-04-14T23:36:20.628132+0000","last_undegraded":"2024-04-14T23:36:20.628132+0000","last_fullsized":"2024-04-14T23:36:20.628132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:12.790559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:12.790559+0000","last_clean_scrub_stamp":"2024-04-14T23:36:12.790559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:47:08.996006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627951+0000","last_change":"2024-04-14T23:36:10.888392+0000","last_active":"2024-04-14T23:36:20.627951+0000","last_peered":"2024-04-14T23:36:20.627951+0000","last_clean":"2024-04-14T23:36:20.627951+0000","last_became_active":"2024-04-14T23:35:46.136236+0000","last_became_peered":"2024-04-14T23:35:46.136236+0000","last_unstale":"2024-04-14T23:36:20.627951+0000","last_undegraded":"2024-04-14T23:36:20.627951+0000","last_fullsized":"2024-04-14T23:36:20.627951+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T23:36:10.888244+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T23:36:10.888244+0000","last_clean_scrub_stamp":"2024-04-14T23:36:10.888244+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:42.924538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.628026+0000","last_change":"2024-04-14T23:36:13.910167+0000","last_active":"2024-04-14T23:36:20.628026+0000","last_peered":"2024-04-14T23:36:20.628026+0000","last_clean":"2024-04-14T23:36:20.628026+0000","last_became_active":"2024-04-14T23:35:47.150517+0000","last_became_peered":"2024-04-14T23:35:47.150517+0000","last_unstale":"2024-04-14T23:36:20.628026+0000","last_undegraded":"2024-04-14T23:36:20.628026+0000","last_fullsized":"2024-04-14T23:36:20.628026+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:13.910031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:13.910031+0000","last_clean_scrub_stamp":"2024-04-14T23:36:13.910031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T00:48:00.517070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627991+0000","last_change":"2024-04-14T23:36:08.509700+0000","last_active":"2024-04-14T23:36:20.627991+0000","last_peered":"2024-04-14T23:36:20.627991+0000","last_clean":"2024-04-14T23:36:20.627991+0000","last_became_active":"2024-04-14T23:35:46.136103+0000","last_became_peered":"2024-04-14T23:35:46.136103+0000","last_unstale":"2024-04-14T23:36:20.627991+0000","last_undegraded":"2024-04-14T23:36:20.627991+0000","last_fullsized":"2024-04-14T23:36:20.627991+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:08.509617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:08.509617+0000","last_clean_scrub_stamp":"2024-04-14T23:36:08.509617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:16:29.165715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516142+0000","last_change":"2024-04-14T23:36:18.869032+0000","last_active":"2024-04-14T23:36:20.516142+0000","last_peered":"2024-04-14T23:36:20.516142+0000","last_clean":"2024-04-14T23:36:20.516142+0000","last_became_active":"2024-04-14T23:35:47.146080+0000","last_became_peered":"2024-04-14T23:35:47.146080+0000","last_unstale":"2024-04-14T23:36:20.516142+0000","last_undegraded":"2024-04-14T23:36:20.516142+0000","last_fullsized":"2024-04-14T23:36:20.516142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:18.868914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:18.868914+0000","last_clean_scrub_stamp":"2024-04-14T23:36:18.868914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:18:59.227536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627719+0000","last_change":"2024-04-14T23:36:08.907938+0000","last_active":"2024-04-14T23:36:20.627719+0000","last_peered":"2024-04-14T23:36:20.627719+0000","last_clean":"2024-04-14T23:36:20.627719+0000","last_became_active":"2024-04-14T23:35:46.132542+0000","last_became_peered":"2024-04-14T23:35:46.132542+0000","last_unstale":"2024-04-14T23:36:20.627719+0000","last_undegraded":"2024-04-14T23:36:20.627719+0000","last_fullsized":"2024-04-14T23:36:20.627719+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T23:36:08.907852+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T23:36:08.907852+0000","last_clean_scrub_stamp":"2024-04-14T23:36:08.907852+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:09:50.764113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516751+0000","last_change":"2024-04-14T23:36:12.913221+0000","last_active":"2024-04-14T23:36:20.516751+0000","last_peered":"2024-04-14T23:36:20.516751+0000","last_clean":"2024-04-14T23:36:20.516751+0000","last_became_active":"2024-04-14T23:35:47.154568+0000","last_became_peered":"2024-04-14T23:35:47.154568+0000","last_unstale":"2024-04-14T23:36:20.516751+0000","last_undegraded":"2024-04-14T23:36:20.516751+0000","last_fullsized":"2024-04-14T23:36:20.516751+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:12.913101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:12.913101+0000","last_clean_scrub_stamp":"2024-04-14T23:36:12.913101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:58:23.166088+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.628230+0000","last_change":"2024-04-14T23:36:07.951581+0000","last_active":"2024-04-14T23:36:20.628230+0000","last_peered":"2024-04-14T23:36:20.628230+0000","last_clean":"2024-04-14T23:36:20.628230+0000","last_became_active":"2024-04-14T23:35:46.131245+0000","last_became_peered":"2024-04-14T23:35:46.131245+0000","last_unstale":"2024-04-14T23:36:20.628230+0000","last_undegraded":"2024-04-14T23:36:20.628230+0000","last_fullsized":"2024-04-14T23:36:20.628230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:07.951498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:07.951498+0000","last_clean_scrub_stamp":"2024-04-14T23:36:07.951498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T06:47:21.999017+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627742+0000","last_change":"2024-04-14T23:36:15.200703+0000","last_active":"2024-04-14T23:36:20.627742+0000","last_peered":"2024-04-14T23:36:20.627742+0000","last_clean":"2024-04-14T23:36:20.627742+0000","last_became_active":"2024-04-14T23:35:47.149206+0000","last_became_peered":"2024-04-14T23:35:47.149206+0000","last_unstale":"2024-04-14T23:36:20.627742+0000","last_undegraded":"2024-04-14T23:36:20.627742+0000","last_fullsized":"2024-04-14T23:36:20.627742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:15.200593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:15.200593+0000","last_clean_scrub_stamp":"2024-04-14T23:36:15.200593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:26:36.467307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516149+0000","last_change":"2024-04-14T23:36:09.822646+0000","last_active":"2024-04-14T23:36:20.516149+0000","last_peered":"2024-04-14T23:36:20.516149+0000","last_clean":"2024-04-14T23:36:20.516149+0000","last_became_active":"2024-04-14T23:35:46.136141+0000","last_became_peered":"2024-04-14T23:35:46.136141+0000","last_unstale":"2024-04-14T23:36:20.516149+0000","last_undegraded":"2024-04-14T23:36:20.516149+0000","last_fullsized":"2024-04-14T23:36:20.516149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:09.822524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:09.822524+0000","last_clean_scrub_stamp":"2024-04-14T23:36:09.822524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:29:35.303618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.514754+0000","last_change":"2024-04-14T23:36:17.114754+0000","last_active":"2024-04-14T23:36:20.514754+0000","last_peered":"2024-04-14T23:36:20.514754+0000","last_clean":"2024-04-14T23:36:20.514754+0000","last_became_active":"2024-04-14T23:35:47.152529+0000","last_became_peered":"2024-04-14T23:35:47.152529+0000","last_unstale":"2024-04-14T23:36:20.514754+0000","last_undegraded":"2024-04-14T23:36:20.514754+0000","last_fullsized":"2024-04-14T23:36:20.514754+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:17.114601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:17.114601+0000","last_clean_scrub_stamp":"2024-04-14T23:36:17.114601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:18:51.140854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627507+0000","last_change":"2024-04-14T23:36:06.984235+0000","last_active":"2024-04-14T23:36:20.627507+0000","last_peered":"2024-04-14T23:36:20.627507+0000","last_clean":"2024-04-14T23:36:20.627507+0000","last_became_active":"2024-04-14T23:35:46.130829+0000","last_became_peered":"2024-04-14T23:35:46.130829+0000","last_unstale":"2024-04-14T23:36:20.627507+0000","last_undegraded":"2024-04-14T23:36:20.627507+0000","last_fullsized":"2024-04-14T23:36:20.627507+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:06.984152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:06.984152+0000","last_clean_scrub_stamp":"2024-04-14T23:36:06.984152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:05:16.729930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627886+0000","last_change":"2024-04-14T23:36:14.522860+0000","last_active":"2024-04-14T23:36:20.627886+0000","last_peered":"2024-04-14T23:36:20.627886+0000","last_clean":"2024-04-14T23:36:20.627886+0000","last_became_active":"2024-04-14T23:35:47.157332+0000","last_became_peered":"2024-04-14T23:35:47.157332+0000","last_unstale":"2024-04-14T23:36:20.627886+0000","last_undegraded":"2024-04-14T23:36:20.627886+0000","last_fullsized":"2024-04-14T23:36:20.627886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:14.522755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:14.522755+0000","last_clean_scrub_stamp":"2024-04-14T23:36:14.522755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:36:16.728466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.628247+0000","last_change":"2024-04-14T23:36:09.252356+0000","last_active":"2024-04-14T23:36:20.628247+0000","last_peered":"2024-04-14T23:36:20.628247+0000","last_clean":"2024-04-14T23:36:20.628247+0000","last_became_active":"2024-04-14T23:35:46.130053+0000","last_became_peered":"2024-04-14T23:35:46.130053+0000","last_unstale":"2024-04-14T23:36:20.628247+0000","last_undegraded":"2024-04-14T23:36:20.628247+0000","last_fullsized":"2024-04-14T23:36:20.628247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T23:36:09.252214+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T23:36:09.252214+0000","last_clean_scrub_stamp":"2024-04-14T23:36:09.252214+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:17:55.711903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516592+0000","last_change":"2024-04-14T23:36:15.832347+0000","last_active":"2024-04-14T23:36:20.516592+0000","last_peered":"2024-04-14T23:36:20.516592+0000","last_clean":"2024-04-14T23:36:20.516592+0000","last_became_active":"2024-04-14T23:35:47.135290+0000","last_became_peered":"2024-04-14T23:35:47.135290+0000","last_unstale":"2024-04-14T23:36:20.516592+0000","last_undegraded":"2024-04-14T23:36:20.516592+0000","last_fullsized":"2024-04-14T23:36:20.516592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:15.832239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:15.832239+0000","last_clean_scrub_stamp":"2024-04-14T23:36:15.832239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:14:10.428400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'3","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627861+0000","last_change":"2024-04-14T23:36:09.869115+0000","last_active":"2024-04-14T23:36:20.627861+0000","last_peered":"2024-04-14T23:36:20.627861+0000","last_clean":"2024-04-14T23:36:20.627861+0000","last_became_active":"2024-04-14T23:35:46.132894+0000","last_became_peered":"2024-04-14T23:35:46.132894+0000","last_unstale":"2024-04-14T23:36:20.627861+0000","last_undegraded":"2024-04-14T23:36:20.627861+0000","last_fullsized":"2024-04-14T23:36:20.627861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2024-04-14T23:36:09.868943+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2024-04-14T23:36:09.868943+0000","last_clean_scrub_stamp":"2024-04-14T23:36:09.868943+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T05:25:18.815635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.514977+0000","last_change":"2024-04-14T23:36:18.155955+0000","last_active":"2024-04-14T23:36:20.514977+0000","last_peered":"2024-04-14T23:36:20.514977+0000","last_clean":"2024-04-14T23:36:20.514977+0000","last_became_active":"2024-04-14T23:35:47.152994+0000","last_became_peered":"2024-04-14T23:35:47.152994+0000","last_unstale":"2024-04-14T23:36:20.514977+0000","last_undegraded":"2024-04-14T23:36:20.514977+0000","last_fullsized":"2024-04-14T23:36:20.514977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:18.155842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:18.155842+0000","last_clean_scrub_stamp":"2024-04-14T23:36:18.155842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:27:27.616509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516969+0000","last_change":"2024-04-14T23:36:05.973327+0000","last_active":"2024-04-14T23:36:20.516969+0000","last_peered":"2024-04-14T23:36:20.516969+0000","last_clean":"2024-04-14T23:36:20.516969+0000","last_became_active":"2024-04-14T23:35:46.128736+0000","last_became_peered":"2024-04-14T23:35:46.128736+0000","last_unstale":"2024-04-14T23:36:20.516969+0000","last_undegraded":"2024-04-14T23:36:20.516969+0000","last_fullsized":"2024-04-14T23:36:20.516969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:05.973204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:05.973204+0000","last_clean_scrub_stamp":"2024-04-14T23:36:05.973204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T03:16:26.629302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516752+0000","last_change":"2024-04-14T23:36:09.895530+0000","last_active":"2024-04-14T23:36:20.516752+0000","last_peered":"2024-04-14T23:36:20.516752+0000","last_clean":"2024-04-14T23:36:20.516752+0000","last_became_active":"2024-04-14T23:35:47.146038+0000","last_became_peered":"2024-04-14T23:35:47.146038+0000","last_unstale":"2024-04-14T23:36:20.516752+0000","last_undegraded":"2024-04-14T23:36:20.516752+0000","last_fullsized":"2024-04-14T23:36:20.516752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:09.895423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:09.895423+0000","last_clean_scrub_stamp":"2024-04-14T23:36:09.895423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T04:33:00.159942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516934+0000","last_change":"2024-04-14T23:36:07.951716+0000","last_active":"2024-04-14T23:36:20.516934+0000","last_peered":"2024-04-14T23:36:20.516934+0000","last_clean":"2024-04-14T23:36:20.516934+0000","last_became_active":"2024-04-14T23:35:46.137073+0000","last_became_peered":"2024-04-14T23:35:46.137073+0000","last_unstale":"2024-04-14T23:36:20.516934+0000","last_undegraded":"2024-04-14T23:36:20.516934+0000","last_fullsized":"2024-04-14T23:36:20.516934+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:07.951592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:07.951592+0000","last_clean_scrub_stamp":"2024-04-14T23:36:07.951592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T01:29:33.432686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.628241+0000","last_change":"2024-04-14T23:36:11.514878+0000","last_active":"2024-04-14T23:36:20.628241+0000","last_peered":"2024-04-14T23:36:20.628241+0000","last_clean":"2024-04-14T23:36:20.628241+0000","last_became_active":"2024-04-14T23:35:47.144302+0000","last_became_peered":"2024-04-14T23:35:47.144302+0000","last_unstale":"2024-04-14T23:36:20.628241+0000","last_undegraded":"2024-04-14T23:36:20.628241+0000","last_fullsized":"2024-04-14T23:36:20.628241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:11.514722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:11.514722+0000","last_clean_scrub_stamp":"2024-04-14T23:36:11.514722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T11:27:03.228941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.515957+0000","last_change":"2024-04-14T23:36:10.669082+0000","last_active":"2024-04-14T23:36:20.515957+0000","last_peered":"2024-04-14T23:36:20.515957+0000","last_clean":"2024-04-14T23:36:20.515957+0000","last_became_active":"2024-04-14T23:35:46.131951+0000","last_became_peered":"2024-04-14T23:35:46.131951+0000","last_unstale":"2024-04-14T23:36:20.515957+0000","last_undegraded":"2024-04-14T23:36:20.515957+0000","last_fullsized":"2024-04-14T23:36:20.515957+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:10.668989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:10.668989+0000","last_clean_scrub_stamp":"2024-04-14T23:36:10.668989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T23:37:42.705283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627785+0000","last_change":"2024-04-14T23:36:13.806230+0000","last_active":"2024-04-14T23:36:20.627785+0000","last_peered":"2024-04-14T23:36:20.627785+0000","last_clean":"2024-04-14T23:36:20.627785+0000","last_became_active":"2024-04-14T23:35:47.151949+0000","last_became_peered":"2024-04-14T23:35:47.151949+0000","last_unstale":"2024-04-14T23:36:20.627785+0000","last_undegraded":"2024-04-14T23:36:20.627785+0000","last_fullsized":"2024-04-14T23:36:20.627785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:13.806117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:13.806117+0000","last_clean_scrub_stamp":"2024-04-14T23:36:13.806117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:58:24.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627507+0000","last_change":"2024-04-14T23:36:09.757945+0000","last_active":"2024-04-14T23:36:20.627507+0000","last_peered":"2024-04-14T23:36:20.627507+0000","last_clean":"2024-04-14T23:36:20.627507+0000","last_became_active":"2024-04-14T23:35:46.133248+0000","last_became_peered":"2024-04-14T23:35:46.133248+0000","last_unstale":"2024-04-14T23:36:20.627507+0000","last_undegraded":"2024-04-14T23:36:20.627507+0000","last_fullsized":"2024-04-14T23:36:20.627507+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:09.757845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:09.757845+0000","last_clean_scrub_stamp":"2024-04-14T23:36:09.757845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:19:55.182556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516299+0000","last_change":"2024-04-14T23:36:17.854908+0000","last_active":"2024-04-14T23:36:20.516299+0000","last_peered":"2024-04-14T23:36:20.516299+0000","last_clean":"2024-04-14T23:36:20.516299+0000","last_became_active":"2024-04-14T23:35:47.135299+0000","last_became_peered":"2024-04-14T23:35:47.135299+0000","last_unstale":"2024-04-14T23:36:20.516299+0000","last_undegraded":"2024-04-14T23:36:20.516299+0000","last_fullsized":"2024-04-14T23:36:20.516299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:17.854795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:17.854795+0000","last_clean_scrub_stamp":"2024-04-14T23:36:17.854795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:49:10.760613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.514486+0000","last_change":"2024-04-14T23:36:07.965414+0000","last_active":"2024-04-14T23:36:20.514486+0000","last_peered":"2024-04-14T23:36:20.514486+0000","last_clean":"2024-04-14T23:36:20.514486+0000","last_became_active":"2024-04-14T23:35:46.129730+0000","last_became_peered":"2024-04-14T23:35:46.129730+0000","last_unstale":"2024-04-14T23:36:20.514486+0000","last_undegraded":"2024-04-14T23:36:20.514486+0000","last_fullsized":"2024-04-14T23:36:20.514486+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:07.965302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:07.965302+0000","last_clean_scrub_stamp":"2024-04-14T23:36:07.965302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T07:21:09.021220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.627962+0000","last_change":"2024-04-14T23:36:20.244177+0000","last_active":"2024-04-14T23:36:20.627962+0000","last_peered":"2024-04-14T23:36:20.627962+0000","last_clean":"2024-04-14T23:36:20.627962+0000","last_became_active":"2024-04-14T23:35:47.158231+0000","last_became_peered":"2024-04-14T23:35:47.158231+0000","last_unstale":"2024-04-14T23:36:20.627962+0000","last_undegraded":"2024-04-14T23:36:20.627962+0000","last_fullsized":"2024-04-14T23:36:20.627962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:20.244073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:20.244073+0000","last_clean_scrub_stamp":"2024-04-14T23:36:20.244073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T08:43:55.325406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516477+0000","last_change":"2024-04-14T23:36:10.870217+0000","last_active":"2024-04-14T23:36:20.516477+0000","last_peered":"2024-04-14T23:36:20.516477+0000","last_clean":"2024-04-14T23:36:20.516477+0000","last_became_active":"2024-04-14T23:35:46.136181+0000","last_became_peered":"2024-04-14T23:35:46.136181+0000","last_unstale":"2024-04-14T23:36:20.516477+0000","last_undegraded":"2024-04-14T23:36:20.516477+0000","last_fullsized":"2024-04-14T23:36:20.516477+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T23:36:10.870106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T23:36:10.870106+0000","last_clean_scrub_stamp":"2024-04-14T23:36:10.870106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T10:19:56.294816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"39'119","reported_seq":220,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T23:36:20.516245+0000","last_change":"2024-04-14T23:36:08.836509+0000","last_active":"2024-04-14T23:36:20.516245+0000","last_peered":"2024-04-14T23:36:20.516245+0000","last_clean":"2024-04-14T23:36:20.516245+0000","last_became_active":"2024-04-14T23:34:27.437932+0000","last_became_peered":"2024-04-14T23:34:27.437932+0000","last_unstale":"2024-04-14T23:36:20.516245+0000","last_undegraded":"2024-04-14T23:36:20.516245+0000","last_fullsized":"2024-04-14T23:36:20.516245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2024-04-14T23:36:08.836391+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2024-04-14T23:36:08.836391+0000","last_clean_scrub_stamp":"2024-04-14T23:36:08.836391+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T02:19:22.866535+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":807453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":210452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":209982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":483328,"data_stored":210474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31668,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340172,"statfs":{"total":96636764160,"available":96604336128,"internally_reserved":0,"allocated":495616,"data_stored":217049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":479232,"data_stored":209940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":479232,"data_stored":209960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1073152,"data_stored":800272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T23:36:29.076 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-14T23:36:29.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.214+0000 7f0c6b405640 1 Processor -- start 2024-04-14T23:36:29.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.215+0000 7f0c6b405640 1 -- start start 2024-04-14T23:36:29.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.215+0000 7f0c6b405640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c640b53c0 0x7f0c640cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:29.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.215+0000 7f0c6b405640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0c640d2ce0 0x7f0c640b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:29.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.215+0000 7f0c6b405640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c640b7090 con 0x7f0c640cfb30 2024-04-14T23:36:29.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.215+0000 7f0c6b405640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f0c640b6e40 con 0x7f0c640d2ce0 2024-04-14T23:36:29.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.215+0000 7f0c6b405640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0c640b7370 con 0x7f0c640b53c0 2024-04-14T23:36:29.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.216+0000 7f0c691a1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c640b53c0 0x7f0c640cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:29.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.216+0000 7f0c699a2640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0c640d2ce0 0x7f0c640b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:29.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.216+0000 7f0c691a1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c640b53c0 0x7f0c640cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.47:52884/0 (socket says 172.21.15.47:52884) 2024-04-14T23:36:29.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.216+0000 7f0c691a1640 1 -- 172.21.15.47:0/3847755064 learned_addr learned my addr 172.21.15.47:0/3847755064 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:29.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.216+0000 7f0c691a1640 1 -- 172.21.15.47:0/3847755064 >> v2:172.21.15.191:3300/0 conn(0x7f0c640d2ce0 msgr2=0x7f0c640b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:29.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.216+0000 7f0c691a1640 1 --2- 172.21.15.47:0/3847755064 >> v2:172.21.15.191:3300/0 conn(0x7f0c640d2ce0 0x7f0c640b7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.216+0000 7f0c691a1640 1 -- 172.21.15.47:0/3847755064 >> v1:172.21.15.191:6789/0 conn(0x7f0c640cfb30 legacy=0x7f0c640d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:29.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.216+0000 7f0c691a1640 1 -- 172.21.15.47:0/3847755064 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c640b7650 con 0x7f0c640b53c0 2024-04-14T23:36:29.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.217+0000 7f0c691a1640 1 --2- 172.21.15.47:0/3847755064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c640b53c0 0x7f0c640cf5f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c009870 tx=0x7f0c5c02ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec2cd155b417079b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:29.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.217+0000 7f0c63fff640 1 -- 172.21.15.47:0/3847755064 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c02f840 con 0x7f0c640b53c0 2024-04-14T23:36:29.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.217+0000 7f0c63fff640 1 -- 172.21.15.47:0/3847755064 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c5c02f9e0 con 0x7f0c640b53c0 2024-04-14T23:36:29.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.217+0000 7f0c63fff640 1 -- 172.21.15.47:0/3847755064 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c02fdb0 con 0x7f0c640b53c0 2024-04-14T23:36:29.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.218+0000 7f0c6b405640 1 -- 172.21.15.47:0/3847755064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c640b53c0 msgr2=0x7f0c640cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:29.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.218+0000 7f0c6b405640 1 --2- 172.21.15.47:0/3847755064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c640b53c0 0x7f0c640cf5f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c009870 tx=0x7f0c5c02ba20 comp rx=0 tx=0).stop 2024-04-14T23:36:29.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.218+0000 7f0c6b405640 1 -- 172.21.15.47:0/3847755064 shutdown_connections 2024-04-14T23:36:29.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.218+0000 7f0c6b405640 1 --2- 172.21.15.47:0/3847755064 >> v2:172.21.15.191:3300/0 conn(0x7f0c640d2ce0 0x7f0c640b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.218+0000 7f0c6b405640 1 --2- 172.21.15.47:0/3847755064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c640b53c0 0x7f0c640cf5f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.218+0000 7f0c6b405640 1 -- 172.21.15.47:0/3847755064 >> 172.21.15.47:0/3847755064 conn(0x7f0c6409d2c0 msgr2=0x7f0c640d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:29.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.218+0000 7f0c6b405640 1 -- 172.21.15.47:0/3847755064 shutdown_connections 2024-04-14T23:36:29.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.218+0000 7f0c6b405640 1 -- 172.21.15.47:0/3847755064 wait complete. 2024-04-14T23:36:29.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.219+0000 7f0c6b405640 1 Processor -- start 2024-04-14T23:36:29.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.219+0000 7f0c6b405640 1 -- start start 2024-04-14T23:36:29.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c6b405640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c640b53c0 0x7f0c641554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:29.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c6b405640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c640cfb30 0x7f0c640b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:29.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c6b405640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c640d2ce0 0x7f0c640b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:29.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c6b405640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0c640b5920 con 0x7f0c640b53c0 2024-04-14T23:36:29.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c6b405640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0c640b57a0 con 0x7f0c640cfb30 2024-04-14T23:36:29.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c6b405640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0c640d1f90 con 0x7f0c640d2ce0 2024-04-14T23:36:29.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c691a1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c640b53c0 0x7f0c641554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:29.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c691a1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c640b53c0 0x7f0c641554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37712/0 (socket says 172.21.15.47:37712) 2024-04-14T23:36:29.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c691a1640 1 -- 172.21.15.47:0/1276624766 learned_addr learned my addr 172.21.15.47:0/1276624766 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:29.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c699a2640 1 --2- 172.21.15.47:0/1276624766 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c640d2ce0 0x7f0c640b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:29.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c689a0640 1 --2- 172.21.15.47:0/1276624766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c640cfb30 0x7f0c640b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:29.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c691a1640 1 -- 172.21.15.47:0/1276624766 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c640d2ce0 msgr2=0x7f0c640b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:29.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c691a1640 1 --2- 172.21.15.47:0/1276624766 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c640d2ce0 0x7f0c640b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c691a1640 1 -- 172.21.15.47:0/1276624766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c640cfb30 msgr2=0x7f0c640b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:29.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c691a1640 1 --2- 172.21.15.47:0/1276624766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c640cfb30 0x7f0c640b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c691a1640 1 -- 172.21.15.47:0/1276624766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c641559e0 con 0x7f0c640b53c0 2024-04-14T23:36:29.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c691a1640 1 --2- 172.21.15.47:0/1276624766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c640b53c0 0x7f0c641554a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c000c00 tx=0x7f0c5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:29.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c61ffb640 1 -- 172.21.15.47:0/1276624766 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c037bc0 con 0x7f0c640b53c0 2024-04-14T23:36:29.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c61ffb640 1 -- 172.21.15.47:0/1276624766 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c5c046070 con 0x7f0c640b53c0 2024-04-14T23:36:29.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c6b405640 1 -- 172.21.15.47:0/1276624766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c640b2590 con 0x7f0c640b53c0 2024-04-14T23:36:29.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.220+0000 7f0c61ffb640 1 -- 172.21.15.47:0/1276624766 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c041400 con 0x7f0c640b53c0 2024-04-14T23:36:29.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.221+0000 7f0c6b405640 1 -- 172.21.15.47:0/1276624766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c6415cce0 con 0x7f0c640b53c0 2024-04-14T23:36:29.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.222+0000 7f0c6b405640 1 -- 172.21.15.47:0/1276624766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c64073f50 con 0x7f0c640b53c0 2024-04-14T23:36:29.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.222+0000 7f0c61ffb640 1 -- 172.21.15.47:0/1276624766 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f0c5c040070 con 0x7f0c640b53c0 2024-04-14T23:36:29.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.222+0000 7f0c61ffb640 1 --2- 172.21.15.47:0/1276624766 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0c5006b990 0x7f0c5006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:29.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.222+0000 7f0c61ffb640 1 -- 172.21.15.47:0/1276624766 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f0c5c0ace20 con 0x7f0c640b53c0 2024-04-14T23:36:29.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.223+0000 7f0c689a0640 1 --2- 172.21.15.47:0/1276624766 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0c5006b990 0x7f0c5006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:29.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.223+0000 7f0c689a0640 1 --2- 172.21.15.47:0/1276624766 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0c5006b990 0x7f0c5006de50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0c6415ffb0 tx=0x7f0c58009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:29.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.227+0000 7f0c61ffb640 1 -- 172.21.15.47:0/1276624766 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0c641559e0 con 0x7f0c640b53c0 2024-04-14T23:36:29.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.409+0000 7f0c6b405640 1 -- 172.21.15.47:0/1276624766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f0c640d2670 con 0x7f0c640b53c0 2024-04-14T23:36:29.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.412+0000 7f0c61ffb640 1 -- 172.21.15.47:0/1276624766 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) ==== 123+0+0 (secure 0 0 0) 0x7f0c5c033030 con 0x7f0c640b53c0 2024-04-14T23:36:29.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.412+0000 7f0c61ffb640 1 -- 172.21.15.47:0/1276624766 <== mon.0 v2:172.21.15.47:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0c5c07b2c0 con 0x7f0c640b53c0 2024-04-14T23:36:29.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.414+0000 7f0c6b405640 1 -- 172.21.15.47:0/1276624766 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0c5006b990 msgr2=0x7f0c5006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:29.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.414+0000 7f0c6b405640 1 --2- 172.21.15.47:0/1276624766 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0c5006b990 0x7f0c5006de50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0c6415ffb0 tx=0x7f0c58009040 comp rx=0 tx=0).stop 2024-04-14T23:36:29.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.414+0000 7f0c6b405640 1 -- 172.21.15.47:0/1276624766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c640b53c0 msgr2=0x7f0c641554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:29.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.414+0000 7f0c6b405640 1 --2- 172.21.15.47:0/1276624766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c640b53c0 0x7f0c641554a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c000c00 tx=0x7f0c5c004730 comp rx=0 tx=0).stop 2024-04-14T23:36:29.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.414+0000 7f0c6b405640 1 -- 172.21.15.47:0/1276624766 shutdown_connections 2024-04-14T23:36:29.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.414+0000 7f0c6b405640 1 --2- 172.21.15.47:0/1276624766 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f0c5006b990 0x7f0c5006de50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.414+0000 7f0c6b405640 1 --2- 172.21.15.47:0/1276624766 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c640d2ce0 0x7f0c640b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.414+0000 7f0c6b405640 1 --2- 172.21.15.47:0/1276624766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c640cfb30 0x7f0c640b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.414+0000 7f0c6b405640 1 --2- 172.21.15.47:0/1276624766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c640b53c0 0x7f0c641554a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.414+0000 7f0c6b405640 1 -- 172.21.15.47:0/1276624766 >> 172.21.15.47:0/1276624766 conn(0x7f0c6409d2c0 msgr2=0x7f0c640b87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:29.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.414+0000 7f0c6b405640 1 -- 172.21.15.47:0/1276624766 shutdown_connections 2024-04-14T23:36:29.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.414+0000 7f0c6b405640 1 -- 172.21.15.47:0/1276624766 wait complete. 2024-04-14T23:36:29.429 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-14T23:36:29.429 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T23:36:29.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.528+0000 7f8c2759c640 1 Processor -- start 2024-04-14T23:36:29.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.528+0000 7f8c2759c640 1 -- start start 2024-04-14T23:36:29.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.529+0000 7f8c2759c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8c200cdf00 0x7f8c200c7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:29.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.529+0000 7f8c2759c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c20072130 con 0x7f8c200cd460 2024-04-14T23:36:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.529+0000 7f8c2759c640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c200cc5d0 con 0x7f8c200cf6c0 2024-04-14T23:36:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.529+0000 7f8c2759c640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f8c20074730 con 0x7f8c200cdf00 2024-04-14T23:36:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.529+0000 7f8c25b39640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8c200cd460 0x7f8c200c7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:39836/0 (socket says 172.21.15.47:39836) 2024-04-14T23:36:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.529+0000 7f8c25b39640 1 -- 172.21.15.47:0/2117115394 learned_addr learned my addr 172.21.15.47:0/2117115394 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-14T23:36:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.529+0000 7f8c1ffff640 1 -- 172.21.15.47:0/2117115394 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1237977920 0 0) 0x7f8c20072130 con 0x7f8c200cd460 2024-04-14T23:36:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.529+0000 7f8c1ffff640 1 -- 172.21.15.47:0/2117115394 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c08003520 con 0x7f8c200cd460 2024-04-14T23:36:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.529+0000 7f8c24b37640 1 --2- 172.21.15.47:0/2117115394 >> v2:172.21.15.191:3300/0 conn(0x7f8c200cdf00 0x7f8c200c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c1ffff640 1 -- 172.21.15.47:0/2117115394 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1508731416 0 0) 0x7f8c08003520 con 0x7f8c200cd460 2024-04-14T23:36:29.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c1ffff640 1 -- 172.21.15.47:0/2117115394 >> v2:172.21.15.191:3300/0 conn(0x7f8c200cdf00 msgr2=0x7f8c200c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:29.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c1ffff640 1 --2- 172.21.15.47:0/2117115394 >> v2:172.21.15.191:3300/0 conn(0x7f8c200cdf00 0x7f8c200c7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c1ffff640 1 -- 172.21.15.47:0/2117115394 >> v1:172.21.15.191:6789/0 conn(0x7f8c200cf6c0 legacy=0x7f8c200cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:29.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c1ffff640 1 -- 172.21.15.47:0/2117115394 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c20074a10 con 0x7f8c200cd460 2024-04-14T23:36:29.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c1ffff640 1 -- 172.21.15.47:0/2117115394 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1583422002 0 0) 0x7f8c100019f0 con 0x7f8c200cd460 2024-04-14T23:36:29.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c1ffff640 1 -- 172.21.15.47:0/2117115394 >> v1:172.21.15.47:6789/0 conn(0x7f8c200cd460 legacy=0x7f8c200c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:29.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c1ffff640 1 --2- 172.21.15.47:0/2117115394 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c080039b0 0x7f8c08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:29.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c1ffff640 1 --2- 172.21.15.47:0/2117115394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c08004800 0x7f8c08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:29.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c1ffff640 1 --2- 172.21.15.47:0/2117115394 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c080051c0 0x7f8c0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:29.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c1ffff640 1 -- 172.21.15.47:0/2117115394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8c20074730 con 0x7f8c08004800 2024-04-14T23:36:29.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c1ffff640 1 -- 172.21.15.47:0/2117115394 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0800c160 con 0x7f8c080051c0 2024-04-14T23:36:29.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c1ffff640 1 -- 172.21.15.47:0/2117115394 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f8c0800c360 con 0x7f8c080039b0 2024-04-14T23:36:29.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c24b37640 1 --2- 172.21.15.47:0/2117115394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c08004800 0x7f8c08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:29.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c25338640 1 --2- 172.21.15.47:0/2117115394 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c080039b0 0x7f8c08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:29.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c25b39640 1 --2- 172.21.15.47:0/2117115394 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c080051c0 0x7f8c0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:29.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c24b37640 1 -- 172.21.15.47:0/2117115394 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c080039b0 msgr2=0x7f8c08003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:29.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c24b37640 1 --2- 172.21.15.47:0/2117115394 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c080039b0 0x7f8c08003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c24b37640 1 -- 172.21.15.47:0/2117115394 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c080051c0 msgr2=0x7f8c0800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T23:36:29.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c24b37640 1 --2- 172.21.15.47:0/2117115394 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c080051c0 0x7f8c0800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c24b37640 1 -- 172.21.15.47:0/2117115394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c08003520 con 0x7f8c08004800 2024-04-14T23:36:29.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c25b39640 1 -- 172.21.15.47:0/2117115394 reap_dead start 2024-04-14T23:36:29.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.530+0000 7f8c25338640 1 --2- 172.21.15.47:0/2117115394 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c080039b0 0x7f8c08003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T23:36:29.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.531+0000 7f8c24b37640 1 --2- 172.21.15.47:0/2117115394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c08004800 0x7f8c08004c80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009ac0 tx=0x7f8c08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c673896efcbce323 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:29.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.533+0000 7f8c1ffff640 1 -- 172.21.15.47:0/2117115394 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c14039070 con 0x7f8c08004800 2024-04-14T23:36:29.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.533+0000 7f8c1ffff640 1 -- 172.21.15.47:0/2117115394 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8c1402c6b0 con 0x7f8c08004800 2024-04-14T23:36:29.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.533+0000 7f8c1ffff640 1 -- 172.21.15.47:0/2117115394 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c14009690 con 0x7f8c08004800 2024-04-14T23:36:29.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.533+0000 7f8c2759c640 1 -- 172.21.15.47:0/2117115394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c08004800 msgr2=0x7f8c08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:29.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.533+0000 7f8c2759c640 1 --2- 172.21.15.47:0/2117115394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c08004800 0x7f8c08004c80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009ac0 tx=0x7f8c08005830 comp rx=0 tx=0).stop 2024-04-14T23:36:29.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.533+0000 7f8c2759c640 1 -- 172.21.15.47:0/2117115394 shutdown_connections 2024-04-14T23:36:29.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.533+0000 7f8c2759c640 1 --2- 172.21.15.47:0/2117115394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c08004800 0x7f8c08004c80 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.533+0000 7f8c2759c640 1 -- 172.21.15.47:0/2117115394 >> 172.21.15.47:0/2117115394 conn(0x7f8c200d0330 msgr2=0x7f8c200d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:29.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.533+0000 7f8c2759c640 1 -- 172.21.15.47:0/2117115394 shutdown_connections 2024-04-14T23:36:29.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.533+0000 7f8c2759c640 1 -- 172.21.15.47:0/2117115394 wait complete. 2024-04-14T23:36:29.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.535+0000 7f8c2759c640 1 Processor -- start 2024-04-14T23:36:29.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.535+0000 7f8c2759c640 1 -- start start 2024-04-14T23:36:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.535+0000 7f8c2759c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c08004800 0x7f8c20099b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.535+0000 7f8c2759c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c200cce50 0x7f8c200c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.535+0000 7f8c2759c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c2015e7e0 0x7f8c201605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.535+0000 7f8c2759c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2015e660 con 0x7f8c08004800 2024-04-14T23:36:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.535+0000 7f8c2759c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2015e4e0 con 0x7f8c2015e7e0 2024-04-14T23:36:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.535+0000 7f8c2759c640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f8c200cbd70 con 0x7f8c200cce50 2024-04-14T23:36:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.535+0000 7f8c25338640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c08004800 0x7f8c20099b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.535+0000 7f8c25338640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c08004800 0x7f8c20099b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37728/0 (socket says 172.21.15.47:37728) 2024-04-14T23:36:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.535+0000 7f8c25338640 1 -- 172.21.15.47:0/301976466 learned_addr learned my addr 172.21.15.47:0/301976466 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-14T23:36:29.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.536+0000 7f8c24b37640 1 --2- 172.21.15.47:0/301976466 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c200cce50 0x7f8c200c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:29.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.536+0000 7f8c25b39640 1 --2- 172.21.15.47:0/301976466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c2015e7e0 0x7f8c201605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:29.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.536+0000 7f8c25338640 1 -- 172.21.15.47:0/301976466 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c200cce50 msgr2=0x7f8c200c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:29.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.536+0000 7f8c25338640 1 --2- 172.21.15.47:0/301976466 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c200cce50 0x7f8c200c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.536+0000 7f8c25338640 1 -- 172.21.15.47:0/301976466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c2015e7e0 msgr2=0x7f8c201605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:29.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.536+0000 7f8c25338640 1 --2- 172.21.15.47:0/301976466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c2015e7e0 0x7f8c201605f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.536+0000 7f8c25338640 1 -- 172.21.15.47:0/301976466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c200c9530 con 0x7f8c08004800 2024-04-14T23:36:29.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.536+0000 7f8c25338640 1 --2- 172.21.15.47:0/301976466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c08004800 0x7f8c20099b10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8c1800e4e0 tx=0x7f8c1800e8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:29.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.536+0000 7f8c1dffb640 1 -- 172.21.15.47:0/301976466 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c18019070 con 0x7f8c08004800 2024-04-14T23:36:29.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.536+0000 7f8c2759c640 1 -- 172.21.15.47:0/301976466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c200b4130 con 0x7f8c08004800 2024-04-14T23:36:29.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.536+0000 7f8c1dffb640 1 -- 172.21.15.47:0/301976466 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8c180052e0 con 0x7f8c08004800 2024-04-14T23:36:29.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.536+0000 7f8c1dffb640 1 -- 172.21.15.47:0/301976466 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c18003850 con 0x7f8c08004800 2024-04-14T23:36:29.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.536+0000 7f8c2759c640 1 -- 172.21.15.47:0/301976466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c200c9220 con 0x7f8c08004800 2024-04-14T23:36:29.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.537+0000 7f8c2759c640 1 -- 172.21.15.47:0/301976466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c20075430 con 0x7f8c08004800 2024-04-14T23:36:29.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.538+0000 7f8c1dffb640 1 -- 172.21.15.47:0/301976466 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 90154+0+0 (secure 0 0 0) 0x7f8c1801c060 con 0x7f8c08004800 2024-04-14T23:36:29.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.538+0000 7f8c1dffb640 1 --2- 172.21.15.47:0/301976466 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8c0c06b9c0 0x7f8c0c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T23:36:29.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.538+0000 7f8c1dffb640 1 -- 172.21.15.47:0/301976466 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f8c18089d30 con 0x7f8c08004800 2024-04-14T23:36:29.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.538+0000 7f8c24b37640 1 --2- 172.21.15.47:0/301976466 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8c0c06b9c0 0x7f8c0c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T23:36:29.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.539+0000 7f8c24b37640 1 --2- 172.21.15.47:0/301976466 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8c0c06b9c0 0x7f8c0c06de80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8c14036000 tx=0x7f8c14030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T23:36:29.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.543+0000 7f8c1dffb640 1 -- 172.21.15.47:0/301976466 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8c18058150 con 0x7f8c08004800 2024-04-14T23:36:29.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.766+0000 7f8c2759c640 1 -- 172.21.15.47:0/301976466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c200b1630 con 0x7f8c08004800 2024-04-14T23:36:29.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.767+0000 7f8c1dffb640 1 -- 172.21.15.47:0/301976466 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5187 (secure 0 0 0) 0x7f8c1805c1f0 con 0x7f8c08004800 2024-04-14T23:36:29.771 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-14T23:36:29.771 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5098,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/1048029655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1048029655},{"type":"v1","addr":"172.21.15.191:6836","nonce":1048029655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5101,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/3689956959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":3689956959},{"type":"v1","addr":"172.21.15.191:6837","nonce":3689956959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/3726899017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3726899017},{"type":"v1","addr":"172.21.15.47:6834","nonce":3726899017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T23:35:46.488445+0000","modified":"2024-04-14T23:35:48.489599+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5334":{"gid":5334,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/1026300185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":1026300185},{"type":"v1","addr":"172.21.15.47:6835","nonce":1026300185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5334,"qdb_cluster":[5334]},"id":2}]} 2024-04-14T23:36:29.771 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 15 2024-04-14T23:36:29.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.768+0000 7f8c2759c640 1 -- 172.21.15.47:0/301976466 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8c0c06b9c0 msgr2=0x7f8c0c06de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:29.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.768+0000 7f8c2759c640 1 --2- 172.21.15.47:0/301976466 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8c0c06b9c0 0x7f8c0c06de80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8c14036000 tx=0x7f8c14030000 comp rx=0 tx=0).stop 2024-04-14T23:36:29.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.768+0000 7f8c2759c640 1 -- 172.21.15.47:0/301976466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c08004800 msgr2=0x7f8c20099b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T23:36:29.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.768+0000 7f8c2759c640 1 --2- 172.21.15.47:0/301976466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c08004800 0x7f8c20099b10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8c1800e4e0 tx=0x7f8c1800e8e0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.769+0000 7f8c2759c640 1 -- 172.21.15.47:0/301976466 shutdown_connections 2024-04-14T23:36:29.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.769+0000 7f8c2759c640 1 --2- 172.21.15.47:0/301976466 >> [v2:172.21.15.191:6832/2137390424,v1:172.21.15.191:6833/2137390424] conn(0x7f8c0c06b9c0 0x7f8c0c06de80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.769+0000 7f8c2759c640 1 --2- 172.21.15.47:0/301976466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c2015e7e0 0x7f8c201605f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.769+0000 7f8c2759c640 1 --2- 172.21.15.47:0/301976466 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c200cce50 0x7f8c200c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.769+0000 7f8c2759c640 1 --2- 172.21.15.47:0/301976466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c08004800 0x7f8c20099b10 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T23:36:29.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.769+0000 7f8c2759c640 1 -- 172.21.15.47:0/301976466 >> 172.21.15.47:0/301976466 conn(0x7f8c200d0330 msgr2=0x7f8c2006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T23:36:29.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.769+0000 7f8c2759c640 1 -- 172.21.15.47:0/301976466 shutdown_connections 2024-04-14T23:36:29.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-14T23:36:29.769+0000 7f8c2759c640 1 -- 172.21.15.47:0/301976466 wait complete. 2024-04-14T23:36:29.783 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-14T23:36:29.783 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-14T23:36:29.784 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-14T23:36:29.784 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:29.793 INFO:tasks.ceph.mds.a:Stopped 2024-04-14T23:36:29.794 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-14T23:36:29.794 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:29.847 INFO:tasks.ceph.mds.c:Stopped 2024-04-14T23:36:29.847 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-14T23:36:29.847 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:29.861 INFO:tasks.ceph.mds.b:Stopped 2024-04-14T23:36:29.861 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-14T23:36:29.861 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:29.916 INFO:tasks.ceph.mds.d:Stopped 2024-04-14T23:36:29.916 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-14T23:36:29.917 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-14T23:36:29.917 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:29.954 INFO:tasks.ceph.osd.0:Stopped 2024-04-14T23:36:29.955 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-14T23:36:29.955 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:30.022 INFO:tasks.ceph.osd.1:Stopped 2024-04-14T23:36:30.022 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-14T23:36:30.022 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:30.090 INFO:tasks.ceph.osd.2:Stopped 2024-04-14T23:36:30.091 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-14T23:36:30.091 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:30.159 INFO:tasks.ceph.osd.3:Stopped 2024-04-14T23:36:30.160 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-14T23:36:30.160 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:30.193 INFO:tasks.ceph.osd.4:Stopped 2024-04-14T23:36:30.194 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-14T23:36:30.194 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:30.264 INFO:tasks.ceph.osd.5:Stopped 2024-04-14T23:36:30.265 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-14T23:36:30.265 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:30.347 INFO:tasks.ceph.osd.6:Stopped 2024-04-14T23:36:30.348 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-14T23:36:30.348 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:30.428 INFO:tasks.ceph.osd.7:Stopped 2024-04-14T23:36:30.428 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-14T23:36:30.429 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-14T23:36:30.429 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:30.453 INFO:tasks.ceph.mgr.y:Stopped 2024-04-14T23:36:30.453 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-14T23:36:30.454 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:30.498 INFO:tasks.ceph.mgr.x:Stopped 2024-04-14T23:36:30.498 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-14T23:36:30.499 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-14T23:36:30.499 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:30.510 INFO:tasks.ceph.mon.a:Stopped 2024-04-14T23:36:30.510 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-14T23:36:30.511 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:30.550 INFO:tasks.ceph.mon.b:Stopped 2024-04-14T23:36:30.550 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-14T23:36:30.550 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T23:36:30.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-14T23:36:30.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-14T23:36:30.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-14T23:36:30.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-14T23:36:30.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-14T23:36:30.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-14T23:36:30.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-14T23:36:30.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-14T23:36:30.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-14T23:36:30.604 INFO:tasks.ceph.mon.c:Stopped 2024-04-14T23:36:30.604 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-14T23:36:30.605 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-04-14T23:36:30.637 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-14T23:36:30.637 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-14T23:36:31.068 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-14T23:36:31.068 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-14T23:36:31.171 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-14T23:36:31.172 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-14T23:36:31.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-14T23:36:31.222 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-14T23:36:31.262 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-14T23:36:31.262 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-14T23:36:31.552 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-14T23:36:31.552 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-14T23:36:31.653 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-14T23:36:31.653 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-14T23:36:31.709 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-14T23:36:31.709 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-14T23:36:31.768 INFO:tasks.ceph:Archiving mon data... 2024-04-14T23:36:31.770 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575/data/mon.a.tgz 2024-04-14T23:36:31.770 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-04-14T23:36:31.786 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.F1ZisRLxmy 2024-04-14T23:36:31.786 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.F1ZisRLxmy 2024-04-14T23:36:31.923 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.F1ZisRLxmy 2024-04-14T23:36:32.008 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.F1ZisRLxmy is 291KB 2024-04-14T23:36:32.102 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.F1ZisRLxmy 2024-04-14T23:36:32.115 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575/data/mon.b.tgz 2024-04-14T23:36:32.116 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2024-04-14T23:36:32.132 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.vmIsHJDU5J 2024-04-14T23:36:32.132 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.vmIsHJDU5J 2024-04-14T23:36:32.283 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.vmIsHJDU5J 2024-04-14T23:36:32.369 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.vmIsHJDU5J is 395KB 2024-04-14T23:36:32.438 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.vmIsHJDU5J 2024-04-14T23:36:32.453 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575/data/mon.c.tgz 2024-04-14T23:36:32.453 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2024-04-14T23:36:32.507 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.4cewEcsNKL 2024-04-14T23:36:32.507 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.4cewEcsNKL 2024-04-14T23:36:32.646 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.4cewEcsNKL 2024-04-14T23:36:32.731 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.4cewEcsNKL is 395KB 2024-04-14T23:36:32.829 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.4cewEcsNKL 2024-04-14T23:36:32.843 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-14T23:36:32.843 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-14T23:36:32.845 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-14T23:36:32.928 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-14T23:36:32.964 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-14T23:36:32.965 INFO:tasks.ceph:Archiving crash dumps... 2024-04-14T23:36:32.967 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575/remote/smithi047/crash 2024-04-14T23:36:32.968 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-14T23:36:32.997 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575/remote/smithi191/crash 2024-04-14T23:36:32.998 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-14T23:36:33.031 INFO:tasks.ceph:Shutting down logrotate 2024-04-14T23:36:33.031 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T23:36:33.042 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T23:36:33.122 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-14T23:36:33.149 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-14T23:36:33.177 INFO:tasks.ceph:Compressing logs... 2024-04-14T23:36:33.177 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-14T23:36:33.192 DEBUG:teuthology.orchestra.run.smithi191:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-14T23:36:33.269 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-14T23:36:33.269 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37435.log 2024-04-14T23:36:33.269 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37475.log 2024-04-14T23:36:33.269 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37435.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-14T23:36:33.270 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37475.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-14T23:36:33.270 INFO:teuthology.orchestra.run.smithi191.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37435.log.gz 2024-04-14T23:36:33.270 INFO:teuthology.orchestra.run.smithi191.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37475.log.gz 2024-04-14T23:36:33.270 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44257.log 2024-04-14T23:36:33.270 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-14T23:36:33.270 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.1.44257.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.1.44257.log.gz -5 2024-04-14T23:36:33.270 INFO:teuthology.orchestra.run.smithi191.stderr: --verbose -- /var/log/ceph/ceph-client.3.44656.log 2024-04-14T23:36:33.270 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37515.log 2024-04-14T23:36:33.270 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-osd.4.log: 91.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-14T23:36:33.271 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.3.44656.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-14T23:36:33.271 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.44656.log.gz 2024-04-14T23:36:33.271 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37515.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-14T23:36:33.271 INFO:teuthology.orchestra.run.smithi191.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-14T23:36:33.271 INFO:teuthology.orchestra.run.smithi191.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37515.log.gz 2024-04-14T23:36:33.271 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37635.log 2024-04-14T23:36:33.271 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37555.log 2024-04-14T23:36:33.271 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37675.log 2024-04-14T23:36:33.272 INFO:teuthology.orchestra.run.smithi191.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37635.log.gz 2024-04-14T23:36:33.272 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44652.log 2024-04-14T23:36:33.272 INFO:teuthology.orchestra.run.smithi191.stderr:gzip 87.1% -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-14T23:36:33.272 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37675.log: -- replaced with /var/log/ceph/ceph-client.admin.37555.log.gz 2024-04-14T23:36:33.272 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.3.44652.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37675.log.gz 2024-04-14T23:36:33.272 INFO:teuthology.orchestra.run.smithi191.stderr: -5 0.0% -- replaced with /var/log/ceph/ceph-client.3.44652.log.gz 2024-04-14T23:36:33.272 INFO:teuthology.orchestra.run.smithi191.stderr: --verbose -- /var/log/ceph/ceph.log 2024-04-14T23:36:33.272 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44252.log 2024-04-14T23:36:33.273 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37595.log 2024-04-14T23:36:33.273 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.1.44252.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-14T23:36:33.273 INFO:teuthology.orchestra.run.smithi191.stderr: -- replaced with /var/log/ceph/ceph-client.1.44252.log.gz 2024-04-14T23:36:33.273 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37595.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37595.log.gz 2024-04-14T23:36:33.273 INFO:teuthology.orchestra.run.smithi191.stderr: 91.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-14T23:36:33.273 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37395.log 2024-04-14T23:36:33.273 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-14T23:36:33.273 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37395.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-14T23:36:33.273 INFO:teuthology.orchestra.run.smithi191.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37395.log.gz 2024-04-14T23:36:33.274 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-mds.d.log: 91.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-14T23:36:33.300 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-mon.c.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-14T23:36:33.319 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52342.log 2024-04-14T23:36:33.320 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54873.log 2024-04-14T23:36:33.320 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47122.log 2024-04-14T23:36:33.320 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50408.log 2024-04-14T23:36:33.320 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52342.log.gz 2024-04-14T23:36:33.320 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.47122.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54873.log.gz 2024-04-14T23:36:33.320 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52046.log 2024-04-14T23:36:33.320 INFO:teuthology.orchestra.run.smithi047.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47122.log.gz 2024-04-14T23:36:33.320 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.50408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46278.log 2024-04-14T23:36:33.321 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52046.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50408.log.gz 2024-04-14T23:36:33.321 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-14T23:36:33.321 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52046.log.gz 2024-04-14T23:36:33.321 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49084.log 2024-04-14T23:36:33.321 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46278.log.gz 2024-04-14T23:36:33.321 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52130.log 2024-04-14T23:36:33.321 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49378.log 2024-04-14T23:36:33.321 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54437.log 2024-04-14T23:36:33.321 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49084.log.gz 2024-04-14T23:36:33.321 INFO:teuthology.orchestra.run.smithi047.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52130.log.gz 2024-04-14T23:36:33.322 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52298.log 2024-04-14T23:36:33.322 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54437.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49378.log.gz 2024-04-14T23:36:33.322 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49462.log 2024-04-14T23:36:33.322 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52298.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.54437.log.gz --verbose 2024-04-14T23:36:33.322 INFO:teuthology.orchestra.run.smithi047.stderr: -- /var/log/ceph/ceph-client.admin.49210.log 2024-04-14T23:36:33.322 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49462.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52298.log.gz 2024-04-14T23:36:33.322 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54311.log 2024-04-14T23:36:33.322 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49462.log.gz 2024-04-14T23:36:33.322 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49588.log 2024-04-14T23:36:33.323 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54311.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49210.log.gz 2024-04-14T23:36:33.323 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51656.log 2024-04-14T23:36:33.323 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54311.log.gz 2024-04-14T23:36:33.323 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47706.log 2024-04-14T23:36:33.323 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.51656.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49588.log.gz 2024-04-14T23:36:33.323 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43912.log 2024-04-14T23:36:33.323 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.47706.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51656.log.gz 2024-04-14T23:36:33.323 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46295.log 2024-04-14T23:36:33.323 INFO:teuthology.orchestra.run.smithi047.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47706.log.gz 2024-04-14T23:36:33.324 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50965.log 2024-04-14T23:36:33.324 INFO:teuthology.orchestra.run.smithi047.stderr: 89.4%/var/log/ceph/ceph-client.admin.46295.log: -- replaced with /var/log/ceph/ceph-client.admin.43912.log.gz 2024-04-14T23:36:33.324 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51259.log 2024-04-14T23:36:33.324 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.50965.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46295.log.gz 2024-04-14T23:36:33.324 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48163.log 2024-04-14T23:36:33.324 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50965.log.gz 2024-04-14T23:36:33.324 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.51259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53682.log 2024-04-14T23:36:33.324 INFO:teuthology.orchestra.run.smithi047.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51259.log.gz 2024-04-14T23:36:33.324 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52214.log 2024-04-14T23:36:33.324 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.53682.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48163.log.gz 2024-04-14T23:36:33.325 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.48467.log 2024-04-14T23:36:33.325 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53682.log.gz 2024-04-14T23:36:33.325 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45568.log 2024-04-14T23:36:33.325 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.2.48467.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52214.log.gz 2024-04-14T23:36:33.325 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47416.log 2024-04-14T23:36:33.325 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.48467.log.gz 2024-04-14T23:36:33.325 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54395.log 2024-04-14T23:36:33.325 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.47416.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45568.log.gz 2024-04-14T23:36:33.325 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54017.log 2024-04-14T23:36:33.326 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49798.log 2024-04-14T23:36:33.326 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47416.log.gz 2024-04-14T23:36:33.326 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54017.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54395.log.gz 2024-04-14T23:36:33.326 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46627.log 2024-04-14T23:36:33.326 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54017.log.gz 2024-04-14T23:36:33.326 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54647.log 2024-04-14T23:36:33.326 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43247.log 2024-04-14T23:36:33.326 INFO:teuthology.orchestra.run.smithi047.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49798.log.gz 2024-04-14T23:36:33.326 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54647.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46627.log.gz 2024-04-14T23:36:33.327 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37986.log 2024-04-14T23:36:33.327 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54647.log.gz 2024-04-14T23:36:33.327 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52693.log 2024-04-14T23:36:33.327 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43247.log.gz 2024-04-14T23:36:33.327 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43581.log 2024-04-14T23:36:33.327 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52693.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37986.log.gz 2024-04-14T23:36:33.327 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46631.log 2024-04-14T23:36:33.327 INFO:teuthology.orchestra.run.smithi047.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52693.log.gz 2024-04-14T23:36:33.327 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47248.log 2024-04-14T23:36:33.328 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46631.log: gzip -5 --verbose 88.2% -- /var/log/ceph/ceph-client.admin.48916.log -- replaced with /var/log/ceph/ceph-client.admin.43581.log.gz 2024-04-14T23:36:33.328 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-14T23:36:33.328 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.47248.log: 88.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.46631.log.gz --verbose 2024-04-14T23:36:33.328 INFO:teuthology.orchestra.run.smithi047.stderr: -- /var/log/ceph/ceph-client.admin.45954.log 2024-04-14T23:36:33.328 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47248.log.gz 2024-04-14T23:36:33.328 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49909.log 2024-04-14T23:36:33.328 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48916.log.gz 2024-04-14T23:36:33.328 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50550.log 2024-04-14T23:36:33.328 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49909.log: gzip -5 --verbose 87.8% -- -- replaced with /var/log/ceph/ceph-client.admin.45954.log.gz /var/log/ceph/ceph-client.admin.45610.log 2024-04-14T23:36:33.329 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-14T23:36:33.329 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49909.log.gz 2024-04-14T23:36:33.329 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.50550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54269.log 2024-04-14T23:36:33.329 INFO:teuthology.orchestra.run.smithi047.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50550.log.gz 2024-04-14T23:36:33.329 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45950.log 2024-04-14T23:36:33.329 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45610.log.gz 2024-04-14T23:36:33.329 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49420.log 2024-04-14T23:36:33.329 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45950.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54269.log.gz 2024-04-14T23:36:33.329 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51133.log 2024-04-14T23:36:33.330 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45950.log.gz 2024-04-14T23:36:33.330 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43828.log 2024-04-14T23:36:33.330 INFO:teuthology.orchestra.run.smithi047.stderr: 89.1%/var/log/ceph/ceph-client.admin.51133.log: -- replaced with /var/log/ceph/ceph-client.admin.49420.log.gz 2024-04-14T23:36:33.330 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44122.log 2024-04-14T23:36:33.330 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43828.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51133.log.gz 2024-04-14T23:36:33.330 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53640.log 2024-04-14T23:36:33.330 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43828.log.gz 2024-04-14T23:36:33.330 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52903.log 2024-04-14T23:36:33.330 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.53640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46624.log 2024-04-14T23:36:33.331 INFO:teuthology.orchestra.run.smithi047.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.44122.log.gz 2024-04-14T23:36:33.331 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52903.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53640.log.gz 2024-04-14T23:36:33.331 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52386.log 2024-04-14T23:36:33.331 INFO:teuthology.orchestra.run.smithi047.stderr:gzip 88.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.52903.log.gz -- 2024-04-14T23:36:33.331 INFO:teuthology.orchestra.run.smithi047.stderr: /var/log/ceph/ceph-client.admin.52567.log 2024-04-14T23:36:33.331 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46624.log: /var/log/ceph/ceph-client.admin.52386.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.46624.log.gz --verbose 2024-04-14T23:36:33.331 INFO:teuthology.orchestra.run.smithi047.stderr: -- /var/log/ceph/ceph-client.admin.45196.log 2024-04-14T23:36:33.331 INFO:teuthology.orchestra.run.smithi047.stderr: 88.0%/var/log/ceph/ceph-client.admin.52567.log: -- replaced with /var/log/ceph/ceph-client.admin.52386.log.gz 2024-04-14T23:36:33.332 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47332.log 2024-04-14T23:36:33.332 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45196.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.52567.log.gz 2024-04-14T23:36:33.332 INFO:teuthology.orchestra.run.smithi047.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48706.log 2024-04-14T23:36:33.332 INFO:teuthology.orchestra.run.smithi047.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45196.log.gz 2024-04-14T23:36:33.332 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.47332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54605.log 2024-04-14T23:36:33.332 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48706.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47332.log.gz 2024-04-14T23:36:33.332 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53724.log 2024-04-14T23:36:33.332 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54605.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48706.log.gz 2024-04-14T23:36:33.332 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51175.log 2024-04-14T23:36:33.332 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.53724.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54605.log.gz 2024-04-14T23:36:33.333 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43370.log 2024-04-14T23:36:33.333 INFO:teuthology.orchestra.run.smithi047.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53724.log.gz 2024-04-14T23:36:33.333 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.51175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43996.log 2024-04-14T23:36:33.333 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43370.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.51175.log.gz --verbose 2024-04-14T23:36:33.333 INFO:teuthology.orchestra.run.smithi047.stderr: -- /var/log/ceph/ceph-client.admin.49630.log 2024-04-14T23:36:33.333 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43370.log.gz 2024-04-14T23:36:33.333 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50881.log 2024-04-14T23:36:33.333 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43996.log.gz 2024-04-14T23:36:33.333 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49126.log 2024-04-14T23:36:33.334 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49630.log.gz 2024-04-14T23:36:33.334 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.50881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54479.log 2024-04-14T23:36:33.334 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50881.log.gz 2024-04-14T23:36:33.334 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43070.log 2024-04-14T23:36:33.334 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54479.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49126.log.gz 2024-04-14T23:36:33.334 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54185.log 2024-04-14T23:36:33.334 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43070.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54479.log.gz 2024-04-14T23:36:33.334 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50593.log 2024-04-14T23:36:33.335 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7%/var/log/ceph/ceph-client.admin.54185.log: -- replaced with /var/log/ceph/ceph-client.admin.43070.log.gz 2024-04-14T23:36:33.335 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50677.log 2024-04-14T23:36:33.335 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.50593.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54185.log.gz 2024-04-14T23:36:33.335 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38089.log 2024-04-14T23:36:33.335 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.50677.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50593.log.gz 2024-04-14T23:36:33.335 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50797.log 2024-04-14T23:36:33.335 INFO:teuthology.orchestra.run.smithi047.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50677.log.gz 2024-04-14T23:36:33.335 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53029.log 2024-04-14T23:36:33.335 INFO:teuthology.orchestra.run.smithi047.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38089.log.gz 2024-04-14T23:36:33.336 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.50797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51511.log 2024-04-14T23:36:33.336 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.53029.log: gzip 88.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.50797.log.gz -- 2024-04-14T23:36:33.336 INFO:teuthology.orchestra.run.smithi047.stderr: /var/log/ceph/ceph.tmp-client.admin.31706.log 2024-04-14T23:36:33.336 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.51511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54101.log 2024-04-14T23:36:33.336 INFO:teuthology.orchestra.run.smithi047.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51511.log.gz 2024-04-14T23:36:33.336 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.tmp-client.admin.31706.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53029.log.gz 2024-04-14T23:36:33.336 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31706.log.gz 2024-04-14T23:36:33.336 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48604.log 2024-04-14T23:36:33.336 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51007.log 2024-04-14T23:36:33.336 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48604.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54101.log.gz 2024-04-14T23:36:33.337 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47458.log 2024-04-14T23:36:33.337 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48604.log.gz 2024-04-14T23:36:33.337 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.51007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52088.log 2024-04-14T23:36:33.337 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.47458.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-14T23:36:33.337 INFO:teuthology.orchestra.run.smithi047.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51007.log.gz 2024-04-14T23:36:33.337 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52088.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47458.log.gz 2024-04-14T23:36:33.337 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44080.log 2024-04-14T23:36:33.337 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52088.log.gz 2024-04-14T23:36:33.337 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43669.log 2024-04-14T23:36:33.337 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52004.log 2024-04-14T23:36:33.338 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43669.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44080.log.gz 2024-04-14T23:36:33.338 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51343.log 2024-04-14T23:36:33.338 INFO:teuthology.orchestra.run.smithi047.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43669.log.gz 2024-04-14T23:36:33.338 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54773.log 2024-04-14T23:36:33.338 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52004.log.gz 2024-04-14T23:36:33.338 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-14T23:36:33.338 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.51343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53288.log 2024-04-14T23:36:33.338 INFO:teuthology.orchestra.run.smithi047.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51343.log.gz 2024-04-14T23:36:33.339 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46870.log 2024-04-14T23:36:33.339 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54773.log: /var/log/ceph/ceph-client.0.53288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46954.log 2024-04-14T23:36:33.339 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53288.log.gz 2024-04-14T23:36:33.339 INFO:teuthology.orchestra.run.smithi047.stderr: 87.8%/var/log/ceph/ceph-client.admin.46870.log: -- replaced with /var/log/ceph/ceph-client.admin.54773.log.gz 2024-04-14T23:36:33.339 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54731.log 2024-04-14T23:36:33.339 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46954.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46870.log.gz 2024-04-14T23:36:33.339 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49252.log 2024-04-14T23:36:33.339 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46954.log.gz 2024-04-14T23:36:33.339 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47038.log 2024-04-14T23:36:33.339 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49252.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54731.log.gz 2024-04-14T23:36:33.340 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54521.log 2024-04-14T23:36:33.340 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.47038.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49252.log.gz 2024-04-14T23:36:33.340 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46296.log 2024-04-14T23:36:33.340 INFO:teuthology.orchestra.run.smithi047.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47038.log.gz 2024-04-14T23:36:33.340 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44844.log 2024-04-14T23:36:33.340 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46296.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.54521.log.gz -5 2024-04-14T23:36:33.340 INFO:teuthology.orchestra.run.smithi047.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53598.log 2024-04-14T23:36:33.340 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46296.log.gz/var/log/ceph/ceph-client.admin.44844.log: 2024-04-14T23:36:33.340 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53975.log 2024-04-14T23:36:33.341 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44844.log.gz 2024-04-14T23:36:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.53598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52256.log 2024-04-14T23:36:33.341 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53598.log.gz 2024-04-14T23:36:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.53975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52479.log 2024-04-14T23:36:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52256.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53975.log.gz 2024-04-14T23:36:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43766.log 2024-04-14T23:36:33.341 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52256.log.gz 2024-04-14T23:36:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46292.log 2024-04-14T23:36:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43766.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52479.log.gz 2024-04-14T23:36:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43455.log 2024-04-14T23:36:33.342 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46292.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.43766.log.gz 2024-04-14T23:36:33.342 INFO:teuthology.orchestra.run.smithi047.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45070.log 2024-04-14T23:36:33.342 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46292.log.gz 2024-04-14T23:36:33.342 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45526.log 2024-04-14T23:36:33.342 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47374.log 2024-04-14T23:36:33.342 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43455.log.gz 2024-04-14T23:36:33.342 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45526.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45070.log.gz 2024-04-14T23:36:33.342 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50035.log 2024-04-14T23:36:33.343 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45526.log.gz 2024-04-14T23:36:33.343 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.47374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46632.log 2024-04-14T23:36:33.343 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.50035.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47374.log.gz 2024-04-14T23:36:33.343 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53556.log 2024-04-14T23:36:33.343 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52521.log 2024-04-14T23:36:33.343 INFO:teuthology.orchestra.run.smithi047.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50035.log.gz 2024-04-14T23:36:33.343 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.53556.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46632.log.gz 2024-04-14T23:36:33.343 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53933.log 2024-04-14T23:36:33.343 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52521.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53556.log.gz 2024-04-14T23:36:33.344 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45358.log 2024-04-14T23:36:33.344 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.53933.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52521.log.gz 2024-04-14T23:36:33.344 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48030.log 2024-04-14T23:36:33.344 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53933.log.gz 2024-04-14T23:36:33.344 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54915.log 2024-04-14T23:36:33.344 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.0.48030.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45358.log.gz 2024-04-14T23:36:33.344 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46293.log 2024-04-14T23:36:33.344 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48030.log.gz 2024-04-14T23:36:33.344 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50923.log 2024-04-14T23:36:33.345 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54915.log.gz 2024-04-14T23:36:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48790.log 2024-04-14T23:36:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.50923.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46293.log.gz 2024-04-14T23:36:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46828.log 2024-04-14T23:36:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48790.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50923.log.gz 2024-04-14T23:36:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-14T23:36:33.345 INFO:teuthology.orchestra.run.smithi047.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48790.log.gz 2024-04-14T23:36:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52609.log 2024-04-14T23:36:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.1.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46828.log.gz 2024-04-14T23:36:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51571.log 2024-04-14T23:36:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49336.log 2024-04-14T23:36:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.51571.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52609.log.gz 2024-04-14T23:36:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47542.log 2024-04-14T23:36:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49336.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51571.log.gz 2024-04-14T23:36:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46630.log 2024-04-14T23:36:33.347 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49336.log.gz 2024-04-14T23:36:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51961.log 2024-04-14T23:36:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.47542.log: /var/log/ceph/ceph-client.admin.46630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45957.log 2024-04-14T23:36:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.51961.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46630.log.gz 2024-04-14T23:36:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50077.log 2024-04-14T23:36:33.347 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51961.log.gz 91.1% 2024-04-14T23:36:33.348 INFO:teuthology.orchestra.run.smithi047.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47542.log.gz 2024-04-14T23:36:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46294.log 2024-04-14T23:36:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45957.log: /var/log/ceph/ceph-client.admin.50077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43720.log 2024-04-14T23:36:33.348 INFO:teuthology.orchestra.run.smithi047.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45957.log.gz 2024-04-14T23:36:33.348 INFO:teuthology.orchestra.run.smithi047.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50077.log.gz 2024-04-14T23:36:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43328.log 2024-04-14T23:36:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44038.log 2024-04-14T23:36:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43720.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46294.log.gz 2024-04-14T23:36:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43328.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43720.log.gz 2024-04-14T23:36:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54059.log 2024-04-14T23:36:33.349 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43328.log.gz 2024-04-14T23:36:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50239.log 2024-04-14T23:36:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44038.log: /var/log/ceph/ceph-client.admin.54059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52819.log 2024-04-14T23:36:33.350 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44038.log.gz 2024-04-14T23:36:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.50239.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54059.log.gz 2024-04-14T23:36:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44970.log 2024-04-14T23:36:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52819.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50239.log.gz 2024-04-14T23:36:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43413.log 2024-04-14T23:36:33.350 INFO:teuthology.orchestra.run.smithi047.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52819.log.gz 2024-04-14T23:36:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52172.log 2024-04-14T23:36:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44970.log: /var/log/ceph/ceph-client.admin.43413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45280.log 2024-04-14T23:36:33.351 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44970.log.gz 2024-04-14T23:36:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52172.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43413.log.gz 2024-04-14T23:36:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49000.log 2024-04-14T23:36:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45952.log 2024-04-14T23:36:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45280.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52172.log.gz 2024-04-14T23:36:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54689.log 2024-04-14T23:36:33.351 INFO:teuthology.orchestra.run.smithi047.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45280.log.gz 2024-04-14T23:36:33.352 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49000.log.gz 2024-04-14T23:36:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51698.log 2024-04-14T23:36:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45952.log: /var/log/ceph/ceph-client.admin.54689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45958.log 2024-04-14T23:36:33.352 INFO:teuthology.orchestra.run.smithi047.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45952.log.gz 2024-04-14T23:36:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.51698.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54689.log.gz 2024-04-14T23:36:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-14T23:36:33.352 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51698.log.gz 2024-04-14T23:36:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50197.log 2024-04-14T23:36:33.352 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45958.log.gz 2024-04-14T23:36:33.353 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45484.log 2024-04-14T23:36:33.353 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.50197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50506.log 2024-04-14T23:36:33.353 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45484.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50197.log.gz 2024-04-14T23:36:33.353 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54563.log 2024-04-14T23:36:33.353 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45112.log 2024-04-14T23:36:33.353 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6%/var/log/ceph/ceph-client.admin.50506.log: -- replaced with /var/log/ceph/ceph-client.admin.45484.log.gz 2024-04-14T23:36:33.353 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49756.log 2024-04-14T23:36:33.353 INFO:teuthology.orchestra.run.smithi047.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50506.log.gz 2024-04-14T23:36:33.353 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46492.log 2024-04-14T23:36:33.354 INFO:teuthology.orchestra.run.smithi047.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54563.log.gz 2024-04-14T23:36:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45112.log: /var/log/ceph/ceph-client.admin.49756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48025.log 2024-04-14T23:36:33.354 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45112.log.gz 2024-04-14T23:36:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46492.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49756.log.gz 2024-04-14T23:36:33.354 INFO:teuthology.orchestra.run.smithi047.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49042.log 2024-04-14T23:36:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.0.48025.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46492.log.gz 2024-04-14T23:36:33.354 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48025.log.gz 2024-04-14T23:36:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44802.log 2024-04-14T23:36:33.355 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50839.log 2024-04-14T23:36:33.355 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49042.log: /var/log/ceph/ceph-client.admin.44802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47500.log 2024-04-14T23:36:33.355 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7%/var/log/ceph/ceph-client.admin.50839.log: -- replaced with /var/log/ceph/ceph-client.admin.49042.log.gz 2024-04-14T23:36:33.355 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49951.log 2024-04-14T23:36:33.355 INFO:teuthology.orchestra.run.smithi047.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44802.log.gz 2024-04-14T23:36:33.355 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.47500.log: gzip -5 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50839.log.gz 2024-04-14T23:36:33.355 INFO:teuthology.orchestra.run.smithi047.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53095.log 2024-04-14T23:36:33.355 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47500.log.gz 2024-04-14T23:36:33.355 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45951.log 2024-04-14T23:36:33.356 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.53095.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49951.log.gz 2024-04-14T23:36:33.356 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52987.log 2024-04-14T23:36:33.356 INFO:teuthology.orchestra.run.smithi047.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53095.log.gz 2024-04-14T23:36:33.356 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44609.log 2024-04-14T23:36:33.356 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45951.log.gz 2024-04-14T23:36:33.356 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47206.log 2024-04-14T23:36:33.356 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52987.log.gz 2024-04-14T23:36:33.357 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45652.log 2024-04-14T23:36:33.357 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51427.log 2024-04-14T23:36:33.357 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.47206.log: /var/log/ceph/ceph-client.admin.45652.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47206.log.gz 2024-04-14T23:36:33.357 INFO:teuthology.orchestra.run.smithi047.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51469.log 2024-04-14T23:36:33.357 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.51427.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45652.log.gz 2024-04-14T23:36:33.357 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43625.log 2024-04-14T23:36:33.357 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51427.log.gz 2024-04-14T23:36:33.357 INFO:teuthology.orchestra.run.smithi047.stderr:gzip/var/log/ceph/ceph-client.admin.51469.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45778.log 2024-04-14T23:36:33.358 INFO:teuthology.orchestra.run.smithi047.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.44609.log.gz 2024-04-14T23:36:33.358 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43625.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51469.log.gz 2024-04-14T23:36:33.358 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48958.log 2024-04-14T23:36:33.358 INFO:teuthology.orchestra.run.smithi047.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43625.log.gz 2024-04-14T23:36:33.358 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45694.log 2024-04-14T23:36:33.358 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48958.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45778.log.gz 2024-04-14T23:36:33.358 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51301.log 2024-04-14T23:36:33.358 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48958.log.gz 2024-04-14T23:36:33.358 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-14T23:36:33.359 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45694.log: /var/log/ceph/ceph-client.admin.51301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52437.log 2024-04-14T23:36:33.359 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45694.log.gz 2024-04-14T23:36:33.359 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mgr.y.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51301.log.gzgzip 2024-04-14T23:36:33.359 INFO:teuthology.orchestra.run.smithi047.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37736.log 2024-04-14T23:36:33.359 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53284.log 2024-04-14T23:36:33.359 INFO:teuthology.orchestra.run.smithi047.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52437.log.gz 2024-04-14T23:36:33.359 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44886.log 2024-04-14T23:36:33.359 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.0.53284.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.0.53284.log.gz 2024-04-14T23:36:33.360 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37736.log.gz 2024-04-14T23:36:33.360 INFO:teuthology.orchestra.run.smithi047.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51049.log 2024-04-14T23:36:33.360 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47080.log 2024-04-14T23:36:33.360 INFO:teuthology.orchestra.run.smithi047.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44886.log.gz 2024-04-14T23:36:33.360 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44188.log 2024-04-14T23:36:33.360 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.51049.log: /var/log/ceph/ceph-client.admin.47080.log: gzip -5 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51049.log.gz 2024-04-14T23:36:33.360 INFO:teuthology.orchestra.run.smithi047.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51217.log 2024-04-14T23:36:33.361 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44188.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47080.log.gz 2024-04-14T23:36:33.361 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44188.log.gz 2024-04-14T23:36:33.361 INFO:teuthology.orchestra.run.smithi047.stderr: /var/log/ceph/ceph-osd.0.log 2024-04-14T23:36:33.361 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.51217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45238.log 2024-04-14T23:36:33.361 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51217.log.gz 2024-04-14T23:36:33.361 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51778.log 2024-04-14T23:36:33.361 INFO:teuthology.orchestra.run.smithi047.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-14T23:36:33.361 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43539.log 2024-04-14T23:36:33.362 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.51778.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45238.log.gz 2024-04-14T23:36:33.362 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51919.log 2024-04-14T23:36:33.362 INFO:teuthology.orchestra.run.smithi047.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51778.log.gz 2024-04-14T23:36:33.362 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44928.log 2024-04-14T23:36:33.362 INFO:teuthology.orchestra.run.smithi047.stderr:gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43539.log.gz 2024-04-14T23:36:33.362 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.51919.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43497.log 2024-04-14T23:36:33.362 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.44928.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51919.log.gz 2024-04-14T23:36:33.362 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50323.log 2024-04-14T23:36:33.363 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44928.log.gz 2024-04-14T23:36:33.363 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49672.log 2024-04-14T23:36:33.363 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.50323.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43497.log.gz 2024-04-14T23:36:33.363 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43954.log 2024-04-14T23:36:33.363 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49672.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50323.log.gz 2024-04-14T23:36:33.363 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49672.log.gz 2024-04-14T23:36:33.363 INFO:teuthology.orchestra.run.smithi047.stderr: -- /var/log/ceph/ceph-client.admin.49168.log 2024-04-14T23:36:33.363 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48748.log 2024-04-14T23:36:33.364 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43954.log.gz 2024-04-14T23:36:33.364 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51091.log 2024-04-14T23:36:33.364 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48748.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49168.log.gz 2024-04-14T23:36:33.364 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54353.log 2024-04-14T23:36:33.364 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48748.log.gz 2024-04-14T23:36:33.364 INFO:teuthology.orchestra.run.smithi047.stderr:gzip/var/log/ceph/ceph-client.admin.51091.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46996.log 2024-04-14T23:36:33.364 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51614.log 2024-04-14T23:36:33.364 INFO:teuthology.orchestra.run.smithi047.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51091.log.gz 2024-04-14T23:36:33.364 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46996.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54353.log.gz 2024-04-14T23:36:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52735.log 2024-04-14T23:36:33.365 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46996.log.gz 2024-04-14T23:36:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.51614.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-14T23:36:33.365 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51614.log.gz 2024-04-14T23:36:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54833.log 2024-04-14T23:36:33.365 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52735.log.gz 2024-04-14T23:36:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.48471.log 2024-04-14T23:36:33.365 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52651.log 2024-04-14T23:36:33.365 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54833.log.gz 2024-04-14T23:36:33.366 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5/var/log/ceph/ceph-client.2.48471.log: --verbose -- /var/log/ceph/ceph-client.admin.48874.log 2024-04-14T23:36:33.366 INFO:teuthology.orchestra.run.smithi047.stderr: 84.4% 0.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-14T23:36:33.366 INFO:teuthology.orchestra.run.smithi047.stderr: -- replaced with /var/log/ceph/ceph-client.2.48471.log.gz 2024-04-14T23:36:33.366 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52651.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-14T23:36:33.366 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52651.log.gz 2024-04-14T23:36:33.366 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.48874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45955.log 2024-04-14T23:36:33.366 INFO:teuthology.orchestra.run.smithi047.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48874.log.gz 2024-04-14T23:36:33.366 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-14T23:36:33.367 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45955.log: gzip -5 --verbose -- 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45955.log.gz 2024-04-14T23:36:33.367 INFO:teuthology.orchestra.run.smithi047.stderr: /var/log/ceph/ceph-client.admin.49714.log 2024-04-14T23:36:33.367 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46629.log 2024-04-14T23:36:33.367 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45960.log 2024-04-14T23:36:33.367 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49714.log.gz 2024-04-14T23:36:33.367 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52777.log 2024-04-14T23:36:33.367 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45960.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46629.log.gz 2024-04-14T23:36:33.367 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46290.log 2024-04-14T23:36:33.367 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45960.log.gz 2024-04-14T23:36:33.368 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47164.log 2024-04-14T23:36:33.368 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46290.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52777.log.gz 2024-04-14T23:36:33.368 INFO:teuthology.orchestra.run.smithi047.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46290.log.gz 2024-04-14T23:36:33.368 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52861.log 2024-04-14T23:36:33.368 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.47164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46912.log 2024-04-14T23:36:33.368 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47164.log.gz 2024-04-14T23:36:33.368 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52861.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52861.log.gz 2024-04-14T23:36:33.368 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54143.log 2024-04-14T23:36:33.368 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43151.log 2024-04-14T23:36:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46912.log: /var/log/ceph/ceph-client.admin.54143.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46912.log.gz 2024-04-14T23:36:33.369 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54143.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51385.log 2024-04-14T23:36:33.369 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-14T23:36:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43151.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43151.log.gz 2024-04-14T23:36:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45400.log 2024-04-14T23:36:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52945.log 2024-04-14T23:36:33.369 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.51385.log: /var/log/ceph/ceph-client.admin.45400.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51385.log.gz 2024-04-14T23:36:33.369 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45400.log.gz 2024-04-14T23:36:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50119.log 2024-04-14T23:36:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.52945.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52945.log.gz 2024-04-14T23:36:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51877.log 2024-04-14T23:36:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45442.log 2024-04-14T23:36:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.50119.log: /var/log/ceph/ceph-client.admin.51877.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50119.log.gz 2024-04-14T23:36:33.370 INFO:teuthology.orchestra.run.smithi047.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51877.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50719.log 2024-04-14T23:36:33.370 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-14T23:36:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45442.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45442.log.gz 2024-04-14T23:36:33.370 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50365.log 2024-04-14T23:36:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46626.log 2024-04-14T23:36:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.50719.log: /var/log/ceph/ceph-client.admin.50365.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50719.log.gz 2024-04-14T23:36:33.371 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50365.log.gz 2024-04-14T23:36:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49504.log 2024-04-14T23:36:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49294.log 2024-04-14T23:36:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46626.log: /var/log/ceph/ceph-client.admin.49504.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46626.log.gz 2024-04-14T23:36:33.371 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.49504.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.49546.log 2024-04-14T23:36:33.371 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-14T23:36:33.371 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49294.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49294.log.gz 2024-04-14T23:36:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45736.log 2024-04-14T23:36:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46291.log 2024-04-14T23:36:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49546.log: /var/log/ceph/ceph-client.admin.45736.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49546.log.gz 2024-04-14T23:36:33.372 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.45736.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.54227.log 2024-04-14T23:36:33.372 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-14T23:36:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.46291.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46291.log.gz 2024-04-14T23:36:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45012.log 2024-04-14T23:36:33.372 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49993.log 2024-04-14T23:36:33.373 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.54227.log: /var/log/ceph/ceph-client.admin.45012.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54227.log.gz 2024-04-14T23:36:33.373 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45012.log.gz 2024-04-14T23:36:33.373 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48832.log 2024-04-14T23:36:33.373 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45154.log 2024-04-14T23:36:33.373 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.49993.log: /var/log/ceph/ceph-client.admin.48832.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49993.log.gz 2024-04-14T23:36:33.373 INFO:teuthology.orchestra.run.smithi047.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48832.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50635.log 2024-04-14T23:36:33.373 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-14T23:36:33.373 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.45154.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45154.log.gz 2024-04-14T23:36:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48664.log 2024-04-14T23:36:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-14T23:36:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.50635.log: /var/log/ceph/ceph-client.admin.48664.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50635.log.gz 2024-04-14T23:36:33.374 INFO:teuthology.orchestra.run.smithi047.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50281.log 2024-04-14T23:36:33.374 INFO:teuthology.orchestra.run.smithi047.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48664.log.gz 2024-04-14T23:36:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mds.a.log: 90.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-14T23:36:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47290.log 2024-04-14T23:36:33.374 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43870.log 2024-04-14T23:36:33.375 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.50281.log: /var/log/ceph/ceph-client.admin.47290.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50281.log.gz 2024-04-14T23:36:33.375 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47290.log.gz 2024-04-14T23:36:33.375 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.43870.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43870.log.gz 2024-04-14T23:36:33.376 INFO:teuthology.orchestra.run.smithi047.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-14T23:36:33.376 INFO:teuthology.orchestra.run.smithi191.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-14T23:36:33.376 INFO:teuthology.orchestra.run.smithi191.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-14T23:36:33.427 INFO:teuthology.orchestra.run.smithi047.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-14T23:36:33.883 INFO:teuthology.orchestra.run.smithi191.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-14T23:36:33.893 INFO:teuthology.orchestra.run.smithi191.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-14T23:36:33.893 INFO:teuthology.orchestra.run.smithi191.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-14T23:36:33.898 INFO:teuthology.orchestra.run.smithi047.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-14T23:36:33.900 INFO:teuthology.orchestra.run.smithi191.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-14T23:36:33.901 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-14T23:36:33.902 INFO:teuthology.orchestra.run.smithi191.stderr:real 0m0.664s 2024-04-14T23:36:33.902 INFO:teuthology.orchestra.run.smithi191.stderr:user 0m2.705s 2024-04-14T23:36:33.902 INFO:teuthology.orchestra.run.smithi191.stderr:sys 0m0.128s 2024-04-14T23:36:33.946 INFO:teuthology.orchestra.run.smithi047.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-14T23:36:33.952 INFO:teuthology.orchestra.run.smithi047.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-14T23:36:33.990 INFO:teuthology.orchestra.run.smithi047.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-14T23:36:33.992 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-14T23:36:33.992 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m0.788s 2024-04-14T23:36:33.992 INFO:teuthology.orchestra.run.smithi047.stderr:user 0m3.005s 2024-04-14T23:36:33.992 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m0.229s 2024-04-14T23:36:33.993 INFO:tasks.ceph:Archiving logs... 2024-04-14T23:36:33.993 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575/remote/smithi047/log 2024-04-14T23:36:33.994 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-14T23:36:34.653 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575/remote/smithi191/log 2024-04-14T23:36:34.653 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-14T23:36:35.076 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-14T23:36:35.087 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-14T23:36:35.088 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-14T23:36:35.090 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-14T23:36:35.172 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-14T23:36:35.182 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-14T23:36:35.182 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T23:36:35.185 DEBUG:teuthology.orchestra.run.smithi191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T23:36:35.198 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-04-14T23:36:35.200 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-04-14T23:36:35.204 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T23:36:35.204 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-04-14T23:36:35.204 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 +834us[ +836us] +/- 49ms 2024-04-14T23:36:35.204 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 53 -772us[ -771us] +/- 51ms 2024-04-14T23:36:35.204 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 -123us[ -123us] +/- 65ms 2024-04-14T23:36:35.205 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:36:35.206 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T23:36:35.206 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-04-14T23:36:35.206 INFO:teuthology.orchestra.run.smithi191.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 +842us[ +847us] +/- 49ms 2024-04-14T23:36:35.206 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 -780us[ -776us] +/- 51ms 2024-04-14T23:36:35.206 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 -145us[ -141us] +/- 65ms 2024-04-14T23:36:35.206 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T23:36:35.207 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-14T23:36:35.216 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-14T23:36:35.217 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-14T23:36:35.227 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-14T23:36:35.321 DEBUG:teuthology.orchestra.run.smithi191:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-14T23:36:35.389 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T23:36:35.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:36:35.420 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T23:36:35.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:36:35.450 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-14T23:36:35.460 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-14T23:36:35.469 INFO:teuthology.task.internal:Duration was 579.227198 seconds 2024-04-14T23:36:35.469 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-14T23:36:35.479 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-14T23:36:35.479 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-14T23:36:35.481 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-14T23:36:35.523 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T23:36:35.532 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T23:36:35.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-14T23:36:35.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-14T23:36:35.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-14T23:36:35.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-14T23:36:35.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-14T23:36:35.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-14T23:36:35.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-14T23:36:35.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-14T23:36:35.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-14T23:36:35.942 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-14T23:36:35.942 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-04-14T23:36:35.943 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-14T23:36:36.003 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi191.front.sepia.ceph.com 2024-04-14T23:36:36.003 DEBUG:teuthology.orchestra.run.smithi191:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-14T23:36:36.067 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-14T23:36:36.067 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-14T23:36:36.069 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-14T23:36:36.098 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-14T23:36:36.098 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-14T23:36:36.137 DEBUG:teuthology.orchestra.run.smithi191:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-14T23:36:36.241 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-14T23:36:36.252 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-14T23:36:36.253 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-14T23:36:36.279 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-14T23:36:36.307 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-14T23:36:36.317 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-14T23:36:36.321 DEBUG:teuthology.orchestra.run.smithi191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-14T23:36:36.344 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-04-14T23:36:36.372 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = core 2024-04-14T23:36:36.388 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-14T23:36:36.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:36:36.414 DEBUG:teuthology.orchestra.run.smithi191:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-14T23:36:36.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T23:36:36.442 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-14T23:36:36.452 INFO:teuthology.task.internal:Transferring archived files... 2024-04-14T23:36:36.453 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575/remote/smithi047 2024-04-14T23:36:36.453 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-14T23:36:36.490 DEBUG:teuthology.misc:Transferring archived files from smithi191:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575/remote/smithi191 2024-04-14T23:36:36.490 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-14T23:36:36.525 INFO:teuthology.task.internal:Removing archive directory... 2024-04-14T23:36:36.526 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-14T23:36:36.528 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-14T23:36:36.575 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-14T23:36:36.588 INFO:teuthology.task.internal:Not uploading archives. 2024-04-14T23:36:36.588 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-14T23:36:36.598 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-14T23:36:36.598 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-14T23:36:36.601 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-14T23:36:36.612 INFO:teuthology.orchestra.run.smithi047.stdout: 265707 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 14 23:36 /home/ubuntu/cephtest 2024-04-14T23:36:36.630 INFO:teuthology.orchestra.run.smithi191.stdout: 265608 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 14 23:36 /home/ubuntu/cephtest 2024-04-14T23:36:36.631 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-14T23:36:36.641 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-14T23:36:36.671 INFO:teuthology.nuke:Checking targets against current locks 2024-04-14T23:36:36.699 DEBUG:teuthology.nuke:shortname: smithi047 2024-04-14T23:36:36.700 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-14T23:36:36.725 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 23:18:59.114032', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKE+7PwwSPHx0pg3eybHBwJH86XWGlwSGUIAoWEFJ89XbWsDW0QXYZQHAsOHXL7QUD5dbt1Dvjle5oC88MtThvQ='} 2024-04-14T23:36:36.726 DEBUG:teuthology.nuke:shortname: smithi191 2024-04-14T23:36:36.726 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-14T23:36:36.746 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-14_21:24:03-fs-squid-distro-default-smithi/7656575', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 23:18:59.112398', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPcdOqrFBD0geKGsRwrHJKXb0W+6HG8gpQV5Ix8r6jNxVv2Er7gpP29gUFi8Z5QJOEqUfD2tJ2flEcP0fRCFnHc='} 2024-04-14T23:36:36.781 INFO:teuthology.orchestra.console.smithi047:Power off 2024-04-14T23:36:36.782 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-14T23:36:36.807 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2024-04-14T23:36:36.807 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T23:36:36.824 INFO:teuthology.orchestra.console.smithi191:Power off 2024-04-14T23:36:36.824 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-14T23:36:36.834 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-04-14T23:36:36.847 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2024-04-14T23:36:36.847 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T23:36:36.875 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-04-14T23:36:40.836 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T23:36:40.877 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T23:36:40.947 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-04-14T23:36:40.987 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-04-14T23:36:44.950 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T23:36:44.988 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T23:36:45.063 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-04-14T23:36:45.100 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-04-14T23:36:45.164 INFO:teuthology.orchestra.console.smithi047:Power off completed 2024-04-14T23:36:45.201 INFO:teuthology.orchestra.console.smithi191:Power off completed 2024-04-14T23:36:45.306 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} duration: 579.2271978855133 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=ea1a1e4af26344e982a2e9547460bbdb status: fail success: false 2024-04-14T23:36:45.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T23:36:45.387 INFO:teuthology.run:FAIL